EN | FR

426 Big Data Hadoop jobs in Canada

AWS Data Engineer - Big data, Hadoop,spark,Python, SQL

M4C Ontario, Ontario Astra North Infoteck Inc.

Posted 21 days ago

Job Viewed

Tap Again To Close

Job Description

Data Engineer

Key responsibilities include developing data architectures, optimizing data flow, ensuring data quality and security, and collaborating with stakeholders to meet business requirements and support data-driven decision-making.Essential skills involve programming (Python, SQL), big data technologies (Hadoop, Spark), cloud platforms (AWS), and strong problem
This advertiser has chosen not to accept applicants from your region.

Manager, Data Processing

Toronto, Ontario Sago

Posted today

Job Viewed

Tap Again To Close

Job Description

Job Description

Job Description

SAGO is a global leader in market research and data solutions, committed to connecting human answers to business questions. The world is transforming, and SAGO is continuously reaching new heights, redefining our solutions beyond our clients' wildest expectations, and making it smarter, faster, and easier to gain insights that matter.

We're a team of innovators, strategists, and problem-solvers, passionate and inspired thinkers, who celebrate our wins. Vibrant Leaders who empower our colleagues and innovate the Market Research industry. Curious learners, constantly finding new ways to transform. Bold thinkers and Authentic team members who show up to work every day being ourselves, never afraid of new ideas or opinions, because we believe they matter.

Requirements

The Manager of Data Processing will be responsible for managing Sago’s internal data team and relationship with vendors, in addition to working directly on data checks and tabulations. They will be asked to coordinate with programmers, quality assurance team members, project managers in managing timelines and responsibilities, ensuring Sago processes are being followed. They will be asked to represent the data team in discussions with clients, colleagues, and partners. They will be expected to help recruit, interview, and train the new members of the team, as well as inform processes and set standards for Sago’s data processing department.

Expectations would be to manage a highly dynamic team, processing and analyzing data to provide actionable insights into market trends, consumer behavior, and competitive dynamics. Must be able to manage a heavy workload with high expectations for quality and turnaround time. Must be able to delegate work, formulate processes for the entire team to follow, and both provide and accept constructive feedback on performance. Will be expected to manage systems for tracking error rates, performance, margin, and bandwidth. Must maintain low error rates across the team. Must be willing to learn new processes and systems with a positive mindset and eagerness to grow into the role.

The analyst uses statistical methods and visualization tools to interpret data and create detailed reports and dashboards. They collaborate with cross-functional teams to support strategic decision-making and continuously improve research methodologies. Strong analytical skills, proficiency in statistical software, and the ability to communicate findings effectively are essential for this position.

KEY JOB RESPONSIBILITIES:

  • Serves as advisor and consultant to members of other teams
  • Excellent Interpersonal skills, outstanding problem solving and decision-making skills.
  • Train, develop and provide on-going technical support to junior internal staff, as well as outsourced teams on best practices and Schlesinger SOPs
  • Perform data checks using Quantum, SPSS and Excel
  • Check Max-diff, Conjoint and segmentation setups
  • Prepare tables in Quantum.
  • Writing data cleaning scripts
  • Do data manipulation like labeling, stacking, recoding etc.
  • Resolving client queries and updating their requirements
  • Communicate and coordinate with clients and internal teams

CORE COMPETENCIES:

  • Have knowledge of Quantum and SPSS; renaming, recoding, labelling, stacking data and other similar types of data manipulation required by clients
  • Know how to QC tables
  • Adapt to working in high pressure environments with strict deadlines and multiple deliverables
  • Good English communication skills

QUALIFICATIONS

Education:

  • Bachelor’s degree

Experience:

  • 7+ years overall Data Processing experience in the Market Research industry
  • 3+ years management experience in the Market Research industry

Computer Skills:

  • Excellent with MS Teams, Office, Word, Excel, PowerPoint, and Outlook
  • SPSS
  • Quantum

This advertiser has chosen not to accept applicants from your region.

Principal Engineer - Distributed Data Processing System

L3R 5B4 Markham, Ontario Huawei Technologies Canada Co., Ltd.

Posted 1 day ago

Job Viewed

Tap Again To Close

Job Description

Huawei Canada has an immediate permanent opening for a Principal Engineer.


About the team:

Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation center in Canada. The lab focuses on researching and developing advanced cloud technologies, supporting the productization and iterative optimization of its technical achievements. Current research areas include cloud native databases, infrastructure resource scheduling and prediction, cloud-native middleware, media engines, and user experience studies. The lab fosters a robust technical environment, allowing collaboration with industry experts to create a highly competitive cloud platform. Our team has an immediate permanent opening for a Principal Software Engineer.


About the job:

  • Work with a team of architects and engineers to develop proof-of-concept distributed systems and product components.

  • Investigate and design data processing system focusing on extra-large volume data for real-time streaming, based distributed system with the latest and state of the art hardware technology.

  • Continuous enhancements on the AI-native data analysis system to fulfill customer requirements utilizing AI techniques for public cloud capacity management and scheduling.

This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Mississauga, Ontario Motion Recruitment Partners

Posted 1 day ago

Job Viewed

Tap Again To Close

Job Description

Big Data Engineer
Mississauga, Ontario
**Hybrid**
Contract
$70/hr - $72.5/hr
Grow your career as a Big Data Engineer with an innovative global bank in Mississauga, Ontario. Contract role with strong possibility of extension or conversion. Will require working a hybrid schedule 3 days onsite per week.
Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. You will work alongside some of the smartest minds in the industry who are excited to share their knowledge and to learn from you.
Contract Duration: 11+ Months
**Required Skills & Experience**
+ 10+ years of Big Data development experience. At least 5 recent years of hands-on coding!
+ Must have strong Spark and Scala skills. Strong Scala development (with previous Java background) preferred.
+ ands-on experience working with Hive, Impala, Kafka, HBase, Spark for data curation/conformance related work.
+ Strong proficiency in Spark for development work related to curation/conformance.
+ Must have data streaming experience with Spark/Kafka or equivalent streaming/batch processing and event-based messaging.
+ Solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
+ Experience working in a Continuous Integration and Continuous Delivery environment and familiarity with tools like Jenkins, TeamCity, SonarQube, OpenShift, ECS, or Kubernetes.
+ Proficient in industry-standard best practices such as Design Patterns, Coding Standards, Coding modularity, and Prototyping.
+ Experience with data visualization tools and techniques for presenting data insights effectively.
+ Agile development experience working in agile and scaled agile teams.
+ Strong data analysis skills and the ability to slice and dice the data as needed for business reporting.
+ Relational SQL (Oracle, SQL Server), NoSQL (MongoDB) and Cache (Couchbase) database integration and data distribution principles experience
+ Leadership & Mentorship: Ability to guide and mentor junior developers, fostering a collaborative team environment and promoting professional growth.
+ Strong communication skills, both written and verbal, with the ability to explain complex technical concepts to both technical and non-technical audiences.
+ Financial services is preferred (e.g., payments, ISO 222 format, posting mechanisms). E-commerce experience is also helpful.
**What You Will Be Doing**
+ Utilize in-depth knowledge and hands-on skills across multiple Applications Development areas to provide technical oversight across systems and applications
+ Will work very closely with and manage the work of a team of data engineers working on a Big Data Platform.
+ 70% hands-on development & coding, 30% delegation and leading a team of Applications developers.
+ Review/analyze/develop proposed technical solutions for projects
+ Contribute to formulation of strategies for applications development and other functional areas
+ Develop comprehensive knowledge of how areas of business integrate to accomplish business goals
+ Provide evaluative judgment based on analysis of factual data in complicated and unique situations
+ Impact the Applications Development area through monitoring delivery of end results, participate in budget management, and handling day-to-day staff management issues, including resource management and allocation of work within the team/project
+ Ensure essential procedures are followed and contribute to defining standards negotiating with external parties when necessary
Motion Recruitment Partners (MRP) is an Equal Opportunity Employer. All applicants must be currently authorized to work on a full-time basis in the country for which they are applying, and no sponsorship is currently available. Employment is subject to the successful completion of a pre-employment screening. Accommodation will be provided in all parts of the hiring process as required under MRP's Employment Accommodation policy. Applicants need to make their needs known in advance.
**Posted by:** Melissa Klein
**Specialization:**
+ Data Engineering
This advertiser has chosen not to accept applicants from your region.

Senior Big Data Engineer

Mississauga, Ontario Citigroup

Posted 7 days ago

Job Viewed

Tap Again To Close

Job Description

About the Role:
+ We are looking for a Senior Data Architectto build and maintain - Platform Modernization, TransformationPrograms
+ You'll be part of a Core Accounts Data team that's responsible for the full software development life cycle, upholding best-in-class engineering standards and modern methodologies.
+ This role involves writing code, collaborating with other developers,understanding business requirements, developing technical solutions, collaborating with other business partners, breaking down acceptance criteria to understand team backlog deliverables, complexities, and risks, and contributing effectively to an agile team.
Key Responsibilities:
+ Design, develop, and maintain robust, scalable, and high-performance applications
+ Partner with architects, product owners, and cross-functional teams to design scalable and distributed system
+ Follow best-in-class Big Data/ETL Applications design standards, security considerations, scalability, maintainability and resource utilization aspects
+ Ensure high levels of unit test coverage, DevOps principles and a culture of continuous delivery and improvement
+ Actively contribute to hands-on coding, code reviews, and refactoring to maintain high engineering standards
+ Ability of analyzing the results across the environment and finding potential or existing errors in code/builds
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
+ Mentor junior engineers and foster a culture of engineering excellence and continuous learning.
Skills and Qualifications:
+ 10+ years of experience
+ Excellent Understanding of Bigdata/ETL ecosystem
+ Proficiency in Apache Spark development with Scala
+ Experience in building Spark Streaming and Batch/Live streaming applications
+ Strong experience in creating applications for Big Data and other Data & Analytics technologies (Spark, Scala, Hadoop, Hive etc.)
+ Ability to analyze Spark job performance in Spark UI and apply required performance tuning
+ Experience of working with Linux Scripting, Kafka, Git, Maven, SSH
+ Well versed with creating and debugging Scala code in IntelliJ IDEA
+ Good problem solving skills
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Primary Location Full Time Salary Range:**
$94,300.00 - $141,500.00
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
This advertiser has chosen not to accept applicants from your region.

Senior Big Data Engineer

Toronto, Ontario TD Bank

Posted 15 days ago

Job Viewed

Tap Again To Close

Job Description

**Work Location:**
Toronto, Ontario, Canada
**Hours:**
37.5
**Line of Business:**
Technology Solutions
**Pay Details:**
$126,100 - $164,100 CAD
This role is eligible for a discretionary variable compensation award that considers business and individual performance.
TD is committed to providing fair and equitable compensation opportunities to all colleagues. Growth opportunities and skill development are defining features of the colleague experience at TD. Our compensation policies and practices have been designed to allow colleagues to progress through the salary range over time as they progress in their role. The base pay actually offered may vary based upon the candidate's skills and experience, job-related knowledge, geographic location, and other specific business and organizational needs.
As a candidate, you are encouraged to ask compensation related questions and have an open dialogue with your recruiter who can provide you more specific details for this role.
**Job Description:**
**Department Overview**
TD Securities offers a wide range of capital markets products and services to corporate, government, and institutional clients who choose us for our innovation, execution, and experience.
With more than 6,500 professionals operating out of 40 cities across the globe, we help clients meet their needs today and prepare for tomorrow. Our services include underwriting and distributing new issues, providing trusted advice and industry-leading insight, extending access to global markets, and delivering integrated transaction banking solutions.
We are growth-oriented, people-focused, and community-minded. As a team, we work to deliver value for our clients every day.
**Job Description**
We are looking for an experienced **Senior Big Data Engineer (Engineer II)** that will work on critical initiatives at TD Securities -- the design and implementation of the Trading Risk Warehouse platform. The successful candidate will be responsible for the design and development of a software solution that will be used by Risk Analysts, Front Office Traders, and Senior Executives. This is a unique opportunity to work on cutting-edge technologies to solve problems of scale and speed. Responsibility of this position includes the following:
**Responsibilities**
+ Implement high quality and efficient codes to leverage distributed computing on Hadoop platform.
+ Ability to build new and modify existing components based on requirements for web UI, RestAPI and data pipeline (ETL).
+ Perform unit testing & integration testing.
+ Find opportunities to optimize current codes.
+ Ability to pinpoint root cause and resolve production issues.
+ Leverage best practices in continuous integration and delivery.
+ Drive transformation by continuously looking for ways to improve existing processes, architecture and software quality.
+ Explore new capabilities and technologies to drive innovation.
**Desired Skillsets:**
+ Java/JEE
+ Spark/Scala
+ Big Data/Hadoop/Hive
+ Spring Boot/Angular/RestAPI
+ Cassandra/No SQL database
+ MS SQL Server
+ Git
+ Linux
**Technical Skills**
+ 7+ years of Java/JEE experience
+ 5+ years of Big Data Technologies (Hadoop, Spark/Scala, Hive)
+ Experience in the Spring tech stack and building microservices using Spring Boot.
+ Experience in Linux environment.
+ Experience in designing and integrating with REST API.
+ Experience working with messaging technologies.
+ Experience with RDBMS, demonstrable fluency in SQL and any non-relational db such as Cassandra (is preferred).
+ Experience of Git, CI/CD toolset (Maven), Jenkins, working within an Agile environment.
+ Strong understanding of design patterns and coding practices.
+ Experience working with scalable and low latency systems.
+ A passion for simplifying and automating work, for making things better, for being efficient and helping others.
**Business Skills**
+ Good communication skills. Experience in collaborating efficiently within a global team
+ Demonstrable experience working in a fast-paced environment, working with PMs and our business sponsors
+ Nice to have - Knowledge of capital markets products including derivatives and cross-asset products
+ Nice to have - Hands-on experience with market risk and/or PnL (profit and loss).
**Additonal Information**
**Join in on what others in TD Technology Solutions are doing:**
+ Inspire a positive work environment and help champion quality, innovation, teamwork and service to the business.
+ Learn voraciously, stretch your thinking, share your knowledge and educate others.
+ Communicate and collaborate with both technical and non-technical professionals.
+ Cultivate winning relationships by building trust with business and technology partners.
+ Share our commitment to productivity, effectiveness and operational efficiency.
#LI-Tech
**Who We Are:**
TD Securities offers a wide range of capital markets products and services to corporate, government, and institutional clients who choose us for our innovation, execution, and experience. With more than 6,500 professionals operating out of 40 cities across the globe, we help clients meet their needs today and prepare for tomorrow. Our services include underwriting and distributing new issues, providing trusted advice and industry-leading insight, extending access to global markets, and delivering integrated transaction banking solutions. In 2023, we acquired Cowen Inc., offering our clients access to a premier U.S. equities business and highly-diverse equity research franchise, while growing our strong, diversified investment bank. We are growth-oriented, people-focused, and community-minded. As a team, we work to deliver value for our clients every day.
**Our Total Rewards Package**
Our Total Rewards package reflects the investments we make in our colleagues to help them and their families achieve their financial, physical, and mental well-being goals. Total Rewards at TD includes a base salary, variable compensation, and several other key plans such as health and well-being benefits, savings and retirement programs, paid time off, banking benefits and discounts, career development, and reward and recognition programs. Learn more ( Information:**
We're delighted that you're considering building a career with TD. Through regular development conversations, training programs, and a competitive benefits plan, we're committed to providing the support our colleagues need to thrive both at work and at home.
Please be advised that this job opportunity is subject to provincial regulation for employment purposes. It is imperative to acknowledge that each province or territory within the jurisdiction of Canada may have its own set of regulations, requirements.
**Colleague Development**
If you're interested in a specific career path or are looking to build certain skills, we want to help you succeed. You'll have regular career, development, and performance conversations with your manager, as well as access to an online learning platform and a variety of mentoring programs to help you unlock future opportunities. Whether you have a passion for helping customers and want to expand your experience, or you want to coach and inspire your colleagues, there are many different career paths within our organization at TD - and we're committed to helping you identify opportunities that support your goals.
**Training & Onboarding**
We will provide training and onboarding sessions to ensure that you've got everything you need to succeed in your new role.
**Interview Process**
We'll reach out to candidates of interest to schedule an interview. We do our best to communicate outcomes to all applicants by email or phone call.
**Accommodation**
Your accessibility is important to us. Please let us know if you'd like accommodations (including accessible meeting rooms, captioning for virtual interviews, etc.) to help us remove barriers so that you can participate throughout the interview process.
We look forward to hearing from you!
**Language Requirement (Quebec only):**
Sans Objet
Federal law prohibits job discrimination based on race, color, sex, sexual orientation, gender identity, national origin, religion, age, equal pay, disability and genetic information.
This advertiser has chosen not to accept applicants from your region.

Junior Big Data Engineer (PySpark)

Mississauga, Ontario Citigroup

Posted 7 days ago

Job Viewed

Tap Again To Close

Job Description

**The Junior Big Data Engineer is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.**
**Responsibilities:**
**Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements**
**Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards**
**Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint**
**Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation**
**Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals**
**Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions**
**Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary**
**Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.**
**Qualifications:**
**Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources.**
**Big Data Infrastructure: Develop and manage large-scale data processing systems using frameworks like Apache Spark, Hadoop, and Kafka.**
**Proficiency in programming languages like Python, or Scala.**
**Strong expertise in data processing frameworks such as Apache Spark, Hadoop.**
**Expertise in Data Lakehouse technologies (Apache Iceberg, Apache Hudi, Trino)**
**Experience with cloud data platforms like AWS (Glue, EMR, Redshift), Azure (Synapse), or GCP (BigQuery).**
**Expertise in SQL and database technologies (e.g., Oracle, PostgreSQL, etc.).**
**Experience with data orchestration tools like Apache Airflow or Prefect.**
**Familiarity with containerization (Docker, Kubernetes) is a plus**
**Good to Have Skills:**
**Distributed caching solutions (Hazelcast or Redis)**
**Prior experience with building distributed, multi-tier applications is highly desirable.**
**Experience with building apps which are highly performant and scalable will be great**
**Education:**
**Bachelor's degree/University degree or equivalent experience**
**Master's degree preferred**
**This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.**
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Primary Location Full Time Salary Range:**
$79,320.00 - $110,680.00
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
This advertiser has chosen not to accept applicants from your region.
Be The First To Know

About the latest Big data hadoop Jobs in Canada !

Data Engineer

Mississauga, Ontario Genentech

Posted today

Job Viewed

Tap Again To Close

Job Description

**The Position**
At Roche, we thrive to deliver more benefits to our patients as part of our 10-year Pharma vision. An integral part of achieving this vision is to deliver new and innovative data analytics solutions to our scientists across Pharma Technical Operations (PT). To do so, we have formed a new organization called PT Digital and Operational Excellence (PTE) with the aspiration to digitally transform and become a lean organization.
PTE is the organization that catalyzes the global development and execution of PT's Digital and Operational Excellence strategy to enable PT to realize our performance promises. We build a strong cross-functional and inclusive community, put the power of data into the hands of our people, further develop the Lean and Digital skills across PT, and scale up our Digital and Advanced Analytics solutions, for the benefit of our colleagues and patients.
We aim to activate data citizenship and digital mind, revolutionize our FAIR data ecosystem and systems landscape, re-design excellent processes, and generate transformative insights. We collaborate closely with global functions to deliver impactful value to our patients.
**The Opportunity**
PTE works in partnership across major global business functions, establishing and implementing an overall Digital / Technology strategy and driving the delivery and scale of key data & digital solutions in support of our vision.
As a Data Engineer at Roche PT, you will play a pivotal role in developing and optimizing the data infrastructure that powers our pharmaceutical operations and data products. Working in multidisciplinary teams-including data scientists, subject matter experts, and fellow data engineers-you'll curate, transform, and construct features integral to our modeling approaches. You will support the delivery of data products and help establish standards to ensure consistency and quality.
**What You'll Do**
+ Design and build scalable data pipelines and storage solutions for real-time and batch processing aligned with SME needs.
+ Contribute to the creation of FAIR (Findable, Accessible, Interoperable, Reusable) data products that enhance decision-making and maintain data integrity, availability, and performance across platforms.
+ Collaborate with process experts to model data landscapes, obtain extracts, define secure exchange methods, and shape data products.
+ Acquire, ingest, and process data from diverse sources into Big Data platforms (e.g., Snowflake).
+ Develop ERDs and reusable pipelines, working with data scientists to map data to hypotheses and prepare it for advanced analytics.
+ Uphold data governance standards to ensure regulatory compliance and secure sensitive data. Address data quality issues to maintain asset accuracy and reliability.
+ Follow best practices in data engineering, including data contracts and validation, to ensure quality and integrity.
+ Contribute to a culture of continuous improvement in engineering practices (DevOps, Data Streaming, etc.).
+ Use data quality and observability tools, including Ataccama and Monte Carlo.
Additional Responsibilities
+ Ensure adherence to Information Security standards across engagements.
+ Collaborate with infrastructure teams to provide a technology stack tailored to project needs and aligned with our standards.
+ Contribute to templates and best practices for the technology stack.
+ Apply innovative techniques to deliver impact for clients and support internal R&D initiatives.
**Who you are:**
+ **Education:** Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
+ **Experience:**
+ 3+ years in data engineering with experience in designing large-scale systems.
+ Hands-on experience with GitLab/GIT, Airflow, Talend, AWS (S3, Lambda, etc.) and dbt.
+ Familiarity with data modeling, SQL, and Python for pipeline development and transformation logic.
+ Experience collaborating in cross-functional teams and applying data governance principles.
+ Experience in client-facing or collaborative project work is beneficial.
+ Ability to clearly communicate complex solutions to audiences of varied technical levels.
+ Strong organisational and interpersonal skills to deliver results, build relationships, and optimise resources.
**Preferred Qualifications:**
+ Experience in the pharmaceutical or healthcare industry is a plus.
+ Knowledge of regulatory requirements (e.g., GMP, FDA) and Quality systems.
+ Exposure to AI-driven data solutions and machine learning pipelines is an advantage.
This role calls for a collaborative, open-minded individual who values learning from colleagues, thoughtfully challenges ideas, and prioritizes impactful work. We seek someone who thrives in a dynamic environment, has a passion for continuous learning, and can be relied upon to work in the best interest of the team.
Relocation Assistance is not available for this role.
**The expected salary range for this position based on the primary location of Oceanside, CA is $97,900 - $181,900 . Actual pay will be determined based on experience, qualifications, geographic location, and other job-related factors permitted by law. A discretionary annual bonus may be available based on individual and Company performance. This position also qualifies for the benefits detailed at the link provided below.**
**Benefits ( is an equal opportunity employer. It is our policy and practice to employ, promote, and otherwise treat any and all employees and applicants on the basis of merit, qualifications, and competence. The company's policy prohibits unlawful discrimination, including but not limited to, discrimination on the basis of Protected Veteran status, individuals with disabilities status, and consistent with all federal, state, or local laws.
If you have a disability and need an accommodation in relation to the online application process, please contact us by completing this form Accommodations for Applicants ( .
This advertiser has chosen not to accept applicants from your region.

Data Engineer

Toronto, Ontario Manulife

Posted 1 day ago

Job Viewed

Tap Again To Close

Job Description

This Data Engineer role is essential for driving efficiency and innovation within our organization. By developing and maintaining automation, this position helps streamline operations and improve efficiency, contributing to our mission of delivering high-quality products and platform services. This role is integral to our goal of continuous improvement and operational excellence.
**Position Responsibilities:**
+ Design, develop, and manage data pipelines that facilitate the detailed extraction, transformation, and loading of data from diverse sources.
+ Automate infrastructure provisioning and deployment using tools such as Terraform.
+ Demonstrate a solid understanding of data privacy and compliance regulations and best-practices.
+ Collaborate with Architecture, security, and risk teams to implement the latest guidelines and Azure standard methodologies.
+ Collaborate with business collaborators to suggest data solutions that align with business goals and improve decision-making processes.
+ Stay up to date with the latest tools and technologies and see opportunities to enhance Manulife's data infrastructure.
+ Ability to learn and implement best practices of big data and cloud computing to ensure solutions are scalable, efficient, and effective.
**Required Qualifications:**
+ 3 to 4 years of relevant industry experience as Data Engineer.
+ Good working knowledge on MS azure services (SQL Queries, ADLS gen 2, ADF, Databricks, Synapse, SQL Server) to design a data ecosystem.
+ Experience in automating data pipelines and familiarity with DevOps and CICD pipelines.
+ Good knowledge of data warehousing concepts and relational data modelling.
+ Strong hands-on knowledge of Python, PySpark, and T-SQL along with experience crafting and developing scripts for ETL processes and automation in Azure Data Factory and Azure Databricks.
+ Proficiency in GIT/Jenkins/dev ops processes to maintain and resolve issues with data pipelines in production.
**_When you join our team:_**
+ We'll empower you to learn and grow the career you want.
+ We'll recognize and support you in a flexible environment where well-being and inclusion are more than just words.
+ As part of our global team, we'll support you in shaping the future you want to see.
**Acerca de Manulife y John Hancock**
Manulife Financial Corporation es un importante proveedor internacional de servicios financieros que ayuda a las personas a tomar decisiones de una manera más fácil y a vivir mejor. Para obtener más información acerca de nosotros, visite .
**Manulife es un empleador que ofrece igualdad de oportunidades**
En Manulife/John Hancock, valoramos nuestra diversidad. Nos esforzamos por atraer, formar y retener una fuerza laboral tan diversa como los clientes a los que prestamos servicios, y para fomentar un entorno laboral inclusivo en el que se aprovechen las fortalezas de las culturas y las personas. Estamos comprometidos con la equidad en las contrataciones, la retención de talento, el ascenso y la remuneración, y administramos todas nuestras prácticas y programas sin discriminación por motivos de raza, ascendencia, lugar de origen, color, origen étnico, ciudadanía, religión o creencias religiosas, credo, sexo (incluyendo el embarazo y las afecciones relacionadas con este), orientación sexual, características genéticas, condición de veterano, identidad de género, expresión de género, edad, estado civil, estatus familiar, discapacidad, o cualquier otro aspecto protegido por la ley vigente.
Nuestra prioridad es eliminar las barreras para garantizar la igualdad de acceso al empleo. Un representante de Recursos Humanos trabajará con los solicitantes que requieran una adaptación razonable durante el proceso de solicitud. Toda la información que se haya compartido durante el proceso de solicitud de adaptación se almacenará y utilizará de manera congruente con las leyes y las políticas de Manulife/John Hancock correspondientes. Para solicitar una adaptación razonable en el proceso de solicitud, envíenos un mensaje a .
**Referenced Salary Location**
Toronto, Ontario
**Modalidades de Trabajo**
Híbrido
**Salary range is expected to be between**
$75,880.00 CAD - $140,920.00 CAD
Si se está postulando para este puesto fuera de la ubicación principal, póngase en contacto con para conocer el rango salarial de su ubicación. El salario real variará según las condiciones locales del mercado, la geografía y los factores relacionados con el trabajo pertinentes, como conocimiento, habilidades, calificaciones, experiencia y educación/capacitación. Los empleados también tienen la oportunidad de participar en programas de incentivos y obtener una compensación de incentivos vinculada al desempeño comercial e individual.
Manulife ofrece a los empleados aptos una amplia variedad de beneficios personalizables, entre ellos, beneficios de salud, odontológicos, de salud mental, oftalmológicos, por discapacidad a corto y a largo plazo, cobertura de seguro de vida y por muerte accidental y desmembramiento, adopción/subrogación y bienestar, y planes de asistencia al empleado/familiar. También ofrecemos a los empleados admisibles varios planes de ahorro para la jubilación (incluidos planes de pensiones y un plan mundial de propiedad de acciones con contribuciones equivalentes del empleador) y recursos de asesoramiento y educación financiera. Nuestro generoso programa de tiempo libre remunerado en Canadá incluye feriados, vacaciones, días personales y días por enfermedad, y ofrecemos la gama completa de ausencia laboral reglamentaria. Si se está postulando para este puesto en los EE. UU., póngase en contacto con para obtener más información sobre las disposiciones relativas al tiempo libre remunerado específicas de EE. UU.
This advertiser has chosen not to accept applicants from your region.
 

Nearby Locations

Other Jobs Near Me

Industry

  1. request_quote Accounting
  2. work Administrative
  3. eco Agriculture Forestry
  4. smart_toy AI & Emerging Technologies
  5. school Apprenticeships & Trainee
  6. apartment Architecture
  7. palette Arts & Entertainment
  8. directions_car Automotive
  9. flight_takeoff Aviation
  10. account_balance Banking & Finance
  11. local_florist Beauty & Wellness
  12. restaurant Catering
  13. volunteer_activism Charity & Voluntary
  14. science Chemical Engineering
  15. child_friendly Childcare
  16. foundation Civil Engineering
  17. clean_hands Cleaning & Sanitation
  18. diversity_3 Community & Social Care
  19. construction Construction
  20. brush Creative & Digital
  21. currency_bitcoin Crypto & Blockchain
  22. support_agent Customer Service & Helpdesk
  23. medical_services Dental
  24. medical_services Driving & Transport
  25. medical_services E Commerce & Social Media
  26. school Education & Teaching
  27. electrical_services Electrical Engineering
  28. bolt Energy
  29. local_mall Fmcg
  30. gavel Government & Non Profit
  31. emoji_events Graduate
  32. health_and_safety Healthcare
  33. beach_access Hospitality & Tourism
  34. groups Human Resources
  35. precision_manufacturing Industrial Engineering
  36. security Information Security
  37. handyman Installation & Maintenance
  38. policy Insurance
  39. code IT & Software
  40. gavel Legal
  41. sports_soccer Leisure & Sports
  42. inventory_2 Logistics & Warehousing
  43. supervisor_account Management
  44. supervisor_account Management Consultancy
  45. supervisor_account Manufacturing & Production
  46. campaign Marketing
  47. build Mechanical Engineering
  48. perm_media Media & PR
  49. local_hospital Medical
  50. local_hospital Military & Public Safety
  51. local_hospital Mining
  52. medical_services Nursing
  53. local_gas_station Oil & Gas
  54. biotech Pharmaceutical
  55. checklist_rtl Project Management
  56. shopping_bag Purchasing
  57. home_work Real Estate
  58. person_search Recruitment Consultancy
  59. store Retail
  60. point_of_sale Sales
  61. science Scientific Research & Development
  62. wifi Telecoms
  63. psychology Therapy
  64. pets Veterinary
View All Big Data Hadoop Jobs