Data engineer roles are in high demand within Canada's growing tech sector. These positions involve building and maintaining data infrastructure, with expertise in areas like 300 Data Engineer jobs in Canada
Big Data Engineer
Mississauga, Ontario
Motion Recruitment Partners
Posted 6 days ago
Job Viewed
Job Description
Big Data Engineer
Mississauga, Ontario
**Hybrid**
Contract
$66/hr - $71/hr
Grow your career as a Big Data Engineer with an innovative global bank in Mississauga, Ontario. Contract role with strong possibility of extension or conversion. Will require working a hybrid schedule 3 days onsite per week.
Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. You will work alongside some of the smartest minds in the industry who are excited to share their knowledge and to learn from you.
Contract Duration: 11+ Months
**Required Skills & Experience**
+ 10+ years of Big Data development experience. At least 5 recent years of hands-on coding!
+ Must have strong Spark and Scala skills. Strong Scala development (with previous Java background) preferred.
+ ands-on experience working with Hive, Impala, Kafka, HBase, Spark for data curation/conformance related work.
+ Strong proficiency in Spark for development work related to curation/conformance.
+ Must have data streaming experience with Spark/Kafka or equivalent streaming/batch processing and event-based messaging.
+ Solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
+ Experience working in a Continuous Integration and Continuous Delivery environment and familiarity with tools like Jenkins, TeamCity, SonarQube, OpenShift, ECS, or Kubernetes.
+ Proficient in industry-standard best practices such as Design Patterns, Coding Standards, Coding modularity, and Prototyping.
+ Experience with data visualization tools and techniques for presenting data insights effectively.
+ Agile development experience working in agile and scaled agile teams.
+ Strong data analysis skills and the ability to slice and dice the data as needed for business reporting.
+ Relational SQL (Oracle, SQL Server), NoSQL (MongoDB) and Cache (Couchbase) database integration and data distribution principles experience
+ Leadership & Mentorship: Ability to guide and mentor junior developers, fostering a collaborative team environment and promoting professional growth.
+ Strong communication skills, both written and verbal, with the ability to explain complex technical concepts to both technical and non-technical audiences.
+ Financial services is preferred (e.g., payments, ISO 222 format, posting mechanisms). E-commerce experience is also helpful.
**What You Will Be Doing**
+ Utilize in-depth knowledge and hands-on skills across multiple Applications Development areas to provide technical oversight across systems and applications
+ Will work very closely with and manage the work of a team of data engineers working on a Big Data Platform.
+ 70% hands-on development & coding, 30% delegation and leading a team of Applications developers.
+ Review/analyze/develop proposed technical solutions for projects
+ Contribute to formulation of strategies for applications development and other functional areas
+ Develop comprehensive knowledge of how areas of business integrate to accomplish business goals
+ Provide evaluative judgment based on analysis of factual data in complicated and unique situations
+ Impact the Applications Development area through monitoring delivery of end results, participate in budget management, and handling day-to-day staff management issues, including resource management and allocation of work within the team/project
+ Ensure essential procedures are followed and contribute to defining standards negotiating with external parties when necessary
Motion Recruitment Partners (MRP) is an Equal Opportunity Employer. All applicants must be currently authorized to work on a full-time basis in the country for which they are applying, and no sponsorship is currently available. Employment is subject to the successful completion of a pre-employment screening. Accommodation will be provided in all parts of the hiring process as required under MRP's Employment Accommodation policy. Applicants need to make their needs known in advance.
**Posted by:** Melissa Klein
**Specialization:**
+ Data Engineering
Mississauga, Ontario
**Hybrid**
Contract
$66/hr - $71/hr
Grow your career as a Big Data Engineer with an innovative global bank in Mississauga, Ontario. Contract role with strong possibility of extension or conversion. Will require working a hybrid schedule 3 days onsite per week.
Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. You will work alongside some of the smartest minds in the industry who are excited to share their knowledge and to learn from you.
Contract Duration: 11+ Months
**Required Skills & Experience**
+ 10+ years of Big Data development experience. At least 5 recent years of hands-on coding!
+ Must have strong Spark and Scala skills. Strong Scala development (with previous Java background) preferred.
+ ands-on experience working with Hive, Impala, Kafka, HBase, Spark for data curation/conformance related work.
+ Strong proficiency in Spark for development work related to curation/conformance.
+ Must have data streaming experience with Spark/Kafka or equivalent streaming/batch processing and event-based messaging.
+ Solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
+ Experience working in a Continuous Integration and Continuous Delivery environment and familiarity with tools like Jenkins, TeamCity, SonarQube, OpenShift, ECS, or Kubernetes.
+ Proficient in industry-standard best practices such as Design Patterns, Coding Standards, Coding modularity, and Prototyping.
+ Experience with data visualization tools and techniques for presenting data insights effectively.
+ Agile development experience working in agile and scaled agile teams.
+ Strong data analysis skills and the ability to slice and dice the data as needed for business reporting.
+ Relational SQL (Oracle, SQL Server), NoSQL (MongoDB) and Cache (Couchbase) database integration and data distribution principles experience
+ Leadership & Mentorship: Ability to guide and mentor junior developers, fostering a collaborative team environment and promoting professional growth.
+ Strong communication skills, both written and verbal, with the ability to explain complex technical concepts to both technical and non-technical audiences.
+ Financial services is preferred (e.g., payments, ISO 222 format, posting mechanisms). E-commerce experience is also helpful.
**What You Will Be Doing**
+ Utilize in-depth knowledge and hands-on skills across multiple Applications Development areas to provide technical oversight across systems and applications
+ Will work very closely with and manage the work of a team of data engineers working on a Big Data Platform.
+ 70% hands-on development & coding, 30% delegation and leading a team of Applications developers.
+ Review/analyze/develop proposed technical solutions for projects
+ Contribute to formulation of strategies for applications development and other functional areas
+ Develop comprehensive knowledge of how areas of business integrate to accomplish business goals
+ Provide evaluative judgment based on analysis of factual data in complicated and unique situations
+ Impact the Applications Development area through monitoring delivery of end results, participate in budget management, and handling day-to-day staff management issues, including resource management and allocation of work within the team/project
+ Ensure essential procedures are followed and contribute to defining standards negotiating with external parties when necessary
Motion Recruitment Partners (MRP) is an Equal Opportunity Employer. All applicants must be currently authorized to work on a full-time basis in the country for which they are applying, and no sponsorship is currently available. Employment is subject to the successful completion of a pre-employment screening. Accommodation will be provided in all parts of the hiring process as required under MRP's Employment Accommodation policy. Applicants need to make their needs known in advance.
**Posted by:** Melissa Klein
**Specialization:**
+ Data Engineering
This advertiser has chosen not to accept applicants from your region.
0
Senior Big Data Engineer
Mississauga, Ontario
Citigroup
Posted 17 days ago
Job Viewed
Job Description
About the Role:
+ We are looking for a Senior Data Architectto build and maintain - Platform Modernization, TransformationPrograms
+ You'll be part of a Core Accounts Data team that's responsible for the full software development life cycle, upholding best-in-class engineering standards and modern methodologies.
+ This role involves writing code, collaborating with other developers,understanding business requirements, developing technical solutions, collaborating with other business partners, breaking down acceptance criteria to understand team backlog deliverables, complexities, and risks, and contributing effectively to an agile team.
Key Responsibilities:
+ Design, develop, and maintain robust, scalable, and high-performance applications
+ Partner with architects, product owners, and cross-functional teams to design scalable and distributed system
+ Follow best-in-class Big Data/ETL Applications design standards, security considerations, scalability, maintainability and resource utilization aspects
+ Ensure high levels of unit test coverage, DevOps principles and a culture of continuous delivery and improvement
+ Actively contribute to hands-on coding, code reviews, and refactoring to maintain high engineering standards
+ Ability of analyzing the results across the environment and finding potential or existing errors in code/builds
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
+ Mentor junior engineers and foster a culture of engineering excellence and continuous learning.
Skills and Qualifications:
+ 10+ years of experience
+ Excellent Understanding of Bigdata/ETL ecosystem
+ Proficiency in Apache Spark development with Scala
+ Experience in building Spark Streaming and Batch/Live streaming applications
+ Strong experience in creating applications for Big Data and other Data & Analytics technologies (Spark, Scala, Hadoop, Hive etc.)
+ Ability to analyze Spark job performance in Spark UI and apply required performance tuning
+ Experience of working with Linux Scripting, Kafka, Git, Maven, SSH
+ Well versed with creating and debugging Scala code in IntelliJ IDEA
+ Good problem solving skills
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Primary Location Full Time Salary Range:**
$94,300.00 - $141,500.00
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
+ We are looking for a Senior Data Architectto build and maintain - Platform Modernization, TransformationPrograms
+ You'll be part of a Core Accounts Data team that's responsible for the full software development life cycle, upholding best-in-class engineering standards and modern methodologies.
+ This role involves writing code, collaborating with other developers,understanding business requirements, developing technical solutions, collaborating with other business partners, breaking down acceptance criteria to understand team backlog deliverables, complexities, and risks, and contributing effectively to an agile team.
Key Responsibilities:
+ Design, develop, and maintain robust, scalable, and high-performance applications
+ Partner with architects, product owners, and cross-functional teams to design scalable and distributed system
+ Follow best-in-class Big Data/ETL Applications design standards, security considerations, scalability, maintainability and resource utilization aspects
+ Ensure high levels of unit test coverage, DevOps principles and a culture of continuous delivery and improvement
+ Actively contribute to hands-on coding, code reviews, and refactoring to maintain high engineering standards
+ Ability of analyzing the results across the environment and finding potential or existing errors in code/builds
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
+ Mentor junior engineers and foster a culture of engineering excellence and continuous learning.
Skills and Qualifications:
+ 10+ years of experience
+ Excellent Understanding of Bigdata/ETL ecosystem
+ Proficiency in Apache Spark development with Scala
+ Experience in building Spark Streaming and Batch/Live streaming applications
+ Strong experience in creating applications for Big Data and other Data & Analytics technologies (Spark, Scala, Hadoop, Hive etc.)
+ Ability to analyze Spark job performance in Spark UI and apply required performance tuning
+ Experience of working with Linux Scripting, Kafka, Git, Maven, SSH
+ Well versed with creating and debugging Scala code in IntelliJ IDEA
+ Good problem solving skills
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Primary Location Full Time Salary Range:**
$94,300.00 - $141,500.00
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
This advertiser has chosen not to accept applicants from your region.
1
Junior Big Data Engineer (PySpark)
Mississauga, Ontario
Citigroup
Posted 18 days ago
Job Viewed
Job Description
**The Junior Big Data Engineer is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.**
**Responsibilities:**
**Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements**
**Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards**
**Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint**
**Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation**
**Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals**
**Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions**
**Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary**
**Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.**
**Qualifications:**
**Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources.**
**Big Data Infrastructure: Develop and manage large-scale data processing systems using frameworks like Apache Spark, Hadoop, and Kafka.**
**Proficiency in programming languages like Python, or Scala.**
**Strong expertise in data processing frameworks such as Apache Spark, Hadoop.**
**Expertise in Data Lakehouse technologies (Apache Iceberg, Apache Hudi, Trino)**
**Experience with cloud data platforms like AWS (Glue, EMR, Redshift), Azure (Synapse), or GCP (BigQuery).**
**Expertise in SQL and database technologies (e.g., Oracle, PostgreSQL, etc.).**
**Experience with data orchestration tools like Apache Airflow or Prefect.**
**Familiarity with containerization (Docker, Kubernetes) is a plus**
**Good to Have Skills:**
**Distributed caching solutions (Hazelcast or Redis)**
**Prior experience with building distributed, multi-tier applications is highly desirable.**
**Experience with building apps which are highly performant and scalable will be great**
**Education:**
**Bachelor's degree/University degree or equivalent experience**
**Master's degree preferred**
**This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.**
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Primary Location Full Time Salary Range:**
$79,320.00 - $110,680.00
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
**Responsibilities:**
**Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements**
**Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards**
**Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint**
**Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation**
**Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals**
**Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions**
**Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary**
**Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.**
**Qualifications:**
**Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources.**
**Big Data Infrastructure: Develop and manage large-scale data processing systems using frameworks like Apache Spark, Hadoop, and Kafka.**
**Proficiency in programming languages like Python, or Scala.**
**Strong expertise in data processing frameworks such as Apache Spark, Hadoop.**
**Expertise in Data Lakehouse technologies (Apache Iceberg, Apache Hudi, Trino)**
**Experience with cloud data platforms like AWS (Glue, EMR, Redshift), Azure (Synapse), or GCP (BigQuery).**
**Expertise in SQL and database technologies (e.g., Oracle, PostgreSQL, etc.).**
**Experience with data orchestration tools like Apache Airflow or Prefect.**
**Familiarity with containerization (Docker, Kubernetes) is a plus**
**Good to Have Skills:**
**Distributed caching solutions (Hazelcast or Redis)**
**Prior experience with building distributed, multi-tier applications is highly desirable.**
**Experience with building apps which are highly performant and scalable will be great**
**Education:**
**Bachelor's degree/University degree or equivalent experience**
**Master's degree preferred**
**This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.**
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Primary Location Full Time Salary Range:**
$79,320.00 - $110,680.00
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
This advertiser has chosen not to accept applicants from your region.
2
Senior Big Data Engineer – Spark & Scala
Toronto, Ontario
Astra North Infoteck Inc.
Posted 14 days ago
Job Viewed
Job Description
Job Title: Senior Big Data Engineer – Spark & Scala
Experience Required: 10+ years
Required Technical Skills:10+ years of experience in designing and implementing applications
8+ years of hands-on experience with:
Apache Spark
Scala
Java
8+ years of experience working with SQL Server RDBMS
Strong understanding of data models and entity relationships
Proficient in Linux-based environments
Knowledge of:
Containerization tools (Docker, OpenShift)
CI/CD tools and processes
Cloud platforms, especially Databricks and Snowflake
Nice to Have:Experience with Spring Boot and Angular
Familiarity with JCL (Job Control Language)
Background in the life insurance industry
Key Responsibilities:Contribute to low-level design of application components
Develop and maintain code with automated unit tests (e.g., JUnit)
Participate in code reviews and provide constructive feedback
Assist in creating implementation and deployment plans
Support user acceptance testing (UAT) by the business
Triage and fix defects identified during testing or production
Collaborate with cross-functional teams for technical delivery
This advertiser has chosen not to accept applicants from your region.
3
Big Data Engineer (PySpark) - Assistant Vice President
Mississauga, Ontario
Citigroup
Posted 18 days ago
Job Viewed
Job Description
Job Description
**The Big Data Engineer is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.**
**Responsibilities:**
**Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements**
**Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards**
**Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint**
**Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation**
**Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals**
**Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions**
**Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary**
**Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.**
**Qualifications:**
**Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources.**
**Big Data Infrastructure: Develop and manage large-scale data processing systems using frameworks like Apache Spark, Hadoop, and Kafka.**
**Proficiency in programming languages like Python, or Scala.**
**Strong expertise in data processing frameworks such as Apache Spark, Hadoop.**
**Expertise in Data Lakehouse technologies (Apache Iceberg, Apache Hudi, Trino)**
**Experience with cloud data platforms like AWS (Glue, EMR, Redshift), Azure (Synapse), or GCP (BigQuery).**
**Expertise in SQL and database technologies (e.g., Oracle, PostgreSQL, etc.).**
**Experience with data orchestration tools like Apache Airflow or Prefect.**
**Familiarity with containerization (Docker, Kubernetes) is a plus**
**Good to Have Skills:**
**Distributed caching solutions (Hazelcast or Redis)**
**Prior experience with building distributed, multi-tier applications is highly desirable.**
**Experience with building apps which are highly performant and scalable will be great**
**Education:**
**Bachelor's degree/University degree or equivalent experience**
**Master's degree preferred**
**This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.**
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Primary Location Full Time Salary Range:**
$94,300.00 - $141,500.00
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
**The Big Data Engineer is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.**
**Responsibilities:**
**Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements**
**Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards**
**Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint**
**Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation**
**Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals**
**Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions**
**Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary**
**Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.**
**Qualifications:**
**Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources.**
**Big Data Infrastructure: Develop and manage large-scale data processing systems using frameworks like Apache Spark, Hadoop, and Kafka.**
**Proficiency in programming languages like Python, or Scala.**
**Strong expertise in data processing frameworks such as Apache Spark, Hadoop.**
**Expertise in Data Lakehouse technologies (Apache Iceberg, Apache Hudi, Trino)**
**Experience with cloud data platforms like AWS (Glue, EMR, Redshift), Azure (Synapse), or GCP (BigQuery).**
**Expertise in SQL and database technologies (e.g., Oracle, PostgreSQL, etc.).**
**Experience with data orchestration tools like Apache Airflow or Prefect.**
**Familiarity with containerization (Docker, Kubernetes) is a plus**
**Good to Have Skills:**
**Distributed caching solutions (Hazelcast or Redis)**
**Prior experience with building distributed, multi-tier applications is highly desirable.**
**Experience with building apps which are highly performant and scalable will be great**
**Education:**
**Bachelor's degree/University degree or equivalent experience**
**Master's degree preferred**
**This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.**
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Primary Location Full Time Salary Range:**
$94,300.00 - $141,500.00
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
This advertiser has chosen not to accept applicants from your region.
4
Lead Big Data Engineer (PySpark) - Vice President
Mississauga, Ontario
Citigroup
Posted 18 days ago
Job Viewed
Job Description
**The Lead Big Data Engineer is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.**
**Responsibilities:**
**Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements**
**Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards**
**Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint**
**Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation**
**Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals**
**Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions**
**Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary**
**Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.**
**Qualifications:**
**Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources.**
**Big Data Infrastructure: Develop and manage large-scale data processing systems using frameworks like Apache Spark, Hadoop, and Kafka.**
**6+ years of proficiency in programming languages like Python, or Scala.**
**Strong expertise in data processing frameworks such as Apache Spark, Hadoop.**
**Expertise in Data Lakehouse technologies (Apache Iceberg, Apache Hudi, Trino)**
**Experience with cloud data platforms like AWS (Glue, EMR, Redshift), Azure (Synapse), or GCP (BigQuery).**
**Expertise in SQL and database technologies (e.g., Oracle, PostgreSQL, etc.).**
**Experience with data orchestration tools like Apache Airflow or Prefect.**
**Familiarity with containerization (Docker, Kubernetes) is a plus**
**Good to Have Skills:**
**Distributed caching solutions (Hazelcast or Redis)**
**Prior experience with building distributed, multi-tier applications is highly desirable.**
**Experience with building apps which are highly performant and scalable will be great**
**Education:**
**Bachelor's degree/University degree or equivalent experience**
**Master's degree preferred**
**This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.**
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Primary Location Full Time Salary Range:**
$120,800.00 - $170,800.00
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
**Responsibilities:**
**Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements**
**Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards**
**Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint**
**Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation**
**Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals**
**Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions**
**Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary**
**Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.**
**Qualifications:**
**Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources.**
**Big Data Infrastructure: Develop and manage large-scale data processing systems using frameworks like Apache Spark, Hadoop, and Kafka.**
**6+ years of proficiency in programming languages like Python, or Scala.**
**Strong expertise in data processing frameworks such as Apache Spark, Hadoop.**
**Expertise in Data Lakehouse technologies (Apache Iceberg, Apache Hudi, Trino)**
**Experience with cloud data platforms like AWS (Glue, EMR, Redshift), Azure (Synapse), or GCP (BigQuery).**
**Expertise in SQL and database technologies (e.g., Oracle, PostgreSQL, etc.).**
**Experience with data orchestration tools like Apache Airflow or Prefect.**
**Familiarity with containerization (Docker, Kubernetes) is a plus**
**Good to Have Skills:**
**Distributed caching solutions (Hazelcast or Redis)**
**Prior experience with building distributed, multi-tier applications is highly desirable.**
**Experience with building apps which are highly performant and scalable will be great**
**Education:**
**Bachelor's degree/University degree or equivalent experience**
**Master's degree preferred**
**This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.**
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Primary Location Full Time Salary Range:**
$120,800.00 - $170,800.00
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
This advertiser has chosen not to accept applicants from your region.
5
Senior Big Data Engineer - Scala, Apache Spark
Brampton, Ontario
Astra North Infoteck Inc.
Posted 22 days ago
Job Viewed
Job Description
Role Name: Senior Big Data Engineer Experience Required: 6–8 years___Role Description:• Design, develop, and maintain scalable data processing pipelines using Scala and Apache Spark• Work with NoSQL databases such as Cassandra, MongoDB, or Cosmos DB to handle large volumes of structured and unstructured data• Collaborate with data architects and engineers to optimize data workflows for performance and reliability• Participate in code reviews, testing, and deployment processes to ensure high code quality• Engage with cross-functional stakeholders to gather requirements and deliver data-driven solutions aligned with business goals• Troubleshoot and resolve production environment issues• Contribute to the continuous improvement of development processes, tools, and best practices___Essential Skills:• Strong hands-on experience in Scala programming• Proven expertise with Apache Spark for distributed data processing• Solid experience with NoSQL databases like Cassandra, MongoDB, or Cosmos DB• Demonstrated ability to build and optimize large-scale data pipelines• Excellent problem-solving and analytical skills
This advertiser has chosen not to accept applicants from your region.
Be The First To Know
About the latest Data engineer Jobs in Canada !
6
Lead Big Data Engineer with AWS Services
Toronto, Ontario
Astra North Infoteck Inc.
Posted 25 days ago
Job Viewed
Job Description
Lead AWS Platform/Data Engineering Lead Experience Range > 12 YearsMandatory 4 Days, In Person - In Office, Downtown TorontoMust Have Technical/Functional SkillsClient is looking for engineers with the following skills:• Strong Experience with AWS Services: S3, Lake Formation, Glue, EMR, EC2 Athena, Lambda, EventBridge, SNS, SQS• Strong Experience in SQL, Python and Spark for Data Engineering tasks• Expertise in Terraform• Experience in designing and implementing Data Pipeline on AWS using native and configurable AWS services• Excellent design and troubleshooting skills.• Proficiency in Apache Spark for distributed data processing• Experience with Amazon Neptune DB for graph-based metadata management• Strong understanding of Data lake architecture, data governance and security best practices• Strengthen Entitlement capability• Launch self-serve data subscription and sharing of data products through Data Portal• Improve data discovery by displaying composite data products only, simplifying catalog organization, Low Latency Solutions• Build, design and implement scalable data lake architecture using AWS S3 and Lakeformation• Build and optimize ETL Pipelines using AWS Glue, EMR and Spark• Implement Event-Driven workflows using EventBridge, SNS and SQS• Design and query datasets using Athena• Manage metadata and data lineage using Amazon Neptune DB• Expose APIs for data subscription and sharing using API Gateway and AWS Lambda• Automate infrastructure provisioning using Terraform• Ensure data security and compliance by implementing robust IAM policies and access controls.• Develop and maintain a self-serve data portal using Angular and integrate it with backend serviceManagerial Skills (Must Have)• Strong Communication Skills• Experience in Leading Teams
This advertiser has chosen not to accept applicants from your region.
7
DevOps Engineer- Big Data
Toronto, Ontario
IT Accel, Inc
Posted today
Job Viewed
Job Description
Job Description
Job Description
Big Data DevOps Engineer (Hadoop / Cassandra)
On-site 4 days a week | Toronto, ON
Overview:
We’re looking for a DevOps Engineer with strong expertise in big data platforms, specifically Hadoop and/or Cassandra (both is a plus). This role requires proven experience administering, configuring, and troubleshooting large-scale distributed systems, as well as deep Linux administration and DevOps toolchain skills. Candidates must demonstrate hands-on engineering experience, not just surface-level administration.
Key Responsibilities:
Install, configure, and maintain Hadoop or Cassandra clusters in production environments.
Manage and optimize performance, replication, failover, and disaster recovery for big data systems.
Develop and maintain automation scripts (Bash, Python, PowerShell) for deployment and monitoring.
Build and manage CI/CD pipelines (Jenkins, GitHub/Bitbucket, Nexus).
Automate provisioning using Terraform, Ansible, Salt, or similar.
Deploy and manage cloud infrastructure (Azure preferred; AWS/GCP a plus).
Monitor and log systems using tools like Splunk, DataDog, ELK, etc.
Ensure data security, scalability, and availability across environments.
Must-Have Skills:
5–10 years of DevOps / Systems Engineering experience.
Strong Linux administration background (Red Hat preferred).
Hands-on experience with Hadoop or Cassandra (administration, scaling, troubleshooting).
Scripting skills (Bash, Python, PowerShell).
Experience with cloud platforms (Azure IaaS, AKS, ADLS, ADF; AWS/GCP a plus).
Strong troubleshooting and engineering mindset with proven production experience.
Nice to Have:
Experience with both Hadoop and Cassandra.
Exposure to Spark, Hive, HBase, or other big data ecosystems.
HPC cluster experience.
Familiarity with AutoSys, ServiceNow, JIRA, Confluence.
#itacceljobs
This advertiser has chosen not to accept applicants from your region.
8