79 Data Engineering jobs in Canada
Big Data Engineer

Posted today
Job Viewed
Job Description
Mississauga, Ontario
**Hybrid**
Contract
$70/hr - $72.5/hr
Grow your career as a Big Data Engineer with an innovative global bank in Mississauga, Ontario. Contract role with strong possibility of extension or conversion. Will require working a hybrid schedule 3 days onsite per week.
Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. You will work alongside some of the smartest minds in the industry who are excited to share their knowledge and to learn from you.
Contract Duration: 11+ Months
**Required Skills & Experience**
+ 10+ years of Big Data development experience. At least 5 recent years of hands-on coding!
+ Must have strong Spark and Scala skills. Strong Scala development (with previous Java background) preferred.
+ ands-on experience working with Hive, Impala, Kafka, HBase, Spark for data curation/conformance related work.
+ Strong proficiency in Spark for development work related to curation/conformance.
+ Must have data streaming experience with Spark/Kafka or equivalent streaming/batch processing and event-based messaging.
+ Solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
+ Experience working in a Continuous Integration and Continuous Delivery environment and familiarity with tools like Jenkins, TeamCity, SonarQube, OpenShift, ECS, or Kubernetes.
+ Proficient in industry-standard best practices such as Design Patterns, Coding Standards, Coding modularity, and Prototyping.
+ Experience with data visualization tools and techniques for presenting data insights effectively.
+ Agile development experience working in agile and scaled agile teams.
+ Strong data analysis skills and the ability to slice and dice the data as needed for business reporting.
+ Relational SQL (Oracle, SQL Server), NoSQL (MongoDB) and Cache (Couchbase) database integration and data distribution principles experience
+ Leadership & Mentorship: Ability to guide and mentor junior developers, fostering a collaborative team environment and promoting professional growth.
+ Strong communication skills, both written and verbal, with the ability to explain complex technical concepts to both technical and non-technical audiences.
+ Financial services is preferred (e.g., payments, ISO 222 format, posting mechanisms). E-commerce experience is also helpful.
**What You Will Be Doing**
+ Utilize in-depth knowledge and hands-on skills across multiple Applications Development areas to provide technical oversight across systems and applications
+ Will work very closely with and manage the work of a team of data engineers working on a Big Data Platform.
+ 70% hands-on development & coding, 30% delegation and leading a team of Applications developers.
+ Review/analyze/develop proposed technical solutions for projects
+ Contribute to formulation of strategies for applications development and other functional areas
+ Develop comprehensive knowledge of how areas of business integrate to accomplish business goals
+ Provide evaluative judgment based on analysis of factual data in complicated and unique situations
+ Impact the Applications Development area through monitoring delivery of end results, participate in budget management, and handling day-to-day staff management issues, including resource management and allocation of work within the team/project
+ Ensure essential procedures are followed and contribute to defining standards negotiating with external parties when necessary
Motion Recruitment Partners (MRP) is an Equal Opportunity Employer. All applicants must be currently authorized to work on a full-time basis in the country for which they are applying, and no sponsorship is currently available. Employment is subject to the successful completion of a pre-employment screening. Accommodation will be provided in all parts of the hiring process as required under MRP's Employment Accommodation policy. Applicants need to make their needs known in advance.
**Posted by:** Melissa Klein
**Specialization:**
+ Data Engineering
Big Data Developer
Posted 9 days ago
Job Viewed
Job Description
Experience: 5+ Years
Location: Downtown, Toronto (Hybrid- 4 days a week)
Job Description:
We are seeking a highly skilled and experienced Big Data Developer with a strong background in designing, developing, and optimizing data applications using modern big data technologies. The ideal candidate will have hands-on experience with Java/Scala , Apache Spark , and Cloudera/HDP , along with a good understanding of cloud-native development and DevOps practices .
Key Responsibilities:
- Design, develop, and optimize Big Data applications using Java/Scala and Apache Spark .
- Work on data ingestion, transformation, and analysis workflows on Cloudera/HDP platforms.
- Write and troubleshoot complex SQL queries to validate business logic and data transformations.
- Develop and deploy cloud-native applications on AWS, Azure, or OpenShift (OCP) using Docker and Kubernetes .
- Collaborate with cross-functional teams in an Agile environment to deliver high-quality solutions.
- Participate in code reviews, testing, and documentation processes.
- Utilize DevOps tools including Jenkins , Git , and JIRA to streamline development and deployment pipelines.
Required Skills:
- 5+ years of experience in Big Data development
- Proficiency in Java or Scala
- Strong expertise with Apache Spark
- Experience working on Cloudera or HDP (Hortonworks Data Platform)
- Advanced SQL skills; ability to write and analyze complex queries
- Working knowledge of AWS/Azure/OCP , Docker , and Kubernetes
- Familiarity with DevOps tools: Jenkins, Git, JIRA
- Excellent problem-solving and communication skills
- Ability to thrive in a fast-paced, Agile environment
Preferred Qualifications:
- Experience in data pipeline development for large-scale data processing
- Exposure to CI/CD pipelines and automation
- Familiarity with security and compliance practices in cloud environments
Big Data Developer
Posted 9 days ago
Job Viewed
Job Description
Experience: 5+ Years
Location: Downtown, Toronto (Hybrid- 4 days a week)
Job Description:
We are seeking a highly skilled and experienced Big Data Developer with a strong background in designing, developing, and optimizing data applications using modern big data technologies. The ideal candidate will have hands-on experience with Java/Scala , Apache Spark , and Cloudera/HDP , along with a good understanding of cloud-native development and DevOps practices .
Key Responsibilities:
- Design, develop, and optimize Big Data applications using Java/Scala and Apache Spark .
- Work on data ingestion, transformation, and analysis workflows on Cloudera/HDP platforms.
- Write and troubleshoot complex SQL queries to validate business logic and data transformations.
- Develop and deploy cloud-native applications on AWS, Azure, or OpenShift (OCP) using Docker and Kubernetes .
- Collaborate with cross-functional teams in an Agile environment to deliver high-quality solutions.
- Participate in code reviews, testing, and documentation processes.
- Utilize DevOps tools including Jenkins , Git , and JIRA to streamline development and deployment pipelines.
Required Skills:
- 5+ years of experience in Big Data development
- Proficiency in Java or Scala
- Strong expertise with Apache Spark
- Experience working on Cloudera or HDP (Hortonworks Data Platform)
- Advanced SQL skills; ability to write and analyze complex queries
- Working knowledge of AWS/Azure/OCP , Docker , and Kubernetes
- Familiarity with DevOps tools: Jenkins, Git, JIRA
- Excellent problem-solving and communication skills
- Ability to thrive in a fast-paced, Agile environment
Preferred Qualifications:
- Experience in data pipeline development for large-scale data processing
- Exposure to CI/CD pipelines and automation
- Familiarity with security and compliance practices in cloud environments
Manager, Data Engineering

Posted 21 days ago
Job Viewed
Job Description
25WD89148
_The French translation can be found below!/La traduction en français se trouve ci-dessous!_
**Position Overview**
Autodesk has invested in data-driven decision-making, optimizing our platform's business, product, and cost. The next five years will transform how we work, with a surge in data volume and scaling of AI/ML to provide even greater value to our customers. Reporting to the Director, Insights and Analytics, the Manager, Data Engineering will build and lead a team focused on building scalable, reliable, and high-quality data pipelines and processes that power strategic analytics, data science and cost optimization activities across Autodesk's platform initiatives.
As part of the Analytics & Insights (A&I) team, you will play a critical role in enabling data-driven decision-making by building and maintaining trusted data pipelines, curated data models and analytics-ready datasets. You will work closely with analysts, data scientists, Finops engineers and product teams to build solutions that support reporting, experimentation, and advanced analytics at scale.
Preference for candidates in Toronto or Montreal, Canada.
**Responsibilities**
+ Lead and mentor a team of data engineers responsible for developing and maintaining data pipelines and infrastructure on platforms such as AWS and Snowflake
+ Define and drive the long-term vision for data engineering in alignment with Autodesk data platform strategy and analytics roadmap
+ Partner with analysts, data scientists, FinOps engineers, engineering and product teams to understand data needs and translate them into scalable data solutions
+ Establish clear standards for operational excellence and define "what good looks like" across all stages of the data lifecycle
+ Drive the design and development of data models and ETL/ELT processes that ensure high data quality, availability, and performance
+ Champion and implement data engineering best practices, including testing, documentation, governance, and observability
+ Leverage AI-driven approaches in data workflows, including anomaly detection, orchestration optimization, and automated code generation
+ Manage project timelines, resources, and priorities across multiple initiatives in a fast-paced, cross-functional environment
+ Stay current with emerging trends in data engineering and proactively evolve the team's capabilities and toolset
**Minimum Qualifications**
+ 10 years of experience in data engineering, with at least 4 years in a leadership or management role
+ Demonstrated success leading technical teams and delivering complex data engineering projects
+ Experience working with cloud data platforms (e.g., AWS, Snowflake, Databricks) and orchestration tools (e.g., Airflow)
+ Proficient in SQL, Python, and data modeling best practices
+ Knowledge of big data processing frameworks (e.g. Spark, Hadoop)
+ Experience building and maintaining large-scale batch and real-time data pipelines
+ Experience with both ETL and ELT pipelines, including traditional ETL tools (e.g., Airflow, Informatica) and modern ELT frameworks (e.g., dbt, Snowflake)
+ Excellent communication and stakeholder management skills
+ Drive scalable architecture through platform systems design and modern design patterns
**Preferred Qualifications**
+ Experience working in product/platform organizations or supporting data engineering for SaaS-based applications
+ Familiarity with data quality frameworks, observability tools, and CI/CD for data
+ Knowledge of FinOps practices, data security, and compliance in cloud environments
+ Knowledge of AWS IAM roles, permissions, and best practices for least-privilege access
+ Passion for coaching talent and building inclusive, high-performing teams
---
**Description du poste**
Autodesk a investi dans la prise de décision basée sur les données afin d'optimiser les activités, les produits et les coûts de notre plateforme. Les cinq prochaines années vont transformer notre façon de travailler, avec une augmentation considérable du volume de données et le développement de l'IA/ML afin d'offrir encore plus de valeur à nos clients. Sous la responsabilité du directeur Insights and Analytics, le responsable de l'ingénierie des données constituera et dirigera une équipe chargée de mettre en place des pipelines et des processus de données évolutifs, fiables et de haute qualité qui alimenteront les activités d'analyse stratégique, de science des données et d'optimisation des coûts dans le cadre des initiatives de la plateforme Autodesk.
Au sein de l'équipe Analytics & Insights (A&I), vous jouerez un rôle essentiel dans la prise de décisions basées sur les données en créant et en maintenant des pipelines de données fiables, des modèles de données organisés et des ensembles de données prêts à être analysés. Vous travaillerez en étroite collaboration avec des analystes, des scientifiques des données, des ingénieurs Finops et des équipes produit afin de créer des solutions qui prennent en charge le reporting, l'expérimentation et l'analyse avancée à grande échelle.
Les candidats basés à Toronto ou à Montréal, au Canada, seront privilégiés.
**Responsabilités**
+ Diriger et encadrer une équipe d'ingénieurs de données chargés de développer et de maintenir des pipelines de données et des infrastructures sur des plateformes telles qu'AWS et Snowflake
+ Définir et piloter la vision à long terme de l'ingénierie des données en accord avec la stratégie de plateforme de données et la feuille de route analytique d'Autodesk
+ Collaborer avec les analystes, les scientifiques de données, les ingénieurs FinOps, les équipes d'ingénierie et les équipes produit afin de comprendre les besoins en matière de données et de les traduire en solutions de données évolutives
+ Établir des normes claires d'excellence opérationnelle et définir ce qui constitue une bonne pratique à toutes les étapes du cycle de vie des données
+ Diriger la conception et le développement de modèles de données et de processus ETL/ELT qui garantissent la qualité, la disponibilité et la performance des données
+ Promouvoir et mettre en œuvre les meilleures pratiques en matière d'ingénierie des données, notamment les tests, la documentation, la gouvernance et l'observabilité
+ Tirer parti des approches basées sur l'IA dans les flux de données, notamment la détection des anomalies, l'optimisation de l'orchestration et la génération automatisée de code
+ Gérer les calendriers, les ressources et les priorités des projets dans le cadre de multiples initiatives, dans un environnement dynamique et interfonctionnel
+ Se tenir au courant des nouvelles tendances en matière d'ingénierie des données et faire évoluer de manière proactive les capacités et les outils de l'équipe
**Qualifications minimales**
+ 10 ans d'expérience en ingénierie des données, dont au moins 4 ans dans un rôle de direction ou de gestion
+ Expérience avérée dans la direction d'équipes techniques et la réalisation de projets complexes d'ingénierie des données
+ Expérience de travail avec des plateformes de données cloud (par exemple, AWS, Snowflake, Databricks) et des outils d'orchestration (par exemple, Airflow)
+ Maîtrise de SQL, Python et des meilleures pratiques en matière de modélisation des données
+ Connaissance des cadres de traitement des mégadonnées (par exemple, Spark, Hadoop)
+ Expérience dans la création et la maintenance de pipelines de données à grande échelle, par lots et en temps réel
+ Expérience avec les pipelines ETL et ELT, y compris les outils ETL traditionnels (par exemple, Airflow, Informatica) et les cadres ELT modernes (par exemple, dbt, Snowflake)
+ Excellentes compétences en communication et en gestion des parties prenantes
+ Capacité à mettre en œuvre une architecture évolutive grâce à la conception de systèmes de plateformes et à des modèles de conception modernes
**Qualifications souhaitées**
+ Expérience dans des organisations de produits/plateformes ou dans le soutien à l'ingénierie des données pour des applications SaaS
+ Connaissance des cadres de qualité des données, des outils d'observabilité et du CI/CD pour les données
+ Connaissance des pratiques FinOps, de la sécurité des données et de la conformité dans les environnements cloud
+ Connaissance des rôles, des autorisations et des meilleures pratiques AWS IAM pour un accès avec le moins de privilèges possible
+ Passion pour l'accompagnement des talents et la constitution d'équipes inclusives et performantes
**Learn More / Plus d'information**
**About Autodesk /** **À propos d'Autodesk**
Welcome to Autodesk! Amazing things are created every day with our software - from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.
We take great pride in our culture here at Autodesk - it's at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.
When you're an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!
Bienvenue chez Autodesk ! Nos logiciels créent chaque jour des choses extraordinaires : des bâtiments les plus écologiques aux voitures les plus propres, en passant par les usines les plus intelligentes et les films à succès. Nous aidons les innovateurs à concrétiser leurs idées, transformant non seulement la façon dont les choses sont fabriquées, mais aussi ce qui peut l'être. Nous sommes très fiers de notre culture chez Autodesk ; elle est au cœur de tout ce que nous faisons. Notre culture guide notre façon de travailler et de nous comporter les uns envers les autres, influence nos interactions avec nos clients et nos partenaires, et définit notre image au monde. En tant qu'Autodeskien, vous pouvez accomplir un travail significatif qui contribue à bâtir un monde meilleur, conçu et réalisé pour tous. Prêt à façonner le monde et votre avenir ? Rejoignez-nous !
**Salary transparency /** **Transparence salariale**
Salary is one part of Autodesk's competitive compensation package. Offers are based on the candidate's experience and geographic location. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.
Le salaire est l'un des éléments du programme de rémunération concurrentiel d'Autodesk. Pour les postes basés au Canada (Colombie-Britannique), nous proposons un salaire de base compris entre X et X dollars. Les offres sont basées sur l'expérience et la situation géographique du candidat et peuvent dépasser cette fourchette. En plus du salaire de base, notre programme de rémunération peut inclure des primes annuelles en espèces, des commissions pour les postes commerciaux, des attributions d'actions et un ensemble complet d'avantages sociaux.
**Diversity & Belonging /** **Diversité et appurtenance**
We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: sommes fiers de cultiver une culture d'appartenance où chacun peut s'épanouir. Pour en savoir plus, cliquez ici : you an existing contractor or consultant with Autodesk?**
**Êtes-vous un sous-traitant ou un consultant existant d'Autodesk ?**
Please search for open jobs and apply internally (not on this external site).
Veuillez rechercher des emplois vacants et postuler à l'interne (pas sur ce site externe).
Manager, Data Engineering
Posted today
Job Viewed
Job Description
Job Description
Description
At CI, we see a great place to work as one that is a safe place for everyone to have a voice, where people are empowered to take ownership over meaningful work, where there is an opportunity to grow through stretching themselves, where they can work on innovative products and projects, and where employees are supported and engaged in doing so.
CI Financial is looking for an innovative leader to join our Data, AI & Analytics (DNA) team as the Manager of Data Engineering (Delivery). In this managerial role within the DNA team, you will oversee & perform the design, development, and optimization of scalable data pipelines and data models that enable seamless, reliable data flow and consumption across a variety of systems. Your work will support business objectives and empower data-driven decision-making. You will support the continuous advancement of our data engineering delivery practices, ensure data integrity, availability, and security, while promote strong collaboration across CI Global Asset Management.
KEY RESPONSIBILITIES:
Leadership & Strategy:
- Manage and lead a team of data engineers to deliver high-quality data solutions.
- Take ownership of project/initiative delivery, including planning, development, testing, and deployment, while working closely with cross-functional teams to ensure successful and timely outcomes.
Data Engineering:
- Design, development, and optimization of scalable data pipelines, data models to enable reliable data movement & consumption across diverse systems.
- Champion best practices in code quality and data architecture within the team.
- Develop and enhance data ingestion, transformation, and validation frameworks to improve productivity and ensure high data accuracy.
- Drive continuous improvements in platform architecture and CI/CD practices.
Collaboration & Communication:
- Collaborate closely with business analysts, product owners and business stakeholders to translate complex business problems into technical solutions.
Performance Optimization & Scalability:
- Troubleshoot and resolve production issues, including performance bottlenecks, data quality problems, and system failures; proactively identify recurring issues and optimize existing processes for reliability and efficiency.
- Drive continuous improvement of data platforms through automation, optimization, and monitoring.
Qualifications:
- 7+ years of hands-on experience in data engineering including 1–2 years of proven experience in managing high-performing data engineering or technology teams.
- Expertise in architecting and building scalable data platforms, ETL/ELT pipelines, and data integration solutions.
- Solid understanding of data warehousing concept and data architecture (Kimball and/or Data Vault 2.0 methodologies)
- Proficiency in languages like SQL and Python and experience with Snowflake or similar data platforms.
- Strong project management skills with experience leading data engineering projects, including defining project scope, timelines, and deliverables, and managing project risks.
- Ability to navigate between technical and business audiences.
- Exceptional problem-solving abilities with proven record of tackling complex data challenges and delivering practical, impactful solutions.
- Experience with DevOps practices, including CI/CD pipelines and automated deployment/testing frameworks.
Preferred Qualifications:
- Knowledge of asset management, financial services, or wealth management industries
WHAT WE OFFER
- Modern HQ location within walking distance from Union Station.
- Equipment Purchase Program.
- Training Reimbursement.
- Paid Professional Designations.
- Employee Share Purchase Program (ESPP).
- Corporate Discount Program.
- Enhanced group benefits.
- Parental Leave Top–up program.
- Fitness membership discounts.
- Volunteer paid Days.
We are focused on building a diverse and inclusive workforce. If you are excited about this role and are not confident you meet all the qualification requirements, we encourage you to apply to investigate the opportunity further.
Please submit your resume in confidence by clicking “Apply”. Only qualified candidates selected for an interview will be contacted. CI Financial Corp. and all of our affiliates (“CI”) are committed to fair and accessible employment practices and provide reasonable accommodations for persons with disabilities. If you require accommodations in order to apply for any job opportunities, require this posting in an additional format, or require accommodation at any stage of the recruitment process please contact us at , or call ext. 4747.
Senior Big Data Engineer
Posted 6 days ago
Job Viewed
Job Description
+ We are looking for a Senior Data Architectto build and maintain - Platform Modernization, TransformationPrograms
+ You'll be part of a Core Accounts Data team that's responsible for the full software development life cycle, upholding best-in-class engineering standards and modern methodologies.
+ This role involves writing code, collaborating with other developers,understanding business requirements, developing technical solutions, collaborating with other business partners, breaking down acceptance criteria to understand team backlog deliverables, complexities, and risks, and contributing effectively to an agile team.
Key Responsibilities:
+ Design, develop, and maintain robust, scalable, and high-performance applications
+ Partner with architects, product owners, and cross-functional teams to design scalable and distributed system
+ Follow best-in-class Big Data/ETL Applications design standards, security considerations, scalability, maintainability and resource utilization aspects
+ Ensure high levels of unit test coverage, DevOps principles and a culture of continuous delivery and improvement
+ Actively contribute to hands-on coding, code reviews, and refactoring to maintain high engineering standards
+ Ability of analyzing the results across the environment and finding potential or existing errors in code/builds
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
+ Mentor junior engineers and foster a culture of engineering excellence and continuous learning.
Skills and Qualifications:
+ 10+ years of experience
+ Excellent Understanding of Bigdata/ETL ecosystem
+ Proficiency in Apache Spark development with Scala
+ Experience in building Spark Streaming and Batch/Live streaming applications
+ Strong experience in creating applications for Big Data and other Data & Analytics technologies (Spark, Scala, Hadoop, Hive etc.)
+ Ability to analyze Spark job performance in Spark UI and apply required performance tuning
+ Experience of working with Linux Scripting, Kafka, Git, Maven, SSH
+ Well versed with creating and debugging Scala code in IntelliJ IDEA
+ Good problem solving skills
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Primary Location Full Time Salary Range:**
$94,300.00 - $141,500.00
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Senior Big Data Developer
Posted 11 days ago
Job Viewed
Job Description
**Responsibilities:**
**Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements**
**Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards**
**Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint**
**Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation**
**Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals**
**Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions**
**Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary**
**Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.**
**Qualifications:**
**6-10 years of relevant experience in Apps Development or systems analysis role, with Big Data technologies, such as Spark (Scala/Python), Kafka streaming, Hadoop, HDFS, and solid understanding of Big Data architecture**
**Good understanding on data file formats, Impala, Hadoop, Parquet, Avro, Iceberg, etc.**
**Extensive experience with web services with Kubernetes, and Version control/CI/CD processes with git, Jenkins, harness, etc.**
**Public cloud experience is preferred, preferably AWS.**
**Strong data analysis skills and the ability to slice and dice the data as needed for business reporting**
**Experience working in an agile environment with a fast paced changing requirements.**
**Excellent planning and organizational skills**
**Ability to adjust priorities quickly as circumstances dictate**
**Demonstrated leadership and project management skills**
**Consistently demonstrates clear and concise written and verbal communication**
**Education:**
**Bachelor's degree/University degree or equivalent experience**
**Master's degree preferred**
**This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.**
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Primary Location Full Time Salary Range:**
$120,800.00 - $170,800.00
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Be The First To Know
About the latest Data engineering Jobs in Canada !
Senior Big Data Engineer
Posted 15 days ago
Job Viewed
Job Description
Toronto, Ontario, Canada
**Hours:**
37.5
**Line of Business:**
Technology Solutions
**Pay Details:**
$126,100 - $164,100 CAD
This role is eligible for a discretionary variable compensation award that considers business and individual performance.
TD is committed to providing fair and equitable compensation opportunities to all colleagues. Growth opportunities and skill development are defining features of the colleague experience at TD. Our compensation policies and practices have been designed to allow colleagues to progress through the salary range over time as they progress in their role. The base pay actually offered may vary based upon the candidate's skills and experience, job-related knowledge, geographic location, and other specific business and organizational needs.
As a candidate, you are encouraged to ask compensation related questions and have an open dialogue with your recruiter who can provide you more specific details for this role.
**Job Description:**
**Department Overview**
TD Securities offers a wide range of capital markets products and services to corporate, government, and institutional clients who choose us for our innovation, execution, and experience.
With more than 6,500 professionals operating out of 40 cities across the globe, we help clients meet their needs today and prepare for tomorrow. Our services include underwriting and distributing new issues, providing trusted advice and industry-leading insight, extending access to global markets, and delivering integrated transaction banking solutions.
We are growth-oriented, people-focused, and community-minded. As a team, we work to deliver value for our clients every day.
**Job Description**
We are looking for an experienced **Senior Big Data Engineer (Engineer II)** that will work on critical initiatives at TD Securities -- the design and implementation of the Trading Risk Warehouse platform. The successful candidate will be responsible for the design and development of a software solution that will be used by Risk Analysts, Front Office Traders, and Senior Executives. This is a unique opportunity to work on cutting-edge technologies to solve problems of scale and speed. Responsibility of this position includes the following:
**Responsibilities**
+ Implement high quality and efficient codes to leverage distributed computing on Hadoop platform.
+ Ability to build new and modify existing components based on requirements for web UI, RestAPI and data pipeline (ETL).
+ Perform unit testing & integration testing.
+ Find opportunities to optimize current codes.
+ Ability to pinpoint root cause and resolve production issues.
+ Leverage best practices in continuous integration and delivery.
+ Drive transformation by continuously looking for ways to improve existing processes, architecture and software quality.
+ Explore new capabilities and technologies to drive innovation.
**Desired Skillsets:**
+ Java/JEE
+ Spark/Scala
+ Big Data/Hadoop/Hive
+ Spring Boot/Angular/RestAPI
+ Cassandra/No SQL database
+ MS SQL Server
+ Git
+ Linux
**Technical Skills**
+ 7+ years of Java/JEE experience
+ 5+ years of Big Data Technologies (Hadoop, Spark/Scala, Hive)
+ Experience in the Spring tech stack and building microservices using Spring Boot.
+ Experience in Linux environment.
+ Experience in designing and integrating with REST API.
+ Experience working with messaging technologies.
+ Experience with RDBMS, demonstrable fluency in SQL and any non-relational db such as Cassandra (is preferred).
+ Experience of Git, CI/CD toolset (Maven), Jenkins, working within an Agile environment.
+ Strong understanding of design patterns and coding practices.
+ Experience working with scalable and low latency systems.
+ A passion for simplifying and automating work, for making things better, for being efficient and helping others.
**Business Skills**
+ Good communication skills. Experience in collaborating efficiently within a global team
+ Demonstrable experience working in a fast-paced environment, working with PMs and our business sponsors
+ Nice to have - Knowledge of capital markets products including derivatives and cross-asset products
+ Nice to have - Hands-on experience with market risk and/or PnL (profit and loss).
**Additonal Information**
**Join in on what others in TD Technology Solutions are doing:**
+ Inspire a positive work environment and help champion quality, innovation, teamwork and service to the business.
+ Learn voraciously, stretch your thinking, share your knowledge and educate others.
+ Communicate and collaborate with both technical and non-technical professionals.
+ Cultivate winning relationships by building trust with business and technology partners.
+ Share our commitment to productivity, effectiveness and operational efficiency.
#LI-Tech
**Who We Are:**
TD Securities offers a wide range of capital markets products and services to corporate, government, and institutional clients who choose us for our innovation, execution, and experience. With more than 6,500 professionals operating out of 40 cities across the globe, we help clients meet their needs today and prepare for tomorrow. Our services include underwriting and distributing new issues, providing trusted advice and industry-leading insight, extending access to global markets, and delivering integrated transaction banking solutions. In 2023, we acquired Cowen Inc., offering our clients access to a premier U.S. equities business and highly-diverse equity research franchise, while growing our strong, diversified investment bank. We are growth-oriented, people-focused, and community-minded. As a team, we work to deliver value for our clients every day.
**Our Total Rewards Package**
Our Total Rewards package reflects the investments we make in our colleagues to help them and their families achieve their financial, physical, and mental well-being goals. Total Rewards at TD includes a base salary, variable compensation, and several other key plans such as health and well-being benefits, savings and retirement programs, paid time off, banking benefits and discounts, career development, and reward and recognition programs. Learn more ( Information:**
We're delighted that you're considering building a career with TD. Through regular development conversations, training programs, and a competitive benefits plan, we're committed to providing the support our colleagues need to thrive both at work and at home.
Please be advised that this job opportunity is subject to provincial regulation for employment purposes. It is imperative to acknowledge that each province or territory within the jurisdiction of Canada may have its own set of regulations, requirements.
**Colleague Development**
If you're interested in a specific career path or are looking to build certain skills, we want to help you succeed. You'll have regular career, development, and performance conversations with your manager, as well as access to an online learning platform and a variety of mentoring programs to help you unlock future opportunities. Whether you have a passion for helping customers and want to expand your experience, or you want to coach and inspire your colleagues, there are many different career paths within our organization at TD - and we're committed to helping you identify opportunities that support your goals.
**Training & Onboarding**
We will provide training and onboarding sessions to ensure that you've got everything you need to succeed in your new role.
**Interview Process**
We'll reach out to candidates of interest to schedule an interview. We do our best to communicate outcomes to all applicants by email or phone call.
**Accommodation**
Your accessibility is important to us. Please let us know if you'd like accommodations (including accessible meeting rooms, captioning for virtual interviews, etc.) to help us remove barriers so that you can participate throughout the interview process.
We look forward to hearing from you!
**Language Requirement (Quebec only):**
Sans Objet
Federal law prohibits job discrimination based on race, color, sex, sexual orientation, gender identity, national origin, religion, age, equal pay, disability and genetic information.