CrawlJobs Logo

Lead Python Full Stack Data Engineer

Canada, Mississauga 120800.00 - 170800.00 USD / Year · Job Posted May 16, 2026
Apply Position
Job Link Share

Job Description

We are assembling an A-team of highly skilled, autonomous, and visionary engineers, and we are seeking an exceptional Lead Full Stack Data Engineer to join our high-performing, co-located squads in Canada. This senior role is for a hands-on player/coach who not only masters the full spectrum of data engineering but also demonstrates exemplary leadership, strategic thinking, and an unwavering commitment to leveraging AI for transformative productivity. The ideal candidate will take ownership of complex data products and platforms, driving the design, development, and optimization of end-to-end data solutions from ingestion to advanced consumption. We are looking for a true AI-first thinker who can architect scalable systems, mentor emerging talent, profoundly understand the functional domains our work impacts, and significantly contribute to our data strategy and culture.

Job Responsibility

  • Lead and Architect end-to-end data solutions
  • Drive Strategic Initiatives within small, co-located squads
  • Act as a Player/Coach
  • Design, Develop, and Optimize highly efficient and resilient data ingestion, processing, and transformation pipelines using advanced Python and PySpark techniques
  • Architect and Implement sophisticated data storage solutions leveraging a diverse set of big data technologies
  • Champion Data Modeling and Governance
  • Strategically Engage with data consumers, data scientists, and business stakeholders
  • Lead the Implementation of real-time data streaming and complex event-driven architectures
  • Enforce and Evolve Best Practices in data engineering and software development
  • Exhibit High Autonomy and Agency
  • Innovate with AI-Powered Development
  • Shape the Future of Our Data Stack
  • Expertly Troubleshoot and Resolve the most challenging technical issues

Requirements

  • 6+ years of progressive, hands-on experience as a Senior/Lead Data Engineer
  • Expert-level proficiency in Python
  • Deep expertise in developing highly optimized, scalable, and production-grade PySpark applications
  • Deep architectural understanding and extensive hands-on experience with the entire Apache Spark ecosystem (Spark Core, Spark SQL, Spark Streaming, Spark MLlib)
  • Advanced proficiency with Hive for enterprise data warehousing
  • Expert knowledge of distributed computing fundamentals, HDFS, and other components of the Hadoop ecosystem
  • Master-level proficiency in SQL, complex query optimization, and advanced data warehousing concepts
  • Extensive experience with various data storage formats (e.g., Parquet, ORC, Avro) and leading data lake solutions (e.g., Delta Lake, Iceberg)
  • Proven experience with enterprise-grade NoSQL databases (e.g., Cassandra, MongoDB, HBase)
  • Expert-level experience with Apache Kafka
  • Extensive experience with big data services on major cloud platforms (e.g., AWS EMR/Glue/Redshift/Kinesis, Azure Databricks/Data Factory/Synapse/Event Hubs, GCP Dataflow/Dataproc/BigQuery/Pub/Sub)
  • Demonstrated mastery and innovative application of AI coding tools (e.g., Claude Code, Codex, Antigravity)
  • Advanced understanding of software engineering principles, design patterns, data structures, algorithms, and performance engineering for distributed systems
  • Extensive experience with RESTful API design, development, and integration for data services
  • Strong expertise in containerization technologies (e.g., Docker, Kubernetes) and orchestration
  • Master-level proficiency with version control systems, especially Git
  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a relative experience is required
  • A Master's degree or Ph.D. is strongly preferred

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Lead Python Full Stack Data Engineer

8 matching positions

Python Full Stack Data Engineer - Assistant Vice President

We are assembling an A-team of highly skilled, autonomous, and AI-first engineer...
Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience: 4+ years of progressive, hands-on experience as a Data Engineer, with a proven track record of delivering complex, large-scale data solutions
  • Expert-level proficiency in Python, with deep expertise in developing highly optimized, scalable, and production-grade PySpark applications for mission-critical data processing
  • Deep understanding and extensive hands-on experience with the entire Apache Spark ecosystem (Spark Core, Spark SQL, Spark Streaming)
  • Advanced proficiency with Hive for enterprise data warehousing, including optimization techniques for large and complex queries
  • Expert knowledge of distributed computing fundamentals, HDFS, and other components of the Hadoop ecosystem
  • Proficiency in SQL, complex query optimization, and advanced data warehousing concepts (e.g., dimensional modeling, data vault, data lakes)
  • Extensive experience with various data storage formats (e.g., Parquet, ORC, Avro) and leading data lake solutions (e.g., Delta Lake, Iceberg)
  • Proven experience with enterprise-grade NoSQL databases (e.g., Cassandra, MongoDB, HBase) and understanding of their architectural trade-offs
  • Expert-level experience with Apache Kafka, including design and implementation of high-throughput, low-latency real-time data pipelines and event-driven architectures
  • Extensive experience with big data services on major cloud platforms (e.g., AWS EMR/Glue/Redshift/Kinesis, Azure Databricks/Data Factory/Synapse/Event Hubs, GCP Dataflow/Dataproc/BigQuery/Pub/Sub), including cloud-native architectural patterns
Job Responsibility
Job Responsibility
  • Operate end-to-end in the design, development, and implementation of full-stack data solutions, ensuring optimal performance, scalability, data quality, security, and compliance across the data lifecycle
  • Collaborate closely within small, co-located squads (4-7 person teams), fostering an environment of high communication and minimal coordination overhead, to deliver impactful data products
  • Develop, maintain, and optimize highly efficient and resilient data ingestion, processing, and transformation pipelines using advanced Python and PySpark techniques for large-scale datasets
  • Implement sophisticated data storage solutions leveraging a diverse set of big data technologies including Hive, distributed file systems (e.g., HDFS, S3), and enterprise-grade NoSQL databases (e.g., Cassandra, MongoDB)
  • Design and implement scalable data models and schemas that support advanced analytics, machine learning, and critical reporting needs, ensuring data integrity, accessibility, and discoverability
  • Engage effectively with data consumers, data scientists, and business stakeholders to deeply understand their requirements, translating them into robust data solutions and providing expert guidance on data utilization and interpretation
  • Implement real-time data streaming and complex event-driven architectures using technologies like Apache Kafka, ensuring low-latency data availability for critical business functions
  • Adhere to and contribute to best practices in data engineering and software development, participating in rigorous code reviews, implementing comprehensive automated testing strategies, and supporting robust CI/CD pipelines within a DevOps culture
  • Exhibit High Autonomy and Agency, taking ownership of technical challenges, making well-reasoned architectural decisions, and proactively identifying and implementing continuous improvements across the data landscape
  • Innovate with AI-Powered Development, actively leveraging, integrating, and contributing to AI coding tools (e.g., internal Citi AI tools, Copilot, Claude Code, Codex, Antigravity) to significantly enhance productivity, code quality, and development velocity, and inspiring others to do the same
  • Fulltime
Read More
Arrow Right

Lead Data Integration Specialist / Senior Full Stack Engineer

Lead Data Integration Specialist / Senior Full Stack Engineer – New York – Compe...
Location
Location
United States , New York
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of hands-on experience in developing production-ready software
  • Experience maintaining and working with data integrations / external API sources
  • Demonstrates skill in manoeuvring both front-end and backend technical projects
  • Brings to the table a collaborative mindset, having effectively led engineering teams
  • Demonstrates a remarkable ability to adapt swiftly to the evolving needs of our growing organization
  • Proficient in client-side technologies such as TypeScript, JavaScript (ES6/React), HTML/CSS
  • Server-side proficiency in Python (Django)
  • Holds practical experience in managing relational databases, with a strong command over PostgreSQL
Job Responsibility
Job Responsibility
  • Design and build a scalable platform that simplifies the creation/operation of hundreds of data partner integrations
  • Liaise with engineers, designers, and product managers to translate our product and technical vision into a concrete roadmap
  • Partner with third-party vendors & our clients to gather requirements and co-create solutions
  • Craft high-quality, thoroughly-tested code that meets the unique requirements of our clients
  • Provide technical mentorship and guidance to fellow engineers
What we offer
What we offer
  • Competitive Package
  • Unlimited PTO and flexible work policy
  • Fulltime
Read More
Arrow Right

Lead Data Integration Specialist / Senior Full Stack Engineer

This young and agile company, providing identity risk solutions, is currently se...
Location
Location
United States , New York
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of hands-on experience in developing production-ready software
  • Experience maintaining and working with data integrations / external API sources
  • Demonstrates skill in manoeuvring both front-end and backend technical projects, adept at prioritising tasks, defining requirements, and facilitating productive discussions within the team
  • Brings to the table a collaborative mindset, having effectively led engineering teams
  • Demonstrates a remarkable ability to adapt swiftly to the evolving needs of our growing organisation and dynamic product landscape
  • Proficient in client-side technologies such as TypeScript, JavaScript (ES6/React), HTML/CSS
  • Server-side proficiency in Python (Django)
  • Holds practical experience in managing relational databases, with a strong command over PostgreSQL
Job Responsibility
Job Responsibility
  • Design and build a scalable platform that simplifies the creation/operation of hundreds of data partner integrations
  • Liaise with engineers, designers, and product managers to translate our product and technical vision into a concrete roadmap
  • Partner with third-party vendors & our clients to gather requirements and co-create solutions
  • Craft high-quality, thoroughly-tested code that meets the unique requirements of our clients
  • Provide technical mentorship and guidance to fellow engineers
What we offer
What we offer
  • Competitive Salary
  • Competitive Package
  • Opportunity to work with an Ambitious, Young, Growing Organisation
  • Unlimited PTO
  • Flexible work policy
  • Fulltime
Read More
Arrow Right

Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)

Do you love building and pioneering in the technology space? Do you enjoy solvin...
Location
Location
United States , McLean, Virginia; New York, New York
Salary
Salary:
197300.00 - 245600.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)

Do you love building and pioneering in the technology space? Do you enjoy solvin...
Location
Location
United States , McLean, Virginia; Chicago, Illinois
Salary
Salary:
179400.00 - 225100.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using data movement tools and technologies
  • Work, as a lead developer, with a team of developers with deep experience in data movement, distributed computing, and full stack systems
  • Utilize programming languages like Python, SQL and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Snowflake, Databricks
  • Optimize information system for end-user and downstream application consumers by using sound data design practices
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Full Stack Engineer (Python and/or Java) – VP

Citi is seeking an accomplished and highly motivated Vice President (VP) level d...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong proficiency in backend languages such as Java, Python, or Kotlin
  • Extensive experience with microservices architecture and developing scalable, resilient services
  • Demonstrated experience deploying and managing applications within containerization platforms like Kubernetes and OpenShift
  • Experienced in Python-based frontend frameworks (e.g., Dash, Streamlit, or other relevant Python web frameworks) would be desirable
  • Deep understanding and practical application of DevOps principles, including CI/CD pipelines, automated testing, and trunk-based development
  • A strong commitment to fully automated testing and continuous integration
  • Prior experience with front office applications and an understanding of trading workflows, financial instruments, or market data will be a significant advantage
  • Bachelor’s degree or University degree in Computer Science, Engineering, or a related field, or equivalent practical experience in a similar role
Job Responsibility
Job Responsibility
  • Design & Develop: Iteratively develop robust, high-performance software solutions from initial concept through to production deployment, directly impacting trader efficiency and capabilities
  • Business Acumen & Product Ownership: Collaborate closely with business stakeholders, demonstrating a keen understanding of business drivers and a strong product owner mindset
  • Code Excellence: Produce clean, efficient, and well-documented code, adhering to best practices and contributing to a high-quality codebase
  • Engineering Leadership: Champion and share best engineering practices, foster a culture of continuous improvement, and mentor junior colleagues across the wider technology team
  • Innovation & Adaptation: Proactively evaluate and integrate new technologies, including AI tooling, to maintain a leading edge in our solutions
  • Full Lifecycle Ownership: Take ownership of the entire software development lifecycle, from design and development to testing, deployment, and monitoring in a DevOps-centric environment
What we offer
What we offer
  • 27 days annual leave (plus bank holidays)
  • A discretional annual performance related bonus
  • Private Medical Care & Life Insurance
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right

Lead Full Stack Engineer

We are seeking a talented Full Stack Engineer to build and maintain sophisticate...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
alterdomus.com Logo
Alter Domus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience building full stack web applications including frontend, backend, and database layers
  • Deep understanding of REST APIs with hands-on experience integrating complex third-party services
  • Strong SQL expertise, including query optimization, indexing strategies, and performance tuning
  • Ability to design and implement scalable database schemas (relational or NoSQL)
  • Experience implementing authentication, authorization, and access control mechanisms
  • Practical experience with React, Python, and PostgreSQL
  • Experience working with AWS services in a production environment
  • Solid understanding of secure document handling and best practices for managing sensitive data
  • Strong grasp of logging, monitoring, and error handling patterns for production-ready systems
  • Hands-on experience with Kubernetes and CI/CD pipelines (e.g., GitHub Actions)
Job Responsibility
Job Responsibility
  • Design, develop, and maintain full stack web applications across frontend, backend, and database layers
  • Build responsive, intuitive user interfaces using modern frontend frameworks
  • Develop robust backend services and APIs to support business workflows
  • Design and implement scalable database schemas for both relational and NoSQL databases
  • Ensure code quality, maintainability, and adherence to best practices
  • Design and implement REST APIs for internal and external consumption
  • Integrate complex third-party services and APIs into application workflows
  • Build and maintain integrations with AI/ML-based document extraction tools
  • Leverage AI APIs to enhance application capabilities and user experience
  • Develop automation workflows to streamline business processes
What we offer
What we offer
  • Support for professional accreditations
  • Flexible arrangements, generous holidays, plus an additional day off for your birthday
  • Continuous mentoring along your career progression
  • Active sports, events and social committees across our offices
  • 24/7 support available from our Employee Assistance Program
  • The opportunity to invest in our growth and success through our Employee Share Plan
  • Fulltime
Read More
Arrow Right

Lead Full Stack Engineer

We're looking for a Lead Full Stack Engineer who thrives at the intersection of ...
Location
Location
Salary
Salary:
Not provided
wingify.com Logo
Wingify
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6–10 years of experience in full-stack development roles with a product-focused mindset
  • Strong proficiency in two or more backend languages: PHP, Node.js, Golang, Python, Java
  • Expert in JavaScript/TypeScript with deep knowledge of modern frameworks—React or Angular preferred
  • Demonstrated experience integrating GenAI APIs (OpenAI, Langflow, custom GPT agents) in real-world applications
  • Strong understanding of software architecture, system design, and microservices
  • Solid DevOps exposure: Docker, Kubernetes, CI/CD pipelines (e.g., Jenkins)
  • Proficient in SQL and NoSQL databases
  • In-depth knowledge of browser internals, rendering optimization, and frontend performance strategies
  • Experience with TDD, code quality enforcement, and unit test coverage
Job Responsibility
Job Responsibility
  • Architect, design, and deliver scalable full-stack features and systems end-to-end—across backend services, APIs, and frontend interfaces
  • Build AI-integrated systems (e.g., NLP automation, GenAI assistants, recommendation engines) using LLMs and GenAI APIs in production environments
  • Mentor and lead a high-performance team of engineers, establishing best practices in architecture, testing, and DevOps
  • Own performance, maintainability, and scalability across your projects and ensure long-term code health
  • Collaborate cross-functionally with Product, Design, and Data teams to align on product direction and technical strategy
  • Stay hands-on with code, lead architectural decisions, and contribute to critical reviews and deployments
What we offer
What we offer
  • Build software that blends product and intelligence
  • Work in a culture where engineers shape product direction
  • Experiment with bleeding-edge AI and GenAI tech
  • Join a team that prioritizes impact, autonomy, and growth
  • Fulltime
Read More
Arrow Right