CrawlJobs Logo

Lead Python Full Stack Data Engineer

https://www.citi.com/ Logo

Citi

Location Icon

Location:
Canada , Mississauga

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

120800.00 - 170800.00 USD / Year

Job Description:

We are assembling an A-team of highly skilled, autonomous, and visionary engineers, and we are seeking an exceptional Lead Full Stack Data Engineer to join our high-performing, co-located squads in Canada. This senior role is for a hands-on player/coach who not only masters the full spectrum of data engineering but also demonstrates exemplary leadership, strategic thinking, and an unwavering commitment to leveraging AI for transformative productivity. The ideal candidate will take ownership of complex data products and platforms, driving the design, development, and optimization of end-to-end data solutions from ingestion to advanced consumption. We are looking for a true AI-first thinker who can architect scalable systems, mentor emerging talent, profoundly understand the functional domains our work impacts, and significantly contribute to our data strategy and culture.

Job Responsibility:

  • Lead and Architect end-to-end data solutions
  • Drive Strategic Initiatives within small, co-located squads
  • Act as a Player/Coach
  • Design, Develop, and Optimize highly efficient and resilient data ingestion, processing, and transformation pipelines using advanced Python and PySpark techniques
  • Architect and Implement sophisticated data storage solutions leveraging a diverse set of big data technologies
  • Champion Data Modeling and Governance
  • Strategically Engage with data consumers, data scientists, and business stakeholders
  • Lead the Implementation of real-time data streaming and complex event-driven architectures
  • Enforce and Evolve Best Practices in data engineering and software development
  • Exhibit High Autonomy and Agency
  • Innovate with AI-Powered Development
  • Shape the Future of Our Data Stack
  • Expertly Troubleshoot and Resolve the most challenging technical issues

Requirements:

  • 6+ years of progressive, hands-on experience as a Senior/Lead Data Engineer
  • Expert-level proficiency in Python
  • Deep expertise in developing highly optimized, scalable, and production-grade PySpark applications
  • Deep architectural understanding and extensive hands-on experience with the entire Apache Spark ecosystem (Spark Core, Spark SQL, Spark Streaming, Spark MLlib)
  • Advanced proficiency with Hive for enterprise data warehousing
  • Expert knowledge of distributed computing fundamentals, HDFS, and other components of the Hadoop ecosystem
  • Master-level proficiency in SQL, complex query optimization, and advanced data warehousing concepts
  • Extensive experience with various data storage formats (e.g., Parquet, ORC, Avro) and leading data lake solutions (e.g., Delta Lake, Iceberg)
  • Proven experience with enterprise-grade NoSQL databases (e.g., Cassandra, MongoDB, HBase)
  • Expert-level experience with Apache Kafka
  • Extensive experience with big data services on major cloud platforms (e.g., AWS EMR/Glue/Redshift/Kinesis, Azure Databricks/Data Factory/Synapse/Event Hubs, GCP Dataflow/Dataproc/BigQuery/Pub/Sub)
  • Demonstrated mastery and innovative application of AI coding tools (e.g., Claude Code, Codex, Antigravity)
  • Advanced understanding of software engineering principles, design patterns, data structures, algorithms, and performance engineering for distributed systems
  • Extensive experience with RESTful API design, development, and integration for data services
  • Strong expertise in containerization technologies (e.g., Docker, Kubernetes) and orchestration
  • Master-level proficiency with version control systems, especially Git
  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a relative experience is required
  • A Master's degree or Ph.D. is strongly preferred

Additional Information:

Job Posted:
May 16, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Lead Python Full Stack Data Engineer

Senior Software Engineer - Full Stack

As a Full Stack Engineer at Cyngn, you will play a crucial role in developing ou...
Location
Location
United States , Mountain View
Salary
Salary:
166500.00 - 198000.00 USD / Year
cyngn.com Logo
Cyngn
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional software development experience in full stack roles
  • Strong proficiency in backend development using Python, Go, Java, or similar languages
  • Solid experience with frontend development using React, Redux, and TypeScript
  • Familiarity with cloud platforms (AWS, Azure, or GCP) and microservices architectures
  • Experience with database design and management, both SQL and NoSQL
  • Knowledge of RESTful API design and implementation
  • Understanding of event-driven architectures and message queuing systems
  • Experience with containerization technologies such as Docker and Kubernetes
  • Familiarity with version control systems (e.g., Git) and CI/CD pipelines
  • Strong problem-solving skills and ability to debug complex issues across the full stack
Job Responsibility
Job Responsibility
  • Develop and maintain both backend and frontend components of our cloud-based fleet management system
  • Collaborate with Backend and Frontend Tech Leads to implement new features and improve existing functionality
  • Write clean, efficient, and maintainable code in languages such as Python, Go or Java for backend, and React, Redux and TypeScript for frontend
  • Contribute to the design and implementation of RESTful APIs and real-time data processing pipelines
  • Assist in developing and optimizing database schemas and queries for both SQL and NoSQL databases
  • Implement responsive and intuitive user interfaces
  • Contribute to the development of advanced mapping features and geospatial data processing
  • Participate in code reviews, providing constructive feedback to peers
  • Assist in troubleshooting and resolving production issues across the full stack
  • Implement and maintain unit tests, integration tests, and end-to-end tests
What we offer
What we offer
  • Health benefits (Medical, Dental, Vision, HSA and FSA (Health & Dependent Daycare), Employee Assistance Program, 1:1 Health Concierge)
  • Life, Short-term and long-term disability insurance (Cyngn funds 100% of premiums)
  • Company 401(k)
  • Commuter Benefits
  • Flexible vacation policy
  • Remote or hybrid work opportunities
  • Sabbatical leave opportunity after 5 years with the company
  • Paid Parental Leave
  • Daily lunches for in-office employees
  • Monthly meal and tech allowances for remote employees
  • Fulltime
Read More
Arrow Right

Lead Data Integration Specialist / Senior Full Stack Engineer

This young and agile company, providing identity risk solutions, is currently se...
Location
Location
United States , New York
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of hands-on experience in developing production-ready software
  • Experience maintaining and working with data integrations / external API sources
  • Demonstrates skill in manoeuvring both front-end and backend technical projects, adept at prioritising tasks, defining requirements, and facilitating productive discussions within the team
  • Brings to the table a collaborative mindset, having effectively led engineering teams
  • Demonstrates a remarkable ability to adapt swiftly to the evolving needs of our growing organisation and dynamic product landscape
  • Proficient in client-side technologies such as TypeScript, JavaScript (ES6/React), HTML/CSS
  • Server-side proficiency in Python (Django)
  • Holds practical experience in managing relational databases, with a strong command over PostgreSQL
Job Responsibility
Job Responsibility
  • Design and build a scalable platform that simplifies the creation/operation of hundreds of data partner integrations
  • Liaise with engineers, designers, and product managers to translate our product and technical vision into a concrete roadmap
  • Partner with third-party vendors & our clients to gather requirements and co-create solutions
  • Craft high-quality, thoroughly-tested code that meets the unique requirements of our clients
  • Provide technical mentorship and guidance to fellow engineers
What we offer
What we offer
  • Competitive Salary
  • Competitive Package
  • Opportunity to work with an Ambitious, Young, Growing Organisation
  • Unlimited PTO
  • Flexible work policy
  • Fulltime
Read More
Arrow Right

Technical Lead - Full-Stack AI Engineer - Private Equity SaaS

Our client, a cutting-edge SaaS platform for private equity and venture capital,...
Location
Location
United States , Chicago
Salary
Salary:
170000.00 - 200000.00 USD / Year
selbyjennings.com Logo
Selby Jennings
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years in full-stack development
  • Strong skills in Go, Python, Node.js, and modern frontend frameworks (React, Next.js.)
  • Hands-on with LLMs (OpenAI, Anthropic preferred) and vector search (Pinecone, pgvector.)
  • Experience deploying in cloud environments (AWS, Azure, GCP.)
  • Startup-ready: thrives in ambiguity and owns projects end-to-end while moving fast and not overthinking.
Job Responsibility
Job Responsibility
  • Build scalable full-stack applications integrating AI agents into a secure SaaS platform.
  • Develop and optimize LLM pipelines, prompts, and backend systems (Supabase, Postgres, vector DBs).
  • Architect APIs and microservices for data processing and retrieval.
  • Implement responsive, high-performance frontend interfaces for complex workflows.
  • Ensure compliance with SOC 2, GDPR, and SEC standards.
  • Collaborate with product and design teams to translate requirements into seamless user experiences.
What we offer
What we offer
  • equity
  • Fulltime
Read More
Arrow Right

Principal Full Stack Engineer

As a Principal Full Stack Engineer, you will be responsible for architecting, de...
Location
Location
United States , San Francisco
Salary
Salary:
170800.00 - 274300.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Business Applications Experience with Oracle Fusion Cloud, Zuora Revenue, Coupa, Anaplan, Avalara, and prior QTC architecture experience
  • Strong proficiency in modern programming languages (e.g., Java, Python) and frameworks (e.g., React, Node.js)
  • Exposure to integration platforms such as Workato and RPA platforms such as UIPath
  • Experience with AI technologies and machine learning frameworks, with a focus on integrating these into business applications
  • Familiarity with cloud environments such as AWS or GCP, and experience with deploying and managing applications in the cloud
  • Ability to tackle complex technical challenges and provide innovative solutions
  • Excellent communication skills to collaborate effectively with cross-functional and leadership teams both across Engineering and Finance organizations
Job Responsibility
Job Responsibility
  • Design and implement scalable and robust full-stack solutions that integrate with finance systems or business applications
  • Collaborate with data scientists and machine learning engineers to incorporate AI features into products, enhancing functionality and user experience
  • Lead technical design and architecture discussions, ensuring best practices are followed in software development and AI integration
  • Work closely with technical product managers (TPM), designers, and other engineers and business teams to deliver high-quality products that meet business needs
  • Drive innovation by exploring new technologies and methodologies to improve product offerings and development processes
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Lead Full Stack Java Developer

As part of OTC derivatives technology team, you will be working with a group of ...
Location
Location
United Kingdom , Belfast
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on professional software development experience
  • Proficiency in programming in Java, Python, JavaScript or Angular
  • Experience of building RESTful APIs using popular frameworks like Spring
  • Experience of working with event driven systems, microservices, micro-frontend UIs
  • Experience of following TDD and clean code principles
  • Proficiency with data structures, algorithms and SQL
  • Bachelor’s degree in computer science or engineering field involving software programming or systems engineering
Job Responsibility
Job Responsibility
  • Manage Applications Development team in an effort to accomplish established goals as well as conduct personnel duties for team
  • Lead resources and serve as a technical SME across the project through advanced knowledge of data structures, distributed systems, use of knowledge and experience to lead, architect, and drive broader adoption forward
  • Utilize in-depth knowledge and skills across multiple Applications Development areas to provide technical oversight across systems and applications
  • Review and analyze proposed technical solutions for projects
  • Contribute to formulation of strategies for applications development and other functional areas
  • Fulltime
Read More
Arrow Right

Senior Full Stack Software Engineer

As a Senior Full Stack Software Engineer, you will be responsible for architecti...
Location
Location
United States , San Francisco
Salary
Salary:
146300.00 - 235000.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Business Applications Experience with Oracle Fusion Cloud, Zuora Revenue, Coupa, Anaplan, Avalara, and prior QTC architecture experience
  • Strong proficiency in modern programming languages (e.g., Java, Python) and frameworks (e.g., React, Node.js)
  • Exposure to integration platforms such as Workato and RPA platforms such as UIPath
  • Experience with AI technologies and machine learning frameworks, with a focus on integrating these into business applications
  • Familiarity with cloud environments such as AWS or GCP, and experience with deploying and managing applications in the cloud
  • Ability to tackle complex technical challenges and provide innovative solutions
  • Excellent communication skills to collaborate effectively with cross-functional and leadership teams both across Engineering and Finance organizations
  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field
Job Responsibility
Job Responsibility
  • Design and implement scalable and robust full-stack solutions that integrate with finance systems or business applications
  • Collaborate with data scientists and machine learning engineers to incorporate AI features into products, enhancing functionality and user experience
  • Lead technical design and architecture discussions, ensuring best practices are followed in software development and AI integration
  • Work closely with technical product managers (TPM), designers, and other engineers and business teams to deliver high-quality products that meet business needs
  • Drive innovation by exploring new technologies and methodologies to improve product offerings and development processes
What we offer
What we offer
  • health coverage, paid volunteer days, wellness resources
  • Fulltime
Read More
Arrow Right

Senior Full Stack Developer

We are looking for a Senior Full Stack Engineer with strong backend expertise in...
Location
Location
Salary
Salary:
Not provided
wearecapicua.com Logo
Capicua Full Stack Creative Hub
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of software development experience (Python + JavaScript/React)
  • Strong backend experience with Async Python, SQL/PostgreSQL, NoSQL (MongoDB), REST APIs
  • Solid knowledge of AWS Serverless: Lambda, API Gateway, DynamoDB, S3, EventBridge, SNS/SQS, boto3
  • Experience with CI/CD (GitHub Actions), Docker, and monitoring (Datadog or similar)
  • Working knowledge of React, HTML/CSS, and modern frontend practices
  • Familiarity with design patterns, microservices, and serverless/event-driven architectures
  • Understanding of GraphQL and OpenSearch
Job Responsibility
Job Responsibility
  • Contributes to business requirement definition and use case design as a technical expert
  • Plans and executes “zero down-time” software deployments
  • Converts business requirements into architectural designs and detailed technical designs
  • Identifies tasks, effort, and dependencies based on software architecture and specifications
  • Drive optimal solution design, collaborating with product owners, architects, and cross-functional teams
  • Translates designs and specifications into software components and writes software code/components
  • Develops data layer and objects using object-oriented design skills
  • Defines test cases, leads code reviews, and generates and maintains relevant documentation
  • Develop and maintain continuous deployment architectures
  • Deployment of services and applications to AWS
  • Fulltime
Read More
Arrow Right

Full Stack Developer

Hoplite Solutions is seeking a Full Stack Developer to participate in developmen...
Location
Location
United States , Chantilly
Salary
Salary:
Not provided
hoplitesolutions.com Logo
Hoplite Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 4-7 years' experience with: Application layer programming languages (e.g., Java, C#, C++)
  • Database / Data Layer experience (e.g., SQL, unstructured data, MongoDB, Python, R, Elasticsearch, data management and analytics tools)
  • Front end development skills (e.g., modern JavaScript frameworks like React.js, HTML, CSS, bootstrap, etc.)
  • Experience developing, deploying, and maintaining systems on cloud platforms (e.g., AWS, Azure)
  • Experience in Agile / Scrum
Job Responsibility
Job Responsibility
  • Work with the Chief Engineer and Technical Leads to translate requirements into user stories to incorporate new functionality into various software applications
  • Develop and/or integrate with Infrastructure as Code DevOps tools to support cloud orchestration of software components
  • Leverage AWS best practices to optimize code for cloud deployment with cost-conscious development and deployment strategies
  • Experience developing front end user interfaces using modern JavaScript frameworks like React.js, HTML, CSS, etc.
  • Experience developing web APIs to interface with cloud applications and databases as part of cloud native software applications
  • Experience working as part of an agile team to deliver software iteratively
What we offer
What we offer
  • Full coverage for health, dental, and vision insurance for both individuals and families
  • 100% coverage for life insurance, long-term and short-term disability
  • Match up to 7% of employees' contributions to their 401(k) funds
  • Follow the federal holiday calendar for paid holidays
  • 4 weeks of paid time off
  • $5,000 yearly for education assistance or technical training
  • $3,000 yearly toward student loan repayment or a 529 College Savings Plan
  • Fulltime
Read More
Arrow Right