Lead Engineer (Python and AWS) Job at Collabera (Toronto)

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...

Location

United Arab Emirates , Dubai

Salary:

Not provided

NorthBay

Expiration Date

Until further notice

Requirements

8+ years of experience in data engineering and data platform development
Strong hands-on experience with: AWS Glue
Amazon EMR (Spark)
AWS Lambda
Apache Airflow (MWAA)
Amazon EC2
Amazon CloudWatch
Amazon Redshift
Amazon DynamoDB
AWS DataZone

Job Responsibility

Design, develop, and optimize scalable data pipelines using AWS native services
Lead the implementation of batch and near-real-time data processing solutions
Architect and manage data ingestion, transformation, and storage layers
Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
Orchestrate complex data workflows using Apache Airflow (MWAA)
Develop and manage serverless data processing using AWS Lambda
Design and optimize data warehouses using Amazon Redshift
Implement and manage NoSQL data models using Amazon DynamoDB
Utilize AWS DataZone for data governance, cataloging, and access management
Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch

Fulltime

Data Engineering Lead

Embark on an exciting journey into the realm of software product development wit...

Location

India

Salary:

Not provided

3Pillar Global

Expiration Date

Until further notice

Requirements

8+ years of experience in Data Engineering or related field, including 2+ years in a lead role
Expert-level proficiency with AWS data services (e.g., Glue, EMR, Lambda, Redshift, S3, Kinesis, Step Functions)
Strong Python skills for data processing, automation, and pipeline development
Experience building batch and streaming pipelines (Spark, PySpark, Kafka, Kinesis, etc.)
Strong SQL expertise and experience with relational and NoSQL databases
Hands-on experience with IaC (Terraform, CloudFormation, CDK)
Familiarity with DevOps tools for CI/CD (e.g., GitHub Actions, GitLab CI, Jenkins)
Understanding of data modeling, data warehousing concepts, and distributed systems

Fulltime

Lead Platform Engineer

It’s happening at Barclays. Be a part of a place where challenges are measured i...

Location

United States , New York

Salary:

220000.00 - 300000.00 USD / Year

Barclays

Expiration Date

Until further notice

Requirements

Strong Python engineering experience (backend, tooling, automation, debugging)
Hands-on expertise with AWS: IAM, S3, Lambda, ECS/EKS, Step Functions, CloudWatch
Proven experience working with Quants, Strats, or front‑office engineering teams
Solid understanding of AI/ML concepts (inference, vector search, embeddings, RAG, evaluation)
Strong debugging abilities across cloud infra, Python environments, containers, and pipelines
Excellent communication and stakeholder management skills in high-pressure FO environments
Experience leading a technical team or owning a global-facing engineering function

Job Responsibility

Build and lead the global FO engineering success function across New York, London, and APAC users
Build trusted relationships with Quants and Strats worldwide, understanding differing desk-specific needs
Prioritize and manage work intake globally based on business impact and urgency
Serve as the voice of FO users to influence platform roadmap and feature prioritization
Write high-quality Python code for automation, integrations, internal utilities, and FO tooling
Diagnose complex issues across cloud (AWS), distributed systems, Python stacks, notebooks, model pipelines, and APIs
Deliver engineering solutions that reduce recurring FO friction and accelerate delivery
Guide global front-office teams on secure and scalable usage of AWS services
Provide hands-on help with debugging, deployment, permissions, networking, and performance
Help global FO teams onboard onto platform AI features such as inference gateways, embeddings, evaluation tools, and tracing

What we offer

Competitive holiday allowance
Life assurance
Private medical care
Pension contribution

Fulltime

Lead Data Engineer

Location

Uzbekistan , Tashkent

Salary:

Not provided

Vention

Expiration Date

Until further notice

Requirements

4+ years in data engineering, including leading teams
Strong experience with Python and SQL
Solid knowledge of Apache Airflow, Kafka, Big Query, and AWS/Azure
Strong experience with ETL processes, data warehousing, and stream processing
Leadership skills with proven ability to mentor and grow engineering teams
Experience working in an Agile environment (Scrum, Kanban, etc.)
B2+ English, with experience communicating with English-speaking customers

Job Responsibility

Guide a team of data engineers in building and optimizing data pipelines
Oversee architecture for data ingestion, transformation, and storage with Big Query and SQL, ensuring high performance and reliability
Collaborate with product managers and clients to define data strategies and resolve complex technical challenges
Stay up-to-date with the latest cloud data technologies and industry best practices, bringing innovation to our data ecosystem

What we offer

EDU corporate community (300+ members): tech communities, interest clubs, events, a small R&D lab, a knowledge base, and a dedicated AI track
Licenses for AI tools: GitHub Copilot, Cursor, and others
Expanded medical support for employees in Tashkent
19 working days of vacation per year, 21 after two years in the company
Corporate getaway & teambuilding activities
Support for the significant events in your life
Referral bonuses for bringing in new talent

Fulltime

Lead Data Engineer

Embark on an exciting journey into the realm of software product development wit...

Location

India , Noida

Salary:

Not provided

3Pillar Global

Expiration Date

Until further notice

Requirements

Demonstrated expertise with a minimum of 8 years of relevant experience in data engineering with experience of leading and managing a technical support or data engineering team
Ability to function as a player-coach — leading while also contributing hands-on
Proficiency in Python for data engineering, ETL/ELT workflows, and automation tasks
Solid understanding of data governance, security, and performance optimization practices
Experience designing, creating and maintaining data pipelines in AWS environments, with strong exposure to AWS Data services like S3, Glue, Lambda, and Step Functions, and other related services
Data Architecture: Expert-level understanding of ETL, data warehouse design, and pipeline optimization
Database Expertise: Deep experience with Teradata, Change Data Capture (CDC) processes, and data synchronization
Integration: Experience with Lambda-based integrations, such as triggering SAS or RMJ events
Strong communication skills and ability to translate complex technical concepts for business stakeholders
Resilience: Ability to make critical, autonomous decisions and lead a team in a high-pressure environment

Job Responsibility

Team Management: Manage the on-site team of 3-4 Data Engineers
Roster & Scheduling: Create, manage, and maintain team rosters and schedules to ensure full 8-hour coverage, 7 days a week, including rotational weekend and holiday coverage
Availability: Must be able to work a day shift and manage a team that provides 7-day-a-week coverage, including weekends and holidays on rotation
Coverage Assurance: Handle all team leave requests (planned and unplanned). You are responsible for ensuring coverage is always maintained, especially during medical or other unexpected absences
Performance & SLAs: Act as the primary operational point of contact, ensuring the team executes all tasks efficiently, makes sound decisions, and adheres to all agreed-upon SLAs
Final Escalation Point: Serve as the final technical escalation point for the team
personally handle the most critical job failures and system issues
Expert RCA: Lead all high-priority Root Cause Analysis (RCA) efforts, documenting solutions and implementing permanent fixes to prevent recurrence
Strategic Improvement: Drive the team's efforts in performance tuning and AWS Glue cost optimization
Automation Strategy: Define and lead the development of new automation jobs (using Glue, Lambda, and Step Functions) to reduce manual support tasks

Fulltime

Lead Data Engineer

We are seeking an experienced Senior Data Engineer to lead the development of a ...

Location

India , Kochi; Trivandrum

Salary:

Not provided

Experion Technologies

Expiration Date

Until further notice

Requirements

5+ years experience in data engineering with analytical platform development focus
Proficiency in Python and/or PySpark
Strong SQL skills for ETL processes and large-scale data manipulation
Extensive AWS experience (Glue, Lambda, Step Functions, S3)
Familiarity with big data systems (AWS EMR, Apache Spark, Apache Iceberg)
Database experience with DynamoDB, Aurora, Postgres, or Redshift
Proven experience designing and implementing RESTful APIs
Hands-on CI/CD pipeline experience (preferably GitLab)
Agile development methodology experience
Strong problem-solving abilities and attention to detail

Job Responsibility

Architect, develop, and maintain end-to-end data ingestion framework for extracting, transforming, and loading data from diverse sources
Use AWS services (Glue, Lambda, EMR, ECS, EC2, Step Functions) to build scalable, resilient automated data pipelines
Develop and implement automated data quality checks, validation routines, and error-handling mechanisms
Establish comprehensive monitoring, logging, and alerting systems for data quality issues
Architect and develop secure, high-performance APIs for data services integration
Create thorough API documentation and establish standards for security, versioning, and performance
Work with business stakeholders, data scientists, and operations teams to understand requirements
Participate in sprint planning, code reviews, and agile ceremonies
Contribute to CI/CD pipeline development using GitLab

Lead Data Engineer

Join our dynamic team as a Lead Data Engineer to spearhead the development, opti...

Location

India , Hyderabad

Salary:

Not provided

Fission Labs

Expiration Date

Until further notice

Requirements

Bachelor’s or master’s degree in computer science, Engineering, or related field
Expert-level understanding of Salesforce object model
Comprehensive knowledge of Salesforce integration patterns
Deep understanding of Salesforce data architecture
Experience with Salesforce Bulk API jobs
Ability to handle complex data transformations and migrations
Knowledge of Salesforce metadata and custom object relationships
Advanced Python programming skills
Proven experience with AWS cloud services, specifically: AWS Glue, AWS Step Functions, AWS Lambda, AWS S3, AWS CloudWatch, Athena
Salesforce data model, Bulk jobs and architecture

Job Responsibility

Experience leading and driving large scale data migration projects
Experience in working with all the stakeholders to plan and coordinate the entire migration process
Proficiency in Python development
Experience building scalable, event-driven data migration solutions
Strong understanding of ETL (Extract, Transform, Load) processes
Familiarity with cloud-native architecture principles

What we offer

Opportunity to work on business challenges from top global clientele with high impact
Vast opportunities for self-development, including online university access and sponsored certifications
Sponsored Tech Talks, industry events & seminars to foster innovation and learning
Generous benefits package including health insurance, retirement benefits, flexible work hours, and more
Supportive work environment with forums to explore passions beyond work

Fulltime

Lead Backend Engineer

As a Lead Backend Engineer, you will play a crucial role in leading the developm...

Location

United States

Salary:

184000.00 - 229000.00 USD / Year

Corelight

Expiration Date

Until further notice

Requirements

Strong appreciation and support for our core values: low ego results, tireless service, and applied curiosity
7+ years of professional software development experience
Experience building REST APIs / GraphQL to support a rich data-heavy visual user interface
Experience using AWS Services (Lambda, AppSync, API Gateway) or equivalent
Experience with Python, Java and/or Go
Knowledge of Relational and NoSQL databases
Experience using Docker, Kubernetes, and containerized microservices
Experience adopting & using Agile development methodologies
Excellent communication skills. You thrive by collaborating with multiple teams and use your communication skills to influence product directions
Bachelor's degree in Computer Science or related fields, or equivalent experience

Job Responsibility

Lead the technical design discussions within the team and collaborate with other teams across the organization
Design, develop and operate scalable, elastic and secure microservices based on serverless architectures
Build REST APIs / GraphQL services to interface with large datasets and analytics using AWS technologies and services like AWS Lambda, API Gateway, DynamoDB, S3, and Cloudwatch
Work in an Agile development team to design and deliver service features end-to-end from design to production deployment and monitoring
Evangelize and drive adoption of software development best practices in code health, quality, test stability and maintainability
Work closely with offshore teams on various development projects

Fulltime

Lead Engineer (Python and AWS)

Collabera

Location:
Canada , Toronto

Category:
IT - Software Development

Contract Type:
Contract work

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
January 06, 2026

Expiration:
February 04, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Lead Engineer (Python and AWS)