Python Data Engineer Jobs

Senior Data Engineer – Data Engineering & AI Platforms

We are looking for a highly skilled Senior Data Engineer (L2) who can design, bu...

Location

India , Chennai, Madurai, Coimbatore

Salary:

Not provided

OptiSol Business Solutions

Expiration Date

Until further notice

Requirements

Strong hands-on expertise in cloud ecosystems (Azure / AWS / GCP)
Excellent Python programming skills with data engineering libraries and frameworks
Advanced SQL capabilities including window functions, CTEs, and performance tuning
Solid understanding of distributed processing using Spark/PySpark
Experience designing and implementing scalable ETL/ELT workflows
Good understanding of data modeling concepts (dimensional, star, snowflake)
Familiarity with GenAI/LLM-based integration for data workflows
Experience working with Git, CI/CD, and Agile delivery frameworks
Strong communication skills for interacting with clients, stakeholders, and internal teams

Job Responsibility

Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms
Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers
Work closely with solutioning and pre-sales teams for technical evaluations and client-facing discussions
Lead squads of L0/L1 engineers—ensuring delivery quality, mentoring, and guiding career growth
Develop cloud-native data engineering solutions using Python, SQL, PySpark, and modern data frameworks
Ensure data reliability, performance, and maintainability across the pipeline lifecycle—from development to deployment
Support long-term ODC/T&M projects by demonstrating expertise during technical discussions and interviews
Integrate emerging GenAI tools where applicable to enhance data enrichment, automation, and transformations

What we offer

Opportunity to work at the intersection of Data Engineering, Cloud, and Generative AI
Hands-on exposure to modern data stacks and emerging AI technologies
Collaboration with experts across Data, AI/ML, and cloud practices
Access to structured learning, certifications, and leadership mentoring
Competitive compensation with fast-track career growth and visibility

Fulltime

Big Data / Scala / Python Engineering Lead

The Applications Development Technology Lead Analyst is a senior level position ...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

At least two years (Over all 10+ hands on Data Engineering experience) of experience building and leading highly complex, technical data engineering teams
Lead data engineering team, from sourcing to closing
Drive strategic vision for the team and product
Experience managing an data focused product, ML platform
Hands on experience relevant experience in design, develop, and optimize scalable distributed data processing pipelines using Apache Spark and Scala
Experience managing, hiring and coaching software engineering teams
Experience with large-scale distributed web services and the processes around testing, monitoring, and SLAs to ensure high product quality
7 to 10+ years of hands-on experience in big data development, focusing on Apache Spark, Scala, and distributed systems
Proficiency in Functional Programming: High proficiency in Scala-based functional programming for developing robust and efficient data processing pipelines
Proficiency in Big Data Technologies: Strong experience with Apache Spark, Hadoop ecosystem tools such as Hive, HDFS, and YARN

Job Responsibility

Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary

Fulltime

Python Data Engineer

The FX Data Analytics & AI Technology team, within Citi's FX Technology organiza...

Location

India , Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

8 to 12 Years experience
Master’s degree or above (or equivalent education) in a quantitative discipline
Proven experience in software engineering and development, and a strong understanding of computer systems and how they operate
Excellent Python programming skills, including experience with relevant analytical and machine learning libraries (e.g., pandas, polars, numpy, sklearn, TensorFlow/Keras, PyTorch, etc.), in addition to visualization and API libraries (matplotlib, plotly, streamlit, Flask, etc)
Experience developing and implementing Gen AI applications from data in a financial context
Proficiency working with version control systems such as Git, and familiarity with Linux computing environments
Experience working with different database and messaging technologies such as SQL, KDB, MongoDB, Kafka, etc
Familiarity with data visualization and ideally development of analytical dashboards using Python and BI tools
Excellent communication skills, both written and verbal, with the ability to convey complex information clearly and concisely to technical and non-technical audiences
Ideally, some experience working with CI/CD pipelines and containerization technologies like Docker and Kubernetes

Job Responsibility

Design, develop and implement quantitative models to derive insights from large and complex FX datasets, with a focus on understanding market trends and client behavior, identifying revenue opportunities, and optimizing the FX business
Engineer data and analytics pipelines using modern, cloud-native technologies and CI/CD workflows, focusing on consolidation, automation, and scalability
Collaborate with stakeholders across sales and trading to understand data needs, translate them into impactful data-driven solutions, and deliver these in partnership with technology
Develop and integrate functionality to ensure adherence with best-practices in terms of data management, need-to-know (NTK), and data governance
Contribute to shaping and executing the overall data strategy for FX in collaboration with the existing team and senior stakeholders

Fulltime

Data Engineering Support Engineer / Manager

Wissen Technology is hiring a seasoned Data Engineering Support Engineer / Manag...

Location

India , Mumbai; Pune

Salary:

Not provided

Wissen

Expiration Date

Until further notice

Requirements

Bachelor of Technology or master's degree in computer science, Engineering, or related field
8-12 years of work experience
Python, SQL
Familiarity with data engineering
Experience with AWS data and analytics services or similar cloud vendor services
Strong problem solving and communication skills
Ability to organise and prioritise work effectively

Job Responsibility

Incident and user management for data and analytics platform
Development and maintenance of Data Quality framework (including anomaly detection)
Implementation of Python & SQL hotfixes and working with data engineers on more complex issues
Diagnostic tools implementation and automation of operational processes
Work closely with data scientists, data engineers, and platform engineers in a highly commercial environment
Support research analysts and traders with issue resolution

Fulltime

Software Engineer, Data Engineering

Join us in building the future of finance. Our mission is to democratize finance...

Location

Canada , Toronto

Salary:

124000.00 - 145000.00 CAD / Year

Robinhood

Expiration Date

Until further notice

Requirements

3+ years of professional experience building end-to-end data pipelines
Hands-on software engineering experience, with the ability to write production-level code in Python for user-facing applications, services, or systems (not just data scripting or automation)
Expert at building and maintaining large-scale data pipelines using open source frameworks (Spark, Flink, etc)
Strong SQL (Presto, Spark SQL, etc) skills
Experience solving problems across the data stack (Data Infrastructure, Analytics and Visualization platforms)
Expert collaborator with the ability to democratize data through actionable insights and solutions

Job Responsibility

Help define and build key datasets across all Robinhood product areas. Lead the evolution of these datasets as use cases grow
Build scalable data pipelines using Python, Spark and Airflow to move data from different applications into our data lake
Partner with upstream engineering teams to enhance data generation patterns
Partner with data consumers across Robinhood to understand consumption patterns and design intuitive data models
Ideate and contribute to shared data engineering tooling and standards
Define and promote data engineering best practices across the company

What we offer

bonus opportunities
equity
benefits

Fulltime

Senior Software Engineer, Data Engineering

Join us in building the future of finance. Our mission is to democratize finance...

Location

United States , Menlo Park

Salary:

146000.00 - 198000.00 USD / Year

Robinhood

Expiration Date

Until further notice

Requirements

5+ years of professional experience building end-to-end data pipelines
Hands-on software engineering experience, with the ability to write production-level code in Python for user-facing applications, services, or systems (not just data scripting or automation)
Expert at building and maintaining large-scale data pipelines using open source frameworks (Spark, Flink, etc)
Strong SQL (Presto, Spark SQL, etc) skills
Experience solving problems across the data stack (Data Infrastructure, Analytics and Visualization platforms)
Expert collaborator with the ability to democratize data through actionable insights and solutions

Job Responsibility

Help define and build key datasets across all Robinhood product areas. Lead the evolution of these datasets as use cases grow
Build scalable data pipelines using Python, Spark and Airflow to move data from different applications into our data lake
Partner with upstream engineering teams to enhance data generation patterns
Partner with data consumers across Robinhood to understand consumption patterns and design intuitive data models
Ideate and contribute to shared data engineering tooling and standards
Define and promote data engineering best practices across the company

What we offer

Market competitive and pay equity-focused compensation structure
100% paid health insurance for employees with 90% coverage for dependents
Annual lifestyle wallet for personal wellness, learning and development, and more
Lifetime maximum benefit for family forming and fertility benefits
Dedicated mental health support for employees and eligible dependents
Generous time away including company holidays, paid time off, sick time, parental leave, and more
Lively office environment with catered meals, fully stocked kitchens, and geo-specific commuter benefits
Bonus opportunities
Equity

Fulltime

Sr. Data Engineer I, Data Infrastructure

Khan Academy is partnering with SafeInsights to provide researchers access to st...

Location

United States , Mountain View

Salary:

137871.00 - 172339.00 USD / Year

Khan Academy

Expiration Date

Until further notice

Requirements

5+ years of experience in data engineering within a production environment
Experience with Google infrastructure services and data services particularly GCS & Big Query
Advanced knowledge of Python
Strong SQL skills
Demonstrated proficiency with Docker and Kubernetes
Experience with Airflow
Background in applied math, statistics, economics, or a related technical field
Motivated by the Khan Academy mission “to provide a free world-class education for anyone, anywhere"
Proven cross-cultural competency skills demonstrating self-awareness, awareness of other, and the ability to adopt inclusive perspectives, attitudes, and behaviors to drive inclusion and belonging throughout the organization.

Job Responsibility

Collaborate with our Data Insights Group to understand the desired end data product and the overall projects goals
Collaborate with our data architect and Data Infrastructure team to understand available data source and tooling
Propose tooling and processes that will work with extant Khan Academy systems to meet the projects goals
Build test and refine these tools and processes
Deliver the SafeInsights container and associated project deliverables
Provide documentation and training required to maintain and enhance the above

What we offer

Competitive salaries
Ample paid time off as needed
Remote-first culture
Generous parental leave
An exceptional team
The chance to put your talents towards a deeply meaningful mission
Opportunities to connect through affinity, ally, and social groups
401(k) + 4% matching
Comprehensive insurance, including medical, dental, vision, and life

Fulltime

Fixed Income Data Python Platform Engineer

Fixed Income Data Python Platform Engineer position at Citi, building and mainta...

Location

Canada , Mississauga

Salary:

94300.00 - 141500.00 USD / Year

Citi

Expiration Date

Until further notice

Requirements

5 years+ of hands-on experience in building an enterprise scale highly componentized application using Python incl. web frameworks like Django or Flask and data science tools - Pandas, Polars, Streamlit, Airflow
Experience with Docker and Kubernetes/Openshift
Experience with DevOps technologies - Ansible, Chef
Experience working in a Continuous Integration and Continuous Delivery environment and familiar with Jenkins, TeamCity, Code Quality Tools - SonarQube, etc.
Proficient in industry standard best practices such as Design Patters, Coding Standards, Coding modularity, Prototypes etc.
Unit testing frameworks - PyTest
Understanding of the SDLC lifecycle for Agile & Waterfall methodologies
Excellent written and oral communication skills
Bachelor's degree/University degree or equivalent experience

Job Responsibility

Analyzes system requirements, including identifying program interactions and appropriate interfaces between impacted components and sub systems
Participate in Sprint Planning, Tasking and Estimation of the assigned work for Python platform
Participate in component and service design for Python analytical services
Work on bug resolution and application improvements, such as performance and maintainability
May occasionally work a non-standard shift including nights and/or weekends and/or have on-call responsibilities
Stay abreast with new trends in open source tooling and champion tools that could help improve efficiency of the Fixed Income quant and data science community
Work closely with quants and data scientists to help them use platform capabilities and develop efficient analytical tools
Continuously look to automate manual touchpoints in the technology delivery pipeline

Fulltime

Python Data Engineer

Arthur Lawrence

Location:
United States, Houston

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Requirements:

Nice to have:

Additional Information:

Job Posted:
December 20, 2025

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Python Data Engineer

Senior Data Engineer – Data Engineering & AI Platforms