Data Engineer - Python, SQL Job at Citi (Pune)

Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)

Do you love building and pioneering in the technology space? Do you enjoy solvin...

Location

United States , McLean, Virginia; Chicago, Illinois

Salary:

179400.00 - 225100.00 USD / Year

Capital One

Expiration Date

Until further notice

Requirements

Bachelor’s Degree
At least 4 years of experience in application development (Internship experience does not apply)
At least 2 years of experience in big data technologies
At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Job Responsibility

Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using data movement tools and technologies
Work, as a lead developer, with a team of developers with deep experience in data movement, distributed computing, and full stack systems
Utilize programming languages like Python, SQL and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Snowflake, Databricks
Optimize information system for end-user and downstream application consumers by using sound data design practices
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

What we offer

Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
Comprehensive, competitive, and inclusive set of health, financial and other benefits

Fulltime

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...

Location

United Arab Emirates , Dubai

Salary:

Not provided

NorthBay

Expiration Date

Until further notice

Requirements

8+ years of experience in data engineering and data platform development
Strong hands-on experience with: AWS Glue
Amazon EMR (Spark)
AWS Lambda
Apache Airflow (MWAA)
Amazon EC2
Amazon CloudWatch
Amazon Redshift
Amazon DynamoDB
AWS DataZone

Job Responsibility

Design, develop, and optimize scalable data pipelines using AWS native services
Lead the implementation of batch and near-real-time data processing solutions
Architect and manage data ingestion, transformation, and storage layers
Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
Orchestrate complex data workflows using Apache Airflow (MWAA)
Develop and manage serverless data processing using AWS Lambda
Design and optimize data warehouses using Amazon Redshift
Implement and manage NoSQL data models using Amazon DynamoDB
Utilize AWS DataZone for data governance, cataloging, and access management
Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch

Fulltime

Senior Generalist (Python, Data) Engineer - Healthcare AI Platform

We are looking for a senior hands-on engineer to own and maintain a sophisticate...

Location

United States

Salary:

Not provided

Provectus

Expiration Date

Until further notice

Requirements

6+ years of hands-on engineering experience with production systems
Generalist mindset, comfortable across backend development, data pipelines, and cloud infrastructure
Strong production Python skills and solid software engineering fundamentals
Hands-on experience with AWS (S3, Lambda, ECS, SQS, Bedrock, RDS or similar)
Experience with analytical data pipelines (SQL, Spark) and data processing at scale
Experience with Infrastructure as Code (Terraform, CDK, or CloudFormation)
Experience with AI-assisted development workflows (Claude Code or alternatives), not just autocomplete
Experience maintaining and scaling systems in production, not just building POCs
Autonomous working style, you don't need a project manager to tell you what to do next
US-based, required due to project compliance and data security constraints

Job Responsibility

Maintain, improve, and extend an AI platform already running in production
Handle a mix of backend development, data engineering, DevOps, and infrastructure work
Translate business and product requirements into technical decisions independently
Work directly with internal stakeholders and consumer teams
Establish and maintain engineering best practices for the platform
Identify and resolve technical issues as the first line of defense

What we offer

Full ownership of a production AI platform
Remote-first, fully flexible work environment
Annual performance bonus
Health, dental, vision, 401(k) with company match, unlimited PTO
Long-term engagement
this role extends beyond the initial project

Sr. Data Engineer - Python Developer

Seeking a hands-on Senior Data Engineer (ETL / Python Developer) to support the ...

Location

United States , Springfield

Salary:

52.00 - 54.00 USD / Hour

Myticas Consulting

Expiration Date

Until further notice

Requirements

5+ years of data engineering experience with a focus on enterprise data warehousing
5+ years of hands-on ETL development using Informatica PowerCenter, Azure Data Factory, or similar tools
5+ years of Python development for data engineering and automation
3+ years of experience with Spark-based processing frameworks (Databricks or equivalent)
Strong SQL expertise and experience with relational databases (such as Teradata, Snowflake, Oracle, SQL Server)
Experience with source control and DevOps practices (Azure DevOps, GitHub, CI/CD)
Bachelor's degree or higher in Computer Science, Engineering, Analytics, or a related field
Strong analytical, problem-solving, and troubleshooting skills

Job Responsibility

Design, develop, and maintain enterprise ETL pipelines using Azure Data Factory (ADF), Informatica PowerCenter, and Python-based frameworks
Build and optimize scalable data processing solutions using Python, Spark, and Databricks
Support Medicaid analytics and federal reporting initiatives (e.g., T-MSIS, PERM, MARS, Quality of Care)
Develop robust data validation, reconciliation, and audit-traceable data pipelines
Write and optimize SQL and stored procedures across relational platforms such as Snowflake, Oracle, and SQL Server
Participate in cloud migration and modernization initiatives within Azure-based architectures
Collaborate with analysts, QA, and reporting teams to ensure data quality, accuracy, and timeliness
Follow data engineering best practices for performance, reliability, reusability, and security
Support production operations, incident resolution, and root-cause analysis
Participate in code reviews, source control, and CI/CD processes using Azure DevOps and GitHub

Fulltime

Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg

The Data Engineer role at NTT DATA requires a Bachelor’s or Master’s degree in C...

Location

India , Bangalore

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

Bachelor’s or Master’s degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
5–7 years of professional hands-on coding experience in collaborative, team-based environments
strong troubleshooting skills in SQL and scripting
proficiency in Python or Java
deep familiarity with SDLC, CI/CD best practices, and Kubernetes deployment
expertise in temporal data modeling (e.g., SCD Type 2)
schema management with a focus on schema evolution (Iceberg Apache)
performance optimization through data partitioning and clustering
architectural theory involving normalization/denormalization and natural vs. surrogate keys
experience with Python

Job Responsibility

Designing and implementing data solutions
optimizing performance
collaborating within a team

Fulltime

Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg

The Data Engineer will play a crucial role in migrating data from on-prem DataLa...

Location

India , Bangalore

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

Bachelor's or Master's degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
Minimum of 3-5 years of professional hands-on-keyboard coding experience in a collaborative, team-based environment
Ability to troubleshoot SQL and basic scripting experience
Professional proficiency in Python or Java
Deep familiarity with the full Software Development Life Cycle (SDLC) and CI/CD best practices
K8s deployment experience
Sophisticated understanding of Temporal Data Modeling, Schema Management, Performance Optimization, and Architectural Theory
Experience with Kafka, ANSI SQL, FTP, Apache Spark
Experience with JSON, Avro, Parquet
Experience with Hadoop (HDFS/Hive), Snowflake, Apache Iceberg, Sybase IQ

Job Responsibility

Perform end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse
Pipeline Migration - Refactoring and migrating extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment
Data Transfer - Executing the physical migration of underlying datasets while ensuring data integrity
Stakeholder Engagement - Acting as a technical liaison to internal clients, facilitating handoff and sign-off conversations with data owners to ensure migrated assets meet business requirements
Consumption Pattern Migration - Translating and optimizing legacy SQL and Spark-based consumption patterns for compatibility with Snowflake and Iceberg
Usage analysis to understand usage patterns and deliver required data products
Data Reconciliation and Quality - Work with reconciliation frameworks to build confidence that migrated data is functionally equivalent to that already used within production flows

Fulltime