CrawlJobs Logo
Capital One Logo Capital One · IT - Software Development

Senior Lead Data Engineer

United States, McLean 209000.00 - 286200.00 USD / Year · Job Posted January 10, 2026
Apply Position
Job Link Share

Job Description

Senior Lead Data Engineer (Snowflake, Databricks, Apache Iceberg, Spark + SQL workload optimizations). Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One.

Job Responsibility

  • Collaborate with and across Agile teams to design/architect, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Lead workload optimization and develop/architect capabilities to drive optimizations at scale (e.g. SQL, Spark optimizations)
  • Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift, Snowflake and Databricks
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Requirements

  • Bachelor’s Degree
  • At least 6 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Nice to have

  • Master's Degree
  • 4+ years of data warehousing experience (Snowflake, Databricks, Redshift)
  • 9+ years of experience in application development including Python, SQL, Scala, or Java
  • 2+ years of experience engineering/leveraging Machine Learning & Gen AI capabilities and tools (Iceberg, Delta adoption, Cortext)
  • 5+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
  • 4+ years of experience with AWS cloud services or other public cloud platforms (Microsoft Azure, Google Cloud)
  • 4+ year experience working on large-scale Data Platforms
  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
  • 4+ years of experience with UNIX/Linux including basic commands and shell scripting

What we offer

  • comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
  • performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
Capital One - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Lead Data Engineer

8 matching positions

Senior Lead Data Engineer

Senior Lead Data Engineer (Bank Tech). Do you love building and pioneering in th...
Location
Location
United States , McLean; Wilmington; Richmond
Salary
Salary:
209000.00 - 262400.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree
  • At least 6 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
  • performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Fulltime
Read More
Arrow Right

Senior Lead Data Engineer

Senior Lead Data Engineer. Do you love building and pioneering in the technology...
Location
Location
United States , McLean; Plano; Chicago; Richmond
Salary
Salary:
209000.00 - 262400.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree
  • At least 6 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
  • performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Fulltime
Read More
Arrow Right

Senior Data Engineer Lead / Architect - Senior Vice President

At Citi Services - Global Trade Technology Organization, we are on a mission to ...
Location
Location
India , Pune, Maharashtra, India, Chennai, Tamil Nadu, India
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of professional experience in data engineering, with a proven track record of designing and building large-scale data systems
  • 3+ years in a technical leadership or architect role, with experience mentoring junior and senior engineers
  • Expert-level proficiency in at least one programming language (Python or Scala preferred) and exceptional SQL skills
  • Proven hands-on experience with Python or Scala for data manipulation, scripting, machine learning, and backend development
  • Deep, hands-on experience with a major cloud platform (AWS, GCP, or Azure) and its data ecosystem (e.g., S3/GCS, Redshift/BigQuery, EMR/Dataproc, Kinesis/Dataflow)
  • Extensive hands-on experience with modern big data technologies and Data streaming (like Hadoop, Hive, Impala, Apache Spark, Kafka, or Flink)
  • Proficiency with workflow orchestration tools such as Airflow, Dagster, or Prefect
  • Proficiency in designing and implementing microservices architectures, RESTful APIs, and event-driven systems with 'Data as a Product' Principle
  • Solid understanding of data modeling concepts and database design for both analytical (OLAP) and transactional (OLTP) workloads
  • Deep understanding and hands-on experience with relational databases (e.g., PostgreSQL, Oracle), NoSQL databases (e.g., MongoDB, Cassandra), data warehousing, and big data technologies (e.g., Spark, Kafka)
Job Responsibility
Job Responsibility
  • Architect & Design: Design, architect, and oversee the development of robust, scalable, and reliable data infrastructure, including data lakes, data warehouses, and real-time streaming platforms on the cloud
  • Build & Code: Act as a senior individual contributor and hands-on technical leader. Write clean, maintainable, and high-performance code for data ingestion, transformation, and serving layers (e.g., using Python, Scala, SQL, and Spark)
  • Lead & Mentor: Lead a team of data engineers, providing technical guidance, mentorship, and career development support. Foster a collaborative and inclusive team environment
  • Champion Culture: Define, document, and champion data engineering best practices across the organization, including CI/CD, data quality, testing frameworks, observability, and code review standards
  • Drive Strategy: Partner with leadership, product managers, data scientists, and analysts to understand data needs and develop a long-term data strategy and roadmap
  • Innovate & Evaluate: Stay at the forefront of data engineering technologies. Evaluate, prototype, and recommend new tools and frameworks to continuously improve our data platform
  • Ensure Governance: Implement and enforce robust data governance, security, and privacy policies in partnership with our security and compliance teams
  • Fulltime
Read More
Arrow Right

Senior Lead Data Engineer (Enterprise Platform Technology) (Java, Python, Scala, AWS)

Do you love building and pioneering in the technology space? Do you enjoy solvin...
Location
Location
United States , McLean; New York
Salary
Salary:
229900.00 - 286200.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree
  • At least 6 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Senior Lead Data Engineer (Bank Tech)

Senior Lead Data Engineer (Bank Tech) - Do you love building and pioneering in t...
Location
Location
United States , Wilmington
Salary
Salary:
Not provided
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree
  • At least 6 years of experience in application development
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Python and Java and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Lead / Senior Data Engineer

We are seeking a Lead / Senior Data Engineer to design, build, and optimize our ...
Location
Location
Malaysia , Kuala Lumpur
Salary
Salary:
10000.00 - 15000.00 RM / Month
https://www.randstad.com Logo
Randstad
Expiration Date
August 01, 2026
Flip Icon
Requirements
Requirements
  • Minimum 4+ years in Data Engineering, Big Data, or Data Architecture
  • Degree in Computer Science, Software Engineering, or a related quantitative field
  • Mastery of Python (including advanced Pandas and NumPy for data manipulation) and expert-level SQL
  • Strong familiarity with preparing data for statistical modeling and predictive frameworks (e.g., XGBoost, Regression, Decision Trees)
  • Experience with modern data stack tools (e.g., Spark, Airflow, dbt) and cloud data platforms (AWS, GCP, or Azure)
Job Responsibility
Job Responsibility
  • Build and orchestrate automated ETL/ELT pipelines for batch and real-time streaming data
  • Design and maintain scalable data lake and data warehouse structures
  • Partner with Data Scientists to optimize data pipelines, feature stores, and datasets required for statistical modeling
  • Tune and optimize complex SQL queries and data workflows for large-scale datasets
  • Establish technical best practices, ensure data quality, and mentor junior engineers
What we offer
What we offer
  • Flexible Hybrid Arrangement: Balance of remote work autonomy and in-office collaboration
  • Professional Growth: Lead high-impact architectural decisions alongside a talented AI and analytics team
  • Competitive Compensation: Monthly salary up to RM 15,000, commensurate with experience and technical assessment
  • Fulltime
Read More
Arrow Right

Lead / Senior Data Engineer

We are seeking a Lead / Senior Data Engineer to design, build, and optimize our ...
Location
Location
Malaysia , Kuala Lumpur
Salary
Salary:
8000.00 - 15000.00 MYR / Month
https://www.randstad.com Logo
Randstad
Expiration Date
July 17, 2026
Flip Icon
Requirements
Requirements
  • Minimum 4+ years in Data Engineering, Big Data, or Data Architecture
  • Degree in Computer Science, Software Engineering, or a related quantitative field
  • Mastery of Python (including advanced Pandas and NumPy for data manipulation) and expert-level SQL
  • Strong familiarity with preparing data for statistical modeling and predictive frameworks (e.g., XGBoost, Regression, Decision Trees)
  • Experience with modern data stack tools (e.g., Spark, Airflow, dbt) and cloud data platforms (AWS, GCP, or Azure)
Job Responsibility
Job Responsibility
  • Build and orchestrate automated ETL/ELT pipelines for batch and real-time streaming data
  • Design and maintain scalable data lake and data warehouse structures
  • Partner with Data Scientists to optimize data pipelines, feature stores, and datasets required for statistical modeling
  • Tune and optimize complex SQL queries and data workflows for large-scale datasets
  • Establish technical best practices, ensure data quality, and mentor junior engineers
What we offer
What we offer
  • Flexible Hybrid Arrangement
  • Professional Growth
  • Competitive Compensation
  • Fulltime
Read More
Arrow Right

Senior Lead Software Engineer – Regulatory Reporting & Big Data

Job Overview: The Applications Development Technology Lead Analyst is a senior l...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8–10 years of hands-on software development experience, with a strong focus on backend engineering and enterprise-scale systems
  • Deep expertise in Java and Spring Boot, with advanced knowledge of SQL and real-time messaging technologies
  • Demonstrated ability to design software architecture and conduct meaningful trade-off analysis across complex technical landscapes
  • Practical experience building and delivering microservices-based architectures in production environments
  • Proficiency with a modern JavaScript framework such as Angular, with the ability to contribute across the full stack where needed
  • Proven leadership and people management skills, with experience guiding engineering teams and allocating work effectively
  • Clear and confident communicator, able to translate complex technical concepts for both engineering and non-technical audiences
  • Bachelor’s degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Architect and lead the development of scalable, high-performance applications within Citi's Insight regulatory reporting framework, ensuring alignment with enterprise architecture standards
  • Design and implement solutions across a modern stack including Java, Spring Boot, SQL, and real-time messaging systems to support large-scale data processing needs
  • Build and optimize data pipelines and analytical workflows using Big Data technologies, contributing to robust and reliable regulatory reporting outcomes
  • Define and enforce engineering standards for coding, testing, debugging, and deployment across the team, raising the bar for software quality and delivery consistency
  • Collaborate with cross-functional teams — including architecture, infrastructure, and business stakeholders — to identify system enhancements and deliver new product capabilities
  • Evaluate complex business and system processes to resolve high-impact technical challenges, developing innovative and pragmatic engineering solutions
  • Mentor and coach mid-level engineers and analysts, providing technical direction and supporting their professional growth
  • Embed risk awareness into engineering decisions, ensuring solutions meet compliance requirements and uphold Citi's standards for data integrity and regulatory adherence
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
What we offer
What we offer
  • Hybrid working model — 3 days in the office and 2 days working remotely
  • Hands-on exposure to Big Data technologies including Spark, Hive, Impala, and HDFS within a large-scale production environment
  • Access to Citi's AI tools and emerging technologies
  • Senior-level ownership and influence over architectural decisions
  • Opportunities to mentor and develop engineering talent
  • A collaborative, global engineering community with access to learning and development resources
  • Competitive compensation and a comprehensive benefits package, including financial wellbeing and family support programs
  • Fulltime
Read More
Arrow Right