CrawlJobs Logo

Lead Data Engineer (Intelligent Foundations and Experiences)

United States, McLean, Virginia Employment contract 197300.00 - 225100.00 USD / Year · Job Posted June 04, 2026
Apply Position
Job Link Share

Job Description

Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One.

Job Responsibility

  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in Big Data development tools and technologies
  • Work with a team of developers with deep experience in machine learning, distributed microservices, and ETL systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Requirements

  • Bachelor’s Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Nice to have

  • 7+ years of experience in application development including Python, SQL, Scala, or Java
  • 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
  • 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
  • 4+ year experience working on real-time data and streaming applications
  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
  • 4+ years of data warehousing experience (Redshift or Snowflake)
  • 4+ years of experience with UNIX/Linux including basic commands and shell scripting
  • 2+ years of experience with Agile engineering practices
  • Experience leveraging interactive AI tooling to accelerate productivity, utilizing capabilities beyond basic code completion

What we offer

  • Performance based incentive compensation
  • Cash bonus(es)
  • Long term incentives (LTI)
  • Health, financial and other benefits

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Lead Data Engineer (Intelligent Foundations and Experiences)

8 matching positions

Lead Analytics Engineer

As a Lead Analytics Engineer, you'll join a large impactful team of data & analy...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of experience in analytics engineering, business intelligence, or data engineering, with a strong focus on data modeling and transformation
  • Solid hands-on experience using SQL and Python, with a track record of building & maintaining production-level data models
  • Strong experience with a modern cloud data warehouse like Databricks, Google BigQuery, Snowflake, or Amazon Redshift
  • Lead architectural and technical decisions for secure, performant, and scalable data products
  • Deep expertise with a modern data transformation tool like dbt (data build tool)
  • Proven experience in data warehouse design and development, using dimensional modeling and other techniques for business intelligence
  • Experienced in AWS Cloud usage and data management (automation, data governance, cost optimisation, delivering reliable & scalable data solutions)
  • Ensure data quality, schema governance and monitoring across pipelines
  • Experience with orchestrators such as Airflow, Kubeflow & Databricks workflows
  • Drive the creation of reusable data products across multiple parts of the organisation
Job Responsibility
Job Responsibility
  • Lead our analytics engineering function, acting as the bridge between our core data pipelines and the business intelligence needs of our stakeholders
  • Building and scaling our data models
  • Mentoring the team, setting best practices, and driving the technical roadmap
  • Delivering high-quality, well-documented solutions that directly serve our internal customers
  • Lead by example, elevate engineering practices, and drive technical excellence across domains
What we offer
What we offer
  • An attractive Base Salary
  • Participation in our Short Term Incentive plan (annual bonus)
  • Work From Anywhere: Enjoy up to 20 days a year of working from anywhere
  • A 24/7 Employee Assistance Program for you and your family
  • A collaborative environment with an opportunity to explore your potential and grow
  • Fulltime
Read More
Arrow Right

Lead Analytics Engineer

As a Lead Analytics Engineer, you'll join a large impactful team of data & analy...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of experience in analytics engineering, business intelligence, or data engineering, with a strong focus on data modeling and transformation
  • Solid hands-on experience using SQL and Python, with a track record of building & maintaining production-level data models
  • Strong experience with a modern cloud data warehouse like Databricks, Google BigQuery, Snowflake, or Amazon Redshift
  • Lead architectural and technical decisions for secure, performant, and scalable data products
  • Deep expertise with a modern data transformation tool like dbt (data build tool)
  • Proven experience in data warehouse design and development, using dimensional modeling and other techniques for business intelligence
  • Experienced in AWS Cloud usage and data management (automation, data governance, cost optimisation, delivering reliable & scalable data solutions)
  • Ensure data quality, schema governance and monitoring across pipelines
  • Experience with orchestrators such as Airflow, Kubeflow & Databricks workflows
  • Drive the creation of reusable data products across multiple parts of the organisation
Job Responsibility
Job Responsibility
  • Lead our analytics engineering function, acting as the bridge between our core data pipelines and the business intelligence needs of our stakeholders
  • Building and scaling our data models
  • Mentoring the team, setting best practices, and driving the technical roadmap
  • Delivering high-quality, well-documented solutions that directly serve our internal customers
  • Elevate engineering practices, and drive technical excellence across domains
What we offer
What we offer
  • An attractive Base Salary
  • Participation in our Short Term Incentive plan (annual bonus)
  • Work From Anywhere: Enjoy up to 20 days a year of working from anywhere
  • A 24/7 Employee Assistance Program for you and your family
  • A collaborative environment with an opportunity to explore your potential and grow
  • Fulltime
Read More
Arrow Right

Principal Software Engineering Manager - Business Enablement

Xbox's Creator Onboarding, Release, and Support (CORS) organization is on a miss...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 4+ years people management experience
  • Experience with CRM platforms (e.g., Dynamics 365), data engineering pipelines, or business process automation
  • Experience leading distributed and geographically diverse engineering teams, including vendor partner management
  • Familiarity with cloud-scale service operations, incident management, and SRE practices
  • Track record of building inclusive teams and fostering psychological safety in engineering organizations
  • Experience with security compliance frameworks and secure-by-design engineering practices
Job Responsibility
Job Responsibility
  • Lead, coach, and grow a diverse engineering organization spanning software engineering, CRM/Dynamics 365, data engineering, and site reliability across multiple geographies and vendor partnerships fostering a culture of belonging, continuous learning, and high performance
  • Own the technical vision and engineering roadmap for Xbox's core business systems including partner onboarding, developer identity, CRM, contract automation, and data platforms ensuring alignment with CORS's strategic priorities and long-term organizational goals
  • Drive production reliability and security excellence across a broad service portfolio, championing Secure Future Initiative (SFI) compliance, incident readiness, and operational rigor as foundational engineering practices
  • Lead AI-driven modernization of business processes, replacing manual workflows with scalable, intelligent automation that accelerates the creator journey and unlocks new partner capabilities
  • Collaborate across CORS and Xbox Business teams with Product Management, Business Development, and peer engineering teams to align on priorities, resolve cross-team dependencies, and deliver cohesive end-to-end creator experiences
  • Fulltime
Read More
Arrow Right

Principal Software Consultant - AI/ML Engineer

As an ML Team Lead, you will be responsible for leading the technical direction ...
Location
Location
Pakistan , Lahore, Karachi, Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in computer science, Artificial Intelligence, Data Science, Software Engineering, or a related field
  • 7+ years of professional software engineering experience with at least 5 years of hands-on experience building and deploying ML systems into production
  • Prior experience as a Tech Lead, Staff Engineer, or hands-on lead for AI/ML engineering teams
  • Strong expertise in classical machine learning domains such as forecasting, ranking, classification, and optimization
  • Hands-on experience building modern LLM and agentic AI systems including RAG pipelines, tool-using agents, multi-step workflows, and evaluation systems
  • Strong proficiency in Python and backend system development
  • Experience with ML frameworks such as PyTorch or TensorFlow
  • Strong understanding of scalable distributed systems, APIs, system integration, architecture design, and production engineering practices
  • Experience operating ML services at scale, including SLO management, monitoring, on-call practices, and incident response
  • Experience working with Kubernetes-based deployments, CI/CD pipelines, and modern cloud-native engineering practices
Job Responsibility
Job Responsibility
  • Lead the technical direction for the team’s ML and LLM systems, including architecture patterns, platform choices, evaluation frameworks, and engineering standards
  • Stay hands-on by designing and implementing complex ML and agentic AI systems, writing production-grade code, and leading through technical execution
  • Design, develop, and deploy scalable ML and LLM-powered applications and services in production environments
  • Build and optimize AI-powered solutions such as RAG systems, multi-step agents, AI assistants, chatbots, forecasting systems, ranking models, classification models, and optimization systems
  • Drive architecture and design reviews to ensure scalability, reliability, security, and maintainability of AI/ML systems
  • Own the technical roadmap for ML/LLM initiatives and translate business objectives into execution plans and scalable solutions
  • Collaborate closely with Product Managers, Engineers, Data Engineers, MLOps Engineers, QA Engineers, and cross-functional stakeholders to deliver business-aligned AI solutions
  • Establish engineering best practices for prompt engineering, model evaluation, regression testing, observability, and production readiness
  • Define and implement quality standards, evaluation suites, acceptance metrics, and regression plans for all AI/ML features
  • Ensure high availability, scalability, and resilience of tier-1 ML services through SLOs, monitoring, incident response, failover strategies, circuit breakers, and multi-zone deployments
  • Fulltime
Read More
Arrow Right

Machine Learning Engineering Lead

As our Machine Learning Engineering Lead, you will be responsible for building a...
Location
Location
United States , New York; Philadelphia; Pittsburgh; Plymouth Meeting
Salary
Salary:
200000.00 - 250000.00 USD / Year
creditgenie.com Logo
Credit Genie
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-10+ years of Backend Software Development experience and demonstrated prior experience working with ML/AI teams in a technical leadership capacity
  • Strong foundation in Software Development and prior experience leading impactful ML software projects
  • Strong foundation and demonstrated prior experience with Version Control, Infrastructure as Code, Testing, CI/CD, Monitoring and Observability
  • Demonstrated ability to deliver end-to-end production-grade ML solutions (e.g., experience with databases and data warehouses, streaming vs. batch data ingestion, feature engineering and versioning of features, Jupyter Notebooks and similar ML development environments, building and testing prediction services, versioning model artifacts, …)
  • Significant prior experience with ML-specific technologies such as Feature Stores/Feature Platforms and Model Registries, and demonstrated knowledge of ML-specific architectural patterns and tradeoffs (real-time vs. batch prediction, batch features vs. streaming features)
Job Responsibility
Job Responsibility
  • Responsible for building the Engineering foundation for the Data Science and ML/AI team, and for setting the company’s ML/AI Engineering roadmap in collaboration with our leadership team
  • Collaborate hands-on with Data Scientists and ML/AI Engineers to deliver production-grade ML/AI systems that support critical areas of our business (e.g., Risk and customer-facing in-app experiences)
  • Collaborate with leads from Engineering, Data Engineering, and Product to expand the existing technological stack of the company and support ML/AI-specific requirements
  • Responsible for setting and maintaining the highest ML Engineering standards in the Data Science and ML/AI team
  • Have fun working on hard and highly impactful problems
What we offer
What we offer
  • Offers Equity
  • Offers Bonus
  • 100% company-paid medical, dental, and vision coverage for you and your dependents on your first day of employment
  • Receive up to $100 per month in fitness reimbursement or enjoy a complimentary full membership to LifeTime Fitness or Equinox
  • 401(k) with a 3.5% match and immediate vesting
  • Meal program available for both lunch and dinner
  • Pre-tax benefits, including a $1,000 HSA match
  • Life and accidental insurance
  • Flexible PTO
  • Fulltime
Read More
Arrow Right

Director of Data Engineering and Agentic AI Automation

We are looking for a Director of Data Engineering and Agentic AI Automation to l...
Location
Location
United States , San Francisco
Salary
Salary:
347000.00 - 490000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years in data engineering, with proven experience building and managing enterprise-scale, auditable ETL pipelines and complex datasets
  • Proficiency in SQL and Python, with demonstrated experience in schema design, data modeling, and orchestration frameworks
  • Expertise in distributed data processing technologies such as Apache Spark, Kafka, and cloud-native storage (e.g., S3, ADLS)
  • Deep knowledge of enterprise data architecture, especially within Finance and Supply Chain
  • Familiarity with financial processes (close, allocations, revenue recognition) and supply chain data models (Supply and demand planning, procurement, vendor master), along with experience in ingesting data from internal engineering systems with large volumes of B2C
  • Strong track record of partnering with senior business stakeholders and translating complex requirements into scalable technical solutions
Job Responsibility
Job Responsibility
  • Build and maintain scalable, auditable data infrastructure that powers accurate financial information, with a focus on revenue recognition, compute attribution, and close automation
  • Lead and grow teams of analytics engineers, data engineers, and AI engineers to deliver high-impact, intelligent data systems
  • Guide work across financial close and allocations automation, B2C revenue automation from engineering systems to ERP (including reconciliation with cash and source systems), and other mission-critical financial processes
  • Design and implement data pipelines connecting ERP, planning, and operational systems, including Oracle Fusion, Anaplan, and Workday
  • Build and support scalable, audit-proof architecture that enables reliable financial reporting and compliance
  • Develop data and AI-powered workflows that enhance forecasting accuracy, compliance automation, and operational efficiency
  • Create and maintain data marts and products that support stakeholders across Revenue, FP&A, Tax, Procurement, Hardware Accounting, and Controller teams
  • Define and enforce best practices for data modeling, lineage, observability, and reconciliation across finance data domains
  • Set the technical direction and manage team structure, mentoring engineers and overseeing contractors or system integrators to ensure delivery of high-quality outcomes
  • Partner with senior leaders across Finance, Engineering, and Infrastructure to align on priorities and integrate new automation capabilities
What we offer
What we offer
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Fulltime
Read More
Arrow Right

Engineering Manager, API

We're looking for an Engineering Manager to lead the team responsible for Runway...
Location
Location
United States
Salary
Salary:
280000.00 - 340000.00 USD / Year
runwayml.com Logo
Runway
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of experience in an engineering manager or team lead role, with a track record of building and scaling high-performing teams
  • 5+ years of hands-on engineering experience, with specific expertise operating TypeScript services in the cloud (AWS/GCP/Azure)
  • Strong product sensibility and business acumen
  • Experience owning revenue-generating platforms or products, with an understanding of API economics, usage-based pricing, and developer experience
  • Solid foundation in data engineering and analytics, including experience with metrics pipelines, data modeling, and business intelligence tooling
  • Database expertise, particularly in managing production databases at scale, data migrations, and ensuring data integrity
  • Excellent cross-functional communication skills
  • Comfort with ambiguity and rapid iteration
  • Empathetic and inclusive leadership style that empowers engineers to do their best work
Job Responsibility
Job Responsibility
  • Drive platform strategy and architecture for our TypeScript-based API infrastructure, ensuring code quality, maintainability, and scalability as we grow
  • Own the public API domain end-to-end, from technical architecture to revenue growth, ensuring it's a high-quality, revenue-generating platform that developers love
  • Manage our data and analytics infrastructure, ensuring data integrity, security, and accessibility for teams across the company
  • Lead and grow a team of 4-6 platform engineers, fostering a culture of technical excellence, collaboration, and continuous improvement
  • Partner with Product Engineering teams to unblock new feature launches, providing platform support and ensuring smooth integration between frontend experiences and backend capabilities
  • Own critical data pipelines and metrics that power business decisions across Finance (cost-of-sales, revenue attribution), Support (usage analytics, error tracking), and Product (feature adoption, performance metrics)
  • Work cross-functionally with leadership to set priorities, communicate progress, and align platform investments with business goals
  • Fulltime
Read More
Arrow Right

Data engineer AI and Analytics - Vice president

We are seeking a highly skilled and forward-thinking Vice President to lead our ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of technology experience, with a significant track record in wealth management technology at leading financial institutions
  • Deep, hands-on experience managing large-scale, high-throughput OLTP databases (e.g., Oracle, PostgreSQL, SQL Server)
  • Extensive experience with analytical data platforms, data warehousing, and data lakes (e.g., Snowflake, BigQuery, Redshift, Hadoop ecosystem)
  • Hands-on experience with the data engineering aspects of AI/ML, including feature engineering, data preparation for model training, and deploying models into production pipelines. Familiarity with MLOps principles
  • Proven track record of designing, building, and operating mission-critical, real-time RESTful APIs at scale
  • Strong data modeling skills for both transactional and analytical use cases
  • Expertise with performance measurement and monitoring tools (e.g., AppDynamics, Splunk, Prometheus, Grafana)
  • Proven ability to lead, mentor, and manage a high-performing engineering team
  • A strong, demonstrable work ethic and a deep sense of ownership, with a history of seeing complex systems through from conception to long-term operational stability
  • The ability to maintain a holistic, end-to-end view of a complex data ecosystem, understanding the flow of data from real-time transaction to analytical insight
Job Responsibility
Job Responsibility
  • Unified Data Platform Ownership:Lead a team of skilled engineers responsible for the design, development, and 24/7 operation of the unified client and account data platform, encompassing both high-throughput OLTP systems and large-scale OLAP analytical stores
  • AI & Advanced Analytics Enablement:Pioneer the application of AI/ML models on core client and account data to generate actionable insights, identify patterns, and create intelligent features for advisor and client applications. Partner with data science teams to provide them with high-quality, curated data
  • Real-Time API Management:Oversee the entire lifecycle of the high-throughput, low-latency APIs that provide real-time data to advisor workstations, client-facing portals, and other critical applications, ensuring they are performant, reliable, and secure
  • Data Integrity & Scale:Take ultimate responsibility for the integrity, availability, and performance of massive volumes of data across both transactional and analytical systems
  • Measurement & Analytics:Champion a culture of measurement. Define, monitor, and report on key performance indicators (KPIs) across the entire ecosystem, from database performance and API latency to data quality and the efficacy of AI models
  • End-to-End Ecosystem View:Serve as the subject matter expert for the entire client and account data ecosystem, from the foundational OLTP databases and real-time APIs to the analytical data warehouses/lakes and the AI/ML models they feed
  • Technical Strategy:Partner with global architects and business leaders to define the technical roadmap for the core data platforms, including strategies for data replication, ETL/ELT processes, and the integration of AI/ML capabilities
  • Fulltime
Read More
Arrow Right