CrawlJobs Logo

Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)

United States, McLean, Virginia Employment contract 179400.00 - 225100.00 USD / Year · Job Posted June 01, 2026
Apply Position
Job Link Share

Job Description

Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Sr. Data Engineers who are passionate about data, data modeling, data quality, governance and permissible use and building data pipelines with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. Team: The Marketing and Messaging team is responsible for delivering hyper-personalized messages and experiences that will delight the customer, attract prospects and drive increasing business value. The team builds scalable platforms that deliver omnichannel messages in owned and paid Adtech channels.

Job Responsibility

  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using data movement tools and technologies
  • Work, as a lead developer, with a team of developers with deep experience in data movement, distributed computing, and full stack systems
  • Utilize programming languages like Python, SQL and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Snowflake, Databricks
  • Optimize information system for end-user and downstream application consumers by using sound data design practices
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Requirements

  • Bachelor’s Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Nice to have

  • 7+ years of experience in application development including Python, SQL, Spark, ETL tools, AWS Glue
  • 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
  • 4+ years of experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, or MySQL)
  • 4+ years of experience working on real-time data and streaming applications
  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
  • 4+ years of data warehousing experience (Redshift or Snowflake)
  • 4+ years of experience with UNIX/Linux including basic commands and shell scripting
  • 4+ years of experience with data modeling for data warehousing
  • 2+ years of experience with Agile engineering practices
  • 1+ years of experience leveraging AI-assisted coding tools (Claude Code, GitHub Copilot) to accelerate the software delivery

What we offer

  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Comprehensive, competitive, and inclusive set of health, financial and other benefits

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)

8 matching positions

Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)

Do you love building and pioneering in the technology space? Do you enjoy solvin...
Location
Location
United States , McLean, Virginia; New York, New York
Salary
Salary:
197300.00 - 245600.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Data Engineering Senior Lead Analyst - Senior Vice President

The Data Engineering Senior Lead Analyst (Data Analytics Sr Lead Analyst - C14) ...
Location
Location
Canada , Mississauga
Salary
Salary:
145100.00 - 217700.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of hands-on professional software engineering experience, including designing and delivering distributed systems, microservices, and full-stack applications in complex enterprise environments
  • Proficiency in programming in Python, JavaScript/TypeScript (React or Angular) is mandatory
  • Experience of using cloud services such as AWS and distributed systems such as Kubernetes, Kafka, S3, Databases like DynamoDB, MongoDB or any other NoSQL database in addition to classical RDBMS such as PostgreSQL, Oracle etc
  • Experience of following TDD and passionate about clean code principles
  • Solid understanding of GenAI principles and architectures, coupled with proficiency in frameworks and libraries (e.g., TensorFlow, PyTorch, Hugging Face Transformers) and MLOps practices for managing the lifecycle of GenAI solutions
  • Strong background in GenAI, including working with LLMs, Google Gemini, and vector databases (e.g. pg_vector)
  • experience in designing retrieval-augmented solutions is highly preferred
  • Solid understanding and experience of using data structures, algorithms and SQL
  • Able to independently work in fast paced and rapidly changing environment
  • Product Management Skills: Business Acumen / Roadmaps / Prioritization: Ability to collaborate with multiple stakeholders across the organization is vital. You must be able to connect technical decisions to business outcomes. This includes understanding your product's P&L, customer acquisition costs, and lifetime value. You should be adept at creating outcome-oriented roadmaps that align with business objectives, not just a list of features. This involves using sophisticated prioritization frameworks to justify your decisions with data and strategic reasoning
Job Responsibility
Job Responsibility
  • Conducts strategic data analysis, identifies insights and implications and make strategic recommendations, develops data displays that clearly communicate complex analysis
  • Mines and analyzes data from various banking platforms to drive optimization and improve data quality
  • Deliver analytics initiatives to address business problems with the ability to identify data required, assess time & effort required and establish a project plan
  • Consults with business clients to determine system functional specifications
  • Applies comprehensive understanding of how multiple areas collectively integrate to contribute towards achieving business objectives
  • Consults with users and clients to solve complex system issues/problems through in-depth evaluation of business processes, systems and industry standards
  • recommends solutions
  • Leads system change process from requirements through implementation
  • provides user and operational support of application to business users
  • Formulates and defines systems scope and goals for complex projects through research and fact-finding combined with an understanding of applicable business systems and industry standards
  • Fulltime
Read More
Arrow Right

Principal MLOps Architect

We are seeking a highly experienced and hands-on Principal AI/ML Architect & App...
Location
Location
Salary
Salary:
Not provided
Intellias
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's or Ph.D. in Computer Science, Data Science, Machine Learning, or a related field
  • 10+ years of experience in AI/ML, data science, or distributed systems engineering.
  • Proven experience designing and deploying production-grade AI solutions at enterprise scale.
  • Strong background in both research and industrial AI environments.
  • Experience leading global or distributed technical teams.
  • Demonstrated success delivering AI transformation initiatives.
  • Large Language Models (LLMs)
  • Generative AI systems
  • NLP / NLU
  • Apache Spark
Job Responsibility
Job Responsibility
  • Lead the design and implementation of AI/ML solutions across multiple business domains.
  • Drive enterprise adoption of Large Language Models (LLMs), Generative AI, NLP/NLU, and advanced analytics solutions.
  • Define AI architecture standards, MLOps best practices, and scalable deployment strategies.
  • Evaluate emerging AI technologies and identify opportunities for innovation and operational impact.
  • Translate research initiatives into production-ready AI solutions.
  • Architect scalable distributed data-processing systems capable of handling large-scale datasets and real-time pipelines.
  • Design and optimize cloud-native AI platforms using modern data engineering frameworks.
  • Lead cloud migration and modernization initiatives from on-premises environments to Azure and/or AWS.
  • Implement efficient data pipelines leveraging Spark, Delta Lake, Databricks, Kubernetes, and containerized environments.
  • Ensure reliability, scalability, observability, and cost-efficiency of AI infrastructure.
  • Fulltime
Read More
Arrow Right
New

Ai Engineer

We are recruiting an AI Engineer for a direct contract with a company based in t...
Location
Location
Portugal , Porto
Salary
Salary:
Not provided
https://www.precisers.pt Logo
Precise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years experience working within a software development team as an engineer
  • Comfortable writing and debugging code in Python. You understand the importance of readable code and are eager to learn best practices.
  • Familiarity with frameworks like FastAPI, Flask, or Django, with experience developing and exposing/consuming APIs.
  • Understanding of containerization and exposure to Docker.
  • Comfortable using Git for team collaboration (Gitlab pipelines exposure is a plus).
  • Machine Learning Fundamentals: Foundational knowledge of ML concepts and practical experience (academic or personal projects) deploying a simple model using libraries like scikit-learn, PyTorch, or TensorFlow.
  • Experience manipulating and analyzing data using libraries such as Pandas and NumPy.
  • A strong desire to learn MLOps principles, cloud infrastructure, and deployment practices (Kubernetes exposure is a plus).
  • BSc in Computer Science or a related technical field.
Job Responsibility
Job Responsibility
  • Implementing solutions for building and deploying AI models in production, with a focus on fault tolerance, scalability, maintainability and automation.
  • Leveraging modern LLM’s to include/enhance parsing capabilities for CVs/job adverts for existing supported languages and new additional languages.
  • Collaborating with the team to design, implement and optimise data processing pipelines and evaluation tools.
  • Fulltime
Read More
Arrow Right
New

Branch Manager

Come and join us as a results driven Branch Manager to deliver sales and exceed ...
Location
Location
United Kingdom , Lymington
Salary
Salary:
Not provided
cityplumbing.co.uk Logo
City Plumbing
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A great positive attitude
  • Enjoy customer interaction
  • Management Experience
  • Safe Practices
  • Forward Thinking
  • Tenacity and resilience
  • A pro-active approach to sales, with a strong desire and ability to win and grow new business
  • Experience of customer relationship management and developing a true partnership approach
  • Excellent communication skills
  • Self confident and self motivated, with the ability to work on own initiative or as part of a wider team
Job Responsibility
Job Responsibility
  • Effective management of the team and resource
  • Setting the standard of a sales orientated culture
  • Delivering against sales and customer demands while maximising profitability
  • Maximising margin and net profit
  • Keeping everyone safe
  • Build and maintain relationships with new and existing trade and retail customers
  • Ability to interpret and analyse financial and statistical information
What we offer
What we offer
  • Bonus
  • Discounts, savings and cash back at numerous retailers
  • Life assurance
  • Extended family policy including maternity, paternity, additional annual leave and more
  • Mental Health First Aiders and Employee Assistance Programme, we look out for each other
  • Complete induction and a company that lets you grow and encourages development
  • Financial education and loans
  • Flexible working options
  • A business striving to create an environment of inclusion so everyone can be their true self
  • Fulltime
Read More
Arrow Right
New

Guest Environment Expert

Our jobs aren’t just about giving guests a clean room and a freshly made bed. In...
Location
Location
United States , Poughkeepsie
Salary
Salary:
18.00 USD / Hour
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ensuring a safe work place
  • following company policies and procedures
  • maintaining confidentiality
  • upholding quality standards
  • ensuring professional uniform, personal appearance, and communications
  • ability to stand, sit, or walk for an extended time
  • ability to move, lift, carry, push, pull, and place objects weighing less than or equal to 50 pounds without assistance
Job Responsibility
Job Responsibility
  • Delivering guest requests
  • stocking carts
  • cleaning rooms and public spaces
  • maintaining the appearance and cleanliness of the whole hotel
  • Parttime
Read More
Arrow Right
New

Project Engineer

Our client is seeking a motivated and experienced Project Engineer to join their...
Location
Location
United Kingdom , Dartford
Salary
Salary:
30000.00 GBP / Year
https://www.office-angels.com Logo
Office Angels
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven construction based industry experience, (ideally within Smoke Ventilation/Fire Alarm Systems but not essential)
  • Computer literate with strong reporting and organisational skills
  • Excellent interpersonal and communication skills
  • Ability to multitask and manage cross-disciplinary projects
  • Strong time management and decision-making abilities
  • Professional, presentable, and self-motivated
  • Team-oriented with a commitment to exceeding client and colleague expectations
  • Full UK Driving License required, ideally with your own transport
Job Responsibility
Job Responsibility
  • Assist in the development and delivery of Risk and Method Statements
  • Compile detailed project reports covering quality, progress, and issues
  • Measuring up for install jobs and conducting Coordinate on-site deliveries to ensure smooth logistics
  • Support the accounts team with project-related financials and debt collection
  • Monitor project costs and provide financial updates, including profit/loss analysis
  • Communicate effectively with subcontractors and ensure alignment with project goals
  • Manage resources according to the client's program and track project progress
  • Ensure all documentation and certification is accurate, complete, and submitted on time
What we offer
What we offer
  • 23 days annual leave plus bank holidays, rising to 25 days annual leave at 2 years service
  • Company mobile phone
  • uniform and PPE
  • Life Insurance
  • Private Health Care
  • Pension Scheme
  • Fulltime
Read More
Arrow Right
New

Sales Assistant

Come and join us as a results driven Sales Assistant on a flexible hours basis t...
Location
Location
United Kingdom , Woking
Salary
Salary:
12.71 - 13.93 GBP / Hour
cityplumbing.co.uk Logo
City Plumbing
Expiration Date
September 07, 2026
Flip Icon
Requirements
Requirements
  • A great positive attitude
  • Teamwork
  • Enjoy customer interaction
  • Flexibility
  • Ideally you’ll have previous experience of selling or assisting customers with purchases, ideally with knowledge of the products associated with our industry - although enthusiasm and a can-do attitude is just as important
  • Flexible with working hours
  • Full, clean driving licence may be required
Job Responsibility
Job Responsibility
  • Supporting the Branch Manager and Assistant Branch Manager with achieving and exceeding sales targets at optimum margins
  • Ensuring we maintain high standards, creating and maintaining a loyal customer base and providing a first class service
  • Assisting with the general duties within the branch such as serving customers on the trade counter, telesales and ensuring the housekeeping standards are maintained both on the trade counter and warehousing
  • You may be required to take on general driving duties when required
What we offer
What we offer
  • Bonus
  • Discounts, savings and cash back at numerous retailers
  • Life assurance
  • Extended family policy including maternity, paternity, additional annual leave and more
  • Mental Health First Aiders and Employee Assistance Programme
  • Complete induction and a company that lets you grow and encourages development
  • Financial education and loans
  • Flexible working options
  • Parttime
Read More
Arrow Right