CrawlJobs Logo

Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)

United States, McLean, Virginia Employment contract 179400.00 - 225100.00 USD / Year · Job Posted June 01, 2026
Apply Position
Job Link Share

Job Description

Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Sr. Data Engineers who are passionate about data, data modeling, data quality, governance and permissible use and building data pipelines with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. Team: The Marketing and Messaging team is responsible for delivering hyper-personalized messages and experiences that will delight the customer, attract prospects and drive increasing business value. The team builds scalable platforms that deliver omnichannel messages in owned and paid Adtech channels.

Job Responsibility

  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using data movement tools and technologies
  • Work, as a lead developer, with a team of developers with deep experience in data movement, distributed computing, and full stack systems
  • Utilize programming languages like Python, SQL and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Snowflake, Databricks
  • Optimize information system for end-user and downstream application consumers by using sound data design practices
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Requirements

  • Bachelor’s Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Nice to have

  • 7+ years of experience in application development including Python, SQL, Spark, ETL tools, AWS Glue
  • 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
  • 4+ years of experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, or MySQL)
  • 4+ years of experience working on real-time data and streaming applications
  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
  • 4+ years of data warehousing experience (Redshift or Snowflake)
  • 4+ years of experience with UNIX/Linux including basic commands and shell scripting
  • 4+ years of experience with data modeling for data warehousing
  • 2+ years of experience with Agile engineering practices
  • 1+ years of experience leveraging AI-assisted coding tools (Claude Code, GitHub Copilot) to accelerate the software delivery

What we offer

  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Comprehensive, competitive, and inclusive set of health, financial and other benefits

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)

8 matching positions

Principal MLOps Architect

We are seeking a highly experienced and hands-on Principal AI/ML Architect & App...
Location
Location
Salary
Salary:
Not provided
Intellias
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's or Ph.D. in Computer Science, Data Science, Machine Learning, or a related field
  • 10+ years of experience in AI/ML, data science, or distributed systems engineering.
  • Proven experience designing and deploying production-grade AI solutions at enterprise scale.
  • Strong background in both research and industrial AI environments.
  • Experience leading global or distributed technical teams.
  • Demonstrated success delivering AI transformation initiatives.
  • Large Language Models (LLMs)
  • Generative AI systems
  • NLP / NLU
  • Apache Spark
Job Responsibility
Job Responsibility
  • Lead the design and implementation of AI/ML solutions across multiple business domains.
  • Drive enterprise adoption of Large Language Models (LLMs), Generative AI, NLP/NLU, and advanced analytics solutions.
  • Define AI architecture standards, MLOps best practices, and scalable deployment strategies.
  • Evaluate emerging AI technologies and identify opportunities for innovation and operational impact.
  • Translate research initiatives into production-ready AI solutions.
  • Architect scalable distributed data-processing systems capable of handling large-scale datasets and real-time pipelines.
  • Design and optimize cloud-native AI platforms using modern data engineering frameworks.
  • Lead cloud migration and modernization initiatives from on-premises environments to Azure and/or AWS.
  • Implement efficient data pipelines leveraging Spark, Delta Lake, Databricks, Kubernetes, and containerized environments.
  • Ensure reliability, scalability, observability, and cost-efficiency of AI infrastructure.
  • Fulltime
Read More
Arrow Right
New

Support Worker

An exciting opportunity has arisen for a Support Worker position within our Olde...
Location
Location
United Kingdom , Grimsby
Salary
Salary:
25272.00 GBP / Year
navigocare.co.uk Logo
Navigo Health and Social Care CIC
Expiration Date
June 10, 2026
Flip Icon
Requirements
Requirements
  • Has a basic understanding of the Mental Health Act 1983, Mental Capacity Act 2005 and DoLs
  • Is open to development of their knowledge in needs of mental health patients
  • Basic written communication skills to enable completion of records, etc.
  • Demonstrates a good understanding of mental health
  • Aware of Health & Safety principles of self and others
  • Work safely within Health and Safety policies
  • Demonstrates ability to listen and communicate effectively and to be empathic, compassionate and patient
  • Demonstrates a good understanding of mental health
  • Have the practical skills to assist with activities of daily living, and be prepared to assist with basic practical tasks
  • Must demonstrate an understanding of confidentiality
Job Responsibility
Job Responsibility
  • Under supervision, assists in the assessment, planning and implementation of mental health care to meet the needs of the individual
  • Participates in the development of high quality care, ensuring the needs of the older person are met
  • This includes ensuring that each patient exercises their rights of choice, dignity and privacy
  • Participation in occupational and diversional activities
  • Attend to the physical needs of clients helping with dressing, washing, toileting and other personal needs where necessary, to give helpful advice and encouragement to patients who wish to perform such tasks for themselves
  • Undertake duties aimed at supporting the patient to return to live in the community (where appropriate) for example, listening to and conversing with clients, helping them to maintain contact with family, friends and community, assisting with recreation aimed at creating a supportive atmosphere where patients can achieve maximum independence
  • To observe the patients general condition and report any changes to the appropriate health professional
  • To be aware of their responsibilities under the Health & Safety at Work Act and to work in such a way as to encourage an atmosphere conducive to healthy working conditions
  • To be aware of and comply with all relevant policies and procedures laid down by NAViGO
  • To work flexibly participating in a 24 hour rota
  • Fulltime
!
Read More
Arrow Right
New

Director of Human Resources

The Director of Human Resources will report directly to the property General Man...
Location
Location
China , Beijing
Salary
Salary:
Not provided
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2-year degree from an accredited university in Human Resources, Business Administration, or related major
  • 4 years experience in the human resources, management operations, or related professional area
  • 4-year bachelor's degree in Human Resources, Business Administration, or related major
  • 2 years experience in the human resources, management operations, or related professional area
Job Responsibility
Job Responsibility
  • Execute and follow-up on engagement survey related activities
  • Champion and build the talent management ranks in support of property and region diversity strategy
  • Translate business priorities into property Human Resources strategies, plans and actions
  • Implement and sustain Human Resources initiatives at the property
  • Coordinate the human capital review process at property(s) and lead succession planning activities on property and in the market, as appropriate
  • Lead the assessment of property(s) leadership pipeline through the human capital review process and assist with follow-up
  • Create value through proactive approaches that will affect performance outcome or control cost
  • Monitor effective use of myHR by property managers and employees
  • Lead and participate in succession management and workforce planning
  • Responsible for Human Resources strategy and execution
  • Fulltime
Read More
Arrow Right
New

Cook

As a cook you would be working as part of a small and friendly team within Tukes...
Location
Location
United Kingdom , Grimsby
Salary
Salary:
25760.00 - 27476.00 GBP / Year
navigocare.co.uk Logo
Navigo Health and Social Care CIC
Expiration Date
June 10, 2026
Flip Icon
Requirements
Requirements
  • Appropriate work experience within the field of catering
  • Catering experience at chef level
  • Knowledge of HACCP and COSHH
  • Good literacy skills
  • Food Hygiene
  • Respect trained or willing to work towards
  • Diploma in Hospitality and Catering or equivalent experience
  • Working Knowledge of ordering and Stock Control
  • Understanding of health promotion through healthy eating
  • Knowledge of HACCP and COSHH
Job Responsibility
Job Responsibility
  • Preparation and cooking of palatable and nutritionally balanced meals on a daily basis using fresh produce and ingredients
  • Plan suitable menus, and to make choices available, including special dietary meals, which take into account medical, cultural and religious needs where appropriate
  • To be responsible for proper standards of hygiene and infection control, and to control kitchen laundry
  • Responsible for ensuring that all utensils, equipment, work surfaces and areas are maintained in a hygienic state of a high standard
  • To be responsible for ordering of stock and ensuring correct storage and stock rotation with every provisions delivery
  • Ensures compliance with Policy and Procedures concerning the health, welfare and safety of service users and staff members
  • Perform such other duties as reasonably correspond to the general character of the post and are commensurate with its level of responsibility
  • The post holder will be responsible for accurate temperature recoding in accordance with HACCP and Food Management Systems guidelines
  • Train assistant cooks staff and members in meal preparation during peak times according to the needs of the business
  • Maintain records of meals prepared and monitor wastage to optimise best use of resources and budget
  • Parttime
!
Read More
Arrow Right
New

Human Resources Coordinator

Human Resources Coordinator
Location
Location
Saudi Arabia , Riyadh
Salary
Salary:
Not provided
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High school diploma or G.E.D. equivalent
  • At least 1 year of related work experience
  • No supervisory experience
  • None
Job Responsibility
Job Responsibility
  • Create and maintain filing systems
  • Create and type office correspondence using a computer
  • Distribute and route mail
  • Order and track Human Resources office supplies and forms
  • Answer phone calls and record messages
  • Create new employee personnel file
  • Assist walk-in candidates with application procedures
  • Maintain space designated for completing applications and ensure it is clean, well maintained, and accessible to individuals with disabilities
  • Respond to questions, requests, and concerns from employees and management regarding company and Human Resources programs, policies and guidelines
  • Inform Human Resources management of issues related to employee relations within the division or property
  • Fulltime
Read More
Arrow Right
New

Supply ESL Teacher

Location
Location
Canada , Toronto
Salary
Salary:
24.00 - 27.00 CAD / Hour
bayswater.ac Logo
Bayswater Education
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree or equivalent
  • Valid TESL/TESOL/CELTA Certificate
Job Responsibility
Job Responsibility
  • Supply teach English as a second language classes to groups of 12-15 students from 9 am - 12:15 pm, Monday-Friday
  • Teach pre-planned coverages, emergency coverages (same day), or both
  • Teach a variety of classes, including ESL, EAP, IELTS, or business English
  • Follow Bayswater policies and procedures in the Teacher Handbook
  • Parttime
Read More
Arrow Right
New

Support Worker

An exciting opportunity has arisen for a Support Worker position within our Olde...
Location
Location
United Kingdom , Grimsby
Salary
Salary:
25272.00 GBP / Year
navigocare.co.uk Logo
Navigo Health and Social Care CIC
Expiration Date
June 10, 2026
Flip Icon
Requirements
Requirements
  • Has a basic understanding of the Mental Health Act 1983, Mental Capacity Act 2005 and DoLs
  • Is open to development of their knowledge in needs of mental health patients
  • Basic written communication skills to enable completion of records, etc.
  • Demonstrates a good understanding of mental health
  • Aware of Health & Safety principles of self and others
  • Work safely within Health and Safety policies
  • Demonstrates ability to listen and communicate effectively and to be empathic, compassionate and patient
  • Demonstrates a good understanding of mental health
  • Have the practical skills to assist with activities of daily living, and be prepared to assist with basic practical tasks
  • Must demonstrate an understanding of confidentiality
Job Responsibility
Job Responsibility
  • Under supervision, assists in the assessment, planning and implementation of mental health care to meet the needs of the individual
  • Participates in the development of high quality care, ensuring the needs of the older person are met
  • Participation in occupational and diversional activities
  • Attend to the physical needs of clients helping with dressing, washing, toileting and other personal needs where necessary
  • Undertake duties aimed at supporting the patient to return to live in the community (where appropriate)
  • To observe the patients general condition and report any changes to the appropriate health professional
  • To be aware of their responsibilities under the Health & Safety at Work Act
  • To be aware of and comply with all relevant policies and procedures laid down by NAViGO
  • To work flexibly participating in a 24 hour rota
  • Attending and participating in ward/department meetings as required
  • Fulltime
!
Read More
Arrow Right
New

Relationship Banker

Wells Fargo is seeking a Relationship Banker (SAFE) to join our National Branch ...
Location
Location
United States , Seminole
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
June 08, 2026
Flip Icon
Requirements
Requirements
  • 2+ years of customer service experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 1+ year of assessing and meeting the needs of customers or helping with issue resolution, demonstrated through work or military experience
  • 1+ year of building and maintaining effective relationships with customers and partners
Job Responsibility
Job Responsibility
  • Proactively acquire, manage, and grow a portfolio of consumer and business customer relationships
  • Lead discovery‑driven conversations to understand customer goals and deliver tailored banking and credit strategies that strengthen relationships, increase retention, and drive balanced growth across deposits, lending, and investments
  • Partner with a team of professionals across Wealth, Home Lending, and Business Banking to deliver integrated solutions by coordinating warm introductions, setting clear expectations, and taking personal ownership to convert qualified opportunities into closed outcomes
  • Champion digital adoption by educating customers on self-service and mobile banking options to elevate satisfaction, engagement, and service efficiency
  • Resolve account inquiries and service requests within authorized limits, documenting actions and setting follow-up plans that reinforce trust and ease
  • Demonstrate risk excellence through accurate documentation, sound judgment, timely issue escalation, and adherence to policies and regulations to support strong control outcomes
  • Fulltime
!
Read More
Arrow Right