CrawlJobs Logo

Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)

United States, McLean, Virginia Employment contract 197300.00 - 245600.00 USD / Year · Job Posted June 14, 2026
Apply Position
Job Link Share

Job Description

Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One.

Job Responsibility

  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Requirements

  • Bachelor's Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Nice to have

  • Master's Degree
  • 1+ years of experience leveraging AI-assisted coding tools (Claude Code, GitHub Copilot) to accelerate the software delivery
  • 7+ years of experience in application development including Python, SQL, Scala, or Java
  • 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
  • 4+ years of experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
  • 4+ years of experience working on real-time data and streaming applications
  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
  • 4+ years of data warehousing experience (Redshift or Snowflake)
  • 4+ years of experience with UNIX/Linux including basic commands and shell scripting
  • 4+ years of experience with data modeling for data warehousing
  • 2+ years of experience with Agile engineering practices

What we offer

  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)

8 matching positions

Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)

Do you love building and pioneering in the technology space? Do you enjoy solvin...
Location
Location
United States , McLean, Virginia; Chicago, Illinois
Salary
Salary:
179400.00 - 225100.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using data movement tools and technologies
  • Work, as a lead developer, with a team of developers with deep experience in data movement, distributed computing, and full stack systems
  • Utilize programming languages like Python, SQL and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Snowflake, Databricks
  • Optimize information system for end-user and downstream application consumers by using sound data design practices
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Lead Software Engineer

Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
June 30, 2026
Flip Icon
Requirements
Requirements
  • 5+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 4+ years of hands-on experience with Python, SQL, and bash scripting for automation
  • Strong experience building big data pipelines using Apache Spark, Hive, Hadoop
  • Experience with Autosys/Airflow or similar orchestration tools
  • Working knowledge of REST APIs, Object Storage, Dremio, and CI/CD pipelines
  • Strong troubleshooting and problem‑solving capabilities
  • Solid foundation in data modeling (conceptual/logical/physical) and database design
  • Experience architecting pipelines using distributed systems patterns (shuffle optimization, spill, broadcast, storage layouts)
  • Experience with streaming frameworks like Spark Structured Streaming or Apache Flink
  • Hands‑on with optimization techniques: clustering, Z‑ordering, vectorized IO (Parquet/ORC), compaction
Job Responsibility
Job Responsibility
  • Lead complex technology initiatives including those that are companywide with broad impact
  • Act as a key participant in developing standards and companywide best practices for engineering complex and large scale technology solutions for technology engineering disciplines
  • Design, code, test, debug, and document for projects and programs
  • Review and analyze complex, large-scale technology solutions for tactical and strategic business objectives, enterprise technological environment, and technical challenges that require in-depth evaluation of multiple factors, including intangibles or unprecedented technical factors
  • Make decisions in developing standard and companywide best practices for engineering and technology solutions requiring understanding of industry best practices and new technologies, influencing and leading technology team to meet deliverables and drive new initiatives
  • Collaborate and consult with key technical experts, senior technology team, and external industry groups to resolve complex technical issues and achieve goals
  • Lead projects, teams, or serve as a peer mentor
  • Fulltime
Read More
Arrow Right
New

Data Engineering Senior Lead Analyst - Senior Vice President

The Data Engineering Senior Lead Analyst (Data Analytics Sr Lead Analyst - C14) ...
Location
Location
Canada , Mississauga
Salary
Salary:
145100.00 - 217700.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of hands-on professional software engineering experience, including designing and delivering distributed systems, microservices, and full-stack applications in complex enterprise environments
  • Proficiency in programming in Python, JavaScript/TypeScript (React or Angular) is mandatory
  • Experience of using cloud services such as AWS and distributed systems such as Kubernetes, Kafka, S3, Databases like DynamoDB, MongoDB or any other NoSQL database in addition to classical RDBMS such as PostgreSQL, Oracle etc
  • Experience of following TDD and passionate about clean code principles
  • Solid understanding of GenAI principles and architectures, coupled with proficiency in frameworks and libraries (e.g., TensorFlow, PyTorch, Hugging Face Transformers) and MLOps practices for managing the lifecycle of GenAI solutions
  • Strong background in GenAI, including working with LLMs, Google Gemini, and vector databases (e.g. pg_vector)
  • experience in designing retrieval-augmented solutions is highly preferred
  • Solid understanding and experience of using data structures, algorithms and SQL
  • Able to independently work in fast paced and rapidly changing environment
  • Product Management Skills: Business Acumen / Roadmaps / Prioritization: Ability to collaborate with multiple stakeholders across the organization is vital. You must be able to connect technical decisions to business outcomes. This includes understanding your product's P&L, customer acquisition costs, and lifetime value. You should be adept at creating outcome-oriented roadmaps that align with business objectives, not just a list of features. This involves using sophisticated prioritization frameworks to justify your decisions with data and strategic reasoning
Job Responsibility
Job Responsibility
  • Conducts strategic data analysis, identifies insights and implications and make strategic recommendations, develops data displays that clearly communicate complex analysis
  • Mines and analyzes data from various banking platforms to drive optimization and improve data quality
  • Deliver analytics initiatives to address business problems with the ability to identify data required, assess time & effort required and establish a project plan
  • Consults with business clients to determine system functional specifications
  • Applies comprehensive understanding of how multiple areas collectively integrate to contribute towards achieving business objectives
  • Consults with users and clients to solve complex system issues/problems through in-depth evaluation of business processes, systems and industry standards
  • recommends solutions
  • Leads system change process from requirements through implementation
  • provides user and operational support of application to business users
  • Formulates and defines systems scope and goals for complex projects through research and fact-finding combined with an understanding of applicable business systems and industry standards
  • Fulltime
Read More
Arrow Right

Principal MLOps Architect

We are seeking a highly experienced and hands-on Principal AI/ML Architect & App...
Location
Location
Salary
Salary:
Not provided
Intellias
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's or Ph.D. in Computer Science, Data Science, Machine Learning, or a related field
  • 10+ years of experience in AI/ML, data science, or distributed systems engineering.
  • Proven experience designing and deploying production-grade AI solutions at enterprise scale.
  • Strong background in both research and industrial AI environments.
  • Experience leading global or distributed technical teams.
  • Demonstrated success delivering AI transformation initiatives.
  • Large Language Models (LLMs)
  • Generative AI systems
  • NLP / NLU
  • Apache Spark
Job Responsibility
Job Responsibility
  • Lead the design and implementation of AI/ML solutions across multiple business domains.
  • Drive enterprise adoption of Large Language Models (LLMs), Generative AI, NLP/NLU, and advanced analytics solutions.
  • Define AI architecture standards, MLOps best practices, and scalable deployment strategies.
  • Evaluate emerging AI technologies and identify opportunities for innovation and operational impact.
  • Translate research initiatives into production-ready AI solutions.
  • Architect scalable distributed data-processing systems capable of handling large-scale datasets and real-time pipelines.
  • Design and optimize cloud-native AI platforms using modern data engineering frameworks.
  • Lead cloud migration and modernization initiatives from on-premises environments to Azure and/or AWS.
  • Implement efficient data pipelines leveraging Spark, Delta Lake, Databricks, Kubernetes, and containerized environments.
  • Ensure reliability, scalability, observability, and cost-efficiency of AI infrastructure.
  • Fulltime
Read More
Arrow Right
New

Pharmacy Technician

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Easthampton
Salary
Salary:
17.00 - 27.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
August 01, 2026
Flip Icon
Requirements
Requirements
  • Must be at least 16 years of age
  • Licensure requirements vary by state
  • Attention and Focus
  • Customer Service Orientation
  • Communication Skills
  • Mathematical Reasoning
  • Problem Resolution
  • Physical demands: Remaining upright on the feet, particularly for sustained periods of time
  • Moving about on foot to accomplish tasks
  • Picking, pinching, typing or otherwise working primarily with fingers
Job Responsibility
Job Responsibility
  • Manage all assigned pharmacy workstations and tasks to support the team’s ability to promptly, safely and accurately fill patient prescriptions
  • Provide caring service that exceeds customer expectations
  • Ensure all medication needs and regulatory compliance standards are met for our patients
  • Demonstrate ethical conduct and maintain patient confidentiality at all times
What we offer
What we offer
  • Dental
  • Vision
  • Wellness resources
  • Employee discounts
  • Access to certain voluntary benefits
  • Other programs
  • Parttime
Read More
Arrow Right
New

Mobile Software Engineer - iOS

Embark on a transformative journey as a Mobile Software Engineer – iOS. At Barcl...
Location
Location
United States , Whippany
Salary
Salary:
75000.00 - 135000.00 USD / Year
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid experience building production iOS applications using Swift and SwiftUI
  • Sound understanding of iOS architecture patterns, such as MVVM, Clean Architecture along with UIKit and SwiftUI frameworks
  • Experience with RESTful API integration, secure data handling, and mobile authentication flows
  • Familiarity with iOS release pipelines, App Store submission, and CI/CD tooling
  • Ability to write testable, well-structured code with unit and UI test coverage
  • Android development experience, including Kotlin and Jetpack Compose
  • Experience with CI/CD for mobile using tools such as Fastlane, Bitrise, and GitHub Actions
  • Background in financial services, transaction processing, or the card servicing domain
Job Responsibility
Job Responsibility
  • Design, develop and improve software
  • Development and delivery of high-quality software solutions
  • Cross-functional collaboration with product managers, designers, and other engineers
  • Collaboration with peers, participate in code reviews
  • Stay informed of industry technology trends and innovations
  • Adherence to secure coding practices
  • Implementation of effective unit testing practices
What we offer
What we offer
  • Medical
  • Dental
  • Vision coverage
  • 401(k)
  • Life insurance
  • Other paid leave for qualifying circumstances
  • Incentive award
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Fulltime
Read More
Arrow Right
New

Public Cloud Network Lead

Join us at Barclays as a Public Cloud Network Lead, to architect, implement and ...
Location
Location
United Kingdom , London; Glasgow
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Multi-Cloud Network Architecture & Hybrid Connectivity – Lead enterprise-scale network design across AWS, Azure, and GCP, delivering hybrid connectivity, encrypted interconnects (MACsec/IPsec), circuit provider management, and legacy infrastructure remediation through Infrastructure as Code
  • Network Security & Compliance – Implement Zero Trust segmentation, deploy cloud-native firewall controls, and ensure compliance with PCI-DSS, DORA, and internal governance frameworks
  • Strategic Planning, Consultancy & Stakeholder Engagement – Define cloud network strategy, evaluate emerging technologies, produce ADRs and HLD/LLD designs, lead Landing Zone design, and influence senior stakeholders on risk, strategy, and cost optimisation
  • Operational Excellence & Incident Response – Own incident escalation, SLA/SLO monitoring, flow analysis, and SRE enablement to drive network operational excellence
  • Automation, IaC & DevOps Practices – Build reusable Terraform, CloudFormation, and Bicep IaC with CI/CD pipelines and Python/Bash automation for standardised network provisioning
Job Responsibility
Job Responsibility
  • architect, implement and operate enterprise-grade multi-cloud network infrastructure at scale for Barclays
  • design secure, high-performance hybrid and multi-cloud architectures connecting thousands of cloud accounts across global regions to Barclays' on-premises infrastructure
  • work horizontally across GTIS Networks, SRE, DevOps, Product, and senior leadership to deliver strategic initiatives and resolve complex technical debt
  • mentor engineers and serving as the escalation point for critical network incidents
  • Build Engineering: Development, delivery, and maintenance of high-quality infrastructure solutions to fulfil business requirements
  • Incident Management: Monitoring of IT infrastructure and system performance to measure, identify, address, and resolve any potential issues, vulnerabilities, or outages
  • Automation: Development and implementation of automated tasks and processes to improve efficiency and reduce manual intervention
  • Security: Implementation of a secure configuration and measures to protect infrastructure against cyber-attacks, vulnerabilities, and other security threats
  • Teamwork: Cross-functional collaboration with product managers, architects, and other engineers to define IT Infrastructure requirements, devise solutions, and ensure seamless integration and alignment with business objectives
  • Learning: Stay informed of industry technology trends and innovations, and actively contribute to the organization's technology communities to foster a culture of technical excellence and growth
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Pharmacy Technician

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Rancho Mirage
Salary
Salary:
18.55 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
August 15, 2026
Flip Icon
Requirements
Requirements
  • Must comply with any state board of pharmacy requirements or laws governing the practice of pharmacy, which includes but is not limited to, age, education, and licensure/certification
  • If the state board of pharmacy does not address or mandate a minimum age requirement, must be at least 16 years of age
  • If the state board of pharmacy does not address or mandate a minimum educational requirement, must have a high school diploma or equivalent, or be actively enrolled in high school or high school equivalency program
  • State-level licensure and national certification requirements vary by state
  • Regular and predictable attendance, including nights and weekends
  • Ability to complete required training within designated timeframe
  • Attention and Focus: Ability to concentrate on a task over a period of time
  • Ability to pivot quickly from one task to another to meet patient and business needs
  • Ability to confirm prescription information and label accuracy, ensuring patient safety
  • Customer Service and Team Orientation: Actively look for ways to help people, and do so in a friendly manner
Job Responsibility
Job Responsibility
  • Living our purpose by following all company SOPs at each workstation to help our Pharmacists manage and improve patient health
  • Following pharmacy workflow procedures at each pharmacy workstation (i.e., production, pick-up, drive-thru, and drop-off) for safe and accurate prescription fulfillment
  • Contributing to positive patient experiences by showing empathy and genuine care: creating heartfelt and personalized moments while serving patients at pick-up, drive-thru, and over the phone
  • keeping patients healthy by offering immunizations and other services at the register and over the phone
  • and demonstrating compassionate care by solving or escalating patient problems
  • Completing basic inventory activities, as permitted by law, and as directed by the pharmacy leadership team, such as accurately putting away medication deliveries and completing cycle counts, returns-to-stocks, waiting bin inventories, etc.
  • Contributing to a high-performing team, embracing a growth mindset, and being receptive to feedback
  • actively seeking opportunities to expand clinical and technical knowledge needed to better assist patients
  • Remaining flexible for both scheduling and business needs, while contributing to a safe, inclusive, and engaging team dynamic
  • voluntarily traveling to stores in the market to work shifts as needed by the business
What we offer
What we offer
  • dental
  • vision
  • wellness resources
  • employee discounts
  • access to certain voluntary benefits
  • other programs
  • Parttime
Read More
Arrow Right