CrawlJobs Logo

Senior Lead Data Engineer (Enterprise Platform Technology) (Java, Python, Scala, AWS)

United States, McLean Employment contract 229900.00 - 286200.00 USD / Year · Job Posted June 14, 2026
Apply Position
Job Link Share

Job Description

Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Lead Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One. Enterprise Platforms Technology (EPTech) comprises many of Capital One's most important enterprise platforms. We play an essential role in establishing practices for building technology solutions across the company, while also delivering capabilities that exemplify those practices. Team: The Marketing and Messaging team is responsible for delivering hyper-personalized messages and experiences that will delight the customer, attract prospects and drive increasing business value. The team builds scalable platforms that deliver omnichannel messages in owned and paid Adtech channels.

Job Responsibility

  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Requirements

  • Bachelor's Degree
  • At least 6 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Nice to have

  • Master's Degree
  • 1+ years of experience leveraging AI-assisted coding tools (Claude Code, GitHub Copilot) to accelerate the software delivery
  • 9+ years of experience in application development including Python, SQL, Scala, or Java
  • 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
  • 5+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
  • 4+ year experience working on real-time data and streaming applications
  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
  • 4+ years of data warehousing experience (Redshift or Snowflake)
  • 4+ years of experience with UNIX/Linux including basic commands and shell scripting
  • 2+ years of experience with Agile engineering practices

What we offer

  • performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Lead Data Engineer (Enterprise Platform Technology) (Java, Python, Scala, AWS)

8 matching positions

Staff Software Engineer (Backend)

At Cloudera, we empower people to transform complex data into clear and actionab...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
cloudera.com Logo
Cloudera
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience building enterprise-grade infrastructure or platform software with deep expertise in distributed systems
  • Hands-on experience developing Apache Spark or related technologies, with a strong understanding of system architecture and component interfaces
  • Production experience operating containerized workloads on Kubernetes (K8s) and Docker at scale
  • Advanced proficiency in data structures and algorithms, with a command of Java, Scala, Go, or Python
  • Experience with private cloud platforms (OpenShift/Rancher) and public cloud providers (AWS, Azure, or GCP)
  • Ability to influence technical planning and decision-making at a program level while maintaining excellent verbal and written communication
  • Bachelor’s, Master’s, or Ph.D. in Computer Science or a related field
Job Responsibility
Job Responsibility
  • Architect & Scale Core Systems: Design and evolve high-performance systems within the Data Engineering platform, focusing on the Spark ecosystem and surrounding cloud-native technologies
  • Solve Complex Challenges: Address non-routine technical problems requiring high levels of creativity and a deep understanding of distributed systems architecture
  • Own the Spark Experience: Build features that enhance Spark’s scale and reliability across production clusters ranging from hundreds to thousands of nodes
  • Provide Technical Leadership: Drive architectural discussions and provide technical direction for major projects, influencing both your immediate team and broader organizational initiatives
  • Lead Projects & Delivery: Act as the primary technical lead for domain-specific projects, managing priorities across complex modules while ensuring high-quality execution
  • Collaborate Cross-Functionally: Work with Product Management, UI/UX, and Field Engineering to translate customer insights into successful technical executions
  • Mentor & Develop Talent: Coach junior and senior engineers, participate in hiring efforts, and conduct high-level technical interviews for system design and coding
What we offer
What we offer
  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups
  • Fulltime
Read More
Arrow Right

Staff Software Engineer (Backend)

At Cloudera, our Data Services Pillar is the heart of data innovation. We create...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
cloudera.com Logo
Cloudera
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience building enterprise-grade infrastructure or platform software with deep expertise in distributed systems
  • Hands-on experience developing Apache Spark or related technologies, with a strong understanding of system architecture and component interfaces
  • Production experience operating containerized workloads on Kubernetes (K8s) and Docker at scale
  • Advanced proficiency in data structures and algorithms, with a command of Java, Scala, Go, or Python
  • Experience with private cloud platforms (OpenShift/Rancher) and public cloud providers (AWS, Azure, or GCP)
  • Ability to influence technical planning and decision-making at a program level while maintaining excellent verbal and written communication
  • Bachelor’s, Master’s, or Ph.D. in Computer Science or a related field
Job Responsibility
Job Responsibility
  • Architect & Scale Core Systems: Design and evolve high-performance systems within the Data Engineering platform, focusing on the Spark ecosystem and surrounding cloud-native technologies
  • Solve Complex Challenges: Address non-routine technical problems requiring high levels of creativity and a deep understanding of distributed systems architecture
  • Own the Spark Experience: Build features that enhance Spark’s scale and reliability across production clusters ranging from hundreds to thousands of nodes
  • Provide Technical Leadership: Drive architectural discussions and provide technical direction for major projects, influencing both your immediate team and broader organizational initiatives
  • Lead Projects & Delivery: Act as the primary technical lead for domain-specific projects, managing priorities across complex modules while ensuring high-quality execution
  • Collaborate Cross-Functionally: Work with Product Management, UI/UX, and Field Engineering to translate customer insights into successful technical executions
  • Mentor & Develop Talent: Coach junior and senior engineers, participate in hiring efforts, and conduct high-level technical interviews for system design and coding
What we offer
What we offer
  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups
  • Fulltime
Read More
Arrow Right

Data Architect

Solirius Reply is looking for experienced Data Architects to work on projects wi...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
solirius.com Logo
Solirius Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience in stakeholder engagement and senior-level communication, including C-suite
  • Proven experience in client-facing and/or consultancy environments
  • Demonstrated ability to translate complex business and analytical requirements into scalable and resilient data architectures
  • Strong track record in designing and delivering end-to-end data platforms in enterprise settings
  • Expertise in conceptual, logical, and physical data modelling
  • Deep understanding of data platforms, data integration, and analytics architectures
  • Ability to design solutions that meet both functional and non-functional requirements, including performance, scalability, security, and compliance
  • Broad experience with data governance, data quality, master data management, and regulatory requirements
  • Advanced knowledge of cloud data platforms: Azure, AWS, and Google Cloud Platform (GCP)
  • Strong experience with data warehousing, data lakes, and lakehouse architectures
Job Responsibility
Job Responsibility
  • Design end-to-end data architectures that meet business, technical, and security requirements
  • Translate business and analytical requirements into scalable, secure, and cost-effective data platforms
  • Ensure alignment with enterprise data architecture, data strategy, and governance standards
  • Lead data architecture reviews and technical design workshops with stakeholders and delivery teams
  • Support Agile delivery teams, defining MVP data architecture and providing ongoing technical direction
  • Collaborate with stakeholders across business, product, and IT to gain buy-in and drive data-driven decisions
  • Define data models, data flows, metadata standards, and integration patterns
  • Contribute to data engineering, automation, and infrastructure-as-code practices for delivery at scale
  • Ensure data security, privacy, compliance, and risk management are embedded in the solution
  • Produce clear data architecture documentation using standards such as conceptual, logical and physical models, C4, Archimate, and cloud-native diagrams, including high-level designs and relevant data artefacts
What we offer
What we offer
  • 25 Days Annual Leave + Bank Holidays
  • Flexibility to work from home
  • 10 days allocated for development training per year
  • Generous Discretionary Bonus
  • Statutory & Contributory Pension
  • Private Healthcare Cover
  • Discounted Gym Membership
  • Enhanced Parental Leave
  • Paid Fertility Leave
  • Cycle to Work and Electric Vehicle schemes
  • Fulltime
Read More
Arrow Right

Principal Engineer

The Principal AI/ML Operations Engineer leads the architecture, automation, and ...
Location
Location
United States , Pleasanton, California
Salary
Salary:
251000.00 - 314500.00 USD / Year
blackline.com Logo
BlackLine
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field
  • 10+ years in ML infrastructure, DevOps, and software system architecture
  • 4+ years in leading MLOps or AI Ops platforms
  • Strong programming skills in languages such as Python, Java, or Scala
  • Expertise in ML frameworks (TensorFlow, PyTorch, scikit-learn) and orchestration tools (Airflow, Kubeflow, Vertex AI, MLflow)
  • Proven experience operating production pipelines for ML and LLM-based systems across cloud ecosystems (GCP, AWS, Azure)
  • Deep familiarity with LangChain, LangGraph, ADK or similar agentic system runtime management
  • Strong competencies in CI/CD, IaC, and DevSecOps pipelines integrating testing, compliance, and deployment automation
  • Hands-on with observability stacks (Prometheus, Grafana, Newrelic) for model and agent performance tracking
  • Understanding of governance frameworks for Responsible AI, auditability, and cost metering across training and inference workloads
Job Responsibility
Job Responsibility
  • Define enterprise-level standards and reference architectures for ML-Ops and AIOps systems
  • Partner with data science, security, and product teams to set evaluation and governance standards (Guardrails, Bias, Drift, Latency SLAs)
  • Mentor senior engineers and drive design reviews for ML pipelines, model registries, and agentic runtime environments
  • Lead incident response and reliability strategies for ML/AI systems
  • Lead the deployment of AI models and systems in various environments
  • Collaborate with development teams to integrate AI solutions into existing workflows and applications
  • Ensure seamless integration with different platforms and technologies
  • Define and manage MCP Registry for agentic component onboarding, lifecycle versioning, and dependency governance
  • Build CI/CD pipelines automating LLM agent deployment, policy validation, and prompt evaluation of workflows
  • Develop and operationalize experimentation frameworks for agent evaluations, scenario regression, and performance analytics
What we offer
What we offer
  • short-term and long-term incentive programs
  • robust offering of benefit and wellness plans
  • Fulltime
Read More
Arrow Right
New

Data Analyst

We are looking for a senior-level data analyst to lead customer experience insig...
Location
Location
United States , Mequon
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree required
  • coursework or focused study in analytics, data, business, or a related technical field is preferred
  • 4–7 years of experience in customer experience analytics, product analytics, journey analysis, or a closely related area
  • Demonstrated ability to build reporting that explains metric movement, performance variance, and the business implications behind the data
  • Hands-on experience with Qualtrics or a similar customer experience platform, including transactional surveys and digital feedback tools
  • Strong background in voice-of-customer analysis and combining feedback data with operational metrics to generate actionable insights
  • Proven ability to work independently, adapt quickly, and make progress in fast-moving or loosely defined environments
  • Effective partnership skills with cross-functional teams, with the ability to communicate insights clearly and support follow-through on actions
Job Responsibility
Job Responsibility
  • Produce recurring customer experience reports that highlight performance patterns, explain notable shifts, and connect findings to business impact
  • Maintain organized execution tracking for initiatives, ensuring priorities, owners, next steps, and results are clearly documented and reviewed regularly
  • Create insight communications such as briefs, summaries, and deep-dive analyses that clarify customer friction points, emerging trends, and recommended actions
  • Work closely with product, operations, technology, and customer experience partners to confirm findings, remove barriers, and drive progress on improvement efforts
  • Investigate customer journey issues by identifying root causes and translating data into practical recommendations for operational and experience enhancements
  • Manage customer feedback measurement activities using platforms such as Qualtrics, including survey setup, digital intercept support, and behavioral insight collection
  • Connect voice-of-customer inputs with operational and journey data to evaluate how customer signals influence service outcomes and business results
  • Tackle ambiguous analytical problems with minimal oversight, establishing structure, priorities, and next steps to keep initiatives moving forward
What we offer
What we offer
  • medical, vision, dental, life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Assistant Restaurant Manager - NOBU Bangkok

Ensure staff is working together as a team to ensure optimum service and that gu...
Location
Location
Thailand , Bangkok
Salary
Salary:
Not provided
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High school diploma or G.E.D. equivalent
  • At least 2 years of related work experience
  • At least 1 year of supervisory experience
Job Responsibility
Job Responsibility
  • Ensure staff is working together as a team to ensure optimum service and that guest needs are met
  • Inspect grooming and attire of staff, and rectify any deficiencies
  • Complete opening and closing duties including setting up necessary supplies and tools, cleaning all equipment and areas, locking doors, etc
  • Inspect storage areas for organization, use of FIFO, and cleanliness
  • Complete scheduled inventories and stock and requisition necessary supplies
  • Monitor dining rooms for seating availability, service, safety, and well being of guests
  • Complete work orders for maintenance repairs
  • Assist management in hiring, training, scheduling, evaluating, counseling, disciplining, and motivating and coaching employees
  • and serve as a role model and first point of contact of the Guarantee of Fair Treatment/Open Door Policy process
  • Follow all company and safety and security policies and procedures
  • Fulltime
Read More
Arrow Right
New

Senior Project Accountant

We are looking for a Senior Project Accountant to oversee the financial activity...
Location
Location
United States , Milwaukee
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Accounting or Finance is required
  • At least 5 years of experience in financial accounting, auditing, or project-based accounting roles
  • Demonstrated background in property accounting, project accounting, or accounting for real estate, construction, nonprofit, or grant-funded environments
  • Strong knowledge of financial reporting, account reconciliation, accrual accounting, and general ledger management
Job Responsibility
Job Responsibility
  • Maintain complete and accurate financial records for assigned properties, including rental revenue, operating costs, maintenance expenses, utilities, taxes, and other project-related transactions
  • Prepare monthly journal entries for accruals, prepaid items, intercompany charges, payroll allocations, reimbursements, and other recurring accounting activity
  • Oversee balance sheet activity by reconciling accounts, monitoring cash positions, and ensuring accounting treatment aligns with generally accepted accounting principles
  • Administer banking transactions such as account transfers and positive pay activity while tracking restricted and unrestricted cash balances appropriately
  • Monitor tenant receivables by documenting approvals, reviewing aging activity, and maintaining reserve calculations for uncollectible balances
  • Partner with property managers, operations staff, investors, and external stakeholders to address subledger discrepancies, project concerns, and financial questions
  • Contribute to annual budgets and ongoing forecasts by evaluating expected revenue, expenses, and cash flow trends and identifying opportunities to improve results
  • Produce monthly financial statements and variance analysis for each project, giving leadership and stakeholders clear insight into operational and financial performance
  • Support compliance obligations by reviewing governing agreements, establishing accounting procedures for new entities, managing project audits, completing required annual reporting, and recording construction draw activity when applicable
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Senior Customer Adoption Expert

The Senior Customer Adoption Expert will be responsible for leading the design, ...
Location
Location
United States , Pleasanton
Salary
Salary:
128000.00 - 161000.00 USD / Year
blackline.com Logo
BlackLine
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep understanding of accounting and financial processes
  • Advanced proficiency in BlackLine products and services
  • Extensive experience with ERP systems and integration
  • Excellent problem-solving and analytical skills
  • Strong communication and interpersonal skills
  • Ability to work independently and as part of a team
  • Bachelor's degree in Computer Science, Information Technology, or related field
  • 5-7 years of experience in a similar role
Job Responsibility
Job Responsibility
  • Leading the design, development, and implementation of advanced technical solutions that meet complex customer requirements and drive significant business value
  • Providing expert technical guidance
  • Collaborating with customers and internal teams
  • Ensuring the successful deployment and integration of BlackLine solutions
What we offer
What we offer
  • Short-term and long-term incentive programs
  • Robust offering of benefit and wellness plans
  • Fulltime
Read More
Arrow Right