CrawlJobs Logo

Lead Data Engineer (Enterprise Platforms Technology)

United States, McLean, Virginia Employment contract 197300.00 - 245600.00 USD / Year · Job Posted May 26, 2026
Apply Position
Job Link Share

Job Description

Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs.  We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One.  Enterprise Platforms Technology (EPTech) comprises many of Capital One’s most important enterprise platforms. We play an essential role in establishing practices for building technology solutions across the company, while also delivering capabilities that exemplify those practices.

Job Responsibility

  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Requirements

  • Bachelor's Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Nice to have

  • 7+ years of experience in application development including Python, SQL, Scala, or Java
  • 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
  • 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
  • 4+ year experience working on real-time data and streaming applications
  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
  • 4+ years of data warehousing experience (Redshift or Snowflake)
  • 4+ years of experience with UNIX/Linux including basic commands and shell scripting
  • 2+ years of experience with Agile engineering practices

What we offer

  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Incentives could be discretionary or non discretionary depending on the plan
  • Comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
  • Healthy Body, Healthy Mind
  • Save Money, Make Money
  • Time, Family and Advice

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Lead Data Engineer (Enterprise Platforms Technology)

8 matching positions

Data Engineering & Analytics Lead

Premium Health is seeking a highly skilled, hands-on Data Engineering & Analytic...
Location
Location
United States , Brooklyn
Salary
Salary:
Not provided
premiumhealth.org Logo
Premium Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred
  • Proven track record and progressively responsible experience in data engineering, data architecture, or related technical roles
  • healthcare experience preferred
  • Strong knowledge of data engineering principles, data integration, ETL processes, and semantic mapping techniques and best practices
  • Experience implementing data quality management processes, data governance frameworks, cataloging, and master data management concepts
  • Familiarity with healthcare data standards (e.g., HL7, FHIR, etc), health information management principles, and regulatory requirements (e.g., HIPAA)
  • Understanding of healthcare data, including clinical, operational, and financial data models, preferred
  • Advanced proficiency in SQL, data modeling, database design, optimization, and performance tuning
  • Experience designing and integrating data from disparate systems into harmonized data models or semantic layers
  • Hands-on experience with modern cloud-based data platforms (e.g Azure, AWS, GCP)
Job Responsibility
Job Responsibility
  • Collaborate with the CDIO and Director of Technology to define a clear data vision aligned with the organization's goals and execute the enterprise data roadmap
  • Serve as a thought leader for data engineering and analytics, guiding the evolution of our data ecosystem and championing data-driven decision-making across the organization
  • Build and mentor a small data team, providing technical direction and performance feedback, fostering best practices and continuous learning, while remaining a hands-on implementor
  • Define and implement best practices, standards, and processes for data engineering, analytics, and data management across the organization
  • Design, implement, and maintain a scalable, reliable, and high-performing modern data infrastructure, aligned with the organizational needs and industry best practices
  • Architect and maintain data lake/lakehouse, warehouse, and related platform components to support analytics, reporting, and operational use cases
  • Establish and enforce data architecture standards, governance models, naming conventions ,and documentation
  • Develop, optimize, and maintain scalable ETL/ELT pipelines and data workflows to collect, transform, normalize, and integrate data from diverse systems
  • Implement robust data quality processes, validation, monitoring, and error-handling frameworks
  • Ensure data is accurate, timely, secure, and ready for self-service analytics and downstream applications
What we offer
What we offer
  • Paid Time Off, Medical, Dental and Vision plans, Retirement plans
  • Public Service Loan Forgiveness (PSLF)
  • Fulltime
Read More
Arrow Right

Enterprise Technology & Solutions Platforms Technical Leader

The Enterprise Technology & Solutions Platforms Technical Leader is responsible ...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
alterdomus.com Logo
Alter Domus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of management or technical leadership experience, including direct line management of software engineers or technical leads
  • Proven ability to balance leadership and hands-on technical contribution
  • Experience configuring and supporting collaboration platforms like Jira, Confluence, Azure Devops, ServiceNow or equivalent
  • Experience with .NET, C#, Javascript, MSSQL, Python or equivalent
  • Expertise in data integration, ETL, and data pipeline engineering, ideally with hands on experience on Airflow & DBT
  • Deep understanding of API design, service orchestration, and secure, scalable architecture
  • Demonstrated success running critical services in production environments, with a focus on performance, reliability, and security
  • Proficiency in CI/CD practices, DevOps principles, and modern cloud or hybrid infrastructure
  • Excellent collaboration and communication skills
Job Responsibility
Job Responsibility
  • Provide technical leadership and hands on development across the full software development lifecycle
  • Apply Lean and Agile principles to develop secure, scalable, and supportable solutions
  • Collaborate with Solution Architects, Business Partners/Technical Domain Leaders, and Business Analysts to translate business needs into robust, integrated technology solutions
  • Champion best practices for data integration, code development, testing working closely with SRE and security teams
  • Apply Site Reliability Engineering (SRE) principles to maintain and improve the availability, performance, and security of all supported platforms
  • Oversee release management, CI/CD pipelines, and deployment processes
  • Manage and mentor a team of 2–5 engineers, architects, and system administrators
  • Drive initiatives to reduce technical debt, improve maintainability, and streamline platform operations
What we offer
What we offer
  • Support for professional accreditations
  • Flexible arrangements, generous holidays, plus an additional day off for your birthday
  • Continuous mentoring along your career progression
  • Active sports, events and social committees across our offices
  • 24/7 support available from our Employee Assistance Program
  • The opportunity to invest in our growth and success through our Employee Share Plan
  • Fulltime
Read More
Arrow Right

Enterprise Data Architect

The Enterprise Data Architect (EDA) is responsible for defining and advancing th...
Location
Location
United States , San Mateo
Salary
Salary:
200000.00 - 275000.00 USD / Year
verkada.com Logo
Verkada
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or related field
  • 10+ years of experience in data architecture, data engineering, or enterprise systems integration
  • Proven track record in designing enterprise-level data architectures in complex, multi-system environments
  • Expertise in data modeling, MDM, Meta Data, and data governance frameworks
  • Experience with cloud-based data platforms (AWS, Azure, GCP) and modern data stacks (e.g., Redshift, BigQuery, Snowflake)
  • Experience with integration platforms (ETL/ELT, APIs, event streaming, middleware)
  • Knowledge of data security (tokenization, encryption, access controls) and compliance frameworks
  • Strong ability to influence cross-functional stakeholders and drive consensus across departments
  • Excellent communication skills, capable of presenting complex data concepts to both technical and non-technical audiences
  • Strategic thinker with the ability to balance long-term architecture vision with short-term delivery needs
Job Responsibility
Job Responsibility
  • Define and own the enterprise data strategy in alignment with corporate goals
  • Design and maintain comprehensive data architecture spanning ERP, HRIS, CRM, ATS, Finance, and other core business systems
  • Ensure the architecture supports scalability, performance, and resilience as the company grows
  • Lead initiatives to break down data silos and establish trusted, unified sources of truth across the organization
  • Champion a company-wide data governance framework
  • Facilitate Regular Meetings
  • Drive Cross-Functional Collaboration
  • Identify & Track Data Gaps
  • Coordinate Remediation Efforts
  • Implement Monitoring & Alerts
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

We are looking for a Data Engineer to join our team and support with designing, ...
Location
Location
Salary
Salary:
Not provided
foundever.com Logo
Foundever
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 7 years plus experience in data engineering
  • Track record of deploying and maintaining complex data systems at an enterprise level within regulated environments
  • Expertise in implementing robust data security measures, access controls, and monitoring systems
  • Proficiency in data modeling and database management
  • Strong programming skills in Python and SQL
  • Knowledge of big data technologies like Hadoop, Spark, and NoSQL databases
  • Deep experience with ETL processes and data pipeline development
  • Strong understanding of data warehousing concepts and best practices
  • Experience with cloud platforms such as AWS and Azure
  • Excellent problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Design and optimize complex data storage solutions, including data warehouses and data lakes
  • Develop, automate, and maintain data pipelines for efficient and scalable ETL processes
  • Ensure data quality and integrity through data validation, cleansing, and error handling
  • Collaborate with data analysts, machine learning engineers, and software engineers to deliver relevant datasets or data APIs for downstream applications
  • Implement data security measures and access controls to protect sensitive information
  • Monitor data infrastructure for performance and reliability, addressing issues promptly
  • Stay abreast of industry trends and emerging technologies in data engineering
  • Document data pipelines, processes, and best practices for knowledge sharing
  • Lead data governance and compliance efforts to meet regulatory requirements
  • Collaborate with cross-functional teams to drive data-driven decision-making within the organization
What we offer
What we offer
  • Impactful work
  • Professional growth
  • Competitive compensation
  • Collaborative environment
  • Attractive salary and benefits package
  • Continuous learning and development opportunities
  • A supportive team culture with opportunities for occasional travel for training and industry events
Read More
Arrow Right

Customer & Marketing Data Engineering Manager

This hybrid role blends marketing strategy, customer analytics, and hands-on eng...
Location
Location
United States , Springfield
Salary
Salary:
Not provided
capstonec.com Logo
Capstone IT Staffing
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years in digital marketing, data analytics, or data engineering
  • 4+ years in a leadership role
  • Expertise with modern marketing and data technologies: Snowflake, SQL, Python, dbt, Airflow, Google Analytics, Tableau, Power BI
  • Strong background in connecting MarTech ecosystems (CRM, automation, attribution tools) to enterprise data platforms
  • Ability to turn marketing goals into clear technical plans and measurable results
  • Exceptional communication skills and comfort working across technical, marketing, and executive teams
  • Bachelor’s degree in Marketing, Computer Science, Data Analytics, or related field
Job Responsibility
Job Responsibility
  • Build and execute data-driven digital marketing strategies that boost customer acquisition, retention, and engagement
  • Analyze customer behavior, campaign performance, and conversion data—turning insights into action
  • Partner with Marketing and Data teams to enable personalization, targeting, and unified reporting
  • Optimize digital channels (email, social, web) to improve ROI and customer experiences
  • Integrate CRM, analytics, and marketing automation tools into enterprise data platforms
  • Lead and mentor a cross-functional team of data engineers, BI developers, and analysts
  • Oversee the development of scalable data pipelines, integrations, and analytics infrastructure (Snowflake, dbt, Airflow)
  • Roll up your sleeves to help design data models, review workflows, and troubleshoot complex technical challenges
  • Modernize outdated systems and implement forward-looking data architectures
  • Align engineering and marketing roadmaps to ensure technology fuels business outcomes
Read More
Arrow Right

Lead Platform Manager

The Team Lead Platform Manager Integration is responsible for the delivery, stab...
Location
Location
United Kingdom , Birmingham
Salary
Salary:
64500.00 GBP / Year
welovesalt.com Logo
Salt
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong integration delivery and engineering skills covering enterprise scale system connectivity and API development
  • Ability to lead complex technology services and balance technical needs with supplier performance
  • Strong understanding of Azure integration tooling
  • Supplier and stakeholder management skills
  • Ability to lead technical teams and set direction across support and delivery
  • Strong knowledge of Azure integration services and native cloud components
  • Good understanding of ERP or major enterprise systems such as Oracle or P6 and how they integrate
  • Knowledge of integration security principles and data transfer risks
  • Knowledge of agile and waterfall delivery approaches
  • Proven experience delivering enterprise scale integrations in a senior or lead position
Job Responsibility
Job Responsibility
  • Own the design, delivery and performance of integration services across the organisation
  • Lead the support and stabilisation of existing integration platforms including point to point links, automated interfaces and API based services
  • Develop and implement an enterprise integration strategy for internal systems and external third parties, suppliers, and partners
  • Oversee Azure integration services including API Management, Logic Apps, Azure Monitor and other native cloud components
  • Lead internal teams and suppliers providing integration development, support and operational services
  • Define technical standards, security controls and design patterns for all integration work
  • Ensure integration services meet SLAs and KPIs and deliver improvements where needed
  • Lead the identification and resolution of integration related issues, risks and vulnerabilities
  • Support integration activity across programmes using agile or waterfall delivery depending on project needs
  • Promote a consistent and inclusive approach across all workstreams
  • Fulltime
Read More
Arrow Right

Data Platform Architect

We are seeking a Data Platform Architect to join our Data Platform team. This ro...
Location
Location
United States , San Francisco
Salary
Salary:
253500.00 - 380500.00 USD / Year
gofundme.com Logo
GoFundMe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in data architecture, platform engineering, or data engineering, with at least 3+ in a senior or architect role
  • Proven expertise with modern cloud-native data stacks including Snowflake, Databricks, MDM, Data Catalogs and CDPs
  • Hands-on experience with Looker or other BI/semantic modeling tools
  • Strong understanding of graph-based data models, recommendation systems, and personalization architectures
  • Expertise in data modeling, metadata management, and semantic layers
  • Proficiency with streaming/event-driven data pipelines and real-time processing (Kafka, Pub/Sub, Spark Streaming, etc.)
  • Familiarity with AI/ML pipelines, feature stores, and unstructured/structured data integration
  • Strong foundation in data governance, lineage, cataloging, and compliance frameworks
  • Excellent communication and leadership skills to align technical direction across diverse teams
Job Responsibility
Job Responsibility
  • Modernize, optimize and evolve a cloud-native data stack into a scalable, secure and high performing ecosystem such as SQL & NoSQL repositories for diverse workloads
  • Leverage modern data platform principles including lakehouse, data fabric and data mesh architectures to improve scalability, decentralization, governance, and interoperability
  • Design Scalable Architectures: Build flexible architectures to support analytics, real-time reporting, AI/ML Ops pipelines, feature stores, and graph-based data relationships
  • Unified Data Platform: Design high performing and cost effective solutions that handle both structured and unstructured data at high volume and high velocity
  • Establish Modeling Standards: Define enterprise-wide standards for data modeling, semantic layers, and golden datasets to enable consistency and reuse
  • Advance Governance & Quality: Implement frameworks for data lineage, quality, privacy, and security (GDPR, CCPA, PII protections)
  • Enable Personalization & Insights: Architect data capabilities that fuel advanced recommendations, relationship mapping, and connected user experiences
  • Evaluate & Integrate Technologies: Guide adoption of best-fit technologies to support evolving use cases in data science, AI, and scalable analytics
  • Partner Cross-Functionally: Collaborate with engineering, product, analytics, and data science teams to translate business vision into technical solutions
  • Mentor & Lead: Provide architectural leadership, coaching engineers on best practices while influencing strategic platform decisions
What we offer
What we offer
  • Make an Impact: Be part of a mission-driven organization making a positive difference in millions of lives every year
  • Innovative Environment: Work with a diverse, passionate, and talented team in a fast-paced, forward-thinking atmosphere
  • Collaborative Team: Join a fun and collaborative team that works hard and celebrates success together
  • Competitive Benefits: Enjoy competitive pay and comprehensive healthcare benefits
  • Holistic Support: Enjoy financial assistance for things like hybrid work, family planning, along with generous parental leave, flexible time-off policies, and mental health and wellness resources to support your overall well-being
  • Growth Opportunities: Participate in learning, development, and recognition programs to help you thrive and grow
  • Commitment to DEI: Contribute to diversity, equity, and inclusion through ongoing initiatives and employee resource groups
  • Community Engagement: Make a difference through our volunteering program
  • equity
  • Fulltime
Read More
Arrow Right

Enterprise Data Architect

As an Enterprise Data Architect, candidate will be one of our most senior techni...
Location
Location
India , Kochi;Trivandrum
Salary
Salary:
Not provided
experionglobal.com Logo
Experion Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years progressive hands-on experience in data engineering and enterprise architecture
  • Recent experience writing production-quality code, building prototypes, and directly contributing to codebase
  • Extensive experience designing/building large-scale resilient data platforms from scratch across hybrid/on-premise/multi-cloud infrastructures
  • Deep hands-on architectural expertise in AWS or Azure with familiarity in second cloud platform
  • Code-level expertise in major open-source data frameworks (Spark, Flink, Trino) with ability to modify/extend OSS source code
  • Mastery of batch, real-time streaming, and event-driven architectural patterns
  • Experience leading technical strategy for complex, high-value RFPs/RFIs for global enterprise customers
  • Modern Data Architecture expertise with RDBMS, ETL, NoSQL, Data Warehousing, Data Governance, Data Modeling
  • Performance Optimization skills with Cloud Datawarehouse platforms (Snowflake/BigQuery/DataBricks)
  • Python and SQL programming proficiency
Job Responsibility
Job Responsibility
  • Architect and deliver enterprise-grade data platforms across on-premises, hybrid, and multi-cloud (AWS, Azure) environments, owning technical roadmap from conception to implementation
  • Actively build proof-of-concepts and prototypes to validate architectural decisions, explore new technologies, and de-risk complex implementations
  • Write code for critical framework components and customize open-source tools by diving into source code to meet unique client requirements
  • Serve as ultimate technical authority in customer meetings and RFPs/RFIs, architecting credible, hands-on solutions that inspire client confidence
  • Mentor senior engineers and architects, establishing best practices in coding, design, and deployment with hands-on work ethic
  • Act as final escalation point for challenging performance, scalability, and design issues, leading diagnosis and resolution efforts
Read More
Arrow Right