CrawlJobs Logo
The Muse Logo The Muse · IT - Software Development

Lead Data Engineer

· Job Posted February 18, 2026
Apply Position
Job Link Share

Job Description

Arcadia is the only healthcare data and software company dedicated to healthcare organizations achieving financial success in value-based care. The Arcadia Data Engineering team onboards and supports the data feed integrations between Client Claim and Clinical data management platforms and our Healthcare Solution Platform. Our customers are top Healthcare providers and payers, and we help them integrate their internal systems with our analytic platform. The Data Engineering team is responsible for the data architecture that drives the partnership with customers and other internal organizations to drive success through adoption of cutting edge analytic solutions that leverage new age technologies and best practices. Our Data Engineers require both SQL Database knowledge and design , along with multiple programing languages.

Job Responsibility

  • Drive the successful development of solution architecture and the completion of data pipeline connectors that automate the flow of data between client Claim and Clinical data platforms and our analytic health solution platform
  • Improving the process of how we design and document data pipelines
  • Identifying high leverage improvement projects and driving them to completion
  • Support of our processes in partaking in peer code reviews, sprint planning, product grooming, maintaining Jira tasks and peer test reviews
  • Contribute to multiple implementations simultaneously, which will include both new customer setup as well as support and enhancements for existing customers
  • Responsible for delivery of work on expected timelines
  • Able to identify risk to project success and communicate to leadership
  • Works mostly independently on delivery w/decreasing involvement from engineering and more senior team members
  • Able to apply critical thinking and problem solving skills to propose solutions for complex problems within day to day work
  • Develop a deep understanding of our systems so you can work on projects to improve them
  • Developing ability to understand technical issues and communicate potential solutions to team members or engineering team
  • Developing working knowledge of the business of healthcare data and how it interacts within the Arcadia products
  • Understanding of shared value contracts that our customers are in and how data is impacted by them
  • Developing knowledge of industry data expected values such as PMPM by LOBs, MM trends, etc.
  • Developing internal and external professional communication skills including presentation of issues using appropriate industry vocabulary
  • Responsible for contributing to the advancement of team processes and internal

Requirements

  • Senior Experience Level of 5-8 years post-grad with relevant industry experience or graduate level degree
  • SQL: 5+ years (Preferred)
  • Python: 3+ years (Preferred)
  • Spark: 4+ years (Preferred)
  • Database Architecture: 2-3 years (Preferred)
  • Cloud Architecture: 1-2 years (Preferred)
  • Healthcare Data: 2-4 years (Preferred)
  • Healthcare Analytics: 1-3 years (Preferred)

Nice to have

  • AWS (S3 and EC2): 2-3 years
  • Nifi: 3- 5 years
  • Kafka: 3-5 years
  • Java : 3-5 years
  • Healthcare Analytics: 3-5 years

What we offer

  • Pet Insurance
  • Health Insurance
  • Dental Insurance
  • Vision Insurance
  • FSA
  • HSA
  • HSA With Employer Contribution
  • Life Insurance
  • Short-Term Disability
  • Long-Term Disability
  • Fitness Subsidies
  • Mental Health Benefits
  • Family Support Resources
  • Non-Birth Parent Or Paternity Leave
  • Adoption Leave
  • Fertility Benefits
  • Birth Parent Or Maternity Leave
  • Hybrid Work Opportunities
  • Flexible Work Hours
  • Remote Work Opportunities
  • Casual Dress
  • Pet-Friendly Office
  • Snacks
  • Company Outings
  • Commuter Benefits Program
  • Paid Vacation
  • Unlimited Paid Time Off
  • Paid Holidays
  • Personal/Sick Days
  • Leave Of Absence
  • 401(K) With Company Matching
  • 401(K)
  • Performance Bonus
  • Work Visa Sponsorship
  • Promote From Within
  • Access To Online Courses
  • Lunch And Learns
  • Diversity, Equity, And Inclusion Program
  • Employee Resource Groups (ERG)
The Muse - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Lead Data Engineer

8 matching positions

New

Lead Data Engineer

Within COO Technology, Wells Fargo is seeking a Lead Data Engineer to help shape...
Location
Location
United States , Iselin; Charlotte; Irving
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
June 08, 2026
Flip Icon
Requirements
Requirements
  • 5+ years of Database Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 5+ years of data management experience within Public Cloud (GCP, AWS, Azure)
  • 5+ years of hands on experience of Python or Java, plus Spark SQL for building data pipelines, libraries, and automation tooling.
  • 5+ years with orchestration tools (Cloud Composer/Airflow) and CI/CD (Cloud Build, Git‑based workflows) for data workloads
Job Responsibility
Job Responsibility
  • Design and implement scalable, secure data platforms on Google Cloud using managed services (BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer).)
  • Build reusable frameworks and tooling (ingestion, transformation, quality, orchestration) that can be adopted by multiple product and domain teams.
  • Enable self‑service data consumption and governance by standardizing patterns, templates, and platform capabilities rather than one‑off pipelines.
  • Design logical and physical data platform architectures leveraging BigQuery, Dataflow/Apache Beam, Dataproc/Spark, Pub/Sub, and Cloud Storage.
  • Define and implement standardized ingestion, transformation, and serving patterns (batch and streaming) as reusable blueprints.
  • Optimize cost, performance, and reliability of GCP data workloads (partitioning, clustering, storage classes, autoscaling strategies).
  • Build opinionated data ingestion frameworks (e.g., config‑driven pipelines, connectors, schema handling, error handling) on top of Dataflow, Dataproc, or Composer.
  • Develop shared transformation libraries in Python/SQL/Beam (e.g., common SCD patterns, data quality checks, masking/tokenization routines).
  • Provide orchestration capabilities via Cloud Composer or Cloud Workflows with reusable DAGs/templates and CI/CD integration.
  • Implement robust data modeling (dimensional, data vault, or canonical models) and semantic layers in BigQuery and related tools.
What we offer
What we offer
  • Health benefits
  • 401(k) Plan
  • Paid time off
  • Disability benefits
  • Life insurance, critical illness insurance, and accident insurance
  • Parental leave
  • Critical caregiving leave
  • Discounts and savings
  • Commuter benefits
  • Tuition reimbursement
  • Fulltime
!
Read More
Arrow Right
New

Lead Data Engineer

Wells Fargo is seeking a Lead Data Engineer
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
June 07, 2026
Flip Icon
Requirements
Requirements
  • 6+ years of Data Engineering experience
  • 6+ years of Strong Experience of Spark/Scala of scala:map,flatMap,option,future,lazy,implicits,fold,immutability, Spark Core, Spark SQL, Data Frames, Datasets
  • 3+ Experience on Python or other scripting languages
  • 3+ years of data warehouse experience, SQL experience (Oracle, SQL, PL/SQL). Understand and write the complex SQL queries and have in-depth understanding of oracle database
  • Prior experience of leading the teams and running the major programs
  • Strong experience with Hadoop, Hive, Autosys
  • Good knowledge of non-relational DBMS platforms, (MongoDB or Neo4j), real-time data streaming via Kafka
  • Working knowledge in developing end to end ML/AI pipeline in Apache Spark, Sparkling Waters, H2O, experience in working on LLMs. Exposer to Agentic AI frameworks
  • Ability to work with Data Engineers in discovering and optimizing bottlenecks in the AI/ML pipeline for real-time or near-real-time applications that consumes large throughput of data
  • Perform various complex activities related to statistical/machine learning. Provide analytical support for developing, evaluating, implementing, monitoring and executing models across business verticals using emerging technologies including but not limited to Python, Agentic AI frameworks like ADK, GCP vertex AI and NLP
Job Responsibility
Job Responsibility
  • Lead moderately complex initiatives within Technology and contribute to large scale data processing framework initiatives related to enterprise strategy deliverables
  • Build and maintain optimized and highly available data pipelines that facilitate deeper analysis and reporting
  • Review and analyze moderately complex business, operational or technical challenges that require an in-depth evaluation of variable factors
  • Oversee the data integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis
  • Resolve moderately complex issues and lead teams to meet data engineering deliverables while leveraging solid understanding of data information policies, procedures and compliance requirements
  • Collaborate and consult with colleagues and managers to resolve data engineering issues and achieve strategic goals
  • Fulltime
!
Read More
Arrow Right

Lead Data Engineer

Rapid7 is seeking a Data Engineer, Data Engineering & Analytics to join a high-p...
Location
Location
India , Pune
Salary
Salary:
Not provided
rapid7.com Logo
Rapid7
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ability to thrive in a fast-paced hybrid organization
  • Comfort working in a highly agile, intensely iterative environment
  • Demonstrated capacity to clearly and concisely communicate complex business activities, technical requirements, and recommendations
  • 8+ years of experience in data engineering, analytics, or business intelligence
  • 8+ years experience designing, implementing, operating, and extending enterprise dimensional data models
  • 3+ years experience building reports and dashboards in Tableau and/or other similar data visualization tools
  • Experience in DBT modeling and understanding modular, performant models
  • Solid understanding of Snowflake, SQL, and data warehouse management
  • Understanding of ETL/ELT processes, data pipelines, and cloud-based data architectures
  • Familiarity with modern data stacks (DBT, Airflow, Fivetran, Matillion, or similar tools)
Job Responsibility
Job Responsibility
  • Implement data modeling best practices to enhance data accessibility and reporting capabilities
  • Ensure data integrity, security, and compliance with industry standards and regulations
  • Document plans and results in user-stories, issues, PRs, the team’s handbook - following the tradition of documentation first
  • Implement the Corp Data philosophy in everything you do
  • Craft code that meets our internal standards for style, maintainability, and best practices for a high-scale database environment
  • Maintain and advocate for these standards through code review
  • Collaborate with IT and DevOps teams to optimize cloud infrastructure and data governance policies
  • Manage and enhance the existing Tableau reporting suite, ensuring self-service analytics and actionable insights for stakeholders
  • Design, develop, and extend DBT code repository to extend the Enterprise Dimensional Warehouse capabilities and infrastructure
  • Develop and maintain a single source of truth for business metrics, ensuring consistency across reporting platforms
  • Fulltime
Read More
Arrow Right

Lead Data Engineer

Join us as a Lead Data Engineer. At Barclays, we don’t just adapt to the future,...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong SQL skills for complex queries, optimization, and performance tuning
  • Knowledge of batch and real-time data processing patterns including understanding with streaming technologies (like Kafka)
  • Experience with Spark for distributed data processing
  • Experience building and maintaining robust ETL/ELT pipelines
  • Data modeling expertise (dimensional modeling, star/snowflake schemas)
  • Hands-on experience with data quality frameworks and validation
  • Proven Experience in designing and implementing scalable data solutions on public cloud
  • Deep knowledge of data services like: AWS S3, Redshift, Athena
  • Understanding of security, IAM, VPC, and cost optimization
  • Proficient in Python or Java for data processing
Job Responsibility
Job Responsibility
  • Design, develop and improve software, utilising various engineering methodologies, that provides business, platform, and technology capabilities for our customers and colleagues
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
  • Fulltime
Read More
Arrow Right

Lead Data Engineer

Lead Data Engineer Do you love building and pioneering in the technology space?...
Location
Location
United States , San Francisco
Salary
Salary:
215200.00 - 245600.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Lead Data Engineer

Rapid7 is seeking a Data Engineer, Data Engineering & Analytics to join a high-p...
Location
Location
India , Pune
Salary
Salary:
Not provided
rapid7.com Logo
Rapid7
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in data engineering, analytics, or business intelligence
  • 8+ years experience designing, implementing, operating, and extending enterprise dimensional data models
  • 3+ years experience building reports and dashboards in Tableau and/or other similar data visualization tools
  • Experience in DBT modeling and understanding modular, performant models
  • Solid understanding of Snowflake, SQL, and data warehouse management
  • Understanding of ETL/ELT processes, data pipelines, and cloud-based data architectures
  • Familiarity with modern data stacks (DBT, Airflow, Fivetran, Matillion, or similar tools)
  • Hands-on experience building and operating cloud infrastructure on AWS
  • Experience managing software installations, upgrades, and configuration in production environments
  • Ability to manage data governance, security, and compliance requirements (SOC 2, GDPR, etc.)
Job Responsibility
Job Responsibility
  • Implement data modeling best practices to enhance data accessibility and reporting capabilities
  • Ensure data integrity, security, and compliance with industry standards and regulations
  • Document plans and results in user-stories, issues, PRs, the team’s handbook - following the tradition of documentation first
  • Implement the Corp Data philosophy in everything you do
  • Craft code that meets our internal standards for style, maintainability, and best practices for a high-scale database environment
  • Maintain and advocate for these standards through code review
  • Collaborate with IT and DevOps teams to optimize cloud infrastructure and data governance policies
  • Manage and enhance the existing Tableau reporting suite, ensuring self-service analytics and actionable insights for stakeholders
  • Design, develop, and extend DBT code repository to extend the Enterprise Dimensional Warehouse capabilities and infrastructure
  • Develop and maintain a single source of truth for business metrics, ensuring consistency across reporting platforms
  • Fulltime
Read More
Arrow Right

Lead Data Engineer

Lead Data Engineer Do you love building and pioneering in the technology space?...
Location
Location
United States , Richmond; McLean; Cambridge
Salary
Salary:
179400.00 - 225100.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Lead Data Engineer

A Lead Data Engineer builds, maintains and supports our data warehouse, deliveri...
Location
Location
Turkey , Istanbul
Salary
Salary:
Not provided
redcloudtechnology.com Logo
RedCloud
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Technical skills across SQL, Database Design (snowflake, PostgreSQL, MySQL) and Python
  • Mentor all levels of engineers and new starters in the team
  • Communicate effectively and clearly to those within your team and across the business
Job Responsibility
Job Responsibility
  • Architect Data Warehouse
  • Design, Build and Maintain ELT Solutions
  • Deliver Data Insights
  • Resolve Bugs
  • Handle production Outages / issues
  • Estimate Features / Bugs
  • Refine feature requirements
  • Carry out code reviews
  • Keeping pace with Technology
What we offer
What we offer
  • 25 Days Annual leave, increasing to 26 days after 12 months in the business
  • Enhanced Company Pension (Matched up to 5% & Salary Sacrifice)
  • Healthcare Cashplan with Medicash
  • Private Healthcare with Aviva
  • Life Insurance with AIG
  • Happl benefit platform with pre-negotiated discounts
  • Stock / Equity (new scheme being established post IPO)
  • Fulltime
Read More
Arrow Right