CrawlJobs Logo
Robert Half Logo Robert Half · IT - Software Development

Data Engineer III

United States, San Ramon Employment contract · Job Posted June 15, 2026
Apply Position
Job Link Share

Job Description

Robert Half, one of FORTUNE’s World’s Most Admired Companies and a Fortune 100 Best Companies to Work For is hiring for a Data Engineer III to join the ATI Data Science Innovation department.

Job Responsibility

  • Lead architecture and design of complex data pipelines on Databricks lakehouse architecture (Unity Catalog, Delta Lake, Structured Streaming)
  • Define technical approach for data engineering initiatives, mentor less-senior engineers, and set standards for code quality through leadership and code reviews
  • Design and build data foundations that enable AI/ML capabilities — feature stores, embedding pipelines, vector search indexes, and model training datasets
  • Align data engineering solutions with business strategy, including support for Agentic AI workloads
  • Own health, scalability, and modernization of data infrastructure with Databricks as the strategic platform — including workload migration, compute optimization, and Unity Catalog adoption
  • Optimize pipeline performance (Delta Lake table layouts, clustering, Z-ordering) and establish monitoring/alerting best practices with clear SLAs
  • Build data infrastructure supporting Agentic AI systems — real-time data access layers, context retrieval pipelines, and agent-accessible data services
  • Collaborate cross-functionally with DevOps, Platform Engineering, and MLOps roles to integrate data solutions into the broader technology environment and shared AI infrastructure – Mlflow registries, feature stores, and agent orchestration layers
  • Provide consultation to Senior Leadership on complex projects and drive continuous improvement initiatives
  • Champion data governance at all layers for data, models, and AI assets
  • Implement data quality strategies (master data management, validation rules, Delta Live Tables expectations) to ensure trust in enterprise data
  • Serve as liaison across data engineering, AI engineering, and business teams
  • promote data literacy and stewardship

Requirements

  • Bachelor's in Computer Science, Engineering, or related field (Master's preferred)
  • 5+ years with Python and SQL in data engineering for big data ML/analytics workloads
  • 5+ years designing, building, and troubleshooting scalable ETL/ELT pipelines for business-critical production systems
  • 3+ years with cloud data services (AWS), container orchestration (Docker, Kubernetes), and IaC (Terraform, CloudFormation)
  • 3+ years architecting ML workflows and data platforms with CI/CD, automated testing, and distributed processing (Spark)
  • 3+ years collaborating cross-functionally with Data Science, MLOps, Platform Engineering, and DevOps teams
  • 3+ years implementing data quality testing and optimizing SQL/Python for cost/performance in the cloud
  • Understanding of the full Data Science SDLC, and experience mentoring engineers
  • Strongly Preferred - 2+ years hands-on with Databricks (Delta Lake, Unity Catalog, Databricks SQL)
  • Experience with MLflow experiment tracking and model registry workflows
  • Experience designing pipelines that serve AI/ML inference — real-time feature engineering, embedding generation, and context retrieval for LLM-based systems
  • Understanding of how data engineering supports Agentic AI: agent-accessible data services, low-latency retrieval, and pipelines enabling autonomous multi-step workflows
  • Familiarity with Databricks Mosaic AI, Vector Search, and/or Feature Store
  • FinOps awareness — compute cluster optimization, cost attribution by workload

Nice to have

  • Familiarity with Salesforce/Heroku data infrastructures
  • Experience with data virtualization (e.g., Dremio)
  • Understanding of Platform Engineering concepts and internal developer platforms
  • Experience migrating from legacy data warehouse/lake to unified lakehouse architecture
  • Familiarity with Odaseva data security and management

What we offer

  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • free online training
Robert Half - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer III

8 matching positions

Data Engineer III

As a Data Engineer III at BST Global, you will be leading the design, developmen...
Location
Location
United States , Tampa
Salary
Salary:
Not provided
bstglobal.com Logo
BST Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced to expert experience with programming languages such as SQL, Python and/or Scala
  • Experience designing and implementing relational and data warehouse schemas
  • Experience with Databricks and building robust data pipelines using ETL/ELT techniques
  • Skilled with version control tools like Git
  • Expert experience leveraging Azure and Microsoft Fabric to design, build and deploy robust data-centric processes
  • Deep knowledge of workflow and orchestration tools such as Apache Airflow
  • Power BI report and Semantic Model design experience
  • Working knowledge of AI and machine learning a plus
  • Passionate & Driven
  • Analytical Thinker & Problem-Solver
Job Responsibility
Job Responsibility
  • Leading the design, development, testing, and maintenance of software products
  • Collaborate with cross-functional teams to implement core product features, troubleshoot issues and optimize application performance
  • Write, test, debug and optimize code that meets business requirements and conforms to established patterns and practices
  • Author unit tests that adhere to code coverage guidelines
  • Participate in Agile ceremonies
  • Learn and apply software engineering design and development standards
  • Solicit feedback from peers while mentoring and coaching junior engineers
  • Communicate progress, issues and risks to stakeholders
  • Accurately estimate assignments
  • Create and maintain technical documentation
  • Fulltime
Read More
Arrow Right

Data Engineer III

Under limited supervision, the Software Engineer III develops information system...
Location
Location
United States
Salary
Salary:
Not provided
genpt.com Logo
Genuine Parts Company
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Typically requires a bachelor’s degree in computer science, software engineering, or a related field and five (5) to eight (8) years of related experience
  • or equivalent combination.
  • Manages multiple tasks simultaneously while meeting deadlines.
  • Possess the latest knowledge on new technology and computer systems.
  • Communicates complex procedures to other colleagues.
  • Understands the latest trends and their role in a commercial environment.
  • Pays close attention to detail and desires to probe further into data.
Job Responsibility
Job Responsibility
  • Designs and constructs moderately complex interfaces between ERP and legacy systems.
  • Provides production support of moderately complex applications in production by troubleshooting issues, proposing solutions, developing and testing fixes, and migrating solutions.
  • Uses back-end programming languages, as well as front-end script languages to optimize performance, scalability, and security.
  • Codes programming logic for new or existing solutions software or applications following design specifications put in place by senior software development staff and leadership.
  • Handles installation, configuration, development, workflow design, monitoring, and/or upgrade of assigned software products.
  • Maintains up-to-date records of issues with existing code.
  • Monitors quality and performance of applications through testing and maintenance.
  • Develops and maintains applications for business processes and systems.
  • Responsible for ensuring adherence to development best practices and standards of associate application developers and application developers within their immediate group and may be required to represent IT on particular projects.
  • Identifies opportunities for process and procedure enhancements and communicates them to other departments/areas to drive efficiency and customer service levels.
What we offer
What we offer
  • Options for healthcare coverage
  • 401(k)
  • Tuition reimbursement
  • Vacation
  • Sick pay
  • Holiday pay
  • Flexible Working Schedules
  • Wellbeing Programs
  • Learning Opportunities
  • Community Engagement
  • Fulltime
Read More
Arrow Right

Data Engineer III

At Retail Insight, data isn’t just an asset—it’s the engine that powers our prod...
Location
Location
United States , Chicago
Salary
Salary:
115000.00 - 130000.00 USD / Year
retailinsight.io Logo
Retail Insight
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience managing and optimising large‑scale MSSQL databases (TBs in size)
  • Expert knowledge of T‑SQL, performance tuning, monitoring, and SQL administration
  • Hands‑on experience designing, implementing, and supporting MSSQL and Azure SQL environments
  • Familiarity with SSIS, CI/CD, Azure, and scripting languages (PowerShell, Python)
  • Exposure to cloud‑based data warehouses such as Snowflake or BigQuery
  • Ability to quickly learn and adopt emerging technologies and data patterns
  • Experience working in agile teams with modern tooling
  • Strong cross‑functional communication skills and comfort engaging directly with clients
  • A relevant technical degree is beneficial (Computer Science, Mathematics, Physics, etc.)
Job Responsibility
Job Responsibility
  • Lead the end‑to‑end design and lifecycle of our data services, ensuring scalability, performance, and alignment with business needs
  • Act as a trusted technical liaison, providing expert guidance and hands‑on issue resolution for internal teams, clients, and external partners
  • Champion engineering excellence by conducting robust peer code reviews, establishing standards, and driving continuous improvement
  • Foster collaboration across our global engineering teams, promoting shared patterns, efficiency, and best‑practice adoption
  • Mentor and support junior engineers, encouraging curiosity, capability growth, and innovative thinking
  • Shape technical direction, working closely with Product and Sales to ensure engineering efforts drive tangible business and client value
What we offer
What we offer
  • Hybrid & Flexible Working: Work from anywhere benefits, plus summer hours and extra days off for life’s big moments (including your birthday and wedding)
  • Generous Time Off: 26 days PTO (increasing with service), paid volunteer days, and full support for your wellbeing, including mental health resources
  • Career & Learning: Access to a top-tier learning platform, career progression plans, and support to create your ideal home workspace
  • Health & Financial Benefits: Comprehensive medical, dental, and vision coverage, plus a 6% matched retirement plan
  • Personal Perks: Annual phone reimbursement, onsite gym access, and customizable benefits via our online platform
  • Fulltime
Read More
Arrow Right

Data Engineer III

This role focuses on building and maintaining scalable data pipelines and platfo...
Location
Location
India , Kancheepuram District
Salary
Salary:
Not provided
rxglobal.com Logo
RX Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Typically, 3+ years of professional data engineering or software engineering experience with a strong data focus
  • Proven delivery of complex, production-grade data pipelines and platforms across multiple components and domains
  • Experience translating ambiguous business and analytical requirements into scalable, governed data solutions
  • Experience working in Agile, cross-functional teams with product, analytics, and data science partners
  • Bachelor’s Degree (Engineering/Computer Science preferred but not required)
  • or equivalent experience required
  • AWS Services: S3, Glue, Redshift, Athena, EMR, Lambda, Cloud Formation, Kinesis, DynamoDB, SQS, SNS, Lake Formation
  • Languages: Python, SQL, Scala
  • Big Data Tools: Apache Spark, DataBricks, Hadoop, Kafka
  • DevOps: Git, CI/CD, CloudFormation or Terraform
Job Responsibility
Job Responsibility
  • Data Pipeline Development
  • Design and build ETL/ELT pipelines to ingest, transform, and load data
  • Use AWS services like Glue, Lambda and Step Functions
  • Schedule and monitor workflows using Step Functions or AWS Glue Workflows
  • Create CI/CD Pipelines based on CloudFormation, Terraform, or CDK
  • Data Storage and Management
  • Manage structured and unstructured data using services like: Amazon S3, Amazon Glue Catalogue, Amazon DynamoDB, Amazon RDS or Aurora, Amazon Redshift
  • Ensure data partitioning, indexing, and lifecycle management
  • Data Integration
  • Integrate data from multiple sources (APIs, on-prem databases, third-party tools)
What we offer
What we offer
  • Comprehensive Health Insurance: Covers you, your immediate family, and parents
  • Enhanced Health Insurance Options: Competitive rates negotiated by the company
  • Group Life Insurance: Ensuring financial security for your loved ones
  • Group Accident Insurance: Extra protection for accidental death and permanent disablement
  • Flexible Working Arrangement: Achieve a harmonious work-life balance
  • Employee Assistance Program: Access support for personal and work-related challenges
  • Medical Screening: Your well-being is a top priority
  • Modern Family Benefits: Maternity, paternity, and adoption support
  • Long-Service Awards: Recognizing dedication and commitment
  • New Baby Gift: Celebrating the joy of parenthood
  • Fulltime
Read More
Arrow Right

Data Engineer III

As a Data Engineer, you will play a key role in designing, developing, and maint...
Location
Location
India , Chennai
Salary
Salary:
Not provided
arcadia.com Logo
Arcadia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years as a Data Engineer, data-adjacent Software Engineer, or a did-everything small data team member with a focus on building and maintaining data pipelines
  • Strong Python skills, especially in the context of data orchestration
  • Strong understanding of database management and design, including experience with Snowflake or an equivalent platform
  • Proficiency in SQL
  • Familiarity with data integration patterns, ETL/ELT processes, and data warehousing concepts
  • Experience with Argo, Prefect, Airflow, or similar data orchestration tools
  • Excellent problem-solving and analytical skills with a strong attention to detail
  • Ability to bring a customer-oriented and empathetic approach to understanding how data is used to drive the business
  • Strong communication skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable and efficient data pipelines in an AWS environment, centered on our Snowflake instance and using Fivetran, Prefect, Argo, and dbt
  • Collaborate with business analysts, analytics engineers, and software engineers to understand data requirements and deliver reliable solutions
  • Design, build and maintain tooling that enables users and services to interact with our data platform, including CI/CD pipelines for our data lakehouse, unit/integration/validation testing frameworks for our data pipelines, and command-line tools for ad-hoc data evaluation
  • Identify and implement best practices for data ingestion, transformation, and storage to ensure data integrity and accuracy
  • Optimize and tune data pipelines for improved performance, scalability, and reliability
  • Monitor data pipelines and proactively address any issues or bottlenecks to ensure uninterrupted data flow
  • Develop and maintain documentation for data pipelines, ensuring knowledge sharing and smooth onboarding of new team members
  • Implement data governance and security measures to ensure compliance with industry standards and regulations
  • Keep up to date with emerging technologies and trends in data engineering and recommend their adoption as appropriate
What we offer
What we offer
  • Competitive compensation based on market standards
  • Flexible Leave Policy
  • Office is in the heart of the city in case you need to step in for any purpose
  • Medical Insurance (1+5 Family Members)
  • We provide comprehensive coverage including accident policy and life Insurance
  • Annual performance cycle
  • Quarterly team engagement activities and rewards & recognitions
  • L&D programs to foster professional growth
  • A supportive engineering culture that values diversity, empathy, teamwork, trust, and efficiency
  • Fulltime
Read More
Arrow Right

Data Engineer III

Location
Location
United States , Indianapolis, Indiana
Salary
Salary:
Not provided
vigneshtechsolutions.com Logo
Vignesh Technological Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree in Computer Science, Engineering, or related field
  • Five (5) years of progressively responsible experience
  • Two (2) years of experience must have included: ETL, Informatica, Shell scripting, OBIEE, Tableau, Python
  • Travel and/or relocation to various unanticipated locations throughout the U.S. required
Job Responsibility
Job Responsibility
  • Help clients through designing, implementing and/or maintaining data warehouse systems
  • Develop plans for data warehouses
  • Plan for the movement of data from old systems to new systems
  • Collaborate with other technical staff to ensure that work aligns with overall client/project goals
  • Monitor data warehouses for stability, security and other key metrics
  • Document the data warehouse and provide support to users
  • Travel and/or Relocation to various unanticipated locations throughout the U.S. required
  • Work with the following: ETL, Informatica, Shell scripting, OBIEE, Tableau, Python
Read More
Arrow Right

Data Engineer III

Are you passionate about building robust data ecosystems that power advanced ana...
Location
Location
United States , Johnston
Salary
Salary:
103040.00 - 148100.00 USD / Year
fm.com Logo
FM
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Prefer 4 year/bachelor’s degree or master’s degree in computer science, Information Technology, Computer Engineering, or equivalent experience
  • 5+ years relatable work experience
  • Ability to design and optimize SQL queries across cloud data warehouses, with strong proficiency in T‑SQL
  • Skilled in data orchestration and ETL tools such as Azure Data Factory or SSIS, and eager to adopt Fabric Data Factory (Pipelines & Dataflows Gen2)
  • Background in CI/CD and version control for data solutions (e.g., Git, deployment pipelines), with interest in DevOps practices for analytics platforms
  • Familiarity with modern data lake architectures, including Delta Lake and medallion design patterns
  • Knowledge of columnar storage formats and lakehouse technologies such as Delta Lake and Parquet for scalable data processing
Job Responsibility
Job Responsibility
  • Architect & Innovate: Design and maintain scalable data pipelines and infrastructure for ingestion, integration, and storage of structured and unstructured data
  • Enable Analytics: Deliver clean, reliable datasets for Business Intelligence, Advanced Analytics, and Data Science teams
  • Optimize Performance: Implement modern practices using Microsoft Fabric, SQL Server, SSIS, Power BI Premium, and big data frameworks like Spark
  • Ensure Quality: Validate solutions through rigorous testing and maintain data integrity across all systems
  • Collaborate & Lead: Partner with Product Owners, Architects, Analysts, and Data Scientists on medium-to-large projects, and lead small-to-medium initiatives independently
  • Drive Continuous Improvement: Automate processes, optimize data delivery, and redesign infrastructure for scalability
What we offer
What we offer
  • incentive plan
  • generous health and well-being programs
  • a 401(k) and pension plan
  • career development opportunities
  • tuition reimbursement
  • flexible work
  • paid time off allowances
  • Fulltime
Read More
Arrow Right

Software Engineer III (Data Engineer)

We are seeking a motivated and detail-oriented Data Engineer to join our data en...
Location
Location
United States , Irvine
Salary
Salary:
96500.00 - 138061.00 USD / Year
haeaus.com Logo
Hyundai AutoEver America
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Technology, or related field
  • 10+ years of experience in data warehouse and MDM applications
  • Extensive knowledge of SQL and relational databases
  • Strong programming skills in Python and PL/SQL
  • 10+ years of experience working with Informatica
  • Knowledge of Informatica IDMC and PowerCenter is a must
  • Knowledge of big data technologies such as Apache Spark, Hadoop, or equivalent cloud-based services
  • Strong understanding of data governance, security, and quality practices in cloud environments
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines and ETL processes to transform and integrate data from multiple sources
  • Develop workflow automation using Apache Airflow and manage production batches with performance tuning
  • Create and optimize data models, schemas, and database structures for scalability and efficiency
  • Implement best practices in data warehouse and MDM applications, ensuring data governance, security, and quality
  • Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions
  • Develop scripts and automation tools to streamline data processing and pipeline operations
  • Implement automated monitoring, alerting systems, and maintain documentation for pipelines and data models
  • Create reports and visualizations to communicate pipeline performance and data insights
What we offer
What we offer
  • comprehensive medical/dental coverage
  • generous PTO
  • education assistance
  • annual merit increase eligibility
  • Fulltime
Read More
Arrow Right