CrawlJobs Logo
Robert Half Logo Robert Half · IT - Software Development

Data Automation Engineer

United States, Washington · Job Posted June 14, 2026
Apply Position
Job Link Share

Job Responsibility

  • Design, build, and maintain scalable data pipelines using AWS services (S3, Glue, Lambda, EMR, DynamoDB)
  • Develop and optimize ETL/ELT workflows across hybrid AWS and Azure environments
  • Integrate structured, unstructured, and streaming data across enterprise systems
  • Leverage Generative AI frameworks (AWS Bedrock, Azure OpenAI, LangChain, Hugging Face) to build intelligent automation
  • Implement solutions for embeddings, vector generation, and RAG workflows
  • Develop AI-driven tools for data quality, anomaly detection, and pipeline optimization
  • Build AI-powered copilots for monitoring, troubleshooting, and workflow automation
  • Engineer real-time and batch ingestion pipelines using Spark, Kafka, and Flume
  • Integrate enterprise platforms and CRM data into data pipelines for analytics and reporting
  • Optimize SQL performance through stored procedures, indexing, and query tuning
  • Implement CI/CD pipelines using tools such as GitHub, Jenkins, or Azure DevOps
  • Develop infrastructure solutions using Infrastructure-as-Code (IaC)
  • Ensure cloud security through IAM, RBAC, encryption, and network isolation
  • Partner with cross-functional teams to gather requirements and deliver solutions
  • Support Agile delivery processes and continuous improvement initiatives
  • Provide technical troubleshooting and performance optimization across data systems

Requirements

  • Bachelor’s degree in Computer Science or related field
  • 2+ years of experience in data engineering, automation, or cloud development
  • Strong experience with Python and SQL
  • Hands-on experience with AWS services (S3, Glue, Lambda, EMR, DynamoDB)
  • Experience with data pipeline development and ETL/ELT processes
  • Familiarity with Spark, Kafka, Flume, or large-scale data processing
  • Exposure to Generative AI / LLM frameworks
  • Experience with CI/CD tools and DevOps practices
  • Strong troubleshooting, performance tuning, and problem-solving skills
  • Ability to obtain Public Trust clearance

Nice to have

  • Certifications in AWS, Azure, or Data Engineering disciplines
  • Experience implementing RAG pipelines, embeddings, or vector search technologies
  • Experience with multi-cloud data integration (AWS ↔ Azure)
  • Familiarity with data governance, lineage, and compliance frameworks
  • Experience with GenAI-powered developer tools
  • Familiarity with Infrastructure-as-Code (Terraform, CloudFormation, Bicep)
  • Experience in regulated environments (FedRAMP, HIPAA, etc.)

What we offer

  • medical, vision, dental, and life and disability insurance
  • enroll in our company 401(k) plan
Robert Half - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Automation Engineer

8 matching positions

New

Data Automation Engineer

We are seeking a highly motivated Data Automation Engineer to design and impleme...
Location
Location
United States , Houston
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science or related field
  • 2+ years of experience in data engineering, automation, or cloud development
  • Strong experience with SQL, Python, PySpark, or related scripting tools
  • Experience with Azure services (Data Factory, Synapse, Data Lake)
  • Experience building and maintaining ETL/data pipelines
  • Familiarity with Azure DevOps, GitHub, or CI/CD pipelines
  • Strong troubleshooting and performance optimization skills
  • ability to obtain Public Trust clearance
Job Responsibility
Job Responsibility
  • Design and implement data pipelines using Azure Data Factory, Synapse, Spark, SQL, and Python
  • Build and maintain ETL/ELT workflows across structured and unstructured data sources
  • Support data ingestion, transformation, and integration for enterprise analytics platforms
  • Develop automation solutions to improve efficiency, scalability, and reliability of data workflows
  • Research and implement AI/ML and Generative AI tools to enhance data processing and insights
  • Eliminate bottlenecks through intelligent automation and workflow optimization
  • Implement data quality, integrity, and metadata management practices
  • Monitor and troubleshoot pipelines to ensure high availability and performance
  • Perform performance testing, tuning (query optimization, indexing), and pipeline benchmarking
  • Partner with engineering, DevOps, and business stakeholders to develop solutions
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Data Automation Engineer

We are seeking a delivery-focused Data Automation Engineer to design and impleme...
Location
Location
United States , Houston
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science or related field
  • 2+ years of experience with SQL, T-SQL, DAX/MDX, Python, or PySpark
  • Experience designing and building ETL solutions within cloud environments
  • Hands-on experience with Azure Data Factory, Synapse, or Azure Data Lake
  • Experience with Microsoft BI tools including SQL Server, SSIS, SSRS, SSAS, or Power BI
  • Familiarity with Azure/AWS CLI automation using Bash or PowerShell
  • Experience with Git or Azure DevOps for release/version management
  • Experience working in Agile environments
  • Ability to obtain a Public Trust clearance required
Job Responsibility
Job Responsibility
  • Develop high-performance data pipelines using Azure Data Factory, Synapse Pipelines, Spark Notebooks, Python, and SQL
  • Design ETL workflows supporting advanced analytics, reporting, and AI/ML use cases
  • Implement data migration, integrity, quality, metadata, and security controls across pipelines
  • Monitor, troubleshoot, and optimize pipelines for availability, scalability, and performance
  • Execute ETL performance testing and validate load performance against benchmarks
  • Analyze pipeline runtime, throughput, latency, and resource utilization
  • Support tuning activities (e.g., query optimization, partitioning, indexing)
  • Validate data completeness and consistency after high-volume processing
  • Collaborate with DevOps and infrastructure teams to optimize compute, memory, and scaling
  • Maintain versioning and configuration control across environments
What we offer
What we offer
  • Medical
  • Vision
  • Dental
  • Life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Full-Stack Data Engineer – Data & ML Automation (Databricks)

We are seeking a Fullstack Data Engineer who can operate at the intersection of ...
Location
Location
India , Pune
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience with CLI tools, scripts, and utilities for automating data platform workflows
  • Experience with Databricks APIs, Terraform, Databricks SDK
  • Experience designing integration tests, end-to-end pipeline tests, validation frameworks for Databricks ETL/ELT pipelines and ML inference workflows
  • Experience building internal applications using React, Streamlit, or similar frameworks
  • Experience with spec-driven development, coding agents and automation patterns, CI/CD workflows for data/ML systems
Job Responsibility
Job Responsibility
  • Develop CLI tools, scripts, and utilities to automate repetitive workflows across the data platform
  • Automate Databricks workflows, job deployments, environment provisioning, and MLOps operations using Databricks APIs, Terraform, Databricks SDK
  • Design and implement integration tests, end-to-end pipeline tests, validation frameworks for Databricks ETL/ELT pipelines and ML inference workflows
  • Improve reliability, observability, and overall engineering productivity across the data & ML team
  • Build quick internal applications using React, Streamlit, or similar frameworks to visualize data flows, provide model inference demos, enable operational or configuration controls
  • Develop internal productivity and monitoring dashboards
  • Apply best practices around spec-driven development, coding agents and automation patterns, CI/CD workflows for data/ML systems
  • Fulltime
Read More
Arrow Right

Automation Data Engineer

Activision Central Technology is seeking a passionate Automation Data Engineer t...
Location
Location
United States , Santa Monica
Salary
Salary:
77500.00 - 143376.00 USD / Year
activision.com Logo
Activision
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A minimum of 3 years relevant work experience
  • Experience developing test frameworks
  • Proficiency in data engineering and analytics
  • Experience working in a collaborative team environment
  • Bachelor's degree in computer science, a related field, or equivalent experience
  • Advanced understanding of Python, C/C++, and SQL
  • Knowledge of online services, devops, and cloud infrastructure
  • Deep grasp of computer architecture, networks, and operating systems
  • Strong passion for automation and software testing
  • Self-motivated, strong sense of independence
Job Responsibility
Job Responsibility
  • Collaborate with automation and data engineers to enhance, evaluate, and scale automated testing features
  • Improve tools and workflows for efficient test development, data analysis, and debugging
  • Support Activision studios globally in designing automation strategies and developing automated tests to identify defects
  • Analyze results, increase automated coverage, and maintain infrastructure for performance, stability, and data integrity
  • Create tools to boost QA productivity, research new techniques, and work with QA leadership to plan and evolve processes
What we offer
What we offer
  • Medical, dental, vision, health savings account or health reimbursement account, healthcare spending accounts, dependent care spending accounts, life and AD&D insurance, disability insurance
  • 401(k) with Company match, tuition reimbursement, charitable donation matching
  • Paid holidays and vacation, paid sick time, floating holidays, compassion and bereavement leaves, parental leave
  • Mental health & wellbeing programs, fitness programs, free and discounted games, and a variety of other voluntary benefit programs like supplemental life & disability, legal service, ID protection, rental insurance, and others
  • If the Company requires that you move geographic locations for the job, then you may also be eligible for relocation assistance
Read More
Arrow Right

Quality Automation Engineer - Data

We are looking for a Data Quality Engineer to design and implement robust data q...
Location
Location
India
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s in Computer Science, Data Engineering, or related field
  • 5–8 years of experience in data-related roles
  • Strong problem-solving and analytical skills
  • Clear communication and documentation abilities
  • Experience working in cross-functional teams
  • Databricks (PySpark, Delta Lake, SQL)
  • Snowflake
  • Azure Data Factory
  • Informatica
  • Teradata
Job Responsibility
Job Responsibility
  • Develop and maintain data quality checks and validation frameworks
  • Collaborate with data engineers and analysts to identify and resolve data issues
  • Monitor data pipelines for anomalies and inconsistencies
  • Implement data profiling and cleansing processes
  • Ensure adherence to data governance and compliance standards
  • Automate data quality reporting and alerting mechanisms
  • Contribute to continuous improvement of data quality practices
  • Fulltime
Read More
Arrow Right

Automation & Data Engineer

As an Automation & Data Engineer, you will play a key role in designing, develop...
Location
Location
Australia , Melbourne
Salary
Salary:
Not provided
servicestream.com.au Logo
Service Stream
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Must be an Australian Citizen
  • Hands‑on experience delivering automation and data engineering solutions using AWS cloud services
  • Strong proficiency in Python for automation, data processing, and orchestration logic
  • Advanced SQL skills for transformation, optimisation, and data validation (Redshift experience highly regarded)
  • Strong understanding of automation and data solution design, including orchestration patterns and error‑handling strategies
  • Proficiency with Git, including branching, pull requests, and collaborative development practices
  • Strong analytical and problem‑solving ability, particularly across automated and data‑driven systems
  • Ability to work autonomously, manage competing priorities, and communicate effectively with both technical and non‑technical stakeholders
  • Tertiary qualification in data engineering, computer science, information technology, engineering, mathematics, or a related discipline — or equivalent professional experience
Job Responsibility
Job Responsibility
  • Design, build, test, and maintain automated data pipelines, integrations, and workflows
  • Implement and operate automation solutions using AWS services including AWS Batch, AWS Glue, Lambda, Redshift, and Step Functions
  • Develop and optimise data models, transformations, and performance‑tuned solutions across data platforms
  • Design automation and data workflows with strong error handling, orchestration, monitoring, and recovery mechanisms
  • Collaborate with stakeholders to gather business requirements and translate them into technical solution designs
  • Provide ongoing operational support, including troubleshooting, root‑cause analysis, and sustainable fixes
  • Produce and maintain technical documentation aligned with security, governance, and operational standards
  • Contribute to team collaboration through code reviews, knowledge sharing, and adherence to development best practices
What we offer
What we offer
  • Flexible working – genuine flexibility options available
  • Growth – national career development opportunities
  • Discounts – access to retail partners such as Woolworths, Airbnb, JB Hi‑Fi and Bupa
  • Paid leave – parental, cultural, community service, study, volunteering, and purchased leave
  • Culture – a workplace that values diversity, inclusion, and celebrates excellence
  • Fulltime
Read More
Arrow Right

Senior QA Automation Engineer – Data & AI Platforms

We are looking for a Senior QA Automation Engineer with strong expertise in test...
Location
Location
Pakistan , Lahore; Karachi; Islamabad
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in Software Quality Assurance and Test Automation
  • Strong expertise in Test Planning, Test Strategy, and Test Execution
  • Hands-on experience with Selenium, Pytest, and Python-based automation
  • Solid experience in API Testing (REST APIs, JSON, Postman / similar tools)
  • Proven experience integrating automation with CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions, etc.)
  • Experience testing Data platforms, ETL pipelines, and large-scale datasets
  • Exposure to AI/ML pipeline testing, including model validation and data quality checks
  • Strong understanding of SDLC, Agile/Scrum, and DevOps practices
  • Excellent analytical, debugging, and communication skills
Job Responsibility
Job Responsibility
  • Lead test planning, test strategy, and test execution for complex web, API, data, and AI/ML-driven systems
  • Design, develop, and maintain automation frameworks using Selenium and Pytest
  • Perform API testing (RESTful services) including functional, regression, and integration testing
  • Validate data pipelines, ETL workflows, and data quality checks across large datasets
  • Test AI/ML pipelines, including model validation, data drift, feature validation, and inference testing
  • Integrate automated test suites into CI/CD pipelines to enable continuous testing
  • Collaborate with DevOps teams to ensure quality gates in build and deployment pipelines
  • Perform root cause analysis and drive defect resolution with engineering teams
  • Ensure adherence to QA best practices, SDLC, and Agile methodologies
  • Mentor junior QA engineers and contribute to improving overall QA maturity
What we offer
What we offer
  • Work on cutting-edge Data and AI/ML platforms
  • Hybrid work model across Lahore, Karachi, and Islamabad
  • Opportunity to influence quality strategy at scale
  • Collaborative engineering culture with strong focus on automation and innovation
  • Fulltime
Read More
Arrow Right

Senior QA Automation Engineer – Data & AI Platforms

We are looking for a Senior QA Automation Engineer with strong expertise in test...
Location
Location
Pakistan , Lahore; Karachi; Islamabad
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in Software Quality Assurance and Test Automation
  • Strong expertise in Test Planning, Test Strategy, and Test Execution
  • Hands-on experience with Selenium, Pytest, and Python-based automation
  • Solid experience in API Testing (REST APIs, JSON, Postman / similar tools)
  • Proven experience integrating automation with CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions, etc.)
  • Experience testing Data platforms, ETL pipelines, and large-scale datasets
  • Exposure to AI/ML pipeline testing, including model validation and data quality checks
  • Strong understanding of SDLC, Agile/Scrum, and DevOps practices
  • Excellent analytical, debugging, and communication skills
Job Responsibility
Job Responsibility
  • Lead test planning, test strategy, and test execution for complex web, API, data, and AI/ML-driven systems
  • Design, develop, and maintain automation frameworks using Selenium and Pytest
  • Perform API testing (RESTful services) including functional, regression, and integration testing
  • Validate data pipelines, ETL workflows, and data quality checks across large datasets
  • Test AI/ML pipelines, including model validation, data drift, feature validation, and inference testing
  • Integrate automated test suites into CI/CD pipelines to enable continuous testing
  • Collaborate with DevOps teams to ensure quality gates in build and deployment pipelines
  • Perform root cause analysis and drive defect resolution with engineering teams
  • Ensure adherence to QA best practices, SDLC, and Agile methodologies
  • Mentor junior QA engineers and contribute to improving overall QA maturity
What we offer
What we offer
  • Work on cutting-edge Data and AI/ML platforms
  • Hybrid work model across Lahore, Karachi, and Islamabad
  • Opportunity to influence quality strategy at scale
  • Collaborative engineering culture with strong focus on automation and innovation
  • Fulltime
Read More
Arrow Right