CrawlJobs Logo
Robert Half Logo Robert Half · IT - Software Development

Data Automation Engineer

United States, Houston · Job Posted June 14, 2026
Apply Position
Job Link Share

Job Description

We are seeking a highly motivated Data Automation Engineer to design and implement modern, AI-driven data solutions within a Microsoft Azure-based analytics ecosystem. This role focuses on building scalable pipelines, automating workflows, and integrating advanced analytics and AI capabilities across enterprise data platforms. The ideal candidate brings strong experience in Azure data services, ETL pipeline development, and automation, along with a delivery-focused mindset and the ability to translate complex business requirements into technical solutions. This role supports mission-critical environments and requires eligibility for a Public Trust clearance.

Job Responsibility

  • Design and implement data pipelines using Azure Data Factory, Synapse, Spark, SQL, and Python
  • Build and maintain ETL/ELT workflows across structured and unstructured data sources
  • Support data ingestion, transformation, and integration for enterprise analytics platforms
  • Develop automation solutions to improve efficiency, scalability, and reliability of data workflows
  • Research and implement AI/ML and Generative AI tools to enhance data processing and insights
  • Eliminate bottlenecks through intelligent automation and workflow optimization
  • Implement data quality, integrity, and metadata management practices
  • Monitor and troubleshoot pipelines to ensure high availability and performance
  • Perform performance testing, tuning (query optimization, indexing), and pipeline benchmarking
  • Partner with engineering, DevOps, and business stakeholders to develop solutions
  • Participate in Agile/DevOps processes and continuous delivery cycles
  • Document pipeline performance, test results, and system improvements

Requirements

  • Bachelor's degree in Computer Science or related field
  • 2+ years of experience in data engineering, automation, or cloud development
  • Strong experience with SQL, Python, PySpark, or related scripting tools
  • Experience with Azure services (Data Factory, Synapse, Data Lake)
  • Experience building and maintaining ETL/data pipelines
  • Familiarity with Azure DevOps, GitHub, or CI/CD pipelines
  • Strong troubleshooting and performance optimization skills
  • ability to obtain Public Trust clearance

Nice to have

  • Experience with Generative AI or AI-driven data automation
  • Microsoft Azure or data engineering certifications
  • Experience with Power BI, SSIS, SSRS, SSAS
  • Knowledge of data lineage, governance, and security frameworks
  • Experience with Infrastructure-as-Code (ARM, Bicep)
  • Exposure to performance tuning and advanced query optimization

What we offer

  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Robert Half - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Automation Engineer

8 matching positions

New

Data Automation Engineer

Location
Location
United States , Washington
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or related field
  • 2+ years of experience in data engineering, automation, or cloud development
  • Strong experience with Python and SQL
  • Hands-on experience with AWS services (S3, Glue, Lambda, EMR, DynamoDB)
  • Experience with data pipeline development and ETL/ELT processes
  • Familiarity with Spark, Kafka, Flume, or large-scale data processing
  • Exposure to Generative AI / LLM frameworks
  • Experience with CI/CD tools and DevOps practices
  • Strong troubleshooting, performance tuning, and problem-solving skills
  • Ability to obtain Public Trust clearance
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines using AWS services (S3, Glue, Lambda, EMR, DynamoDB)
  • Develop and optimize ETL/ELT workflows across hybrid AWS and Azure environments
  • Integrate structured, unstructured, and streaming data across enterprise systems
  • Leverage Generative AI frameworks (AWS Bedrock, Azure OpenAI, LangChain, Hugging Face) to build intelligent automation
  • Implement solutions for embeddings, vector generation, and RAG workflows
  • Develop AI-driven tools for data quality, anomaly detection, and pipeline optimization
  • Build AI-powered copilots for monitoring, troubleshooting, and workflow automation
  • Engineer real-time and batch ingestion pipelines using Spark, Kafka, and Flume
  • Integrate enterprise platforms and CRM data into data pipelines for analytics and reporting
  • Optimize SQL performance through stored procedures, indexing, and query tuning
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • enroll in our company 401(k) plan
Read More
Arrow Right

Data Automation Engineer

We are seeking a delivery-focused Data Automation Engineer to design and impleme...
Location
Location
United States , Houston
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science or related field
  • 2+ years of experience with SQL, T-SQL, DAX/MDX, Python, or PySpark
  • Experience designing and building ETL solutions within cloud environments
  • Hands-on experience with Azure Data Factory, Synapse, or Azure Data Lake
  • Experience with Microsoft BI tools including SQL Server, SSIS, SSRS, SSAS, or Power BI
  • Familiarity with Azure/AWS CLI automation using Bash or PowerShell
  • Experience with Git or Azure DevOps for release/version management
  • Experience working in Agile environments
  • Ability to obtain a Public Trust clearance required
Job Responsibility
Job Responsibility
  • Develop high-performance data pipelines using Azure Data Factory, Synapse Pipelines, Spark Notebooks, Python, and SQL
  • Design ETL workflows supporting advanced analytics, reporting, and AI/ML use cases
  • Implement data migration, integrity, quality, metadata, and security controls across pipelines
  • Monitor, troubleshoot, and optimize pipelines for availability, scalability, and performance
  • Execute ETL performance testing and validate load performance against benchmarks
  • Analyze pipeline runtime, throughput, latency, and resource utilization
  • Support tuning activities (e.g., query optimization, partitioning, indexing)
  • Validate data completeness and consistency after high-volume processing
  • Collaborate with DevOps and infrastructure teams to optimize compute, memory, and scaling
  • Maintain versioning and configuration control across environments
What we offer
What we offer
  • Medical
  • Vision
  • Dental
  • Life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Full-Stack Data Engineer – Data & ML Automation (Databricks)

We are seeking a Fullstack Data Engineer who can operate at the intersection of ...
Location
Location
India , Pune
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience with CLI tools, scripts, and utilities for automating data platform workflows
  • Experience with Databricks APIs, Terraform, Databricks SDK
  • Experience designing integration tests, end-to-end pipeline tests, validation frameworks for Databricks ETL/ELT pipelines and ML inference workflows
  • Experience building internal applications using React, Streamlit, or similar frameworks
  • Experience with spec-driven development, coding agents and automation patterns, CI/CD workflows for data/ML systems
Job Responsibility
Job Responsibility
  • Develop CLI tools, scripts, and utilities to automate repetitive workflows across the data platform
  • Automate Databricks workflows, job deployments, environment provisioning, and MLOps operations using Databricks APIs, Terraform, Databricks SDK
  • Design and implement integration tests, end-to-end pipeline tests, validation frameworks for Databricks ETL/ELT pipelines and ML inference workflows
  • Improve reliability, observability, and overall engineering productivity across the data & ML team
  • Build quick internal applications using React, Streamlit, or similar frameworks to visualize data flows, provide model inference demos, enable operational or configuration controls
  • Develop internal productivity and monitoring dashboards
  • Apply best practices around spec-driven development, coding agents and automation patterns, CI/CD workflows for data/ML systems
  • Fulltime
Read More
Arrow Right

Automation Data Engineer

Activision Central Technology is seeking a passionate Automation Data Engineer t...
Location
Location
United States , Santa Monica
Salary
Salary:
77500.00 - 143376.00 USD / Year
activision.com Logo
Activision
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A minimum of 3 years relevant work experience
  • Experience developing test frameworks
  • Proficiency in data engineering and analytics
  • Experience working in a collaborative team environment
  • Bachelor's degree in computer science, a related field, or equivalent experience
  • Advanced understanding of Python, C/C++, and SQL
  • Knowledge of online services, devops, and cloud infrastructure
  • Deep grasp of computer architecture, networks, and operating systems
  • Strong passion for automation and software testing
  • Self-motivated, strong sense of independence
Job Responsibility
Job Responsibility
  • Collaborate with automation and data engineers to enhance, evaluate, and scale automated testing features
  • Improve tools and workflows for efficient test development, data analysis, and debugging
  • Support Activision studios globally in designing automation strategies and developing automated tests to identify defects
  • Analyze results, increase automated coverage, and maintain infrastructure for performance, stability, and data integrity
  • Create tools to boost QA productivity, research new techniques, and work with QA leadership to plan and evolve processes
What we offer
What we offer
  • Medical, dental, vision, health savings account or health reimbursement account, healthcare spending accounts, dependent care spending accounts, life and AD&D insurance, disability insurance
  • 401(k) with Company match, tuition reimbursement, charitable donation matching
  • Paid holidays and vacation, paid sick time, floating holidays, compassion and bereavement leaves, parental leave
  • Mental health & wellbeing programs, fitness programs, free and discounted games, and a variety of other voluntary benefit programs like supplemental life & disability, legal service, ID protection, rental insurance, and others
  • If the Company requires that you move geographic locations for the job, then you may also be eligible for relocation assistance
Read More
Arrow Right

Quality Automation Engineer - Data

We are looking for a Data Quality Engineer to design and implement robust data q...
Location
Location
India
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s in Computer Science, Data Engineering, or related field
  • 5–8 years of experience in data-related roles
  • Strong problem-solving and analytical skills
  • Clear communication and documentation abilities
  • Experience working in cross-functional teams
  • Databricks (PySpark, Delta Lake, SQL)
  • Snowflake
  • Azure Data Factory
  • Informatica
  • Teradata
Job Responsibility
Job Responsibility
  • Develop and maintain data quality checks and validation frameworks
  • Collaborate with data engineers and analysts to identify and resolve data issues
  • Monitor data pipelines for anomalies and inconsistencies
  • Implement data profiling and cleansing processes
  • Ensure adherence to data governance and compliance standards
  • Automate data quality reporting and alerting mechanisms
  • Contribute to continuous improvement of data quality practices
  • Fulltime
Read More
Arrow Right

Automation & Data Engineer

As an Automation & Data Engineer, you will play a key role in designing, develop...
Location
Location
Australia , Melbourne
Salary
Salary:
Not provided
servicestream.com.au Logo
Service Stream
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Must be an Australian Citizen
  • Hands‑on experience delivering automation and data engineering solutions using AWS cloud services
  • Strong proficiency in Python for automation, data processing, and orchestration logic
  • Advanced SQL skills for transformation, optimisation, and data validation (Redshift experience highly regarded)
  • Strong understanding of automation and data solution design, including orchestration patterns and error‑handling strategies
  • Proficiency with Git, including branching, pull requests, and collaborative development practices
  • Strong analytical and problem‑solving ability, particularly across automated and data‑driven systems
  • Ability to work autonomously, manage competing priorities, and communicate effectively with both technical and non‑technical stakeholders
  • Tertiary qualification in data engineering, computer science, information technology, engineering, mathematics, or a related discipline — or equivalent professional experience
Job Responsibility
Job Responsibility
  • Design, build, test, and maintain automated data pipelines, integrations, and workflows
  • Implement and operate automation solutions using AWS services including AWS Batch, AWS Glue, Lambda, Redshift, and Step Functions
  • Develop and optimise data models, transformations, and performance‑tuned solutions across data platforms
  • Design automation and data workflows with strong error handling, orchestration, monitoring, and recovery mechanisms
  • Collaborate with stakeholders to gather business requirements and translate them into technical solution designs
  • Provide ongoing operational support, including troubleshooting, root‑cause analysis, and sustainable fixes
  • Produce and maintain technical documentation aligned with security, governance, and operational standards
  • Contribute to team collaboration through code reviews, knowledge sharing, and adherence to development best practices
What we offer
What we offer
  • Flexible working – genuine flexibility options available
  • Growth – national career development opportunities
  • Discounts – access to retail partners such as Woolworths, Airbnb, JB Hi‑Fi and Bupa
  • Paid leave – parental, cultural, community service, study, volunteering, and purchased leave
  • Culture – a workplace that values diversity, inclusion, and celebrates excellence
  • Fulltime
Read More
Arrow Right

Senior QA Automation Engineer – Data & AI Platforms

We are looking for a Senior QA Automation Engineer with strong expertise in test...
Location
Location
Pakistan , Lahore; Karachi; Islamabad
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in Software Quality Assurance and Test Automation
  • Strong expertise in Test Planning, Test Strategy, and Test Execution
  • Hands-on experience with Selenium, Pytest, and Python-based automation
  • Solid experience in API Testing (REST APIs, JSON, Postman / similar tools)
  • Proven experience integrating automation with CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions, etc.)
  • Experience testing Data platforms, ETL pipelines, and large-scale datasets
  • Exposure to AI/ML pipeline testing, including model validation and data quality checks
  • Strong understanding of SDLC, Agile/Scrum, and DevOps practices
  • Excellent analytical, debugging, and communication skills
Job Responsibility
Job Responsibility
  • Lead test planning, test strategy, and test execution for complex web, API, data, and AI/ML-driven systems
  • Design, develop, and maintain automation frameworks using Selenium and Pytest
  • Perform API testing (RESTful services) including functional, regression, and integration testing
  • Validate data pipelines, ETL workflows, and data quality checks across large datasets
  • Test AI/ML pipelines, including model validation, data drift, feature validation, and inference testing
  • Integrate automated test suites into CI/CD pipelines to enable continuous testing
  • Collaborate with DevOps teams to ensure quality gates in build and deployment pipelines
  • Perform root cause analysis and drive defect resolution with engineering teams
  • Ensure adherence to QA best practices, SDLC, and Agile methodologies
  • Mentor junior QA engineers and contribute to improving overall QA maturity
What we offer
What we offer
  • Work on cutting-edge Data and AI/ML platforms
  • Hybrid work model across Lahore, Karachi, and Islamabad
  • Opportunity to influence quality strategy at scale
  • Collaborative engineering culture with strong focus on automation and innovation
  • Fulltime
Read More
Arrow Right

Senior QA Automation Engineer – Data & AI Platforms

We are looking for a Senior QA Automation Engineer with strong expertise in test...
Location
Location
Pakistan , Lahore; Karachi; Islamabad
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in Software Quality Assurance and Test Automation
  • Strong expertise in Test Planning, Test Strategy, and Test Execution
  • Hands-on experience with Selenium, Pytest, and Python-based automation
  • Solid experience in API Testing (REST APIs, JSON, Postman / similar tools)
  • Proven experience integrating automation with CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions, etc.)
  • Experience testing Data platforms, ETL pipelines, and large-scale datasets
  • Exposure to AI/ML pipeline testing, including model validation and data quality checks
  • Strong understanding of SDLC, Agile/Scrum, and DevOps practices
  • Excellent analytical, debugging, and communication skills
Job Responsibility
Job Responsibility
  • Lead test planning, test strategy, and test execution for complex web, API, data, and AI/ML-driven systems
  • Design, develop, and maintain automation frameworks using Selenium and Pytest
  • Perform API testing (RESTful services) including functional, regression, and integration testing
  • Validate data pipelines, ETL workflows, and data quality checks across large datasets
  • Test AI/ML pipelines, including model validation, data drift, feature validation, and inference testing
  • Integrate automated test suites into CI/CD pipelines to enable continuous testing
  • Collaborate with DevOps teams to ensure quality gates in build and deployment pipelines
  • Perform root cause analysis and drive defect resolution with engineering teams
  • Ensure adherence to QA best practices, SDLC, and Agile methodologies
  • Mentor junior QA engineers and contribute to improving overall QA maturity
What we offer
What we offer
  • Work on cutting-edge Data and AI/ML platforms
  • Hybrid work model across Lahore, Karachi, and Islamabad
  • Opportunity to influence quality strategy at scale
  • Collaborative engineering culture with strong focus on automation and innovation
  • Fulltime
Read More
Arrow Right