Senior Data Engineer, Robert Half

Robert Half

Location:
United States, Houston

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Not provided

Save Job

Apply Position

Job Description:

Robert Half is seeking a highly skilled Senior Data Engineer with deep expertise in the Microsoft Azure data ecosystem and Databricks to design, build, and optimize robust, scalable data pipelines and analytics platforms. This role will play a critical part in delivering enterprise-grade data solutions that support business intelligence, advanced analytics, and data science initiatives.

Job Responsibility:

Design and develop end-to-end data pipelines using Azure Data Factory, Azure Synapse, Azure Data Lake, and Azure SQL/SQL MI
Develop and optimize big data processing workflows using Azure Databricks (PySpark/Scala)
Implement and maintain ETL/ELT processes for large-scale, structured and unstructured data sources
Collaborate with data scientists, analysts, and stakeholders to deliver clean, reliable, and performant datasets
Leverage CI/CD practices to deploy data solutions using Azure DevOps
Apply data governance, security, and compliance best practices across the data lifecycle
Monitor, troubleshoot, and optimize data workflows for performance and cost-efficiency
Work in agile teams to continuously improve data architecture and engineering practices

Requirements:

5+ years of experience in data engineering or software development
Strong expertise in Microsoft Azure data services (ADF, Databricks, Synapse, Data Lake, Azure Functions, Event Hub, etc.)
Proficiency with Databricks and big data frameworks (e.g., Spark, Delta Lake)
Experience with Python, SQL, and optionally Scala
Familiarity with DevOps tools (e.g., Git, Azure DevOps, Terraform) and CI/CD pipelines
Solid understanding of data modeling, warehousing, and performance tuning
Excellent problem-solving and communication skills

Nice to have:

Experience working in high-volume, enterprise-scale environments
Familiarity with streaming data solutions (Event Hubs, Kafka)
Prior work with MLOps pipelines or support for data science teams
Knowledge of Power BI or similar BI tools for data visualization
Experience with infrastructure-as-code and dataOps practices
Exposure to Azure Purview, Databricks Unity Catalog, or other data governance tools
Background in a regulated industry such as finance, healthcare, or insurance
Relevant certifications (e.g., Azure Data Engineer Associate, Databricks Certified Data Engineer)

What we offer:

Access to top jobs
Competitive compensation
Medical insurance
Vision insurance
Dental insurance
Life and disability insurance
401(k) plan
Free online training

Additional Information:

Job Posted:
May 07, 2025

Employment Type:

Fulltime

Work Type:

On-site work

View All Jobs In This Company

Job Link Share:

Senior Data Engineer