CrawlJobs Logo

Senior Data Engineer

https://www.roberthalf.com Logo

Robert Half

Location Icon

Location:
United States, Houston

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

Robert Half is seeking a highly skilled Senior Data Engineer with deep expertise in the Microsoft Azure data ecosystem and Databricks to design, build, and optimize robust, scalable data pipelines and analytics platforms. This role will play a critical part in delivering enterprise-grade data solutions that support business intelligence, advanced analytics, and data science initiatives.

Job Responsibility:

  • Design and develop end-to-end data pipelines using Azure Data Factory, Azure Synapse, Azure Data Lake, and Azure SQL/SQL MI
  • Develop and optimize big data processing workflows using Azure Databricks (PySpark/Scala)
  • Implement and maintain ETL/ELT processes for large-scale, structured and unstructured data sources
  • Collaborate with data scientists, analysts, and stakeholders to deliver clean, reliable, and performant datasets
  • Leverage CI/CD practices to deploy data solutions using Azure DevOps
  • Apply data governance, security, and compliance best practices across the data lifecycle
  • Monitor, troubleshoot, and optimize data workflows for performance and cost-efficiency
  • Work in agile teams to continuously improve data architecture and engineering practices

Requirements:

  • 5+ years of experience in data engineering or software development
  • Strong expertise in Microsoft Azure data services (ADF, Databricks, Synapse, Data Lake, Azure Functions, Event Hub, etc.)
  • Proficiency with Databricks and big data frameworks (e.g., Spark, Delta Lake)
  • Experience with Python, SQL, and optionally Scala
  • Familiarity with DevOps tools (e.g., Git, Azure DevOps, Terraform) and CI/CD pipelines
  • Solid understanding of data modeling, warehousing, and performance tuning
  • Excellent problem-solving and communication skills

Nice to have:

  • Experience working in high-volume, enterprise-scale environments
  • Familiarity with streaming data solutions (Event Hubs, Kafka)
  • Prior work with MLOps pipelines or support for data science teams
  • Knowledge of Power BI or similar BI tools for data visualization
  • Experience with infrastructure-as-code and dataOps practices
  • Exposure to Azure Purview, Databricks Unity Catalog, or other data governance tools
  • Background in a regulated industry such as finance, healthcare, or insurance
  • Relevant certifications (e.g., Azure Data Engineer Associate, Databricks Certified Data Engineer)
What we offer:
  • Access to top jobs
  • Competitive compensation
  • Medical insurance
  • Vision insurance
  • Dental insurance
  • Life and disability insurance
  • 401(k) plan
  • Free online training

Additional Information:

Job Posted:
May 07, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.