CrawlJobs Logo

Data Engineer

https://www.roberthalf.com Logo

Robert Half

Location Icon

Location:
United States, Philadelphia

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Contract work

Salary Icon

Salary:

Not provided

Job Description:

We are seeking a talented Data Engineer to join a cutting-edge team supporting machine learning (ML) research efforts. This role focuses on building and optimizing data pipelines and infrastructure to enable more efficient ML model development and deployment. As a key collaborator with ML and NLP teams, you’ll work on infrastructure solutions for faster model building, optimization, and production deployment. If you're a hands-on engineer with strong cloud infrastructure experience, particularly with AWS, and a passion for enabling ML research, we want to hear from you!

Job Responsibility:

  • Design, build, and maintain data pipelines and ML infrastructure to support AI/ML research teams
  • Collaborate with ML and NLP scientists to address content retrieval needs and build search-related solutions
  • Create scalable solutions using technologies like Python, Airflow, Databricks, Kubernetes, and AWS
  • Optimize Databricks notebooks using PySpark, structure ML pipelines, and assist with model production workflows
  • Develop and deploy REST APIs for model serving and infrastructure communication
  • Maintain and support Kubernetes clusters for model deployment in production environments
  • Focus on content retrieval and database query solutions, contributing backend querying expertise (Java, Kotlin, Go)

Requirements:

  • Strong background in AWS infrastructure with the ability to hit the ground running
  • Skills in Kubernetes, especially for deploying models in containerized environments
  • Proficiency in Airflow for robust and scalable data pipeline development
  • Demonstrated expertise in Python, especially for microservices and pipelines
  • Ability to collaborate with ML teams without direct modeling responsibilities

Nice to have:

  • Databricks
  • PySpark
  • Pytorch
  • Content Retrieval/Database Querying (Java, Kotlin, Go)
  • ML pipelines
What we offer:
  • Work closely with top-tier AI/ML research teams on cutting-edge initiatives
  • Develop tools and infrastructure that drive innovation in AI and NLP
  • Competitive compensation with benefits (health, vision, dental)

Additional Information:

Job Posted:
May 15, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.