This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We are seeking a talented Data Engineer to join a cutting-edge team supporting machine learning (ML) research efforts. This role focuses on building and optimizing data pipelines and infrastructure to enable more efficient ML model development and deployment. As a key collaborator with ML and NLP teams, you’ll work on infrastructure solutions for faster model building, optimization, and production deployment. If you're a hands-on engineer with strong cloud infrastructure experience, particularly with AWS, and a passion for enabling ML research, we want to hear from you!
Job Responsibility:
Design, build, and maintain data pipelines and ML infrastructure to support AI/ML research teams
Collaborate with ML and NLP scientists to address content retrieval needs and build search-related solutions
Create scalable solutions using technologies like Python, Airflow, Databricks, Kubernetes, and AWS
Optimize Databricks notebooks using PySpark, structure ML pipelines, and assist with model production workflows
Develop and deploy REST APIs for model serving and infrastructure communication
Maintain and support Kubernetes clusters for model deployment in production environments
Focus on content retrieval and database query solutions, contributing backend querying expertise (Java, Kotlin, Go)
Requirements:
Strong background in AWS infrastructure with the ability to hit the ground running
Skills in Kubernetes, especially for deploying models in containerized environments
Proficiency in Airflow for robust and scalable data pipeline development
Demonstrated expertise in Python, especially for microservices and pipelines
Ability to collaborate with ML teams without direct modeling responsibilities
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.