This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
A VC-backed conversational AI scale-up is expanding its engineering team and is looking for a Senior Data Engineer with deep Spark expertise to help architect and scale the data backbone behind cutting-edge AI-driven systems.
Job Responsibility:
Design and evolve distributed, cloud-based data infrastructure that supports both real-time and batch processing at scale
Build high-performance data pipelines that power analytics, AI/ML workloads, and integrations with third-party platforms
Champion data reliability, quality, and observability, introducing automation and monitoring across pipelines
Collaborate closely with engineering, product, and AI teams to deliver data solutions for business-critical initiatives
Requirements:
4+ years in software development and data engineering with ownership of production-grade systems
Proven expertise in Spark/PySpark
Strong knowledge of distributed computing and modern data modeling approaches
Solid programming skills in Python, with an emphasis on clean, maintainable code
Hands-on experience with SQL and NoSQL databases (e.g., PostgreSQL, DynamoDB, Cassandra)
Excellent communicator who can influence and partner across teams
Nice to have:
Experience in high-growth, early-stage environments
Familiarity with MLOps and deploying ML models into production data workflows
A problem-solver at heart, excited by innovation and complex challenges
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.