Senior Data Engineer

• Design and implement scalable data platforms and pipelines across cloud environments (Azure/Fabric, AWS, GCP, Databricks, Snowflake)
• develop reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake
• implement modern data architectures including lakehouse patterns and medallion layering (bronze, silver, gold)
• deliver high-quality datasets that support analytics, machine learning, causal modeling, and optimization systems
• enable data pipelines for GenAI use cases (including LLMs, RAG pipelines, and vector-based data flows)
• design scalable logical and physical data models for analytical and operational use cases
• orchestrate workflows using tools such as Airflow, dbt, Lakeflow, or equivalents
• apply modern architecture patterns including event-driven and streaming architectures
• ensure adherence to best practices in data governance, lineage, quality, and access control (RBAC/ABAC)
• establish strong data observability
• enable data serving layers (APIs, feature inputs, analytical endpoints) to support downstream systems
• continuously monitor and optimize pipelines and infrastructure for performance, scalability, and cost efficiency
• work closely with data scientists, ML engineers, analysts, and business stakeholders to translate requirements into robust data solutions

Strong hands-on experience with Apache Spark and Delta Lake, and strong programming skills in Python and SQL. Proven experience building batch and streaming data pipelines and production-grade data platforms, with solid understanding of data modeling, data quality, and governance principles. Experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP. Familiarity with modern data platforms such as Databricks and Snowflake is expected. Experience with lakehouse architectures and distributed data systems, and strong understanding of scalability, reliability, and performance considerations in data pipelines. Strong problem-solving skills focused on scalability and reliability, with a collaborative approach to working in cross-functional teams.

• Experience with GenAI and AI data systems (e.g., RAG pipelines, vector databases, LLM data preparation)
• CI/CD for data pipelines and infrastructure-as-code tools such as Terraform, ARM, or CloudFormation
• additional exposure to streaming technologies (e.g., Kafka), Spark optimization, or advanced analytics and ML workloads (including causal or experimentation platforms)
• experience building data products or large-scale analytics platforms

• Private health insurance
• Education program
• Wellbeing program
• Free beverages
• Events
• Competitive conditions
• Challenging projects
• Cool colleagues
• Honest feedback