Data Engineer

• Design, develop, and implement data pipelines and ETL workflows using cutting-edge Azure technologies (e.g., Databricks, Synapse Analytics, Synapse Pipelines)
• Manage and optimize big data processes, ensuring scalability, efficiency, and data accuracy
• Build and work with real-time data pipelines leveraging technologies such as Kafka, Event Hubs, and Spark Streaming
• Apply advanced skills in Python and Spark SQL to build data solutions for analytics and machine learning
• Collaborate with business analysts and stakeholders to implement impactful dashboards using Power BI
• Architect and support the seamless integration of diverse data sources into a central platform for analytics, reporting, and model serving via ML Flow

• Azure Databricks expertise, including ML Flow/model serving
• Proficiency in Azure Synapse Analytics and Synapse Pipelines
• Strong knowledge and hands-on experience with Python and Spark SQL
• Practical experience with Power BI for designing and deploying dashboards
• Familiarity with real-time data pipelines such as Kafka, Event Hubs, and Spark Streaming (preferred but not mandatory)
• Bachelor's degree in Computer Science, Data Science, Software Engineering, or equivalent experience
• 3+ years of dedicated data engineering experience, with a focus on big data and cloud analytics
• Excellent problem-solving and analytical skills, with a strong ability to troubleshoot and optimize systems
• Ability to work autonomously while collaborating across teams to deliver timely projects

Familiarity with real-time data pipelines such as Kafka, Event Hubs, and Spark Streaming

• Competitive salary range of $140K - $175K
• Hybrid work flexibility, combining the best of onsite collaboration and remote productivity
• Comprehensive health, dental, and vision insurance
• Industry perks and discounts
• Paid time off and generous holiday schedule