Job Description
Build and maintain data ingestion pipelines using Data Factory, Dataflows Gen2, Pipelines, and event driven patterns. Develop Lakehouse structures using Delta Lake, Notebooks (PySpark), and medallion architecture. Implement Fabric Data Warehouse objects (tables, stored procedures, views, SQL endpoints). Create and optimize semantic models for Power BI, including Direct Lake datasets. Develop KQL databases and real time analytics components where required. Implement CI/CD pipelines for Fabric using Git integration and DevOps best practices. Monitor, troubleshoot, and optimize Fabric workloads for performance and cost. Ensure data quality through validation rules, profiling, and automated checks. Support production deployments, incident resolution, and environment management. Work with Hiscox business teams to understand data requirements and translate them into technical solutions. Collaborate with Solution Architects to ensure alignment with overall platform design. Provide technical guidance to analysts, report developers, and data consumers. Apply data governance standards using Purview integration, lineage, and metadata management. Implement access controls, workspace security, and data protection policies. Ensure compliance with insurance regulatory requirements (e.g., GDPR, Solvency II, IFRS 17). Contribute to reusable frameworks, templates, and accelerators for Fabric engineering. Stay updated with new Fabric features and recommend adoption where beneficial. Participate in code reviews, design sessions, and engineering best practice forums.
