CrawlJobs Logo

Azure Data Platform Lead

India · Job Posted June 03, 2026
Apply Position
Job Link Share

Job Description

Lead the design, implementation, and optimization of enterprise-scale Azure data platform solutions, driving modern data architecture initiatives and establishing best practices for data engineering and analytics.

Job Responsibility

  • Design and implement scalable data platform architectures using Azure services (Synapse, Data Factory, Fabric, SQL Database)
  • Establish data lakehouse and data warehouse solutions with medallion architecture patterns
  • Define data governance frameworks, security protocols, and compliance standards
  • Lead platform evaluations, vendor selections, and technology roadmap planning
  • Architect data ingestion pipelines from diverse sources including databases, APIs, files, and streaming systems
  • Design and optimize ETL/ELT processes using SQL, Python, Spark, and Azure native services
  • Implement data quality frameworks, monitoring, and alerting systems
  • Establish CI/CD pipelines for data workflows and infrastructure as code
  • Design seamless integrations with BI tools, analytics platforms, and downstream systems
  • Optimize performance, cost, and scalability through automated resource management
  • Enable advanced analytics and machine learning capabilities on the platform
  • Lead data migration projects and platform modernization initiatives

Requirements

  • 7+ years Azure data platform experience (Data Factory, Synapse Analytics, SQL Database, Storage)
  • Expert-level SQL, Python, and experience with Apache Spark (PySpark/Scala)
  • Strong understanding of data architecture patterns, data modeling, and distributed systems
  • Experience with Azure DevOps, ARM templates, and infrastructure automation
  • Knowledge of data governance tools and frameworks (Microsoft Purview preferred)
  • Hands-on experience with modern data stack components and cloud-native architectures
  • RESTful API integration, real-time streaming, and batch processing systems
  • Enterprise data warehouse and analytics platform implementation
  • Performance tuning, cost optimization, and capacity planning experience
  • Proven ability to lead technical teams and mentor junior engineers
  • Experience presenting technical solutions to stakeholders at all levels
  • Strong documentation and knowledge transfer capabilities
  • Project management experience with data platform initiatives

Nice to have

  • Microsoft Azure certifications (Data Engineer Associate, Solutions Architect Expert)
  • Experience with Microsoft Fabric and Power Platform integration
  • Machine learning and AI model deployment experience
  • Multi-cloud platform knowledge and cloud migration experience
  • Industry-specific data architecture experience (retail, financial services, healthcare)

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Azure Data Platform Lead

8 matching positions

Data Engineering & Analytics Lead

Premium Health is seeking a highly skilled, hands-on Data Engineering & Analytic...
Location
Location
United States , Brooklyn
Salary
Salary:
Not provided
premiumhealth.org Logo
Premium Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred
  • Proven track record and progressively responsible experience in data engineering, data architecture, or related technical roles
  • healthcare experience preferred
  • Strong knowledge of data engineering principles, data integration, ETL processes, and semantic mapping techniques and best practices
  • Experience implementing data quality management processes, data governance frameworks, cataloging, and master data management concepts
  • Familiarity with healthcare data standards (e.g., HL7, FHIR, etc), health information management principles, and regulatory requirements (e.g., HIPAA)
  • Understanding of healthcare data, including clinical, operational, and financial data models, preferred
  • Advanced proficiency in SQL, data modeling, database design, optimization, and performance tuning
  • Experience designing and integrating data from disparate systems into harmonized data models or semantic layers
  • Hands-on experience with modern cloud-based data platforms (e.g Azure, AWS, GCP)
Job Responsibility
Job Responsibility
  • Collaborate with the CDIO and Director of Technology to define a clear data vision aligned with the organization's goals and execute the enterprise data roadmap
  • Serve as a thought leader for data engineering and analytics, guiding the evolution of our data ecosystem and championing data-driven decision-making across the organization
  • Build and mentor a small data team, providing technical direction and performance feedback, fostering best practices and continuous learning, while remaining a hands-on implementor
  • Define and implement best practices, standards, and processes for data engineering, analytics, and data management across the organization
  • Design, implement, and maintain a scalable, reliable, and high-performing modern data infrastructure, aligned with the organizational needs and industry best practices
  • Architect and maintain data lake/lakehouse, warehouse, and related platform components to support analytics, reporting, and operational use cases
  • Establish and enforce data architecture standards, governance models, naming conventions ,and documentation
  • Develop, optimize, and maintain scalable ETL/ELT pipelines and data workflows to collect, transform, normalize, and integrate data from diverse systems
  • Implement robust data quality processes, validation, monitoring, and error-handling frameworks
  • Ensure data is accurate, timely, secure, and ready for self-service analytics and downstream applications
What we offer
What we offer
  • Paid Time Off, Medical, Dental and Vision plans, Retirement plans
  • Public Service Loan Forgiveness (PSLF)
  • Fulltime
Read More
Arrow Right

Senior Azure Data Engineer

Seeking a Lead AI DevOps Engineer to oversee design and delivery of advanced AI/...
Location
Location
Poland
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 6 years of professional experience in the Data & Analytics area
  • 1+ years of experience (or acting as) in the Senior Consultant or above role with a strong focus on data solutions build in Azure and Databricks/Synapse/(MS Fabric is nice to have)
  • Proven experience in Azure cloud-based infrastructure, Databricks and one of SQL implementation (e.g., Oracle, T-SQL, MySQL, etc.)
  • Proficiency in programming languages such as SQL, Python, PySpark is essential (R or Scala nice to have)
  • Very good level of communication including ability to convey information clearly and specifically to co-workers and business stakeholders
  • Working experience in the agile methodologies – supporting tools (JIRA, Azure DevOps)
  • Experience in leading and managing a team of data engineers, providing guidance, mentorship, and technical support
  • Knowledge of data management principles and best practices, including data governance, data quality, and data integration
  • Good project management skills, with the ability to prioritize tasks, manage timelines, and deliver high-quality results within designated deadlines
  • Excellent problem-solving and analytical skills, with the ability to identify and resolve complex data engineering issues
Job Responsibility
Job Responsibility
  • Act as a senior member of the Data Science & AI Competency Center, AI Engineering team, guiding delivery and coordinating workstreams
  • Develop and execute a cloud data strategy aligned with organizational goals
  • Lead data integration efforts, including ETL processes, to ensure seamless data flow
  • Implement security measures and compliance standards in cloud environments
  • Continuously monitor and optimize data solutions for cost-efficiency
  • Establish and enforce data governance and quality standards
  • Leverage Azure services, as well as tools like dbt and Databricks, for efficient data pipelines and analytics solutions
  • Work with cross-functional teams to understand requirements and provide data solutions
  • Maintain comprehensive documentation for data architecture and solutions
  • Mentor junior team members in cloud data architecture best practices
What we offer
What we offer
  • Stable employment
  • “Office as an option” model
  • Workation
  • Great Place to Work® certified employer
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
Read More
Arrow Right

Lead Platform Manager

The Team Lead Platform Manager Integration is responsible for the delivery, stab...
Location
Location
United Kingdom , Birmingham
Salary
Salary:
64500.00 GBP / Year
welovesalt.com Logo
Salt
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong integration delivery and engineering skills covering enterprise scale system connectivity and API development
  • Ability to lead complex technology services and balance technical needs with supplier performance
  • Strong understanding of Azure integration tooling
  • Supplier and stakeholder management skills
  • Ability to lead technical teams and set direction across support and delivery
  • Strong knowledge of Azure integration services and native cloud components
  • Good understanding of ERP or major enterprise systems such as Oracle or P6 and how they integrate
  • Knowledge of integration security principles and data transfer risks
  • Knowledge of agile and waterfall delivery approaches
  • Proven experience delivering enterprise scale integrations in a senior or lead position
Job Responsibility
Job Responsibility
  • Own the design, delivery and performance of integration services across the organisation
  • Lead the support and stabilisation of existing integration platforms including point to point links, automated interfaces and API based services
  • Develop and implement an enterprise integration strategy for internal systems and external third parties, suppliers, and partners
  • Oversee Azure integration services including API Management, Logic Apps, Azure Monitor and other native cloud components
  • Lead internal teams and suppliers providing integration development, support and operational services
  • Define technical standards, security controls and design patterns for all integration work
  • Ensure integration services meet SLAs and KPIs and deliver improvements where needed
  • Lead the identification and resolution of integration related issues, risks and vulnerabilities
  • Support integration activity across programmes using agile or waterfall delivery depending on project needs
  • Promote a consistent and inclusive approach across all workstreams
  • Fulltime
Read More
Arrow Right

Azure Data Architect

Location: 100% Remote; Years’ Experience: 10+ years Professional Experience; Edu...
Location
Location
United States
Salary
Salary:
Not provided
sparibis.com Logo
Sparibis
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in data science, machine learning, and statistical modeling
  • Bachelor’s degree in data science, Statistics, Mathematics, Computer Science, or a related quantitative field experience
  • Must be able to obtain and maintain a Secret security clearance
  • Expertise in statistical modeling, machine learning algorithms, and data mining techniques
  • Experience with cloud computing platforms (e.g., Azure, Data Lake, Synapse Analytics, Machine Learning, Databricks, Logic Apps, AI Foundry)
  • Proficiency in programming languages such as Python, R, SQL, PySpark
  • Strong proficiency in Python or similar language and SQL for data preparation, analysis, and modeling
  • Experience with data visualization tools (e.g., Power BI)
  • Strong experience with data extraction, cleaning, and transformation (ETL) processes
  • Experience in data governance, metadata management, and data cataloging
Job Responsibility
Job Responsibility
  • Data Science Strategy: Develop and implement a data science strategy for the project, aligning with USMC’s strategic goals and objectives
  • Problem Identification: Work with USMC stakeholders to identify opportunities to leverage data to improve HR processes, such as recruitment, retention, training, and performance management
  • Data Exploration & Analysis: Lead the exploration and analysis of large datasets to identify trends, patterns, and insights to understand data quality, gaps, and potential enhancements
  • Model Development: Design, develop, and validate predictive models using machine learning algorithms and statistical techniques
  • Model Deployment: Deploy and maintain machine learning models in a production environment, ensuring scalability and reliability
  • Data Visualization: Create compelling data visualizations using tools such as Power BI to communicate insights to stakeholders
  • Team Leadership: Lead and mentor a team of data scientists, providing technical guidance and support
  • Collaboration: Collaborate with other teams, including software developers, system architects, and business analysts, and to integrate data science solutions
  • Data Quality: Ensure data quality and accuracy by implementing data validation and cleansing processes
  • Compliance: Ensure that all data science activities comply with relevant USMC and DoD regulations and security policies
Read More
Arrow Right

Lead Data Engineer

Lead Data Engineer to serve as both a technical leader and people coach for our ...
Location
Location
India , Gurugram
Salary
Salary:
Not provided
https://www.circlek.com Logo
Circle K
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or master’s degree in computer science, Engineering, or related field
  • 8-10 years of data engineering experience with strong hands-on delivery using ADF, SQL, Python, Databricks, and Spark
  • Experience designing data pipelines, warehouse models, and processing frameworks using Snowflake or Azure Synapse
  • Proficient with CI/CD tools (Azure DevOps, GitHub) and observability practices
  • Solid grasp of data governance, metadata tagging, and role-based access control
  • Proven ability to mentor and grow engineers in a matrixed or global environment
  • Strong verbal and written communication skills, with the ability to operate cross-functionally
  • Strong Knowledge of Data Engineering concepts (Data pipelines creation, Data Warehousing, Data Marts/Cubes, Data Reconciliation and Audit, Data Management)
  • Working Knowledge of Dev-Ops processes (CI/CD), Git/Jenkins version control tool, Master Data Management (MDM) and Data Quality tools
  • Strong Experience in ETL/ELT development, QA and operation/support process (RCA of production issues, Code/Data Fix Strategy, Monitoring and maintenance)
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable pipelines across ADF, Databricks, Snowflake, and related platforms
  • Lead the technical execution of non-domain specific initiatives (e.g. reusable dimensions, TLOG standardization, enablement pipelines)
  • Architect data models and re-usable layers consumed by multiple downstream pods
  • Guide platform-wide patterns like parameterization, CI/CD pipelines, pipeline recovery, and auditability frameworks
  • Mentoring and coaching team
  • Partner with product and platform leaders to ensure engineering consistency and delivery excellence
  • Act as an L3 escalation point for operational data issues impacting foundational pipelines
  • Own engineering best practices, sprint planning, and quality across the Enablement pod
  • Contribute to platform discussions and architectural decisions across regions
  • Fulltime
Read More
Arrow Right

Lead Data Engineer

As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in...
Location
Location
United Kingdom , Any UK Office Hub (Bristol / London / Manchester / Swansea)
Salary
Salary:
80000.00 - 96000.00 GBP / Year
madetech.com Logo
Made Tech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies
  • Strong experience in IaC and able to guide how one could deploy infrastructure into different environments
  • Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop
  • Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes)
  • Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines
  • You understand how to create reusable libraries to encourage uniformity or approach across multiple data pipelines
  • Able to document and present end-to-end diagrams to explain a data processing system on a cloud environment
  • Some knowledge of how you would present diagrams (C4, UML, etc.)
  • Enthusiasm for learning and self-development
  • You have experience of working on agile delivery-lead projects and can apply agile practices such as Scrum, XP, Kanban
Job Responsibility
Job Responsibility
  • Define, shape and perfect data strategies in central and local government
  • Help public sector teams understand the value of their data, and make the most of it
  • Establish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCP
  • Contribute to our recruitment efforts and take on line management responsibilities
  • Help implement efficient data pipelines & storage
What we offer
What we offer
  • 30 days of paid annual leave
  • Flexible parental leave options
  • Part time remote working for all our staff
  • Paid counselling as well as financial and legal advice
  • 7% employer matched pension
  • Flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan
  • Optional social and wellbeing calendar of events
  • Fulltime
Read More
Arrow Right

Big Data Lead Developer

We are seeking a highly skilled and experienced Big Data Lead Developer to estab...
Location
Location
Canada , Mississauga
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of relevant experience in Big Data application development or systems analysis role
  • Experience in leading and mentoring big data engineering teams
  • Strong understanding of big data concepts, architectures, and technologies (e.g., Hadoop, PySpark, Hive, Kafka, NoSQL databases)
  • Proficiency in programming languages such as Java, Scala, or Python
  • Excellent problem-solving and analytical skills
  • Strong presentation, communication and interpersonal skills
  • Experience with data warehousing and business intelligence tools
  • Experience with data visualization and reporting
  • Knowledge of cloud-based big data platforms (e.g., AWS EMR, Azure HDInsight, Google Cloud Dataproc)
  • Proficiency in Unix/Linux environments
Job Responsibility
Job Responsibility
  • Lead and mentor a team of big data engineers, fostering a collaborative and high-performing environment
  • Provide technical guidance, code reviews, and support for professional development
  • Design and implement scalable and robust big data architectures and pipelines to handle large volumes of data from various sources
  • Evaluate and select appropriate big data technologies and tools based on project requirements and industry best practices
  • Implement and integrate these technologies into our existing infrastructure
  • Develop and optimize data processing and analysis workflows using technologies such as Spark, Hadoop, Hive, and other relevant tools
  • Implement data quality checks and ensure adherence to data governance policies and procedures
  • Continuously monitor and optimize the performance of big data systems and pipelines to ensure efficient data processing and retrieval
  • Collaborate effectively with cross-functional teams, including data scientists, business analysts, and product managers, to understand their data needs and deliver impactful solutions
  • Stay up to date with the latest advancements in big data technologies and explore new tools and techniques to improve our data infrastructure
What we offer
What we offer
  • Global benefits designed to support your well-being, growth, and work-life balance
  • Fulltime
Read More
Arrow Right

IT Development Manager for Data Intelligence Platform

You will lead technical developments of a Data Intelligence Platform and partner...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
https://www.bosch.pl/ Logo
Robert Bosch Sp. z o.o.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in developing Data Management and Analytics applications
  • Extensive Knowledge of (Meta) Data Management capabilities: Data Governance, Data Lineage, Data Assets, Data Products, Data Catalog, Data Marketplace, Data Policy, Ontologies
  • Considerable experience in designing, developing & integrating Data and Analytics applications using modern architectures and frameworks, structured and unstructured data
  • Broad and up to date technical knowledge: Databases (e.g. Oracle, Databricks), Middleware/Integration (e.g. Solace, Kafka), API Management, Cloud Providers (Azure, AWS, Google), AI Technologies (LLMs, Agents)
  • Experimental mindset, self-motivation to search for solutions and appreciate learning new things
  • Strong communication skills, proactive in contacting people
  • English (fluent in spoken and written)
Job Responsibility
Job Responsibility
  • Lead technical developments of a Data Intelligence Platform
  • Partner with Business, Solution and IT Architects on the strategy and delivery of the Platform functionalities
  • Define consistent system specific guidelines for the software development and configuration environment in alignment with central guidelines
  • Assess customer requirements from a technical perspective with respective effort estimations and assist in the design and development of proof of concept and prototypes
  • Document specifications and support the creation of operational support manuals during the technical implementation
  • Take over responsibility for interface implementation and documentation
  • Steer external and internal developers
  • Support DevOps by sizing and scalability concepts (for specific use cases)
What we offer
What we offer
  • Competitive salary + annual bonus
  • Hybrid work with flexible working hours
  • Referral Bonus Program
  • Copyright costs for IT employees
  • Private medical care and life insurance
  • Cafeteria System with multiple benefits (incl. MultiSport, shopping vouchers, cinema tickets, etc.)
  • Prepaid Lunch Card
  • Non-working day on the 31st of December
  • Fulltime
Read More
Arrow Right