CrawlJobs Logo

Azure DataOps Lead

rackspace.com Logo

Rackspace

Location Icon

Location:
India , Gurgaon

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

The Azure DataOps Lead will be responsible for leading the operational delivery, automation, and governance of Azure-based data platforms for enterprise clients. This role involves managing L1/L2/L3 operations, driving proactive monitoring, ensuring SLA adherence, and enabling seamless collaboration between Data Engineering, Cloud, and Business teams. The ideal candidate combines hands-on Azure Data Platform expertise, strong DataOps process management, and team leadership skills to ensure operational excellence, cost optimization, and continuous improvement across customer environments.

Job Responsibility:

  • Lead and manage the Azure DataOps function, ensuring smooth daily operations, incident resolution, and performance stability across production data platforms
  • Oversee data pipeline orchestration and automation using Azure Data Factory (ADF), Synapse Analytics, Databricks, and Logic Apps
  • Implement CI/CD pipelines for data workflows using Azure DevOps or equivalent automation tools
  • Drive incident, problem, change, and request management processes aligned with ITIL best practices
  • Coordinate with L1/L2 support teams for escalations, RCA preparation, and client communication
  • Maintain governance for data quality, access control, and compliance using Azure Purview, Key Vault, and RBAC
  • Collaborate with Data Architects and Cloud Engineers to design scalable, resilient, and cost-efficient Azure data solutions
  • Ensure 24/7 operational readiness through proactive alert monitoring, performance tuning, and preventive maintenance
  • Contribute to automation initiatives using PowerShell, Python, or ARM templates to reduce manual efforts and improve system reliability
  • Partner with customer stakeholders to report on SLAs, KPIs, RCA summaries, and provide technical recommendations for improvement
  • Support onboarding and knowledge transition for new clients and ensure documentation consistency across environments
  • Mentor and upskill the DataOps L1/L2 teams, fostering a culture of ownership, accountability, and process discipline

Requirements:

  • 8–12 years of total IT experience with at least 3–5 years in Azure DataOps or Data Engineering leadership
  • Hands-on expertise with key Azure Data Services, including: Azure Data Factory (ADF), Azure Synapse Analytics, Azure Databricks, Azure SQL Database / SQL Managed Instance, Azure Data Lake Storage Gen2 (ADLS)
  • Strong understanding of DataOps concepts
  • Experience in monitoring and alerting using Log Analytics, Application Insights, and Azure Monitor
  • Working knowledge of incident management, RCA documentation, and operational reporting
  • Strong analytical skills for troubleshooting performance issues and identifying optimization opportunities
  • Excellent communication and stakeholder management skills across global teams

Nice to have:

  • Microsoft Certified: Azure Data Engineer Associate
  • Proficiency across the Azure stack, including Azure SQL Database, Azure Key Vault, Azure Monitor, and Azure Event Hub
  • Experience with Power BI, DataBricks Notebooks, or ML Ops pipelines is a plus
  • Experience working in managed services environments with 24/7 rotational support models

Additional Information:

Job Posted:
January 11, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Azure DataOps Lead

Azure DataOps Lead

The Azure DataOps Lead will be responsible for leading the operational delivery,...
Location
Location
India
Salary
Salary:
Not provided
rackspace.com Logo
Rackspace
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8–12 years of total IT experience with at least 3–5 years in Azure DataOps or Data Engineering leadership
  • Hands-on expertise with key Azure Data Services, including: Azure Data Factory (ADF)
  • Azure Synapse Analytics
  • Azure Databricks
  • Azure SQL Database / SQL Managed Instance
  • Azure Data Lake Storage Gen2 (ADLS)
  • Strong understanding of DataOps concepts
  • Experience in monitoring and alerting using Log Analytics, Application Insights, and Azure Monitor
  • Working knowledge of incident management, RCA documentation, and operational reporting
  • Strong analytical skills for troubleshooting performance issues and identifying optimization opportunities
Job Responsibility
Job Responsibility
  • Lead and manage the Azure DataOps function, ensuring smooth daily operations, incident resolution, and performance stability across production data platforms
  • Oversee data pipeline orchestration and automation using Azure Data Factory (ADF), Synapse Analytics, Databricks, and Logic Apps
  • Implement CI/CD pipelines for data workflows using Azure DevOps or equivalent automation tools
  • Drive incident, problem, change, and request management processes aligned with ITIL best practices
  • Coordinate with L1/L2 support teams for escalations, RCA preparation, and client communication
  • Maintain governance for data quality, access control, and compliance using Azure Purview, Key Vault, and RBAC
  • Collaborate with Data Architects and Cloud Engineers to design scalable, resilient, and cost-efficient Azure data solutions
  • Ensure 24/7 operational readiness through proactive alert monitoring, performance tuning, and preventive maintenance
  • Contribute to automation initiatives using PowerShell, Python, or ARM templates to reduce manual efforts and improve system reliability
  • Partner with customer stakeholders to report on SLAs, KPIs, RCA summaries, and provide technical recommendations for improvement
Read More
Arrow Right

Lead Data Engineer

As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in...
Location
Location
United Kingdom , Any UK Office Hub (Bristol / London / Manchester / Swansea)
Salary
Salary:
80000.00 - 96000.00 GBP / Year
madetech.com Logo
Made Tech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies
  • Strong experience in IaC and able to guide how one could deploy infrastructure into different environments
  • Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop
  • Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes)
  • Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines
  • You understand how to create reusable libraries to encourage uniformity or approach across multiple data pipelines
  • Able to document and present end-to-end diagrams to explain a data processing system on a cloud environment
  • Some knowledge of how you would present diagrams (C4, UML, etc.)
  • Enthusiasm for learning and self-development
  • You have experience of working on agile delivery-lead projects and can apply agile practices such as Scrum, XP, Kanban
Job Responsibility
Job Responsibility
  • Define, shape and perfect data strategies in central and local government
  • Help public sector teams understand the value of their data, and make the most of it
  • Establish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCP
  • Contribute to our recruitment efforts and take on line management responsibilities
  • Help implement efficient data pipelines & storage
What we offer
What we offer
  • 30 days of paid annual leave
  • Flexible parental leave options
  • Part time remote working for all our staff
  • Paid counselling as well as financial and legal advice
  • 7% employer matched pension
  • Flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan
  • Optional social and wellbeing calendar of events
  • Fulltime
Read More
Arrow Right

AI Solutions Architect

We are seeking an experienced AI Solutions Architect to join our data team and d...
Location
Location
United States , San Diego
Salary
Salary:
160000.00 - 180000.00 USD / Year
clearwayenergy.com Logo
Clearway Energy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or related field
  • 5+ years of experience in AI/ML solution architecture and implementation
  • Proven track record of taking AI projects from proof-of-concept to production
  • Strong experience with Snowflake Cortex AI or similar systems for enterprise AI workflows
  • Hands-on experience with AI agentic frameworks (LangChain, LangGraph, Semantic Kernel, CrewAI, or AutoGen) for building autonomous AI workflows
  • Proficiency in integrating LLM APIs and SDKs (OpenAI, Anthropic, Azure OpenAI, Hugging Face) into production applications
  • Experience designing and implementing RAG systems, including vector databases (Pinecone, Weaviate, Chroma, pgvector, or similar), embedding models, and retrieval optimization
  • Experience building interactive applications with Gradio and Streamlit
  • Advanced GitHub/GitLab workflows including CI/CD, branching strategies, and code review processes
  • Expertise in Python, SQL, and modern ML frameworks (PyTorch, TensorFlow, scikit-learn)
Job Responsibility
Job Responsibility
  • Design and architect end-to-end AI solutions using Snowflake Cortex AI, Modal, and cloud-native technologies
  • Develop rapid proof-of-concepts for Retrieval augmented generation (RAG) applications, operational optimization, process optimization, energy forecasting, predictive maintenance, and computer vision (drone footage) use cases
  • Design and implement AI agentic workflows using frameworks such as LangChain, LangGraph, CrewAI, or similar orchestration tools
  • Create interactive demos and prototypes using Gradio and Streamlit for stakeholder validation
  • Translate business requirements into technical specifications and system architectures
  • Build and deploy scalable AI/ML models for business process optimization, renewable energy applications, including wind/solar forecasting, and asset performance optimization
  • Integrate AI capabilities via APIs and SDKs from providers including OpenAI, Anthropic, Azure OpenAI, and Hugging Face
  • Implement MLOps pipelines using Dagster, Snowflake, Sentry, and Modal for model training, deployment, and monitoring
  • Design and optimize RAG architectures, including vector database implementation, embedding strategies, and retrieval pipelines
  • Ensure robust version control and collaboration practices using GitLab
What we offer
What we offer
  • generous PTO
  • medical, dental & vision care
  • HSAs with company contributions
  • health FSAs
  • dependent daycare FSAs
  • commuter benefits
  • relocation
  • 401(k) plan with employer match
  • a variety of life & accident insurances
  • fertility programs
  • Fulltime
Read More
Arrow Right

AI Solutions Architect

We are seeking an experienced AI Solutions Architect to join our data team and d...
Location
Location
United States , Scottsdale
Salary
Salary:
160000.00 - 180000.00 USD / Year
clearwayenergy.com Logo
Clearway Energy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or related field
  • 5+ years of experience in AI/ML solution architecture and implementation
  • Proven track record of taking AI projects from proof-of-concept to production
  • Strong experience with Snowflake Cortex AI or similar systems for enterprise AI workflows
  • Hands-on experience with AI agentic frameworks (LangChain, LangGraph, Semantic Kernel, CrewAI, or AutoGen) for building autonomous AI workflows
  • Proficiency in integrating LLM APIs and SDKs (OpenAI, Anthropic, Azure OpenAI, Hugging Face) into production applications
  • Experience designing and implementing RAG systems, including vector databases (Pinecone, Weaviate, Chroma, pgvector, or similar), embedding models, and retrieval optimization
  • Experience building interactive applications with Gradio and Streamlit
  • Advanced GitHub/GitLab workflows including CI/CD, branching strategies, and code review processes
  • Expertise in Python, SQL, and modern ML frameworks (PyTorch, TensorFlow, scikit-learn)
Job Responsibility
Job Responsibility
  • Design and architect end-to-end AI solutions using Snowflake Cortex AI, Modal, and cloud-native technologies
  • Develop rapid proof-of-concepts for Retrieval augmented generation (RAG) applications, operational optimization, process optimization, energy forecasting, predictive maintenance, and computer vision (drone footage) use cases
  • Design and implement AI agentic workflows using frameworks such as LangChain, LangGraph, CrewAI, or similar orchestration tools
  • Create interactive demos and prototypes using Gradio and Streamlit for stakeholder validation
  • Translate business requirements into technical specifications and system architectures
  • Build and deploy scalable AI/ML models for business process optimization, renewable energy applications, including wind/solar forecasting, and asset performance optimization
  • Integrate AI capabilities via APIs and SDKs from providers including OpenAI, Anthropic, Azure OpenAI, and Hugging Face
  • Implement MLOps pipelines using Dagster, Snowflake, Sentry, and Modal for model training, deployment, and monitoring
  • Design and optimize RAG architectures, including vector database implementation, embedding strategies, and retrieval pipelines
  • Ensure robust version control and collaboration practices using GitLab
What we offer
What we offer
  • generous PTO
  • medical, dental & vision care
  • HSAs with company contributions
  • health FSAs
  • dependent daycare FSAs
  • commuter benefits
  • relocation
  • 401(k) plan with employer match
  • a variety of life & accident insurances
  • fertility programs
  • Fulltime
Read More
Arrow Right

Data Engineering Architect

Location
Location
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 11+ years of professional experience in the Data & Analytics area
  • 5+ years of experience in the Senior Consultant role with a strong focus on Azure data solutions
  • Advanced knowledge and understanding of architecture, application design, systems engineering, and integration
  • Very good knowledge of cloud data services, data warehousing, big data technologies, and data lakes
  • Expertise in data modeling, data integration, and ETL processes
  • Proven experience in using of Microsoft ETL tools (Azure Databricks, Azure Data Factory, Data Lake and SSIS)
  • Programming skills for data analysis (especially PySpark, SparkSQL, Python, SQL)
  • Familiarity with data governance, data security, and compliance standards
  • Familiarity with agile methodologies and the ability to apply DevOps and DataOps principles to data pipelines
  • Ability to use ARM templates
Job Responsibility
Job Responsibility
  • Acting as a Senior Consultant/Solution Advisor
  • Technology partner: Advise on designing data architectures in Microsoft Azure
  • Empowering customer to spot and leverage business opportunities by unlocking the power of data
  • Providing technical and problem-solving expertise for client representatives and Lingaro project teams
  • Data Integration: Lead data integration efforts, including ETL processes, to ensure seamless data flow
  • Cloud Services Utilization: Leverage Azure, as well as tools like dbt and Databricks, for efficient data pipelines and analytics solutions
  • Advise on security measures and compliance standards in cloud environments
  • Continuously monitor and optimize data solutions for cost-efficiency
  • Data Governance: Advise data governance and quality standards
  • Collaboration: Work with cross-functional teams to understand requirements and provide data solutions
What we offer
What we offer
  • Stable employment
  • “Office as an option” model
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
  • Internal Gallup Certified Strengths Coach to support your growth
  • Grow as we grow as a company
Read More
Arrow Right

Senior Director of Data Engineering and Machine Learning

Lead the Data Revolution at Modus Create. At Modus Create, we empower the world’...
Location
Location
United States of America
Salary
Salary:
200000.00 - 240000.00 USD / Year
moduscreate.com Logo
Modus Create
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years in data or software engineering roles
  • 7+ years leading Data Engineering/ML teams—ideally at scale or in global consulting contexts
  • Hands-on experience with cloud data platforms, big data toolchains (Spark, Kafka), data transformation tools (Airflow, dbt), and ML platforms
  • Success in pre-sales, solutioning, and growing data/ML engagements within enterprise or mid-market accounts
  • Demonstrated ability to create enablement programs, uplift team capabilities, and grow inclusive, high-performing engineering cultures
  • Deep empathy for client pain points and the ability to craft and deliver impactful, measurable solutions
  • Excellent across technical, executive, and cross-functional settings, with an ability to successfully navigate diverse cultural differences
Job Responsibility
Job Responsibility
  • Build Modern Data Platforms: Design and oversee architecture for cloud-native data platforms, pipelines, and streaming systems on AWS, Azure, or GCP
  • Ensure robust solutions using platforms such as Databricks, Snowflake, Redshift, BigQuery, Spark, Kafka, Airflow, dbt, and Kubernetes
  • Deliver Products that are Intelligent: Define and drive responsible ML strategy, from model development to integration, using platforms like SageMaker, Azure ML, or TensorFlow
  • Enable smarter client experiences by embedding ML into applications, automation, and analytics
  • Lead & Grow Teams: Foster a culture of trust, continuous learning, and experimentation by hiring, mentoring, and empowering distributed teams of data and ML engineers
  • Define career paths, feedback frameworks, and learning programs grounded in a culture of experimentation,continuous growth, and a sense of belonging at every level
  • Shape Technical Strategy & Best Practices: Develop modular runbooks, tooling standards, and engineering frameworks optimizing for scalability, observability, and security
  • Champion collaborative practices like Agile/Lean development, dataOps, MLOps, and CI/CD for data pipelines and models
  • Business Development & Sales Enablement: Partner with Sales, Partnerships, and Account Teams to find and co-create thoughtful, outcome-driven data & ML engagements
  • Translate client needs into solution designs, shareable collateral, and winning proposals and estimates that reflect both technical strength and business empathy
What we offer
What we offer
  • Remote work with flexible working hours
  • Flexible Time Off/PTO
  • Premium Health Insurance (medical, vision, and dental)
  • Other benefits such as FSA and HSA
  • 401 (k)
  • Modus Global Office Programme: for when you want to get out of your home, we offer on-demand access to private offices, meeting rooms, coworking spaces and business lounges in locations in over 120 countries
  • Employee Referral Program
  • Travel according to client or team needs
  • The chance to work side-by-side with thought leaders in emerging tech
  • Access to more than 12,000 courses with a licensed Coursera account
  • Fulltime
Read More
Arrow Right

Senior Consultant A2 - Data & AI

Microsoft Industry Solutions - Global Center for Innovation and Delivery Center ...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience
  • Bachelor's degree in computer science engineering or equivalent work experience
  • Customer facing Project delivery leadership experience involving solution design, project envisioning, planning, development and deployment of complex solutions with minimum of 5 plus years
  • One or more of the following certifications, or other industry equivalent ones, is a plus: Microsoft Certified: Fabric Analytics Engineer Associate (DP600)
  • Microsoft Certified: Azure AI Engineer Associate (AI102)
  • Microsoft Certified: Azure Solution Architect Expert (AZ-305)
  • Areas of Expertise: Data Architecture & Platform Engineering
  • AI-First Delivery
  • Engineering Excellence & DataOps
  • AI / ML & Intelligent Systems
Job Responsibility
Job Responsibility
  • Lead technical delivery of complex, cloud native and AI enabled engagements
  • Define and drive the technology strategy for large and complex customer engagements
  • Design, develop, and deploy solutions on Microsoft Azure
  • Identifies the best practice approach for a project
  • Identifies dependencies and risks that go beyond the immediate scope and timeframe for a complex project
  • Collaborates, as appropriate, with peers and cross-functional teams to scale the business
  • Drives AI-First data engineering principles and mindset in the team
  • Continuously upskill self to become strong Full stack data engineer
  • Drives new ways of thinking, across the division and subsidiary
  • Implement rapid prototyping and able to lead from brainstorming and whiteboarding ideas to production-ready solutions
  • Fulltime
Read More
Arrow Right

Lead Data Engineer

As a Lead Data Engineer at Rearc, you'll play a pivotal role in establishing and...
Location
Location
United States
Salary
Salary:
Not provided
rearc.io Logo
Rearc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in data engineering, data architecture, or related technical fields
  • Proven ability to design, build, and optimize large-scale data ecosystems
  • Strong track record of leading complex data engineering initiatives
  • Deep hands-on expertise in ETL/ELT design, data warehousing, and data modeling
  • Extensive experience with data integration frameworks and best practices
  • Advanced knowledge of cloud-based data services and architectures (AWS Redshift, Azure Synapse Analytics, Google BigQuery, or equivalent)
  • Strong strategic and analytical thinking
  • Proficiency with modern data engineering frameworks (Databricks, Spark, lakehouse technologies like Delta Lake)
  • Exceptional communication and interpersonal skills
Job Responsibility
Job Responsibility
  • Engage deeply with stakeholders to understand data needs, business challenges, and technical constraints
  • Translate stakeholder needs into scalable, high-quality data solutions
  • Implement with a DataOps mindset using tools like Apache Airflow, Databricks/Spark, Kafka
  • Build reliable, automated, and efficient data pipelines and architectures
  • Lead and execute complex projects
  • Provide technical direction and set engineering standards
  • Ensure alignment with customer goals and company principles
  • Mentor and develop data engineers
  • Promote knowledge sharing and thought leadership
  • Contribute to internal and external content
What we offer
What we offer
  • Comprehensive health benefits
  • Generous time away and flexible PTO
  • Maternity and paternity leave
  • Access to educational resources with reimbursement for continued learning
  • 401(k) plan with company contribution
Read More
Arrow Right