CrawlJobs Logo

Azure DataOps Lead

rackspace.com Logo

Rackspace

Location Icon

Location:
India

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

The Azure DataOps Lead will be responsible for leading the operational delivery, automation, and governance of Azure-based data platforms for enterprise clients. This role involves managing L1/L2/L3 operations, driving proactive monitoring, ensuring SLA adherence, and enabling seamless collaboration between Data Engineering, Cloud, and Business teams. The ideal candidate combines hands-on Azure Data Platform expertise, strong DataOps process management, and team leadership skills to ensure operational excellence, cost optimization, and continuous improvement across customer environments.

Job Responsibility:

  • Lead and manage the Azure DataOps function, ensuring smooth daily operations, incident resolution, and performance stability across production data platforms
  • Oversee data pipeline orchestration and automation using Azure Data Factory (ADF), Synapse Analytics, Databricks, and Logic Apps
  • Implement CI/CD pipelines for data workflows using Azure DevOps or equivalent automation tools
  • Drive incident, problem, change, and request management processes aligned with ITIL best practices
  • Coordinate with L1/L2 support teams for escalations, RCA preparation, and client communication
  • Maintain governance for data quality, access control, and compliance using Azure Purview, Key Vault, and RBAC
  • Collaborate with Data Architects and Cloud Engineers to design scalable, resilient, and cost-efficient Azure data solutions
  • Ensure 24/7 operational readiness through proactive alert monitoring, performance tuning, and preventive maintenance
  • Contribute to automation initiatives using PowerShell, Python, or ARM templates to reduce manual efforts and improve system reliability
  • Partner with customer stakeholders to report on SLAs, KPIs, RCA summaries, and provide technical recommendations for improvement
  • Support onboarding and knowledge transition for new clients and ensure documentation consistency across environments
  • Mentor and upskill the DataOps L1/L2 teams, fostering a culture of ownership, accountability, and process discipline

Requirements:

  • 8–12 years of total IT experience with at least 3–5 years in Azure DataOps or Data Engineering leadership
  • Hands-on expertise with key Azure Data Services, including: Azure Data Factory (ADF)
  • Azure Synapse Analytics
  • Azure Databricks
  • Azure SQL Database / SQL Managed Instance
  • Azure Data Lake Storage Gen2 (ADLS)
  • Strong understanding of DataOps concepts
  • Experience in monitoring and alerting using Log Analytics, Application Insights, and Azure Monitor
  • Working knowledge of incident management, RCA documentation, and operational reporting
  • Strong analytical skills for troubleshooting performance issues and identifying optimization opportunities
  • Excellent communication and stakeholder management skills across global teams

Nice to have:

  • Microsoft Certified: Azure Data Engineer Associate
  • Proficiency across the Azure stack, including Azure SQL Database, Azure Key Vault, Azure Monitor, and Azure Event Hub
  • Experience with Power BI, DataBricks Notebooks, or ML Ops pipelines is a plus
  • Experience working in managed services environments with 24/7 rotational support models

Additional Information:

Job Posted:
January 05, 2026

Work Type:
Remote work
Icon
Rackspace - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Azure DataOps Lead

Azure DataOps Lead

The Azure DataOps Lead will be responsible for leading the operational delivery,...
Location
Location
India , Gurgaon
Salary
Salary:
Not provided
rackspace.com Logo
Rackspace
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8–12 years of total IT experience with at least 3–5 years in Azure DataOps or Data Engineering leadership
  • Hands-on expertise with key Azure Data Services, including: Azure Data Factory (ADF), Azure Synapse Analytics, Azure Databricks, Azure SQL Database / SQL Managed Instance, Azure Data Lake Storage Gen2 (ADLS)
  • Strong understanding of DataOps concepts
  • Experience in monitoring and alerting using Log Analytics, Application Insights, and Azure Monitor
  • Working knowledge of incident management, RCA documentation, and operational reporting
  • Strong analytical skills for troubleshooting performance issues and identifying optimization opportunities
  • Excellent communication and stakeholder management skills across global teams
Job Responsibility
Job Responsibility
  • Lead and manage the Azure DataOps function, ensuring smooth daily operations, incident resolution, and performance stability across production data platforms
  • Oversee data pipeline orchestration and automation using Azure Data Factory (ADF), Synapse Analytics, Databricks, and Logic Apps
  • Implement CI/CD pipelines for data workflows using Azure DevOps or equivalent automation tools
  • Drive incident, problem, change, and request management processes aligned with ITIL best practices
  • Coordinate with L1/L2 support teams for escalations, RCA preparation, and client communication
  • Maintain governance for data quality, access control, and compliance using Azure Purview, Key Vault, and RBAC
  • Collaborate with Data Architects and Cloud Engineers to design scalable, resilient, and cost-efficient Azure data solutions
  • Ensure 24/7 operational readiness through proactive alert monitoring, performance tuning, and preventive maintenance
  • Contribute to automation initiatives using PowerShell, Python, or ARM templates to reduce manual efforts and improve system reliability
  • Partner with customer stakeholders to report on SLAs, KPIs, RCA summaries, and provide technical recommendations for improvement
  • Fulltime
Read More
Arrow Right

Lead Data Engineer

As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in...
Location
Location
United Kingdom , Any UK Office Hub (Bristol / London / Manchester / Swansea)
Salary
Salary:
80000.00 - 96000.00 GBP / Year
madetech.com Logo
Made Tech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies
  • Strong experience in IaC and able to guide how one could deploy infrastructure into different environments
  • Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop
  • Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes)
  • Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines
  • You understand how to create reusable libraries to encourage uniformity or approach across multiple data pipelines
  • Able to document and present end-to-end diagrams to explain a data processing system on a cloud environment
  • Some knowledge of how you would present diagrams (C4, UML, etc.)
  • Enthusiasm for learning and self-development
  • You have experience of working on agile delivery-lead projects and can apply agile practices such as Scrum, XP, Kanban
Job Responsibility
Job Responsibility
  • Define, shape and perfect data strategies in central and local government
  • Help public sector teams understand the value of their data, and make the most of it
  • Establish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCP
  • Contribute to our recruitment efforts and take on line management responsibilities
  • Help implement efficient data pipelines & storage
What we offer
What we offer
  • 30 days of paid annual leave
  • Flexible parental leave options
  • Part time remote working for all our staff
  • Paid counselling as well as financial and legal advice
  • 7% employer matched pension
  • Flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan
  • Optional social and wellbeing calendar of events
  • Fulltime
Read More
Arrow Right
New

Data Engineer (Azure&Databricks)

We are seeking a Data Engineer to design and implement data solutions in Microso...
Location
Location
Hungary , Budapest
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
June 14, 2026
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, IT, or a related field
  • Minimum 2 years of Databricks and 4 years of Azure experience (certifications preferred)
  • Experience as a Data Architect/Engineer with hands-on expertise in Data Lakehouse, Data Lake, and Data Warehouse design
  • Strong knowledge of Databricks, Data Lakes and Spark
  • Strong experience with Azure Platform Services (Identities, Network, Storage)
  • Proficiency with Azure Data Services, including Azure Data Factory, Azure SQL
  • Experience with streaming data technologies like Databricks Streaming, Kafka, Azure Streaming Services
  • Experience with Azure DevOps especially Azure Pipelines
  • Proficiency in Python, PySpark, SQL
  • Familiarity with DataOps
Job Responsibility
Job Responsibility
  • Lead technical decisions for enterprise data architecture using Databricks
  • Develop strategies for cost-effective, high-performance data architectures, covering everything from data streams to analytical storage
  • Design and implement data solutions in Microsoft Azure, based on project needs
  • Build and maintain ETL processes and data models for analytical pipelines, especially in Finance
  • Establish and uphold best practices for software development, like version control, testing, and CI
  • Support pre-sales activities, including RFPs, proposals, and client communications
  • Guide discussions on cloud data warehousing and machine learning platforms
  • Provide technical support for vendor and third-party engagements
  • Offer ongoing support for business and technology teams on platform strategy and ...
What we offer
What we offer
  • Flexible remote working
  • Training and learning opportunities
  • Support and opportunities for professional development
  • Cafeteria package
  • Private health insurance
  • Home office allowance
  • Fulltime
Read More
Arrow Right

Data Architect

As a Data Architect at HSO, you will play a key role in enabling the design and ...
Location
Location
Australia , Sydney
Salary
Salary:
Not provided
hso.com Logo
HSO
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years’ experience designing and building data solutions in production environments
  • Proven experience implementing Microsoft Fabric and/or Azure Databricks for customers
  • Strong understanding of modern cloud data architectures and Azure services
  • Experience with data governance frameworks and data modelling
  • Exposure to AI and machine learning workloads and the data architectures that support them
  • Hands-on experience with DevOps/DataOps practices, CI/CD pipelines, and source control
  • Experience leading projects and technical teams end-to-end
  • Strong customer-facing skills with the confidence to workshop solutions directly with clients
  • Ability to translate complex technical architectures into clear, business-focused explanations
  • Strong problem-solving and organisational skills with the ability to manage competing priorities
Job Responsibility
Job Responsibility
  • Design, lead, and deliver modern, well-architected cloud data platforms based on Microsoft Azure foundations
  • Scope and develop frameworks, reference architectures, tooling, costing models, and governance standards
  • Act as technical lead on Microsoft Fabric and Azure Databricks implementations
  • Lead data platform initiatives end-to-end, including design, migration, data modelling, testing, deployment, and ongoing support
  • Apply data architecture patterns and best practices across projects
  • Consider non-functional requirements including performance, security, governance, operational needs, and cost optimisation
  • Work directly with enterprise customers to design and implement modern data architectures
  • Support customers with cloud data infrastructure, security, licensing, governance, modelling, and migration
  • Qualify new customers and help existing customers identify new opportunities and enhancements
  • Clearly communicate complex technical concepts to non-technical stakeholders
  • Fulltime
Read More
Arrow Right
New

Software Automation Testing Expert

We are seeking an experienced Software Automation Testing Specialist to support ...
Location
Location
Egypt , Giza
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in testing or related software disciplines
  • strong understanding of testing methodologies including regression, integration, performance, acceptance, and unit testing
  • hands-on experience with web, cloud, and data visualisation-based applications
  • proficient in database fundamentals, including CRUD operations
  • experience using test management tools, preferably Azure DevOps
  • worked with at least two browser automation tools such as Selenium, Cypress, or Puppeteer
  • comfortable coding or scripting using Python or similar languages
  • experience testing APIs using tools such as Postman
  • understanding CI/CD pipelines and DevOps concepts including GitOps, DataOps, and SecOps
  • knowledge of cloud platforms such as GCP, AWS, or Azure
Job Responsibility
Job Responsibility
  • Participate in and lead testing activities across complex programmes and projects
  • Analyse testing requirements and develop effective test strategies aligned with business and technical needs
  • Select, recommend, and apply appropriate automation and test management tools
  • Define and track testing metrics to monitor quality, effectiveness, and delivery performance
  • Provide testing guidance and risk management support to project teams and stakeholders
  • Communicate testing progress, risks, and outcomes to internal and external partners
  • Develop and present testing proposals and improvement initiatives
  • Identify and implement improvements to testing methods, standards, and practices
  • Stay up to date with emerging testing tools, technologies, and industry trends
  • Support knowledge sharing through communities of practice, lessons learned, and testing collateral
  • Fulltime
Read More
Arrow Right

AI Solutions Architect

We are seeking an experienced AI Solutions Architect to join our data team and d...
Location
Location
United States , San Diego
Salary
Salary:
160000.00 - 180000.00 USD / Year
clearwayenergy.com Logo
Clearway Energy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or related field
  • 5+ years of experience in AI/ML solution architecture and implementation
  • Proven track record of taking AI projects from proof-of-concept to production
  • Strong experience with Snowflake Cortex AI or similar systems for enterprise AI workflows
  • Hands-on experience with AI agentic frameworks (LangChain, LangGraph, Semantic Kernel, CrewAI, or AutoGen) for building autonomous AI workflows
  • Proficiency in integrating LLM APIs and SDKs (OpenAI, Anthropic, Azure OpenAI, Hugging Face) into production applications
  • Experience designing and implementing RAG systems, including vector databases (Pinecone, Weaviate, Chroma, pgvector, or similar), embedding models, and retrieval optimization
  • Experience building interactive applications with Gradio and Streamlit
  • Advanced GitHub/GitLab workflows including CI/CD, branching strategies, and code review processes
  • Expertise in Python, SQL, and modern ML frameworks (PyTorch, TensorFlow, scikit-learn)
Job Responsibility
Job Responsibility
  • Design and architect end-to-end AI solutions using Snowflake Cortex AI, Modal, and cloud-native technologies
  • Develop rapid proof-of-concepts for Retrieval augmented generation (RAG) applications, operational optimization, process optimization, energy forecasting, predictive maintenance, and computer vision (drone footage) use cases
  • Design and implement AI agentic workflows using frameworks such as LangChain, LangGraph, CrewAI, or similar orchestration tools
  • Create interactive demos and prototypes using Gradio and Streamlit for stakeholder validation
  • Translate business requirements into technical specifications and system architectures
  • Build and deploy scalable AI/ML models for business process optimization, renewable energy applications, including wind/solar forecasting, and asset performance optimization
  • Integrate AI capabilities via APIs and SDKs from providers including OpenAI, Anthropic, Azure OpenAI, and Hugging Face
  • Implement MLOps pipelines using Dagster, Snowflake, Sentry, and Modal for model training, deployment, and monitoring
  • Design and optimize RAG architectures, including vector database implementation, embedding strategies, and retrieval pipelines
  • Ensure robust version control and collaboration practices using GitLab
What we offer
What we offer
  • generous PTO
  • medical, dental & vision care
  • HSAs with company contributions
  • health FSAs
  • dependent daycare FSAs
  • commuter benefits
  • relocation
  • 401(k) plan with employer match
  • a variety of life & accident insurances
  • fertility programs
  • Fulltime
Read More
Arrow Right

AI Solutions Architect

We are seeking an experienced AI Solutions Architect to join our data team and d...
Location
Location
United States , Scottsdale
Salary
Salary:
160000.00 - 180000.00 USD / Year
clearwayenergy.com Logo
Clearway Energy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or related field
  • 5+ years of experience in AI/ML solution architecture and implementation
  • Proven track record of taking AI projects from proof-of-concept to production
  • Strong experience with Snowflake Cortex AI or similar systems for enterprise AI workflows
  • Hands-on experience with AI agentic frameworks (LangChain, LangGraph, Semantic Kernel, CrewAI, or AutoGen) for building autonomous AI workflows
  • Proficiency in integrating LLM APIs and SDKs (OpenAI, Anthropic, Azure OpenAI, Hugging Face) into production applications
  • Experience designing and implementing RAG systems, including vector databases (Pinecone, Weaviate, Chroma, pgvector, or similar), embedding models, and retrieval optimization
  • Experience building interactive applications with Gradio and Streamlit
  • Advanced GitHub/GitLab workflows including CI/CD, branching strategies, and code review processes
  • Expertise in Python, SQL, and modern ML frameworks (PyTorch, TensorFlow, scikit-learn)
Job Responsibility
Job Responsibility
  • Design and architect end-to-end AI solutions using Snowflake Cortex AI, Modal, and cloud-native technologies
  • Develop rapid proof-of-concepts for Retrieval augmented generation (RAG) applications, operational optimization, process optimization, energy forecasting, predictive maintenance, and computer vision (drone footage) use cases
  • Design and implement AI agentic workflows using frameworks such as LangChain, LangGraph, CrewAI, or similar orchestration tools
  • Create interactive demos and prototypes using Gradio and Streamlit for stakeholder validation
  • Translate business requirements into technical specifications and system architectures
  • Build and deploy scalable AI/ML models for business process optimization, renewable energy applications, including wind/solar forecasting, and asset performance optimization
  • Integrate AI capabilities via APIs and SDKs from providers including OpenAI, Anthropic, Azure OpenAI, and Hugging Face
  • Implement MLOps pipelines using Dagster, Snowflake, Sentry, and Modal for model training, deployment, and monitoring
  • Design and optimize RAG architectures, including vector database implementation, embedding strategies, and retrieval pipelines
  • Ensure robust version control and collaboration practices using GitLab
What we offer
What we offer
  • generous PTO
  • medical, dental & vision care
  • HSAs with company contributions
  • health FSAs
  • dependent daycare FSAs
  • commuter benefits
  • relocation
  • 401(k) plan with employer match
  • a variety of life & accident insurances
  • fertility programs
  • Fulltime
Read More
Arrow Right
New

Data Optimisation Engineer

About the Role Randstad Digital are seeking an Data Operations Engineer, where y...
Location
Location
Australia , Brisbane
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
May 21, 2026
Flip Icon
Requirements
Requirements
  • Strong data platform expertise with SQL, Databricks, ADF, dbt, and Python/PySpark for daily troubleshooting
  • Proven DataOps capability including experience with Git workflows, automated deployments, and operational runbooks
  • Solid understanding of Azure cloud operations covering storage, compute, networking, and platform-level troubleshooting
  • Excellent communication and incident management skills to collaborate effectively during operational events
  • A bachelor’s degree in IT or a related discipline, with the ability to produce quality results under pressure
Job Responsibility
Job Responsibility
  • Manage and operate the Azure data platform, including Azure Data Factory, Azure Databricks, and Power BI
  • Configure and maintain CI/CD tools using Azure DevOps and Infrastructure as Code (Terraform) to manage deployments across environments
  • Design, build, and support data pipelines with a focus on data quality, performance optimisation, and automated failure handling
  • Implement operational workflows, business continuity solutions, and monitoring to ensure platform reliability
  • Drive automation to reduce operational toil and lead workshops to encourage the adoption of new services and tooling
  • Fulltime
Read More
Arrow Right