CrawlJobs Logo

Senior DevOps Lead Data Engineering

India, Pune · Job Posted February 17, 2026
Apply Position
Job Link Share

Job Description

We are seeking an experienced and highly skilled Senior DevOps Engineering Lead with 7-10 years of progressive experience to drive our data platform infrastructure automation, CI/CD excellence, and operational efficiency. This role is pivotal in managing and scaling our resilient and performant systems, with a strong focus on empowering microservices architecture. The ideal candidate will possess deep technical expertise in a wide range of DevOps tools and practices, coupled with strong leadership and problem-solving abilities.

Job Responsibility

  • CI/CD Pipeline Ownership: Design, implement, and maintain robust, scalable, and secure CI/CD pipeline architecture for microservices applications, ensuring continuous integration, delivery, and deployment
  • Infrastructure Planning & Management: Lead the design, provisioning, optimization and management of scalable data infrastructure (compute, storage, networking) across cloud , ECS and/or on-premise environments, specifically supporting a data mesh paradigm
  • Elastic Stack Expertise: Manage and optimize Elastic Stack (Elasticsearch, Kibana, Logstash, Beats) for centralized logging, monitoring, and analytics
  • Automation & Scripting: Design, Develop and maintain automation scripts and tools using Shell scripts, Python, Java, or other relevant languages to streamline operational tasks and improve efficiency
  • Infrastructure Procurement & Lifecycle: Oversee the end-to-end Solution (SLTN) process for infrastructure procurement, ensuring timely and compliant acquisition of resources
  • Capacity Estimation & Planning: Conduct thorough capacity planning and performance analysis for microservices and underlying infrastructure to ensure scalability and reliability
  • Access Management & Security: Design and implement secure machine-to-machine communication strategies and manage infrastructure access, adhering to security best practices
  • Microservices Operations: Provide operational expertise and support for highly distributed microservices architectures, including troubleshooting, performance tuning, and incident response
  • Governance & Observability: Implement and enforce data governance policies through automation, and establish comprehensive observability (monitoring, logging, alerting) for data pipelines and infrastructure
  • Mentorship & Best Practices: Mentor junior DevOps engineers, promote DevOps best practices (e.g., IaC, GitOps, observability), and foster a culture of continuous improvement
  • Cross-Functional Collaboration: Work closely with partner development, QA, and infra security teams to ensure seamless integration and deployment processes

Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field
  • 7-10 years of hands-on experience in DevOps, Site Reliability Engineering (SRE), or a similar role
  • Proven expertise in designing and implementing DevOps leadership
  • In-depth experience with container orchestration platforms like AWS, Openshift ECS (or Kubernetes)
  • Strong practical experience with Elastic Stack (Elasticsearch, Kibana, Logstash, Beats) for transaction, logging and monitoring
  • Proficiency in scripting languages (Schell scripting, Python is a must), and strong Java development skills, particularly for tooling and automation
  • Demonstrated knowledge of microservices architecture principles and operational challenges
  • Familiarity with machine-to-machine authentication and authorization mechanisms
  • Must have knowledge of automation principles and practices
  • Experience with job scheduling tools like Autosys
  • Familiarity with Helix Blueprint or similar automation frameworks
  • Excellent problem-solving, communication, and collaboration skills
  • Modern Engineering Practices: Familiarity in modern engineering practices such as Trunk-Based Development, Test-Driven Development (TDD), Behavior-Driven Development (BDD), Contract Testing, and Agile methodologies

Nice to have

  • AWS Certifications (e.g., Solutions Architect, DevOps Engineer, SysOps Administrator)
  • Experience with Kafka and Tibco messaging infrastructure, including best practices for messaging design and operations

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior DevOps Lead Data Engineering

8 matching positions

AI, Metrics and Insights Engineering Lead - Senior Vice President

Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in AI, ML and Data Engineering and development
  • 5+ years of leadership experience managing distributed teams
  • Deep technical expertise in middleware technologies and their application in AI systems
  • Strong understanding of modern software development methodologies (Agile, DevOps)
  • Experience with Kafka and modern data stack like Trino, Iceberg, Databricks etc.
  • Proficient in Python and key python libraries, Agentic Frameworks, MCP
  • Expertise in containerization (Docker), orchestration (Kubernetes), and experience with CI/CD pipelines for AL/ML model deployment
  • Knowledge of distributed training and parallel processing frameworks is also required to handle large-scale AI projects efficiently
  • Experience with AWS services and infrastructure related to AI/ML, workflow
  • Experience in pattern recognition and predictive modeling
Job Responsibility
Job Responsibility
  • Lead Engineers and Developers: Design and execute our comprehensive Gen AI and Metrics strategy aligned with the organization's overall goals and help identify opportunities to automate and optimize business processes using generative AI
  • Lead and develop a High Performing Team: Lead, mentor, and manage a team of ML Engineers, Data Engineers and AI practitioners, ensuring retention and growth of top talent in this space
  • Drive Innovation: Collaborate with cross-functional teams, including data scientists, engineers, and product managers, to develop impactful solutions and foster a culture of innovation and experimentation within the team
  • Hands-On Execution and Delivery: Oversee the end-to-end development and deployment of Solutions, ensuring timely delivery and adherence to quality standards. Actively involved in design and coding
  • Collaboration and Stakeholder Interaction: Build strong relationships with key stakeholders, including executives, business leaders, and clients. Collaborate with technical teams to ensure the feasibility and scalability of AI solutions to solve business problems
  • Deep understanding of latest and upcoming AI trends: Stay up to date with the latest advancements in the field and identify emerging opportunities. Lead and participate in research activities to explore and advance state-of-the-art generative AI techniques. Stay actively engaged in monitoring ongoing research efforts, keeping abreast of emerging trends, and ensuring that the Generative AI team remains at the forefront of the field
  • Regulatory and Ethical Compliance: Ensure that AI initiatives meet regulatory, data privacy, ethical AI standards, and corporate governance policies requirements while pushing the boundaries of technology innovation
  • Fulltime
Read More
Arrow Right

Senior Technical Lead - Data & AI (Oil & Gas)

At Codvo, we are committed to building scalable, future-ready data platforms tha...
Location
Location
India , Pune
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience: 12+ years in technical roles, with at least 4+ years in a technical leadership or principal engineer capacity, managing cross-functional engineering teams
  • Cloud Expertise: Expert-level, hands-on knowledge of Microsoft Azure as a primary platform
  • Data & AI Expertise: Proven mastery of Databricks and Apache Spark (PySpark)
  • Extensive experience designing and building large-scale ETL/ELT data pipelines
  • Strong understanding of AI/ML workflows and data requirements for industrial AI use cases
  • DevOps & IaC Expertise: Deep proficiency with Infrastructure as Code (Terraform, ARM templates)
  • Hands-on mastery of Kubernetes and containerization (Docker)
  • Proven experience building and managing complex CI/CD pipelines (Azure DevOps, Jenkins)
  • Cloud Security: Strong, practical knowledge of cloud network security (VNETs, NSGs, Firewalls) and identity management (Azure Key Vault, IAM)
  • Industry Knowledge: Experience in the Oil & Gas sector or a similar heavy-industry/critical infrastructure environment
Job Responsibility
Job Responsibility
  • Technical Leadership & Mentorship: Lead, mentor, and provide technical direction to a multi-disciplinary team of engineers (Data, DevOps, Security). Foster a culture of high technical standards, collaboration, and continuous improvement
  • Detailed Solution Design: Partner with the Solutions Architect and Project Manager to decompose high-level architecture into detailed technical designs, actionable tasks, and implementation plans for the engineering team
  • Hands-on Development: Act as the lead engineer, personally designing and building the most complex components of the solution, including data pipelines, IaC modules, and CI/CD frameworks
  • Cross-Functional Integration: Drive the seamless integration of diverse systems, including OT data from historians (OSIsoft PI), data platforms (Databricks), cloud infrastructure (Azure), and CI/CD pipelines (Azure DevOps)
  • Technical Governance & Quality: Enforce technical best practices across all domains. Conduct rigorous code reviews, design reviews, and security assessments. Ensure all solutions adhere to security-by-design principles, CI/CD automation standards, and data governance policies
  • Stakeholder Collaboration: Translate complex technical concepts and risks to the Project Manager and business stakeholders. Manage technical dependencies and help the PM with accurate effort estimation and milestone tracking
  • Problem Solving: Serve as the primary escalation point for the team's most complex technical challenges, leading root cause analysis and implementing robust, long-term solutions
  • Fulltime
Read More
Arrow Right

Principal Java Engineer and DevOps Platform Lead - Senior Vice President

We are seeking a visionary and highly experienced Principal Java Engineer and De...
Location
Location
Canada , Mississauga
Salary
Salary:
145100.00 - 217700.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of relevant experience in Java/Spring enterprise projects, with a proven track record of delivering at global scale
  • 5+ years of senior leadership experience managing distributed, cross-regional DevOps or platform engineering teams
  • Demonstrated experience defining and executing global DevOps strategy across large, complex organizations
  • Deep expertise in CI/CD tooling: Jenkins, Tekton, Harness, SonarQube, and related code quality platforms
  • Proven experience designing and deploying cloud-native applications on large-scale container platforms (OpenShift/Kubernetes)
  • Hands-on expertise building enterprise-scale, highly componentized applications using Java, Spring Framework, and Docker Containers
  • Strong proficiency in industry-standard best practices such as Design Patterns, Coding Standards, Coding Modularity, and Prototypes
  • Experience with SOA and microservices architecture utilizing REST
  • hands-on experience with Kafka for event-driven systems
  • Strong background in RDBMS, SQL/PLSQL, and data layer design for high-availability systems
Job Responsibility
Job Responsibility
  • Define and own the multi-year global DevOps platform and Tooling roadmap, aligning engineering standards and delivery practices across all regions and business lines
  • Design and develop enterprise-grade web applications and cloud services using Java/Spring, Angular/React, and OpenShift — built for global scale, reliability, and maintainability
  • Lead the design, governance, and continuous improvement of global CI/CD pipelines using Jenkins, Tekton, Harness, and SonarQube — driving consistency and velocity across all engineering teams worldwide
  • Lead, mentor, and grow distributed DevOps and platform engineering teams across multiple geographies, fostering a high-performance and inclusive engineering culture
  • Drive adoption of cloud-native architectures and large-scale container platform clusters (OpenShift/Kubernetes), ensuring global deployment pipelines are resilient and scalable
  • Partner with global technology leaders, product owners, and senior business stakeholders to align platform investments with enterprise priorities and developer experience goals
  • Establish and enforce global standards for monitoring, tracing, and alerting using OpenTelemetry, Splunk, and ELK — ensuring platform health and SLA adherence across all regions
  • Champion agile delivery, design patterns, coding standards, and modular architecture practices across globally distributed engineering teams
  • Lead the development of front-end developer tooling and web interfaces using Angular (V8+), TypeScript, RxJS, SCSS, and HTML5 — optimizing for performance and usability at scale
  • Provide executive-level reporting and communication on platform health, delivery metrics, and strategic initiatives across global time zones
  • Fulltime
Read More
Arrow Right

Senior Engineer/Technical Lead (DevOps - AWS)

As a DevOps Engineer, you will work together with other cloud engineers, archite...
Location
Location
India , Ahmedabad
Salary
Salary:
Not provided
arrow.com Logo
Arrow Electronics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years in DevOps, with a strong focus on automation, cloud infrastructure, and CI/CD practices
  • Advanced knowledge of Terraform, with experience in writing, testing, and deploying modules
  • Extensive experience with AWS services (EC2, S3, RDS, Lambda, VPC, etc.) and best practices in cloud architecture
  • Proven experience in containerization with Docker and orchestration with Kubernetes in production environments
  • Strong understanding of CI/CD processes, with hands-on experience in CircleCI or similar tools
  • Proficient in Python and Linux Shell scripting for automation and process improvement
  • Experience with Datadog or similar tools for monitoring and alerting in large-scale environments
  • Proficient with Git, including branching, merging, and collaborative workflows
  • Experience with Kustomize or similar tools for managing Kubernetes configurations
  • Experience in designing and building cloud native solutions using AWS services for product development in large scale
Job Responsibility
Job Responsibility
  • Work together with other cloud engineers, architects, developers, and customer engineering teams
  • Fulltime
Read More
Arrow Right

Senior Technical Lead DevOps - AWS

As a Senior DevOps Engineer, you are the cornerstone of operational excellence, ...
Location
Location
Costa Rica
Salary
Salary:
Not provided
3pillarglobal.com Logo
3Pillar Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, IT, or related field
  • or equivalent practical experience
  • Minimum of 8 years of experience in a DevOps or Site Reliability Engineering role, with expertise in data center technologies
  • Extensive experience with cloud platforms such as AWS including services like EC2, S3, RDS, Lambda, or Kubernetes, with expertise in data center integrations
  • Strong understanding of containerization technologies such as Docker and container orchestration tools like Kubernetes, with knowledge of containerization solutions
  • Experience with CI/CD tools such as Jenkins, GitHub Actions, or GitLab CI/CD
  • Solid understanding of networking concepts, security best practices, and infrastructure automation, with expertise in data center security configurations
  • Excellent problem-solving and troubleshooting skills, with a strong attention to detail
  • Effective communication and collaboration skills, with the ability to work effectively in a cross-functional team environment
Job Responsibility
Job Responsibility
  • Design, implement, and maintain CI/CD pipelines using tools such as Jenkins and GitHub Actions to automate software build, test, and deployment processes, with a specific focus on data center technologies
  • Manage and configure infrastructure as code using tools such as Terraform and CloudFormation, ensuring scalability, reliability, and security, with expertise in on-prem data center configurations
  • Implement and maintain monitoring and alerting systems using AWS CloudWatch and other tools to ensure the health and performance of our applications and infrastructure,data center monitoring solutions
  • Collaborate with development and operations teams to troubleshoot and resolve issues in production environments, with a deep understanding of On-prem data center integration challenges
  • Continuously evaluate and implement best practices for DevOps processes, tools, and technologies, with a specific focus on optimizing workflows related to data center technologies
  • Lead efforts to optimize cloud resources usage and costs while ensuring high availability and performance, leveraging AWS database services and other cloud-native technologies, with consideration for data center integration requirements
  • Implement certificate upgrades, migrations, and other security-related tasks, ensuring compliance with industry standards and best practices
What we offer
What we offer
  • Medical Insurance benefits as per company policy
  • Life Insurance as per company policy
  • 12 days of paid vacation, sick leave and paid holidays as per local law
  • Paternity and maternity leave as per as per local law
  • Marriage, bereavement and graduation leaves as per company policy
  • Sick leave and paid holidays as per local law
  • Christmas bonus as per local law
  • Saving Fund “Asociacion Solidarista”
  • Beach house (Managed by the Asociacion Solidarista)
  • Discounts in local shops
  • Fulltime
Read More
Arrow Right

Senior Technical Lead DevOps - AWS

As a Senior DevOps Engineer, you are the cornerstone of operational excellence, ...
Location
Location
Guatemala
Salary
Salary:
Not provided
3pillarglobal.com Logo
3Pillar Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, IT, or related field
  • or equivalent practical experience
  • Minimum of 8 years of experience in a DevOps or Site Reliability Engineering role, with expertise in data center technologies
  • Extensive experience with cloud platforms such as AWS including services like EC2, S3, RDS, Lambda, or Kubernetes, with expertise in data center integrations
  • Strong understanding of containerization technologies such as Docker and container orchestration tools like Kubernetes, with knowledge of containerization solutions
  • Experience with CI/CD tools such as Jenkins, GitHub Actions, or GitLab CI/CD
  • Solid understanding of networking concepts, security best practices, and infrastructure automation, with expertise in data center security configurations
  • Excellent problem-solving and troubleshooting skills, with a strong attention to detail
  • Effective communication and collaboration skills, with the ability to work effectively in a cross-functional team environment
Job Responsibility
Job Responsibility
  • Design, implement, and maintain CI/CD pipelines using tools such as Jenkins and GitHub Actions to automate software build, test, and deployment processes, with a specific focus on data center technologies
  • Manage and configure infrastructure as code using tools such as Terraform and CloudFormation, ensuring scalability, reliability, and security, with expertise in on-prem data center configurations
  • Implement and maintain monitoring and alerting systems using AWS CloudWatch and other tools to ensure the health and performance of our applications and infrastructure,data center monitoring solutions
  • Collaborate with development and operations teams to troubleshoot and resolve issues in production environments, with a deep understanding of On-prem data center integration challenges
  • Continuously evaluate and implement best practices for DevOps processes, tools, and technologies, with a specific focus on optimizing workflows related to data center technologies
  • Lead efforts to optimize cloud resources usage and costs while ensuring high availability and performance, leveraging AWS database services and other cloud-native technologies, with consideration for data center integration requirements
  • Implement certificate upgrades, migrations, and other security-related tasks, ensuring compliance with industry standards and best practices
What we offer
What we offer
  • Medical Insurance benefits as per company policy
  • Life Insurance as per company policy
  • 15 days of paid vacation, sick leave and paid holidays as per local law
  • Paternity and maternity leave as per as per local law
  • Marriage, bereavement and graduation leaves as per company policy
  • Sick leave and paid holidays as per local law
  • Christmas and Middle year bonuses as per local law
  • Monthly productivity bonus as per local law
  • Discounts in local shops
  • Direct deposit of payroll
  • Fulltime
Read More
Arrow Right

Senior Test Automation & AI Quality Engineering Lead - VOIS

We are seeking a highly experienced and hands-on Test Automation and Quality Eng...
Location
Location
India , Pune
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience (15+ years) in Test Automation and Quality Engineering with strong hands-on expertise
  • Proficient in programming languages such as Java, JavaScript, TypeScript or Python with solid understanding of OOP and design patterns
  • Skilled in automation tools and frameworks including Playwright (preferred), Selenium, Appium and Tosca
  • Experience with API automation using REST Assured, Postman or Karate
  • Knowledge of BDD frameworks such as Cucumber or SpecFlow and unit testing tools like JUnit or TestNG
  • Familiarity with CI/CD tools including Azure DevOps (essential), Jenkins, Git and container technologies
  • Understanding of AI/GenAI applications in testing, including prompt engineering and intelligent automation solutions
  • Experience with cloud platforms and testing microservices architectures
  • Strong leadership, communication and stakeholder engagement capabilities across global environments
  • Data-driven, collaborative and committed to continuous improvement and innovation
Job Responsibility
Job Responsibility
  • Define and lead a unified automation strategy across UI, API, mobile, integration and end-to-end testing
  • Establish enterprise-wide governance, standards, frameworks and reusable automation assets
  • Drive shift-left and shift-right testing within Agile and SAFe environments
  • Measure and improve automation effectiveness using key metrics such as coverage, cycle time and defect leakage
  • Architect and evolve scalable automation frameworks using Playwright, Selenium and modern design principles
  • Lead API-first testing strategies for microservices and cloud-native platforms
  • Ensure robust test data management, service virtualisation and environment readiness
  • Integrate automation into CI/CD pipelines using Azure DevOps and related tools
  • Champion AI-led testing innovations including self-healing scripts, predictive analytics and GenAI-powered test generation
  • Evaluate and scale AI agents and LLM-based tools for autonomous test execution and analysis
What we offer
What we offer
  • Opportunity to lead large-scale AI-driven quality engineering transformation initiatives
  • Exposure to global Vodafone markets and cross-functional collaboration
  • Work with cutting-edge automation, AI and GenAI tools and frameworks
  • Career growth in a strategic and innovation-focused environment
  • A culture that supports continuous learning, diversity and inclusive collaboration
  • Fulltime
Read More
Arrow Right

Application Development Lead - Senior Vice President

The Applications Development Technology Senior Lead Analyst is a senior level po...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of relevant experience
  • Experience in implementing projects
  • Experience in systems analysis and programming of software applications
  • Demonstrated Subject Matter Expert (SME) in area(s) of Applications Development
  • Demonstrated knowledge of client core business functions
  • Demonstrated leadership, project management, and development skills
  • Relationship and consensus building skills
  • 10-12 years of experience in developing and managing Enterprise Applications
  • Core Java, Spring Hibernate and related skills
  • Solid foundation in OOP concepts
Job Responsibility
Job Responsibility
  • Lead integration of functions to meet goals, deploy new products, and enhance processes
  • Analyze complex business processes, system processes, and industry standards to define and develop solutions to high level problems
  • Provide expertise in area of advanced knowledge of applications programming and plan assignments involving large budgets, cross functional project, or multiple projects
  • Develop application methodologies and standards for program analysis, design, coding, testing, debugging, and implementation
  • Utilize advanced knowledge of supported main system flows and comprehensive knowledge of multiple areas to achieve technology goals
  • Consult with end users to identify system function specifications and incorporate into overall system design
  • Allocate work, and act as an advisor/coach developers, analysts, and new team members
  • Influence and negotiate with senior leaders and communicate with external parties
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Design & Development: Create and optimize scalable ETL (Extraction, Transformation, Loading) pipelines using PySpark for massive datasets
  • Fulltime
Read More
Arrow Right