CrawlJobs Logo
NorthBay Logo NorthBay · IT - Software Development

DataOps Engineer (AWS)

India 3800000.00 - 4100000.00 INR / Year · Job Posted January 12, 2026
Apply Position
Job Link Share

Job Description

We are looking for a skilled DevOps + Data Engineer (AWS) to design, build, and manage scalable cloud infrastructure and data platforms. The ideal candidate will have strong experience in AWS, Terraform, CI/CD, and ETL/data pipelines, and will work closely with data engineers, analytics teams, and application developers to ensure reliable, secure, and high-performing systems.

Job Responsibility

  • Design, deploy, and manage AWS cloud infrastructure using Infrastructure as Code (Terraform)
  • Build, maintain, and optimize ETL/data pipelines for large-scale data processing
  • Automate infrastructure provisioning, deployment, and monitoring
  • Develop and manage CI/CD pipelines for data and application workloads
  • Ensure high availability, scalability, security, and cost optimization of AWS environments
  • Support data ingestion, transformation, and orchestration workflows
  • Monitor systems, troubleshoot issues, and improve system reliability
  • Implement logging, monitoring, and alerting for infrastructure and data pipelines
  • Collaborate with Data Engineers, Analytics teams, and DevOps teams
  • Enforce security best practices, IAM policies, and compliance standards

Requirements

  • 5–7 years of experience in DevOps, Data Engineering, or Cloud Engineering
  • Strong hands-on experience with AWS services (EC2, S3, RDS, Lambda, EMR, Glue, Redshift, etc.)
  • Solid experience with Terraform for infrastructure automation
  • Experience building and maintaining ETL/data pipelines
  • Proficiency in Python and/or Shell scripting
  • Experience with CI/CD tools (GitHub Actions, Jenkins, GitLab CI, etc.)
  • Strong understanding of Linux systems and networking fundamentals
  • Experience with monitoring tools (CloudWatch, Prometheus, Grafana, ELK, etc.)

Nice to have

  • Experience with Airflow, AWS Glue, or similar orchestration tools
  • Knowledge of Docker and Kubernetes
  • Experience with data warehouses and analytics platforms
  • Understanding of security best practices and data governance
  • Exposure to cost optimization and performance tuning on AWS
NorthBay - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

DataOps Engineer (AWS)

8 matching positions

Dataops Engineer (Database)

DataOps Engineer Experience: 3–5 Years Location: Chennai | Madurai | Coimbator...
Location
Location
India , Chennai City Corporation
Salary
Salary:
Not provided
optisolbusiness.com Logo
OptiSol Business Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience in Oracle, SQL Server, or PostgreSQL administration
  • Expertise in performance tuning, query optimization, and indexing
  • Proficiency in T-SQL scripting and database automation
  • Hands-on experience troubleshooting database issues
  • Knowledge of cloud platforms (Azure SQL, AWS RDS)
  • Strong analytical, problem-solving, and communication skills
Job Responsibility
Job Responsibility
  • Manage and administer Oracle, SQL Server, or PostgreSQL databases
  • Optimize performance through query tuning, indexing, and execution plans
  • Troubleshoot issues like deadlocks, blocking, and slow queries
  • Implement backup, restore, and disaster recovery strategies
  • Ensure high availability using AAGs, failover clusters, and replication
  • Monitor and maintain database health and performance
  • Automate DBA tasks using T-SQL, PowerShell, and DataOps practices
  • Manage and monitor cloud databases (Azure SQL, AWS RDS)
  • Collaborate with engineering teams for scalable data solutions
  • Support CI/CD and database deployment processes
What we offer
What we offer
  • Opportunity to work on modern DataOps and database systems
  • Exposure to cloud, AI, and advanced data technologies
  • Collaborative and growth-focused work environment
  • Learning, certifications, and career development opportunities
  • Fulltime
Read More
Arrow Right

Data Engineer - AWS

We are seeking an AWS Data Engineer with 4–7 years of experience to design and b...
Location
Location
India , Mumbai
Salary
Salary:
Not provided
necsws.com Logo
NEC Software Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree in Computer Science, Engineering, or related field
  • 4–7 years of experience in application development and data engineering
  • 3+ years of experience with big data technologies
  • 3+ years of experience with cloud platforms (AWS preferred
  • Azure or GCP also acceptable)
  • Proficiency in Python, SQL, Scala, or Java (3+ years)
  • Experience with distributed computing tools such as Hadoop, Hive, EMR, Kafka, or Spark (3+ years)
  • Hands-on experience with real-time data and streaming applications (3+ years)
  • NoSQL database experience (MongoDB, Cassandra) – 3+ years
  • Data warehousing expertise (Redshift or equivalent) – 3+ years
Job Responsibility
Job Responsibility
  • Develop, test, deploy, orchestrate, monitor, and troubleshoot cloud-based data pipelines and automation workflows in alignment with best practices and security standards
  • Collaborate with data scientists, architects, ETL developers, and business stakeholders to capture, format, and integrate data from internal systems, external sources, and data warehouses
  • Research and experiment with batch and streaming data technologies to evaluate their business impact and suitability for current use cases
  • Contribute to the definition and continuous improvement of data engineering processes and procedures
  • Ensure data integrity, accuracy, and security across corporate data assets
  • Maintain high data quality standards for Data Services, Analytics, and Master Data Management
  • Build automated, scalable, and test-driven data pipelines
  • Apply software development practices including Git-based version control, CI/CD, and release management to enhance AWS CI/CD pipelines
  • Partner with DevOps engineers and architects to improve DataOps tools and frameworks
  • Fulltime
Read More
Arrow Right

DataOps Engineer

At Paymentology, we’re redefining what’s possible in the payments space. As the ...
Location
Location
Salary
Salary:
Not provided
paymentology.com Logo
Paymentology
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3-5 years of hands-on experience in DevOps, Platform Engineering, or DataOps roles
  • Experience supporting or contributing to data platforms or data infrastructure projects
  • Hands-on proficiency with Infrastructure as Code, particularly Terraform
  • Experience working with AWS or GCP and common cloud architecture patterns
  • Practical experience or strong understanding of Kubernetes and containerised workloads
  • Familiarity with observability tooling across monitoring, logging, metrics, and alerting
  • Strong scripting skills in Python, Bash, or GoLang to automate operational processes
  • Excellent problem-solving skills and the ability to work effectively in a collaborative, fully remote environment
  • A strong inclination to develop DataOps and MLOps knowledge and capabilities
Job Responsibility
Job Responsibility
  • Design and implement cloud infrastructure for a modern data platform using Infrastructure as Code, with a strong focus on scalability, security, and reliability
  • Build and maintain CI/CD pipelines that support data engineering workflows and infrastructure deployments
  • Implement and operate observability solutions including monitoring, logging, metrics, and alerting to ensure platform reliability and fast incident response
  • Collaborate closely with data engineers to translate platform and workflow requirements into robust infrastructure solutions
  • Apply best practices for availability, disaster recovery, and cost efficiency, while documenting infrastructure patterns and operational procedures
  • Fulltime
Read More
Arrow Right

DataOps Engineer

Looking for DataOps Engineer to lead database performance management for SaaS he...
Location
Location
Salary
Salary:
Not provided
hivex.tech Logo
Hivex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3.5+ years of professional database management, development, and/or DataOps experience in a SaaS product environment
  • Experience database performance engineering large scale systems through high growth
  • Experience leading data quality management activities
  • Ability to collaborate with Java and Python developers on best practices for database performance and data quality
  • Deep knowledge of database internals and best practices for transactional and analytical processing
  • Ability to problem-solve collaboratively and independently
Job Responsibility
Job Responsibility
  • Define and build automated a database performance engineering process and framework
  • Collect and manage deterministic, well-known, and representative test sets
  • Optimize database performance using configuration, best-practices, and effective models
  • Engage with developers to collaborate on requirements and performance engineering
  • Create and manage ETL processes
  • Detect and respond to operational and customer problems
Read More
Arrow Right

Principal Data Engineer

Principal Data Engineer. This role has been designed as 'Onsite' with an expecta...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in Data Engineering, with demonstrated architectural ownership
  • Expert-level experience with Snowflake (mandatory), including performance optimization, data modeling, security, and ecosystem components
  • Expert proficiency in SQL and strong Python skills for pipeline development and automation
  • Experience with modern orchestration tools (Airflow, Dagster, Prefect, or equivalent)
  • Strong understanding of ELT/ETL patterns, distributed processing, and data lifecycle management
  • Familiarity with streaming/event technologies (Kafka, Kinesis, Pub/Sub, etc.)
  • Experience implementing data quality, observability, and lineage solutions
  • Solid understanding of cloud infrastructure (AWS, GCP, or Azure)
  • Strong background in DataOps practices: CI/CD, testing, version control, automation
  • Proven leadership in driving architectural direction and mentoring engineering teams
Job Responsibility
Job Responsibility
  • Architecture & Strategy: Own a significant portion of the architecture of our data platform, ensuring scalability, performance, reliability, and security
  • Define standards and best practices for data modeling, transformation, orchestration, governance, and lifecycle management
  • Evaluate and integrate modern data technologies and frameworks that align with our long-term platform strategy
  • Collaborate with engineering and product leadership to shape the technical roadmap
  • Engineering & Delivery: Design, build, and manage scalable, resilient data pipelines for batch, streaming, and event-driven workloads
  • Develop clean, high-quality data models and schemas to support analytics, BI, operational systems, and ML workflows
  • Implement data quality, lineage, observability, and automated testing frameworks
  • Build ingestion patterns for APIs, event streams, files, and third-party data sources
  • Optimize compute, storage, and transformation layers for performance and cost efficiency
  • Leadership & Collaboration: Serve as a senior technical leader and mentor within the data engineering team
What we offer
What we offer
  • Health & Wellbeing: comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • Personal & Professional Development: programs to help reach career goals
  • Unconditional Inclusion: inclusive work environment
  • Fulltime
Read More
Arrow Right

Business Intelligence Engineer

We are seeking a skilled BI & AWS Data Engineer to play a pivotal role in evolvi...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
June 30, 2026
Flip Icon
Requirements
Requirements
  • AWS Data Stack: Strong proficiency with AWS Athena, Glue, S3, Lambda, and Redshift/Postgres/MySQL RDS
  • BI Expertise: Exceptional, advanced-level Power BI development (including DAX, data modeling, and gateway administration)
  • Data Engineering Fundamentals: Advanced SQL and moderate-to-strong Python programming for data processing
  • Software Practices: Version control via GitHub
  • familiarity with CI/CD, Terraform, or DataOps is highly desirable
  • Cloud-based AI services (e.g., AWS Bedrock)
  • Supporting data structures for Generative AI or prompt engineering
  • Collaborating with Data Science teams to support ML pipelines
Job Responsibility
Job Responsibility
  • Design, build, and optimize scalable data pipelines and data lake components within AWS
  • Act as the hands-on expert for Power BI development, constructing complex solution designs, managing data models (DAX), and handling system administration
  • Contribute to emerging AI-enabled workflows, generative AI use cases, and cloud-based AI service integration (e.g., AWS Bedrock)
  • Drive database and reporting migrations (e.g., Jaspersoft to Power BI
  • MySQL/Postgres queries to AWS Athena)
Read More
Arrow Right

Senior Sales Engineer

The Senior Sales Engineer role at Infinite Lambda is designed for a technical le...
Location
Location
United States
Salary
Salary:
Not provided
infinitelambda.com Logo
Infinite Lambda
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Education: A Bachelor’s degree in Engineering, Computer Science, or a related field is required
  • an advanced degree is preferred
  • Experience: A proven track record in sales engineering or technical sales, preferably within the data, cloud, or technology sectors, with significant leadership experience
  • Technical expertise: experience in data engineering, analytics engineering and data scientist roles and related technologies, such as AWS, Azure, Snowflake, Redshift, Databricks, dbt and machine learning frameworks is essential
  • Data architecture: Stream processing and batch data warehouse processing, event-driven architecture, microservices, DataOps and MLOps practices
  • Market expansion: Experience in international markets or expanding into new regions is a plus, particularly knowledge of South American markets and business practices, which is desirable for this role. SOFT SKILLS: Communication: Exceptional verbal and written communication skills, with the ability to translate complex technical concepts into business benefits for clients and stakeholders
  • Leadership and strategy: Experience in leading sales engineering teams or functions, with a strategic mindset to influence company direction and market expansion
  • Collaboration: Strong ability to work effectively across different departments and levels, fostering collaboration with Product & Services, Customer Success, and Sales & Partnerships.
Job Responsibility
Job Responsibility
  • Initiate and manage engagements with prospective clients from the early stages of the sales process, ensuring a strong start to the sales cycle
  • Understand and document client needs, articulating how Infinite Lambda’s products and services can address these needs effectively
  • Collaborate with the sales team to drive a collaborative approach, creating compelling proposals that align with client expectations
  • Conduct and facilitate technical deep-dive workshops with prospective clients to showcase capabilities and gather insights, using workshop outputs to strengthen proposals
  • Identify relevant Infinite Lambda products and services, working with the sales team to position them strategically for each opportunity
  • Assist both the sales and delivery teams in estimating project scope, effort, and resources, producing realistic and commercially viable account strategies. This includes defining initial team composition, tools to utilise, and a high-level roadmap
  • Work with departments such as Product & Services, Customer Success, and Sales & Partnerships to clearly define roles and responsibilities, ensuring seamless collaboration across functions
  • Collaborate with Product & Services to stay informed about existing offerings and influence product roadmaps, helping design new products and services based on client feedback and market trends
  • Enhance the positioning of Infinite Lambda’s products and services during the sales process and beyond, improving how value is communicated to clients
  • Liaise with senior leadership (CEO, CTO, CPO, COO, CSO) at Infinite Lambda to formulate a clear strategy for combining data and cloud expertise into a holistic value proposition, strengthening the company’s market positioning
What we offer
What we offer
  • Private health insurance
  • Work-from-home budget
  • Unlimited paid holiday
  • Wellness benefits.
  • Fulltime
Read More
Arrow Right

Senior Dataops/Cloud Data Engineer

Our client is looking for a Senior DataOps/Cloud Data Engineer for a 15 month co...
Location
Location
Canada , North York
Salary
Salary:
533.22 - 569.16 CAD / Day
https://www.randstad.com Logo
Randstad
Expiration Date
July 11, 2026
Flip Icon
Requirements
Requirements
  • Data engineering (pandas, pyspark)
  • Data lakehouse solutions such as Databricks (Delta Lake)
  • Working with XLSX, CSV, JSON files, relational databases, cloud storage, structured and unstructured data
  • Experience using AWS Services such as Glue, StepFunctions, Lambda, S3
  • Extract/Transform/Load data using tools such as Informatica IDMC
Job Responsibility
Job Responsibility
  • Design, develop, test, implement, and troubleshoot: data pipelines using various tools such as Databricks, Azure Data Factory, AWS Glue
  • complex data transformation procedures
  • data models for data warehouses and lakehouses
What we offer
What we offer
  • Earn a competitive rate within the industry
  • Potential for extension
  • Fulltime
Read More
Arrow Right