CrawlJobs Logo

Senior DataOps Engineer

· Job Posted February 08, 2026
Apply Position
Job Link Share

Job Description

Drive optimisations, upgrades and maintenance of a Kubernetes based data and modelling platform. Supporting access management fielding questions around Airflow and minor feature enhancements. Assist with Migration of Data pipelines.

Job Responsibility

  • Drive optimisations, upgrades and maintenance of a Kubernetes based data and modelling platform
  • Supporting access management fielding questions around Airflow and minor feature enhancements
  • Assist with Migration of Data pipelines

Requirements

  • 5+ years of experience as DataOps Engineer or similar role covering the most of required skills
  • Expertise in Cloud architecture and key technologies (Kubernetes, Airflow, Managed Airflow)
  • Expertise in modern development tools and practices (e.g. CI/CD, DevOps, Observability, Pair Programming, TDD)
  • Knowledge of infrastructure-as-code tools (CloudFormation)
  • Experience with databases (Database: Redshift)
  • Programming language (Python)
  • Expertise in choosing and applying design patterns.
  • Developing software with scale, security and reliability in mind.
  • Knowledge of software development principles, design patterns and best practices
  • Test Driven Development and testing practices

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior DataOps Engineer

8 matching positions

Staff DataOps Engineer

We are looking for a Staff DataOps / Platform Engineer to join the Data and ML p...
Location
Location
France , Paris
Salary
Salary:
Not provided
doctolib.fr Logo
Doctolib
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience after graduation as a Senior Data Platform, Senior Data Engineer or in a similar role, with a history of architecting and scaling robust data platforms
  • Extensive experience with Google Cloud Platform and a command of Kubernetes & Terraform for automated deployments
  • Authority on implementing network and IAM security best practices
  • Deep technical proficiency in orchestrating data pipelines using Airflow or Dagster, deploying applications to the cloud, and leveraging modern data warehouses such as BigQuery
  • Highly skilled in programming with Python, and have a solid understanding of software development principles
  • Excellent troubleshooter who excels at diagnosing and fixing data infrastructure and identifying performance bottlenecks
  • Strong communicator who can articulate complex technical concepts to both technical and non-technical audiences
Job Responsibility
Job Responsibility
  • Design and implement enterprise-scale data infrastructure strategies, conducting thorough impact and cost analysis for major technical decisions, and establishing architectural standards across the organization
  • Build and optimize complex, multi-region data pipelines handling petabyte-scale datasets, ensuring 99.9% reliability and implementing advanced monitoring and alerting systems
  • Lead cost analysis initiatives, identify optimization opportunities across our data stack, and implement solutions that reduce infrastructure spend while improving performance and reliability
  • Provide technical guidance to data engineers and cross-functional teams, conduct architecture reviews, and drive adoption of best practices in DataOps, security, and governance
  • Evaluate emerging technologies, conduct proof-of-concepts for new data tools and platforms, and lead the technical roadmap for data infrastructure modernization
What we offer
What we offer
  • Free comprehensive health insurance for you and your children
  • Parent Care Program: receive one additional month of leave on top of the legal parental leave
  • Free mental health and coaching services through our partner Moka.care
  • For caregivers and workers with disabilities, a package including an adaptation of the remote policy, extra days off for medical reasons, and psychological support
  • Work from EU countries and the UK for up to 10 days per year, thanks to our flexibility days policy
  • Work Council subsidy to refund part of sport club membership or creative class
  • Up to 14 days of RTT
  • A subsidy from the work council to refund part of the membership to a sport club or a creative class
  • Lunch voucher with Swile card
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

In this vital role as Specialist / Senior Data Engineer at Amgen you will be res...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's/Bachelor's degree and 8 to 13 years of Computer Science, IT or related field experience
  • Experience managing a team of data engineers
  • Experience architecting and building data and analytics solutions that extract, transform, and load data from multiple source systems
  • Demonstrated hands-on experience with cloud platforms (AWS) and the ability to architect cost-effective and scalable data solutions
  • Proficiency in Python, PySpark, SQL
  • Experience with dimensional data modeling
  • Experience working with Apache Spark, Apache Airflow
  • Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops
  • Experienced with AWS or GCP or Azure cloud services
  • Understanding of end to end project/product life cycle
Job Responsibility
Job Responsibility
  • Lead and mentor a team of data engineers, fostering a culture of innovation, collaboration, and continuous learning for solving complex problems of R&D division
  • Oversee the development of data extraction, validation, and transformation techniques, ensuring ingested data is of high quality and compatible with downstream systems
  • Guide the team in writing and validating high-quality code for data ingestion, processing, and transformation, ensuring resiliency and fault tolerance
  • Drive the development of data tools and frameworks for managing and accessing data efficiently across the organization
  • Oversee the implementation of performance monitoring protocols across data pipelines, ensuring real-time visibility, alerts, and automated recovery mechanisms
  • Coach engineers in building dashboards and aggregations to monitor pipeline health and detect inefficiencies, ensuring optimal performance and cost-effectiveness
  • Lead the implementation of self-healing solutions, reducing failure points and improving pipeline stability and efficiency across multiple product features
  • Oversee data governance strategies, ensuring compliance with security policies, regulations, and data accessibility best practices
  • Guide engineers in data modeling, metadata management, and access control, ensuring structured data handling across various business use cases
  • Collaborate with business leaders, product owners, and cross-functional teams to ensure alignment of data architecture with product requirements and business objectives
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

We are seeking highly skilled and motivated Senior Software Engineers to develop...
Location
Location
United States
Salary
Salary:
Not provided
invent.ai Logo
invent.ai
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of work experience including scalable SaaS systems
  • Bachelor's degree or higher in a related field
  • Strong hands-on experience across our core tech stack: Python and Apache Spark (PySpark) for data processing, AWS Serverless ecosystem (Lambda) for backends, and React for frontend UI
  • Deep understanding of Object-Oriented Programming principles, design patterns, and system architecture
  • Experience integrating and managing AI coding tools in daily workflows to multiply productivity
  • Strong testing mindset with experience in writing robust unit, integration, and end-to-end tests to validate complex system behaviors
  • Familiarity with CI/CD best practices, DevOps, DataOps, and Platform Engineering concepts
  • Ability and motivation to self-teach, manage through ambiguity, and provide high-context instructions to AI models
Job Responsibility
Job Responsibility
  • Own the end-to-end development of cross-domain features, working seamlessly across Python/PySpark batch processes, AWS Lambda serverless backends, and React frontends
  • Practice contract-driven development by defining strict interfaces, API schemas, and data structures before implementation to ensure conflict-free teamwork
  • Utilize modern AI coding assistants (e.g., Cursor, Copilot) to accelerate implementation, allowing you to focus on complex business logic and architecture rather than boilerplate syntax
  • Develop best-in-class architecture by ensuring components are modularized, secure, and scalable
  • Shift focus to verifying AI-generated code through comprehensive automated testing (TDD) and edge-case validation
  • Adhere to modern software engineering practices through architectural reviews, focusing on intent and contract alignment rather than basic syntax checks
  • Exercise DevOps principles to deploy, maintain, and monitor production workflows, ensuring continuous delivery and actionable telemetry data
  • Act as a bridge between data scientist groups and product teams, productizing machine learning models using cutting edge cloud and big data technologies
What we offer
What we offer
  • Monthly fixed contribution to internet bill and fun packets (Netflix, Amazon Prime etc.)
  • Comprehensive private health insurance
  • Career growth support with Udemy, Medium, HBR and other learning tools
  • Extra off days for different occasions (birthday, moving day, maternity & paternity leaves etc.)
  • Powerful referral bonus
  • All-day snacks at the office
  • Team activities
  • Social club meetings
  • Annual retreats
  • Monthly happy Friday drinks and other celebrations
  • Fulltime
Read More
Arrow Right

Senior Sales Engineer

The Senior Sales Engineer role at Infinite Lambda is designed for a technical le...
Location
Location
United States
Salary
Salary:
Not provided
infinitelambda.com Logo
Infinite Lambda
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Education: A Bachelor’s degree in Engineering, Computer Science, or a related field is required
  • an advanced degree is preferred
  • Experience: A proven track record in sales engineering or technical sales, preferably within the data, cloud, or technology sectors, with significant leadership experience
  • Technical expertise: experience in data engineering, analytics engineering and data scientist roles and related technologies, such as AWS, Azure, Snowflake, Redshift, Databricks, dbt and machine learning frameworks is essential
  • Data architecture: Stream processing and batch data warehouse processing, event-driven architecture, microservices, DataOps and MLOps practices
  • Market expansion: Experience in international markets or expanding into new regions is a plus, particularly knowledge of South American markets and business practices, which is desirable for this role. SOFT SKILLS: Communication: Exceptional verbal and written communication skills, with the ability to translate complex technical concepts into business benefits for clients and stakeholders
  • Leadership and strategy: Experience in leading sales engineering teams or functions, with a strategic mindset to influence company direction and market expansion
  • Collaboration: Strong ability to work effectively across different departments and levels, fostering collaboration with Product & Services, Customer Success, and Sales & Partnerships.
Job Responsibility
Job Responsibility
  • Initiate and manage engagements with prospective clients from the early stages of the sales process, ensuring a strong start to the sales cycle
  • Understand and document client needs, articulating how Infinite Lambda’s products and services can address these needs effectively
  • Collaborate with the sales team to drive a collaborative approach, creating compelling proposals that align with client expectations
  • Conduct and facilitate technical deep-dive workshops with prospective clients to showcase capabilities and gather insights, using workshop outputs to strengthen proposals
  • Identify relevant Infinite Lambda products and services, working with the sales team to position them strategically for each opportunity
  • Assist both the sales and delivery teams in estimating project scope, effort, and resources, producing realistic and commercially viable account strategies. This includes defining initial team composition, tools to utilise, and a high-level roadmap
  • Work with departments such as Product & Services, Customer Success, and Sales & Partnerships to clearly define roles and responsibilities, ensuring seamless collaboration across functions
  • Collaborate with Product & Services to stay informed about existing offerings and influence product roadmaps, helping design new products and services based on client feedback and market trends
  • Enhance the positioning of Infinite Lambda’s products and services during the sales process and beyond, improving how value is communicated to clients
  • Liaise with senior leadership (CEO, CTO, CPO, COO, CSO) at Infinite Lambda to formulate a clear strategy for combining data and cloud expertise into a holistic value proposition, strengthening the company’s market positioning
What we offer
What we offer
  • Private health insurance
  • Work-from-home budget
  • Unlimited paid holiday
  • Wellness benefits.
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

We are looking for a Senior Data Engineer to design and build scalable, cloud-na...
Location
Location
Romania , Cluj-Napoca; Oradea
Salary
Salary:
Not provided
qubiz.com Logo
Qubiz
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years experience in Data Engineering or similar roles
  • Strong expertise in Python, Apache Spark / PySpark, and SQL & Data Warehousing concepts
  • Proven experience with Data Lakes, large-scale data processing, and Medallion architecture
  • Hands-on experience with Microsoft ecosystem: Microsoft Fabric / Azure Data Services / Synapse / Data Factory
  • Experience with Power BI or similar BI tools
  • Strong understanding of ETL/ELT pipelines, data modeling, and performance optimization
  • Experience with real-time or near real-time data pipelines
  • Experience working with AI/ML-enabled data platforms
  • Familiarity with LLMs (e.g. GPT-based tools), embeddings, or vector databases
Job Responsibility
Job Responsibility
  • Design and implement end-to-end data pipelines (batch & streaming)
  • Build and maintain data lake / Lakehouse architectures using modern cloud tools
  • Implement Medallion Architecture (Bronze, Silver, Gold layers) for scalable data processing
  • Process and optimize high-volume datasets using Apache Spark (PySpark) or SQL
  • Develop robust data models for analytics and reporting
  • Ensure data quality, governance, lineage, and security
  • Integrate and leverage AI tools (LLMs, embeddings, ML pipelines) where relevant
  • Collaborate with analysts, data scientists, and stakeholders to deliver insights
  • Optimize pipelines for performance, scalability, and cost efficiency
  • Build automated data pipelines and workflows (DataOps mindset, CI/CD)
What we offer
What we offer
  • Real responsibilities and challenging projects
  • Friendly environment suited for professional and personal development
  • Clear paths and real help in your professional development
  • Training and certifications
  • Fun team-building sessions
  • Private health insurance
  • 50% discount for gym or sports pass of your choice
  • Fresh fruit on your table every day
  • Fulltime
Read More
Arrow Right

Senior Data Engineer (Contractor)

As a Senior Data Engineer, you’ll design, build, and operate scalable, reliable ...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
mypos.com Logo
myPOS
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience)
  • 6+ years of experience as a Data Engineer, building and maintaining production-grade pipelines and datasets
  • Strong Python and SQL skills with a solid understanding of data structures, performance, and optimization strategies
  • Hands-on experience with orchestration (like Airflow, Dagster, Databricks Workflows) and distributed processing in a cloud environment
  • Experience with analytical data modeling (star and snowflake schemas), DWH, ETL/ELT patterns, and dimensional concepts
  • Experience building reliable incremental data ingestion pipelines from DBs and APIs.
  • Familiarity with at least one major cloud provider (GCP, AWS, Azure) and deploying data solutions in the cloud
  • Familiarity with CI/CD for data pipelines, IaC (Terraform), and/or DataOps practices
  • Strong troubleshooting mindset: ability to debug issues across data, infra, pipelines, and deployments
  • Collaborative mindset and clear communication across engineering, analytics, and business stakeholders
Job Responsibility
Job Responsibility
  • Build and maintain data pipelines for ingestion, transformation, and export across multiple sources and destinations
  • Develop and evolve scalable data architecture to meet business and performance requirements
  • Partner with analysts and data scientists to deliver curated, analysis-ready datasets and enable self-service analytics
  • Implement best practices for data quality, testing, monitoring, lineage, and reliability
  • Optimize workflows for performance, cost, and scalability (e.g., tuning Spark jobs, query optimization, partitioning strategies)
  • Ensure secure data handling and compliance with relevant data protection standards and internal policies
  • Contribute to documentation, standards, and continuous improvement of the data platform and engineering processes
  • Ensure secure, compliant handling of data and models, including access controls, auditability, and governance practices
  • Build and maintain MLOps automation: CI/CD for ML, environment management, artifact handling, versioning of data/models/code
What we offer
What we offer
  • Vibrant international team operating in hi-tech environment
  • Excellent compensation package
  • myPOS Academy for upskilling and training
  • Unlimited access to courses on LinkedIn Learning
  • Refer a friend bonus as we know that working with friends is fun
  • Teambuilding, social activities and networks on a multi-national level
  • Fulltime
Read More
Arrow Right

Senior Data Engineer (Contractor)

As a Senior Data Engineer, you’ll design, build, and operate scalable, reliable ...
Location
Location
Romania , Bucharest
Salary
Salary:
Not provided
mypos.com Logo
myPOS
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience)
  • 6+ years of experience as a Data Engineer, building and maintaining production-grade pipelines and datasets
  • Strong Python and SQL skills with a solid understanding of data structures, performance, and optimization strategies
  • Hands-on experience with orchestration (like Airflow, Dagster, Databricks Workflows) and distributed processing in a cloud environment
  • Experience with analytical data modeling (star and snowflake schemas), DWH, ETL/ELT patterns, and dimensional concepts
  • Experience building reliable incremental data ingestion pipelines from DBs and APIs
  • Familiarity with at least one major cloud provider (GCP, AWS, Azure) and deploying data solutions in the cloud
  • Familiarity with CI/CD for data pipelines, IaC (Terraform), and/or DataOps practices
  • Strong troubleshooting mindset: ability to debug issues across data, infra, pipelines, and deployments
  • Collaborative mindset and clear communication across engineering, analytics, and business stakeholders
Job Responsibility
Job Responsibility
  • Build and maintain data pipelines for ingestion, transformation, and export across multiple sources and destinations
  • Develop and evolve scalable data architecture to meet business and performance requirements
  • Partner with analysts and data scientists to deliver curated, analysis-ready datasets and enable self-service analytics
  • Implement best practices for data quality, testing, monitoring, lineage, and reliability
  • Optimize workflows for performance, cost, and scalability (e.g., tuning Spark jobs, query optimization, partitioning strategies)
  • Ensure secure data handling and compliance with relevant data protection standards and internal policies
  • Contribute to documentation, standards, and continuous improvement of the data platform and engineering processes
  • Ensure secure, compliant handling of data and models, including access controls, auditability, and governance practices
  • Build and maintain MLOps automation: CI/CD for ML, environment management, artifact handling, versioning of data/models/code
What we offer
What we offer
  • Vibrant international team operating in hi-tech environment
  • Excellent compensation package
  • myPOS Academy for upskilling and training
  • Unlimited access to courses on LinkedIn Learning
  • Refer a friend bonus as we know that working with friends is fun
  • Teambuilding, social activities and networks on a multi-national level
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Are you passionate about shaping the future of AI and empowering millions of use...
Location
Location
Canada , Vancouver
Salary
Salary:
114400.00 - 203900.00 CAD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Compliance: Anticipates the need for data governance and designs data modeling and data handling procedures, with direct support and partnership with Corporate, External, and Legal Affairs (CELA), to ensure compliance with applicable laws and policies across all aspects of the development process
  • Tags data based on categorization (e.g., personally identifiable information [PII], pseudo-anonymized, financial)
  • Documents data type, build data dictionary, classifications, and lineage to ensure traceability
  • Governs accessibility of data within assigned data pipelines
  • Provides guidance on contributions to the data glossary to document the origin, usage, and format of data for each program
  • Independently implements data governance and privilege of least access practices leveraging security tools
  • Builds responsible AI-compliant data products and/or applications
  • Data Management and Transformation: Plans and creates efficient techniques and operations (e.g., inserting, aggregating, joining) to transform raw data into a form (e.g., dimensional data model) that is compatible with downstream data consumers, databases, and formats that support applications, analytics and reporting
  • Independently uses software, query languages, and computing tools (e.g., cloud-based) to transform raw data across end-to-end pipelines
  • Evaluates data to ensure data quality and completeness using queries, data wrangling, and statistical techniques
  • Fulltime
Read More
Arrow Right