CrawlJobs Logo

Senior Software Engineer (Cloud ETL & Data)

Lithuania, Vilnius Employment contract · Job Posted May 20, 2026
Apply Position
Job Link Share

Job Description

We are seeking a data-centric Senior Software Engineer to design, build, and evolve the core of our iModel Cloud Sync Services. This role is part of our Infrastructure Cloud team and will be focused on developing reliable, large-scale cloud services that ingest, transform, and synchronize complex engineering data from a multitude of sources. As a Senior Software Engineer, you will be pivotal in building the data backbone of our platform. You will work hands-on with distributed systems and cloud-native technologies to solve complex data-synchronization problems, ensuring our users have a seamless and reliable experience with their digital twins.

Job Responsibility

  • Data & ETL Leadership:Design and build robust, scalable ETL pipelines for parsing, validating, and transforming diverse engineering data formats
  • Develop and implement strategies for schema management and versioning within data synchronization workflows
  • Architect solutions that guarantee deterministic execution, fault tolerance, and transactional consistency for all data operations
  • Software & Systems Design:Build distributed, event-driven, and task-oriented systems using microservices, messaging, and containerized workloads on Microsoft Azure
  • Implement resilience patterns such as retries, circuit breakers, and rate limiting to ensure high availability
  • Design and implement concurrency control, idempotency, and conflict-resolution patterns in distributed data workflows
  • Build and maintain comprehensive observability, including structured logging, metrics, and distributed tracing
  • Collaboration & Mentorship:Collaborate with architects on high-level design and implementation decisions
  • Mentor junior engineers through code reviews and technical guidance
  • Contribute to shared engineering standards and documentation

Requirements

  • Graduate or postgraduate degree in Computer Science, Software Engineering, or equivalent experience
  • 7+ years of professional experience in software engineering with exposure to distributed or cloud based systems
  • Strong experience with Azure, microservices, containers, and Kubernetes
  • Hands on experience building ETL pipelines, workflow based systems, or event driven architectures
  • Solid proficiency in an object-oriented language, with a preference for C# .NET
  • Solid understanding of observability, CI/CD, reliability, and cloud operations
  • Strong problem solving skills and the ability to deliver production quality software

Nice to have

  • Experience with workflow orchestration engines (e.g., Azure Durable Functions, Temporal, Airflow)
  • Knowledge of advanced data consistency patterns (e.g., Change Data Capture, event sourcing, saga patterns)
  • Familiarity with infrastructure-as-code and modern CI/CD practices (e.g., Terraform, Azure DevOps)
  • Prior experience in the AEC (Architecture, Engineering, Construction) domain or with complex 3D/geometric data

What we offer

  • A great Team and culture
  • An exciting career as an integral part of a world-leading software company
  • An attractive salary and benefits package
  • A commitment to inclusion, belonging and colleague wellbeing
  • A company committed to making a real difference by advancing the world’s infrastructure
  • Training and professional development opportunities (certifications programs, conferences etc.)
  • Additional annual leave days and extra paid days for different occasions (marriage, moving day, bereavement leave etc.)
  • Health insurance package and accidents insurance 24/7
  • Referral program with bonuses
  • Extra paid day for volunteering in the organization of your choice
  • Ability to work from office or fully remote from home

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Software Engineer (Cloud ETL & Data)

8 matching positions

Senior Software Engineer (Cloud ETL & Data)

We are seeking a data-centric Senior Software Engineer to design, build, and evo...
Location
Location
Lithuania , Vilnius; Kaunas
Salary
Salary:
6500.00 EUR / Month
bentley.com Logo
Bentley Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Graduate or postgraduate degree in Computer Science, Software Engineering, or equivalent experience
  • 7+ years of professional experience in software engineering with exposure to distributed or cloud based systems
  • Strong experience with Azure, microservices, containers, and Kubernetes
  • Hands on experience building ETL pipelines, workflow based systems, or event driven architectures
  • Solid proficiency in an object-oriented language, with a preference for C# .NET
  • Solid understanding of observability, CI/CD, reliability, and cloud operations
  • Strong problem solving skills and the ability to deliver production quality software.
Job Responsibility
Job Responsibility
  • Design and build robust, scalable ETL pipelines for parsing, validating, and transforming diverse engineering data formats
  • Develop and implement strategies for schema management and versioning within data synchronization workflows
  • Architect solutions that guarantee deterministic execution, fault tolerance, and transactional consistency for all data operations
  • Build distributed, event-driven, and task-oriented systems using microservices, messaging, and containerized workloads on Microsoft Azure
  • Implement resilience patterns such as retries, circuit breakers, and rate limiting to ensure high availability
  • Design and implement concurrency control, idempotency, and conflict-resolution patterns in distributed data workflows
  • Build and maintain comprehensive observability, including structured logging, metrics, and distributed tracing
  • Collaborate with architects on high-level design and implementation decisions
  • Mentor junior engineers through code reviews and technical guidance
  • Contribute to shared engineering standards and documentation.
What we offer
What we offer
  • A great Team and culture
  • An exciting career as an integral part of a world-leading software company providing solutions for architecture, engineering, and construction
  • An attractive salary and benefits package
  • A commitment to inclusion, belonging and colleague wellbeing through global initiatives and resource groups
  • A company committed to making a real difference by advancing the world’s infrastructure for better quality of life
  • Training and professional development opportunities (certifications programs, conferences etc.)
  • Additional annual leave days and extra paid days for different occasions
  • Health insurance package and accidents insurance 24/7
  • Referral program with bonuses
  • Extra paid day for volunteering in the organization of your choice
  • Fulltime
Read More
Arrow Right

Software Developer - Senior / Senior Data Engineer

Imagine being at the forefront of protecting financial integrity and enabling cr...
Location
Location
United States , Southlake, TX or Austin, TX
Salary
Salary:
55.92 - 62.13 USD / Hour
aquent.com Logo
Aquent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field
  • 8+ years of hands-on experience in data management, including gathering data from diverse sources, consolidating it into centralized locations, and transforming it with business logic for consumption in visualization and data analysis
  • Strong expertise in BigQuery, Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, and related cloud platform services
  • Proficiency in Python and SQL for data processing and automation
  • Extensive experience with ETL processes and data pipeline design
  • Excellent problem-solving skills and meticulous attention to detail
  • Strong communication and collaboration skills, with the ability to actively listen, dialogue freely, and verbalize ideas effectively
  • Ability to thrive in an Agile work environment, delivering incremental value to customers by effectively managing and prioritizing tasks
Job Responsibility
Job Responsibility
  • Design, build, and maintain robust and scalable data pipelines using cloud platform tools such as BigQuery, Cloud Storage, Dataflow (Apache Beam), Cloud Composer (Airflow), and Pub/Sub
  • Develop high-performance, production-grade Python and SQL code, optimizing queries for efficient data extraction, transformation, and loading (ETL) processes
  • Implement complex data models in BigQuery, leveraging partitioning, clustering, and materialized views to achieve optimal performance
  • Collaborate closely with cross-functional teams, including business customers and Subject Matter Experts, to gather data requirements and deliver impactful solutions
  • Implement and uphold best practices for data quality, data governance, and data security
  • Proactively monitor and troubleshoot data pipeline issues, ensuring high availability and performance of critical data flows
  • Contribute to strategic data architecture decisions, providing recommendations for continuous improvement of data pipelines
  • Stay current with emerging trends and technologies in cloud-based data engineering and cyber security to drive innovation
  • Lead investigation and resolution efforts for identified data issues, taking ownership to resolve them in a timely manner
  • Document processes and procedures thoroughly for producing accurate metrics and ensuring operational clarity
What we offer
What we offer
  • subsidized health, vision, and dental plans
  • paid sick leave
  • retirement plans with a match
Read More
Arrow Right

Senior Software Engineer - Data Products

We are seeking a highly skilled Senior Software Engineer with deep expertise in ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, Engineering, or a related field (or equivalent experience).
  • 8+ years of experience in software and/or data engineering with expertise in big data technologies such as Apache Spark, Apache Airflow.
  • Expertise with at least one of the following Apache Druid, StarRocks, and Trino.
  • Strong understanding of SOLID principles and distributed systems architecture.
  • Proven experience in distributed data processing, data warehousing, and real-time data pipelines.
  • Advanced SQL skills, with expertise in query optimization for large datasets.
  • Exceptional problem-solving abilities and the capacity to work independently or collaboratively.
  • Excellent verbal and written communication skills.
  • Experience with cloud platforms such as AWS, GCP, or Azure, and containerization tools like Docker and Kubernetes. (preferred)
  • Familiarity with additional big data technologies, including Hadoop and Kafka.
Job Responsibility
Job Responsibility
  • Design and build APIs and backend services using Spring Boot to support data products and analytics workflows.
  • Write clean, maintainable, and efficient code, ensuring adherence to best practices through code reviews.
  • Design, develop, and maintain data pipelines and ETL workflows using Apache Spark and Apache Airflow.
  • Optimize data storage, retrieval, and processing systems to ensure reliability, scalability, and performance.
  • Develop and fine-tune complex queries and analytics solutions using Druid, Trino, and StarRocks for large-scale datasets.
  • Monitor, troubleshoot, and improve data systems to minimize downtime and maximize efficiency.
  • Partner with data scientists, software engineers, and other teams to deliver integrated, high-quality solutions.
  • Provide technical guidance and mentorship to junior engineers, promoting best practices in software and data engineering.
What we offer
What we offer
  • Global access to mental health and financial wellness support and resources.
  • Local benefits including statutory and voluntary benefits which may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension).
  • Time off in accordance with local leave policies.
  • Fulltime
Read More
Arrow Right

Senior Cloud Engineer, Data Processing

As a Senior Cloud Engineer, Data Processing on the Sustaining Engineering L3 tea...
Location
Location
India , Chennai
Salary
Salary:
Not provided
aptiv.com Logo
Aptiv plc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree – Computer Science, Computer Engineering, or similar
  • 8+ years Python and/or Golang software development experience
  • Proven ability to analyze and navigate legacy codebases, including independently investigating, debugging, and resolving issues without detailed documentation
  • Demonstrated skill at navigating ambiguity and resolving issues without detailed instructions or oversight
  • Experience interfacing applications with relational and non-relational databases (e.g., MySQL, MongoDB), including CRUD operations and schema design
  • Proficient in Linux environments and shell scripting
  • Deep experience with Kubernetes, AWS, RabbitMQ, MongoDB, and MySQL in production settings
  • Familiarity with debugging tools, performance profiling, and system optimization techniques
  • Strong written and oral communication skills, with the ability to clearly document and explain technical concepts
Job Responsibility
Job Responsibility
  • Support and enhance Aptiv’s cloud-based data processing systems for automotive datalogger data, including ingest pipelines, ETL workflows, and analytics infrastructure
  • Investigate, root-cause, and resolve production issues across distributed systems, often involving complex legacy code and minimal documentation
  • Collaborate with systems analysts, engineers, and developers to troubleshoot issues, implement improvements, and ensure system reliability and performance
  • Partner with internal stakeholders to develop and execute validation plans that confirm fixes and enhancements meet operational and customer expectations
  • Stay current with evolving cloud technologies, data processing frameworks, and tooling to continuously improve support capabilities and system efficiency
What we offer
What we offer
  • Higher Education Opportunities (UDACITY, UDEMY, COURSERA are available for your continuous growth and development)
  • Life and accident insurance
  • Sodexo cards for food and beverages
  • Well Being Program that includes regular workshops and networking events
  • EAP Employee Assistance
  • Access to fitness clubs (T&C apply)
  • Creche facility for working parents
  • Fulltime
Read More
Arrow Right

Senior Software Development Engineer, Big Data

The Zillow Group’s Housing Trends Data Engineering team brings innovative analys...
Location
Location
United States
Salary
Salary:
152900.00 - 257100.00 USD / Year
Zillow
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong proficiency in Python programming
  • Hands-on experience with big data ecosystems, architectures and modern data platforms, including AWS cloud data services and Lakehouse/Lakebase platforms
  • Hands-on experience with Databricks is a significant advantage
  • Proven ability to design, build, and orchestrate batch and real-time data pipelines, processing large-scale datasets from diverse sources
  • Practical experience with cutting-edge data engineering technologies such as SparkSQL and Spark Streaming, PostgreSQL, EKS, and Kubernetes
  • Familiarity with Agile/DevOps software development processes and tools such as GitLab and CI/CD
  • A good understanding of data science concepts, fundamental machine learning algorithms/libraries, and development lifecycle is a must-to-have
  • Familiarity with LLM and Agentic AI technologies and engineering patterns is a big advantage
  • Strong ability in performing root cause analysis to address operational issues and identify opportunities for improvement
  • Exceptional communication skills to drive effective customer engagement, collaborate with cross-functional teams, and clearly articulate technical concepts to technical and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Build data systems to link raw data and concrete Housing Trends insights
  • Build and extend our internal forecasting model development framework
  • Develop and maintain scalable data products and deliver pipelines built for speed, accuracy, and consistency that will scale as our stakeholders’ need
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability and performance, etc
  • Collaborate with data scientists to understand their data requirements and build systems/tools that enable efficient model training and experimentation
  • Implement feature stores and ETL pipelines to streamline feature engineering and model development
  • Build and maintain infrastructure for deploying machine learning models into production environments
  • Be a trusted partner for our stakeholders, such as Forecasting, Zestimates, and the ML teams within the AI organization to assist them for data investigation/publication, ML model development and infrastructure support
What we offer
What we offer
  • Eligible for equity awards based on factors such as experience, performance and location
  • Fulltime
Read More
Arrow Right

Senior Engineer - Data Engineer

Position - Data Engineer
Location
Location
India , Indore; Ahmedabad
Salary
Salary:
Not provided
arrow.com Logo
Arrow Electronics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience: 4 to 8 years in software/data engineering
  • Proficiency in SQL, NoSQL databases (e.g., DynamoDB, MongoDB), ETL tools, and data warehousing solutions
  • Proficiency in Python is a must
  • Cloud Platforms: Azure, AWS (e.g., EC2, S3, RDS) or GCP
  • Experience with data visualization tools (e.g., Tableau, Power BI, Looker)
  • Knowledge of data governance and security practices
  • Experience with DevOps practices, including CI/CD pipelines and containerization (Docker, Kubernetes)
  • Excellent verbal and written communication skills in English
  • Experience working in Agile development environments
  • Understanding of AI and ML concepts, frameworks (e.g., TensorFlow, PyTorch), and practical applications
Job Responsibility
Job Responsibility
  • Design and development of real time software and Cloud/Web/mobile based software application
  • Analyze domain specific technical, high level or low level requirement and modification as per end customer or system requirement
  • Perform software testing including unit, functional and system level requirement including manual and automated
  • Perform code review following coding guidelines and static code analysis & troubleshoots software problems of limited difficulty
  • Document technical deliverable like software specifications, design document, code commenting, test cases and test report, Release note etc. throughout the project life cycle
  • Develop software solutions from established programming languages or by learning new language required for specific project
  • Fulltime
Read More
Arrow Right

Senior Staff Data Engineer- Data Platform

At Marktplaats, data is at the heart of everything we do, but Intelligence is wh...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of hands-on experience in Software Development or Data Engineering
  • at least 5+ years specifically focused on building Data Platforms
  • deep understanding of how Platform infra supports Analytics workloads
  • proven experience evolving complex platforms from legacy patterns to modern, cloud-native solutions
  • deep knowledge of Spark internals, JVM tuning, and performance optimization for high-scale batch and streaming datasets
  • deep expertise in Unity Catalog, Delta Lake internals, and optimizing high-volume workloads
  • strict software engineering discipline (CI/CD, Testing, OOP) applied to data pipelines
  • understanding of microservices architecture
  • understanding the needs of Analytics/DWH teams (Data Modeling, dbt)
  • strong background in building automated pipelines using Terraform/Terragrunt and ensuring system observability
Job Responsibility
Job Responsibility
  • Lead the evolution of our Data Platform and architect the "Data Exchange" strategy
  • define robust patterns for API-based ingestion, Event-Driven Architectures (Kafka), and Reverse ETL
  • ensure architectures are optimized for cost and performance on AWS
  • act as a catalyst for technical evolution
  • constantly scan the horizon for next-generation technologies
  • lead the implementation of new paradigms
  • design the strategy for Unity Catalog implementation and Data Contracts
  • champion FinOps, automating cost controls for our highest-volume workloads
  • build the underlying infrastructure that allows Analytics/DWH teams to run efficient transformations
  • elevate the technical bar of the team, mentoring Staff and Senior engineers
What we offer
What we offer
  • An attractive Base Salary
  • Participation in our Short Term Incentive plan (annual bonus)
  • Work From Anywhere: Enjoy up to 20 days a year of working from anywhere
  • A 24/7 Employee Assistance Program for you and your family
  • a collaborative environment with an opportunity to explore your potential and grow
  • a range of locally relevant benefits
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

As Senior Data Engineer you will be responsible for designing, building, maintai...
Location
Location
Portugal , Lisbon
Salary
Salary:
35571.65 - 48126.35 EUR / Year
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree and 3 to 5 years of Computer Science, IT or related field experience
  • Proficiency in Python, PySpark, and Scala for data processing and ETL (Extract, Transform, Load) workflows, with hands-on experience in using Databricks for building ETL pipelines and handling big data processing
  • Experience with data warehousing platforms such as Amazon Redshift, or Snowflake
  • Strong knowledge of SQL and experience with relational (e.g., PostgreSQL, MySQL) databases
  • Familiarity with big data frameworks like Apache Hadoop, Spark, and Kafka for handling large datasets
  • Experienced with software engineering best-practices, including but not limited to version control (GitLab, Subversion, etc.), CI/CD (Jenkins, GITLab etc.), automated unit testing, and Dev Ops
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data solutions for data generation, collection, and processing
  • Be a key team member that assists in design and development of the data pipeline
  • Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems
  • Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
  • Take ownership of data pipeline projects from inception to deployment, manage scope, timelines, and risks
  • Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs
  • Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency
  • Implement data security and privacy measures to protect sensitive data
  • Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions
  • Collaborate and communicate effectively with product teams
What we offer
What we offer
  • Work That Matters – Build tech that accelerates scientific breakthroughs and helps patients worldwide
  • Modern Tech Stack – Cloud-first, automation-focused, AI-powered
  • Global Scale, Agile Mindset – Collaborate across continents while working in nimble, high-impact teams
  • Continuous Learning – Access to certifications, trainings, mentorship, and career mobility
  • AMGEN Total Rewards Plan – Comprehensive benefits in healthcare, finance, and well-being
  • Flexibility – Hybrid work model with time split between our Lisbon office and remote work
  • Fulltime
Read More
Arrow Right