CrawlJobs Logo
Fivetran Logo Fivetran · IT - Software Development

Principal Software Engineer - Data Lakes

Germany · Job Posted June 28, 2026
Apply Position
Job Link Share

Job Description

Fivetran is building data pipelines to power the modern data stack for thousands of companies. We’re seeking a Principal Software Engineer to contribute to the technical architecture, design and development of Fivetran’s Managed Data Lake product offering. As part of a senior engineering team, you’ll partner with product and engineering teams to build scalable, high-performance systems, advance open-source technologies, and set technical standards that raise the bar across the organization.

Job Responsibility

  • Partner closely with product teams to understand requirements and design cutting-edge new capabilities that go directly into customer’s hands
  • Design, develop, implement, and operate highly reliable large-scale data lake systems in cooperation with a dedicated data lake engineering team
  • Contribute to open-source projects such as DuckDB and Polaris
  • Embrace Fivetran innovations with open-source standards and toolsets
  • Analyze fault-tolerance and high availability issues, performance and scale challenges, and solve them
  • Ensure operational excellence of the services and meet the commitments to our customers regarding security, reliability, availability, and performance
  • Set technical directions and influence cross-functional teams

Requirements

  • 6+ years of hands-on or research experience with high-performance relational data management systems
  • Deep understanding of infrastructure & software optimizations and performance engineering to drive significant performance, latency, and availability improvements
  • Proven track record of leading and delivering large and complicated projects
  • Strong development skills in Java and C++
  • Solid experience with public clouds (AWS, Azure, GCP)
  • Demonstrated knowledge of columnar storage formats
  • Growth mindset and excitement about breaking the status quo by seeking innovative solutions
  • Excellent team player who is consistent in making everyone around you better

Nice to have

Strongly prefer an MS or PhD in Computer Science, ideally focusing on database management and/or storage engines

What we offer

  • 100% employer-paid medical insurance
  • Generous paid time-off policy (PTO), plus paid sick time, inclusive parental leave policy, holidays, and volunteer days off
  • RSU stock grants
  • Professional development and training opportunities
  • Company virtual happy hours, free food, and fun team-building activities
  • Monthly cell phone stipend
  • Access to an innovative mental health support platform that offers personalized care and resources in areas such as: therapy, coaching, and self-guided mindfulness exercises for all covered employees and their covered dependents
Fivetran - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Principal Software Engineer - Data Lakes

8 matching positions

Principal Data Engineer

Do you want to lead the development and transformation of the data platform that...
Location
Location
Denmark , Copenhagen
Salary
Salary:
Not provided
3shape.com Logo
3Shape
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Several years of experience designing, building, and operating modern cloud-based data platforms, ideally in a large organization, technology company, or consulting environment, supported by a degree in Computer Science, Data Engineering, Software Engineering, or a related field
  • Strong experience with modern cloud-based data platforms and technologies (preferably Azure Databricks, Apache Spark, Delta Lake), combined with solid software engineering skills in Python, SQL, CI/CD, and Infrastructure as Code
  • Experience establishing scalable platform architectures, governance frameworks, and operating models that enable teams to build trusted, secure, and high-quality data products
  • Strong communication and stakeholder management skills, with the ability to engage and influence both technical and non-technical stakeholders. You enjoy enabling data domain teams, collaborating with business teams, and translating complex technical concepts into practical solutions and business value
  • A collaborative leadership style and experience driving alignment, standards, and best practices across teams in a federated environment
  • Curiosity, ambition, and a genuine passion for data, AI, and digital transformation, combined with a hands-on mindset and a drive to continuously improve platform capabilities and data excellence
Job Responsibility
Job Responsibility
  • Lead the transformation of the Databricks platform into an AI-ready foundation, strengthening platform ownership, governance, and scalability across the organization
  • Define and evolve enterprise-wide standards for data platform architecture, governance, security, and access management in close collaboration with Group IT and other key stakeholders
  • Enable and guide domain data teams through technical leadership, architectural best practices, platform capabilities, and data product standards, incl. design and establish scalable frameworks for ingesting and managing data
  • Contribute hands-on to development, working closely with engineers to design, build, and deliver robust, scalable data platform capabilities, and foster alignment and collaboration by driving platform consistency, reusable patterns, and knowledge sharing
  • Drive planning and prioritization across the end-to-end data lifecycle, aligning platform evolution with data products, analytics, and AI initiatives
  • Drive operational excellence and cost optimization of the platform, including governance of Databricks usage and consumption models
  • Identify, evaluate, and drive adoption of new platform capabilities, AI technologies, and emerging data platform opportunities
  • Drive a culture of data excellence by improving data literacy, promoting best practices, and helping teams across the organization maximize the value of data, analytics, and AI
What we offer
What we offer
  • Vibrant and international environment with social, diverse, and highly skilled and cooperative colleagues - we are more than 40 nationalities in our DK based office
  • Attractive healthcare package to keep you fit and well
  • Breakfast every day, and delicious and healthy lunch cooked by our private chefs
  • Great social work environment with many optional activities and social clubs, ranging from wine & beer, board games, running to bicycle clubs
  • Attractive offices and R&D lab spaces in downtown Copenhagen close to Kgs. Nytorv, Nyhavn, and the Copenhagen Canals
  • Purpose: Help improve dental patients on a global scale
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

Our Client is seeking a Principal Data Engineer to roll up their sleeves and bui...
Location
Location
United States , New York
Salary
Salary:
175000.00 - 220000.00 USD / Year
solomonpage.com Logo
Solomon Page
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong foundation in software engineering principles, including SOLID design, modularity, and scalability.
  • Expert proficiency in Databricks, including Delta Lake, Unity Catalog, Delta Live Tables, MLflow, and Databricks Workflows.
  • Deep experience with Snowflake, including data modeling, performance optimization, and integration with upstream/downstream pipeline tooling.
  • Expert proficiency in Python for data pipeline and automation development.
  • Advanced SQL skills with experience optimizing complex queries and data models at scale.
  • Proven experience designing and maintaining cloud-native data pipelines on AWS (e.g., MWAA/Airflow, Lambda, ECS, SQS, Glue, S3, Redshift, etc.).
  • Experience implementing and managing Terraform or similar IaC frameworks.
  • Strong understanding of lakehouse architecture patterns, data ingestion, transformation, and orchestration, including familiarity with ML/AI pipeline integration patterns.
  • Familiarity with CI/CD pipelines, automated testing, and modern DevOps practices.
  • 8+ years of experience in data engineering or backend development, with a focus on scalable data solutions.
Job Responsibility
Job Responsibility
  • Build and maintain end-to-end data pipelines — from raw ingestion through transformation and delivery — across diverse data sources (APIs, web data, internal feeds, etc.).
  • Hands-on development of scalable, production-grade pipelines within Databricks, including Delta Lake table management, Workflows, and cluster optimization.
  • Build and maintain data models, schemas, and transformation logic in Snowflake, optimizing for performance and reliability.
  • Develop and manage Databricks environments including Unity Catalog, Delta Live Tables, and integration patterns that support both internal data consumers and external sharing use cases.
  • Build and manage orchestration workflows using AWS services (MWAA/Airflow, Lambda, ECS, SQS, MSK) and Databricks-native orchestration where appropriate.
  • Implement and maintain infrastructure as code (IaC) using Terraform, ensuring reproducibility and compliance with cloud standards.
  • Establish and enforce best practices in data modeling, schema design, and ETL/ELT processes for high-volume structured and semi-structured data across Snowflake and Databricks.
  • Ensure data quality, lineage, and observability through automated testing, monitoring, and alerting across all pipeline layers.
  • Collaborate closely with technology leadership to align data platform development with business strategy and product goals.
  • Stay at the forefront of industry trends in data engineering, lakehouse architecture, and cloud-native data platforms.
  • Fulltime
Read More
Arrow Right

Principal Software Engineer - Simulation & Digital Twin Architect

At General Motors, our product teams are redefining mobility. Through a human-ce...
Location
Location
United States , Austin;Warren;Mountain View
Salary
Salary:
Not provided
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s or PhD in Computer Science, Software Engineering, Robotics, Electrical/Computer Engineering, or related field
  • 10+ years of software engineering experience, including principal-level architecture or technical leadership for large-scale, multi-team platforms or systems
  • Deep experience with at least one major 3D or manufacturing simulation environment (e.g., Unity, Unreal, NVIDIA Isaac/Omniverse)
  • Proven track record integrating systems across PLM/CAD, MES/production, PLC/controls, and data/analytics platforms
  • Strong programming skills in C++, C#, Python, or similar, with experience designing APIs, services, and data models
  • Experience with cloud and on-prem environments (e.g., Kubernetes, GPU clusters, data lakes) for high-scale simulation and Digital Twin workloads
Job Responsibility
Job Responsibility
  • Own the end-to-end architecture for GM’s manufacturing Digital Twin & Simulation stack (plant models, AMR/cobot and equipment simulation, material flow, and integrations with PLM, CAD, MES, and data platforms)
  • Define and maintain enterprise reference architectures, APIs, and data contracts used across plants and business units
  • Architect scalable data schemas and pipelines for ingesting and managing plant and floor data for both simulation and operational twins
  • Design modular, distributed simulation architectures that balance fidelity and cost across cloud and on-prem environments (e.g., Kubernetes, GPU clusters, data lakes)
  • Lead cross-functional, multi-team initiatives
  • align teams and vendors to shared architectures and standards
  • Act as a principal technical voice for Digital Twin & Simulation, mentoring senior/staff/principal engineers and influencing technical direction across GM
What we offer
What we offer
  • Relocation benefits
  • Fulltime
Read More
Arrow Right

Principal Software Engineer

We are looking for a strong Principal Software Engineer who is passionate about ...
Location
Location
United States , Redmond
Salary
Salary:
163000.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
Job Responsibility
Job Responsibility
  • Working on solving ambiguous problems, designing and developing services with high reliability, 24x7 availability
  • Working with big data technologies like Azure Data Lake, COSMOS
  • Creating high-availability services based on new and upcoming streaming solutions
  • Working with short release cycles and delivering quality software including architecture, design, development, test, ship and support the software
  • Collaborating with multiple teams within Ads Marketplace, Ads Platform, Ads Data platform, Search Platform
  • Fulltime
Read More
Arrow Right

Principal Software Engineer

Conversion and attribution are core business capabilities for measuring advertis...
Location
Location
China , Beijing
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • Solid experience of shipping high performance C#, Java, or equivalent language code software
  • Understanding of distributed system and data parallel computing is preferred
  • Data processing or analytics experience with Spark, Flink, Kafka, Azure Data Lake is a plus
  • Domain knowledge of ads, search or content services is a plus
  • Experience of designing mission critical data pipelines with SLA commitment is a plus
  • Quick learning and solid problem solving and debugging skills
  • Accountable and proactive
  • Good communication skill, fluent in English (both oral and written)
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
Job Responsibility
Job Responsibility
  • Provides critical technical leadership across conversion and attribution, driving the continuous expansion of conversion signal coverage, the evolution of measurement logic, and systematic improvements in system reliability
  • Operating under complex business constraints and within a rapidly evolving industry landscape, the role requires balancing measurement accuracy, platform stability, and long‑term extensibility
  • In close collaboration with product, modeling, and engineering partners, this position delivers stable, scalable conversion and attribution capabilities that create sustained business value
  • Fulltime
Read More
Arrow Right

Senior Principal Data Engineer

Your success is a train ride away! As we move America’s workforce toward the fut...
Location
Location
United States , Washington
Salary
Salary:
175427.00 - 215100.00 USD / Year
amtrak.com Logo
AMTRAK
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree or equivalent in Computer Science, Computer Information Systems, or a related field
  • 7 years of progressive, post-baccalaureate experience as a Senior Principal Data Engineer or any occupation related to Software Development
  • Experience building solutions using Informatica Data Quality, Informatica MDM, Erwin, and Informatica Power Center
  • Experience administering applications in UNIX, LINUX, and Windows environments
  • Experience writing and executing scripts in Perl
  • Experience implementing solutions on AWS leveraging identity resolutions, data lake, metadata, and data governance
  • Experience performing data migrations, cleansing, integration, and normalization for data warehouses
  • Experience creating customized Master Data Management (MDM) and IDD solutions
  • All positions require pre-employment background check verification and a pre-employment drug screen
Job Responsibility
Job Responsibility
  • Lead the technological advancement and architecture of data-driven solutions across multiple departments including Operations, Finance, Safety, Marketing, and IT
  • Spearhead the design, development, and delivery of end-to-end solutions on contemporary technology platforms
  • Oversee designing data ingestion, transfer, and consumption processes that are cost-effective and performance efficient
  • Act as a Subject Matter Expert (SME) for key and critical source systems to offer essential guidance and mentorship to the Development, Testing, Implementation, and Support teams
  • Adapt and enhance solutions to meet evolving requirements, ensuring alignment with business objectives
  • Fulltime
Read More
Arrow Right

Principal Engineer, Iceberg

At Cloudera, we empower people to transform complex data into clear and actionab...
Location
Location
Salary
Salary:
Not provided
cloudera.com Logo
Cloudera
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS or MS in Computer Science or related field
  • 8+ years experience as a Software Engineer
  • Hands-on programmer with solid data-structures and algorithms
  • Experience with systems design, development
  • Strong understanding of at least one of the following languages: Java, Scala, C++, Python. And interested to learn the languages we’re using.
  • Passionate about programming, clean coding habits, attention to detail, and focus on quality
  • Strong ability to research and solve problems independently without constant supervision
  • Ability to work effectively both independently and as part of an international and virtual team
  • Excellent communication and collaboration skills
  • (Most importantly) Open-minded attitude, desire to learn new things and build great products
Job Responsibility
Job Responsibility
  • Become a core contributor to Apache Iceberg
  • Bring performance improvements to all of the engines in the Cloudera stack, by implementing new features in Iceberg and working with other teams to leverage them during queries
  • Work with Product Managers and Customers to determine ways Iceberg can be improved for Modern Data Lakes
  • Develop new features in Java on a modern platforms
  • Gain a solid understanding and deep technical knowledge of components across the Cloudera stack, but focusing on Iceberg, which you can utilize in your daily tasks
  • Get to work on large scale distributed systems, from 100s to 1000s of nodes, in production clusters
  • Debug system level deployment issues, root cause analysis, perform system test analysis and resolve failures
  • Collaborate with other team members and stakeholders
What we offer
What we offer
  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups
  • Fulltime
Read More
Arrow Right

Principal Engineer, Iceberg

At Cloudera, we empower people to transform complex data into clear and actionab...
Location
Location
Salary
Salary:
Not provided
cloudera.com Logo
Cloudera
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS or MS in Computer Science or related field
  • 8+ years experience as a Software Engineer
  • Hands-on programmer with solid data-structures and algorithms
  • Experience with systems design, development
  • Strong understanding of at least one of the following languages: Java, Scala, C++, Python. And interested to learn the languages we’re using.
  • Passionate about programming, clean coding habits, attention to detail, and focus on quality
  • Strong ability to research and solve problems independently without constant supervision
  • Ability to work effectively both independently and as part of an international and virtual team
  • Excellent communication and collaboration skills
  • Open-minded attitude, desire to learn new things and build great products
Job Responsibility
Job Responsibility
  • Become a core contributor to Apache Iceberg
  • Bring performance improvements to all of the engines in the Cloudera stack, by implementing new features in Iceberg and working with other teams to leverage them during queries
  • Work with Product Managers and Customers to determine ways Iceberg can be improved for Modern Data Lakes
  • Develop new features in Java on a modern platforms
  • Gain a solid understanding and deep technical knowledge of components across the Cloudera stack, but focusing on Iceberg, which you can utilize in your daily tasks
  • Get to work on large scale distributed systems, from 100s to 1000s of nodes, in production clusters
  • Debug system level deployment issues, root cause analysis, perform system test analysis and resolve failures
  • Collaborate with other team members and stakeholders
What we offer
What we offer
  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups
  • Fulltime
Read More
Arrow Right