CrawlJobs Logo

Software Engineer – Data Platforms

Germany, Berlin · Job Posted June 30, 2026
Apply Position
Job Link Share

Job Description

Join our team at smartclip as a Software Engineer, Data Platforms. You will design and build the engines that process, transform, and refine terabytes of TV and advertising data every single day. Your goal is to ensure our data platform is scalable, resilient, and cutting-edge.

Job Responsibility

  • Join our team at smartclip as a Software Engineer, Data Platforms. You will design and build the engines that process, transform, and refine terabytes of TV and advertising data every single day. Your goal is to ensure our data platform is scalable, resilient, and cutting-edge.
  • Engineer Scalable Platforms: Design and implement technical solutions for Big Data applications in an agile, high-performance environment.
  • Optimize Data Flows: Continuously develop and refine our data aggregation pipelines (TV data, advertising, and forecasting) primarily based on Spark and Scala.
  • Cloud-Native Deployment: Host, manage, and scale your solutions using Docker and Kubernetes within the AWS cloud.
  • Champion Quality: Lead the way in test automation – from unit tests to complex integration tests. For us, Test Driven Development (TDD) is the only way to build reliable systems.
  • Tech Exploration: Evaluate new frameworks and tools, share your findings with the team, and help us stay at the forefront of Big Data technology.

Requirements

  • You are a software engineer at heart who loves the challenge of massive scale – you turn the complexity of terabytes of data into elegant, efficient code.
  • Engineering Background: You have a solid track record in software engineering, with a strong focus on JVM languages (Scala/Java) and/or Python.
  • Big Data Expertise: You are experienced with Spark, Hadoop, or similar distributed systems. Experience with Trino, Flowman, or Delta Lake will make you stand out.
  • Infrastructure Knowledge: You are comfortable with CI/CD, Docker, Kubernetes, and AWS.
  • Quality Mindset: You don’t ship without tests. You value efficiency, clean architecture, and pragmatic solutions.
  • Open Source Advocate: You love the freedom and transparency of open-source software (you won't find any closed-source or Microsoft stacks here).
  • Mindset: A 'let's figure it out' attitude, a hands-on mentality, and fluency in German and English.

Nice to have

Experience with Trino, Flowman, or Delta Lake

What we offer

  • 30 days of vacation + Dec 24 & 31 off
  • Smart Fridays (4 days week possible)
  • mobility (Germany ticket & JobRad)
  • sports and health offerings
  • mental health support
  • corporate benefits
  • RTL+ access

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer – Data Platforms

8 matching positions

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
  • Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
  • Experience building data lake or data engineering products, tools, or pipelines
  • Familiarity with container-based architectures (Docker, Kubernetes)
  • Ability to debug complex distributed systems on Linux and/or Windows platforms
Job Responsibility
Job Responsibility
  • Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
  • Use AI tools and coding best practices across the development lifecycle
  • Design data refresh, scheduling, and query optimisation features with minimal supervision
  • Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
  • Coach junior engineers through code reviews
  • Debug complex issues in distributed systems running on Azure, Linux, and Windows
  • Run live site operations on a rotational, on-call basis
  • Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
  • Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data Platforms and Services - Minecraft

At Mojang Studios, the creators of Minecraft, we are on a mission to build a bet...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience.
Job Responsibility
Job Responsibility
  • Build and operate scalable data services and APIs powering personalization, analytics, and player insights across Mojang
  • Own end-to-end cloud infrastructure (Azure + Terraform + CI/CD) for reliable, repeatable deployments across environments
  • Ensure production reliability (ICM/DRI ownership, monitoring, incident response) for critical data systems and services
  • Drive performance, cost efficiency, and security compliance across data pipelines, services, and infrastructure
  • Build and maintain shared C++ telemetry libraries used across gameplay systems and services.
  • Fulltime
Read More
Arrow Right

Senior Software Engineer (Backend) - Data & Storage Platforms

As a Senior Software Engineer in the Storage, Search, and Data (SSD) group, you ...
Location
Location
United States , Seattle, Washington; San Francisco, California; Sunnyvale, California
Salary
Salary:
202000.00 - 224000.00 USD / Year
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ Years of Engineering Experience: Proven track record of building and maintaining large-scale distributed systems
  • Deep Storage Knowledge: Practical, hands-on experience with: Relational & NoSQL: Distributed MySQL, Cassandra, or Redis
  • Batch & Object: HDFS, S3/GCS, and Metadata services
  • Distributed Systems: If you’ve worked on systems like Google Spanner or TiDB, you’ll be a great fit for our Transactional Storage (Docstore) team
  • Coding Mastery: Expert-level proficiency in Java, Go, or C++, with a strong focus on concurrency, memory management, and performance tuning
  • Query Engines: Experience with large-scale analytical engines like Presto, Hive, or Trino
Job Responsibility
Job Responsibility
  • Own & Execute: Lead the design and implementation of major features for Uber’s storage and data platforms (e.g., Docstore, Pinot, or OpenSearch)
  • Cloud-Native Modernization: Build and optimize services that leverage GCP and OCI Object Storage, focusing on high-throughput metadata management and S3-compatible API support
  • Storage Optimization: Drive efficiency across our HDFS and Blobstore layers, using table formats like Apache Hudi or Iceberg to improve data freshness and reduce cost
  • AI/ML Integration: Work with AI teams to design high-performance data pipelines, ensuring our storage layers can handle the intense IO demands of GPU-based model training
  • Operational Leadership: Ensure 99.99% availability for your services. You will lead root-cause analyses (RCAs), improve observability, and mentor L3/L4 engineers on best practices for distributed systems
What we offer
What we offer
  • Uber's bonus program
  • equity award & other types of comp
  • 401(k) plan
  • various benefits
  • Fulltime
Read More
Arrow Right

Staff Software Engineer : Storage, Search, & Data Platforms

The Storage, Search, and Data (SSD) group is the custodian of Uber's digital int...
Location
Location
United States , Seattle; San Francisco; Sunnyvale
Salary
Salary:
232000.00 - 258000.00 USD / Year
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of software engineering experience, with a proven history of designing and operating massive-scale distributed data systems
  • Elite engineering skills in Go, Java, C++, or Rust. You are comfortable deep-diving into database internals, kernel-level optimizations, and complex distributed consensus protocols
  • Proven experience leading technical strategy across multiple teams or organizations, turning high-level business goals into concrete technical realities
  • Extensive experience managing Tier-0, mission-critical systems with 99.99% availability and global blast-radius constraints
Job Responsibility
Job Responsibility
  • Define and execute the multi-year roadmap to transition Uber from Data Storage to a Cloud-Native Data Provider, solving for cross-region latency, global metadata consistency, and exabyte-scale cost efficiency
  • Partner with Uber's AI/ML leadership to architect the Data-to-GPU pipeline. You will design the one-stop storage APIs that allow researchers to leverage high-performance data access across multi-cloud regions and vendors seamlessly
  • Drive the next generation of our core engines: Docstore (NoSQL), Vitess (Sharded MySQL), Apache Pinot (Real-time Analytics), and OpenSearch (Discovery)
  • You will represent Uber in the global community as a leader in key open source technologies including Apache, Hudi, Iceberg and many others
What we offer
What we offer
  • Eligible to participate in Uber's bonus program
  • May be offered an equity award & other types of comp
  • Eligible to participate in a 401(k) plan
  • Various benefits
  • Fulltime
Read More
Arrow Right

Software Engineer / Data Engineer

We are looking for a Software Engineer / Data Engineer to build and enhance inte...
Location
Location
United States , New York
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant experience in software engineering, data engineering, or a closely related technical role
  • Strong backend development expertise in Python, with practical experience building production-grade services and data-driven applications
  • Hands-on experience with PySpark, Databricks, and AWS for data processing, platform development, and cloud-based deployment
  • Ability to work across multiple layers of technology, including APIs, databases, application logic, frontend components, and infrastructure
  • Familiarity with JavaScript or TypeScript and exposure to modern frontend frameworks such as React or Next.js
  • Experience developing solutions that incorporate large language models
  • broader machine learning knowledge is an advantage
  • Proven ability to translate loosely defined business or research needs into well-structured technical solutions
Job Responsibility
Job Responsibility
  • Create and support internal applications, including dashboards, research platforms, and workflow solutions that improve day-to-day productivity across the firm
  • Develop and maintain AI-enabled internal systems such as application services, knowledge retrieval capabilities, agent-based tools, and monitoring frameworks for performance and quality
  • Collaborate with investment professionals and data science teams to convert research processes into stable, user-focused software products
  • Define technical direction for new systems, selecting appropriate architecture and establishing engineering standards that can scale with future development
  • Build backend services and data pipelines using Python, PySpark, and Databricks to support analytics, automation, and application functionality
  • Contribute to frontend experiences for internal users with modern web technologies such as Next.js, React, and interactive visualization tools
  • Design solutions that connect APIs, user interfaces, data storage, and cloud infrastructure into cohesive, maintainable platforms
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • company 401(k) plan
  • free online training
Read More
Arrow Right

Senior Software Engineer / Principal Software Engineer - Copilot CLI

Within GitHub and Microsoft CoreAI, the Copilot CLI team builds GitHub's coding ...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years
Job Responsibility
Job Responsibility
  • Take ownership of critical product and platform areas of the Copilot CLI and shared agent runtime
  • Set a high technical and quality bar for agentic systems and developer-facing tooling
  • Design and ship performant, reliable terminal experiences that developers depend on for daily work
  • Use data, benchmarks, and direct user feedback to guide iteration and investment
  • Collaborate across org boundaries to enable other teams to build agentic products on top of a shared foundation
  • Influence architecture, technical direction, and engineering standards beyond your immediate team
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation
  • Fulltime
Read More
Arrow Right

Software Engineer 2 / Senior Software Engineer

We are looking for an experienced Software Engineers for our Bangalore location ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
komprise.com Logo
Komprise, Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid grasp of computer science fundamentals and especially data structures, algorithms, multi-threading
  • Ability to solve difficult problems with a simple elegant solution
  • Should have solid object-oriented programming background with impeccable design skills
  • Experience in developing management applications and performance management applications is ideal
  • Experience with object-based file systems and REST interfaces is a plus (e.g. Amazon S3, Azure, Google Cloud Service)
  • Should have a BE or higher in CS, EE, Math or related engineering or science field
  • At least 5+ years of experience in software deployment
  • Tech Stack: Java, Maven Virtualisation, SaaS, Github, Jira, Slack, Cloud Solutions and Hypervisors
Job Responsibility
Job Responsibility
  • Responsible for designing and developing features that powers Komprise data management platform to manage billions of files and petabytes of data
  • Responsible for designing of major components and systems of our product architecture, ensuring that Komprise data management platform is highly available and scalable
  • Responsible for writing performance code, evaluate feasibility, develop for quality and optimize for maintainability
  • Work in agile, customer focused and fast paced team with direct interaction with the customers
  • Responsible for analysing customer escalated issues and provide resolutions in a timely manner
  • Should be able to design and implement highly performant, scalable distributed systems
Read More
Arrow Right

Software Engineer II and Senior Software Engineer

The FIO (Office Files and Identity) Team drives collaboration, identity, cloud f...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, or Rust
  • OR equivalent experience
  • 4+ years industry engineering experience coding in languages including, but not limited to, C, C++, C#, Java or Rust
  • 4+ years industry experience building and shipping production quality, performant and cross-platform applications
  • Experience collaborating cross-team and cross-function to deliver software features or projects
  • Platform-specific experience building Windows, MacOS, iOS or Android applications
  • Experience designing and implementing efficient network communications, including network protocols, performance and reliability tooling, modeling and implementing complex customer scenarios across network services
  • Experience designing and implementing client-side storage stacks, with a focus on correctness, resiliency, performance, and adaptability
  • Understanding of client file system design and APIs, including advanced performance optimizations
  • Experience directly implementing large-scale data pipelines for product telemetry, with ability to evolve system as business and technical needs change
Job Responsibility
Job Responsibility
  • Design and write code
  • Work across organizations and directly with partners both in Office and across Microsoft, including other engineers and product leaders
  • Use data as the basis for decision making
  • Be a steward of products that ship to hundreds of millions of customers around the world, staying connected to customers through data and feedback and being agile and responsive to issues
  • Grow as an engineer in a modern and highly impactful team
  • Fulltime
Read More
Arrow Right