CrawlJobs Logo
Aurora Innovation Logo Aurora Innovation · IT - Software Development

Data Platform Engineer

United States, Pittsburgh 105000.00 - 157000.00 USD / Year · Job Posted January 18, 2026
Apply Position
Job Link Share

Job Description

We’re searching for a software engineer to join Aurora’s Data Platform. The Data Platform Team is responsible for offloading, ingesting and scaling data through various pipelines, including autonomy sensor data, vehicle logs, sims, models, and training sets, along with their life cycle management. The ideal candidate will design and implement systems that efficiently work for both physical offloaders and cloud, and also be an effective liaison between onboard system to cloud system.

Job Responsibility

  • Contribute to the development of internal products and following best practices to simplify data retention
  • Work on tasks to improve the log data availability, discoverability and end to end lifecycle
  • Design efficient AV Log storage patterns that balance performance and affordability
  • Help drive the system efficiency by improving data hygiene across Aurora to deliver cost efficiency
  • Support software engineers across different teams and proactively working together with stakeholders on tasks to satisfy company OKR

Requirements

  • BS/MS or PhD in Computer Science or a related field
  • Minimum 1 year related experience
  • Required programming skills: GoLang/Python
  • General knowledge of backend software systems networking, load balancing, API gateways, system security, gRPC services
  • AWS infrastructure experience, including S3 and DynamoDB in a production commercial system
  • Knowledge of database design, database management and database scalability

Nice to have

  • Proficiencies with coding in C++
  • Proficiencies with Linux system
  • Experience with large scale distributed systems or microservice architectures
  • Experience with DynamoDB / AWS Glue Catalog / AWS Athena
  • A passion for writing robust, intuitive, high-performance code, and being pragmatic about it
  • Ability to navigate and work efficiently in large codebase
  • Strong software development background demonstrated by industry experience in building platforms that serve AV development and commercialization

What we offer

  • annual bonus
  • equity compensation
Aurora Innovation - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Platform Engineer

8 matching positions

Data Platform Engineer

OneTrust’s mission is to enable innovation through the responsible use of data a...
Location
Location
United States , New York
Salary
Salary:
81150.00 - 121725.00 USD / Year
onetrust.com Logo
OneTrust
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Engineering or related field
  • 3+ years of overall experience and 3+ years of experience with very large-scale data warehouse projects
  • Strong experience in SQL, knowledge of dimensional modeling, supporting data warehouse, scaling, optimizing and performance tuning ETL pipelines
  • 1+ years of experience with Python and manipulation of various data formats for extraction and transformation
  • 1+ years of experience with Snowflake, Airflow, ETL/Integration tools administration
  • Hands-on experience with Data Warehouse technologies (Snowflake, Redshift) and Big Data technologies (Hadoop, Hive, Spark, Kafka, Kinesis)
  • Experience evaluating new tools and enriching existing architecture
  • You are a self-starter, hands-on technical expert who continuously gather and synthesize high-impact needs from business partners, design and implement the appropriate technical platform solution, and effectively communicate about deliverables,timelines and tradeoffs
Job Responsibility
Job Responsibility
  • Build and automate modern data platforms (AWS, AZURE, Snowflake) with native technologies, deploy applications, and provision of infrastructure
  • Perform Administration, Maintenance and provide support to production systems (Snowflake, Fivetran, DBT, Power BI, Airflow)
  • Build and maintain CI/CD pipelines and infrastructure as code (IaC) practice across the platform for safe and reproducible deployments
  • Design, build and implement automation framework for scale that deliver data with measurable quality under the SLA
  • Drive technical conversations with stakeholders to understand the platform's needs and come up with a provisioning strategy
  • Work effectively using scrum with multiple team members to deliver value effectively
  • Reduce technical debt over time with root cause identification, issue resolution and promote best practices across the platform
What we offer
What we offer
  • comprehensive healthcare coverage
  • flexible PTO
  • equity RSUs
  • annual performance bonus opportunities
  • retirement account support
  • 14+ weeks of paid parental leave
  • career development opportunities
  • company-paid privacy certification exam fees
  • Fulltime
Read More
Arrow Right

Data Platform Engineer

We’re looking for a Data Platform Engineer (d/f/m) who enjoys working with data ...
Location
Location
Germany , Berlin
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience building scalable, reliable data solutions and bring a platform mindset
  • Solid programming skills in a JVM language or Python
  • Comfortable with SQL
  • Knowledge of cloud fundamentals and hands‑on experience (e.g., GCP, BigQuery, Dataproc, Cloud Run, IAM)
  • Hands‑on experience with infrastructure and operations practices and tooling (e.g., IaC (Terraform), CI/CD (GitHub Actions))
  • Strong data quality & governance mindset (schema evolution, data quality checks, data contracts, metadata, access control)
  • AI literacy and curiosity, ideally with exposure to app development and LLM integration patterns (e.g., RAG, vector stores, MCP)
Job Responsibility
Job Responsibility
  • Design, build, and evolve a resilient, future‑proof cloud data platform
  • Collaborate with Product, Data Science, and Analytics to understand needs and deliver platform capabilities
  • Drive operational excellence by integrating monitoring, alerting, FinOps, and observability best practices
  • Help us move faster on AI readiness by enabling platform integrations for AI use cases and supporting LLM‑ready data
  • Shape the future of our data platform by contributing to architecture discussions and code reviews
  • Raise our standards by standardizing services and tooling, and producing clear documentation and communication
What we offer
What we offer
  • 28 days of paid time off
  • €50 monthly transportation/mobility allowance
  • Development budget and access to coaching
  • Up to 12 (non-birth parent) or 20 (birth parent) weeks of fully paid parental leave
  • Online and offline library
  • Attractive base salary and participation in annual incentive plans
  • Work from anywhere - up to 20 days per year
  • 24/7 Employee Assistance Programme for you and your immediate family
  • Fulltime
Read More
Arrow Right

Data Platform Engineer

Location
Location
Canada
Salary
Salary:
Not provided
myticas.com Logo
Myticas Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Geospatial Data Engineering: Experience designing and maintaining scalable data pipelines for spatial datasets and geospatial analytics workloads
  • Python Data Engineering Stack: Strong Python experience using libraries such as Pandas, NumPy, SQLAlchemy, pytest, and other data engineering tools
  • Geospatial Libraries & Tooling: Hands-on experience with GeoPandas, Rasterio, Xarray, rioxarray, QGIS, or similar spatial processing tools
  • Spatial Databases: Expertise working with PostgreSQL/PostGIS or other spatially enabled databases for large geospatial datasets
  • Workflow Orchestration: Experience with pipeline orchestration tools such as Airflow, DBT, or similar data workflow frameworks
  • Cloud Data Platforms: Experience deploying and managing data pipelines within AWS or comparable cloud infrastructure environments
  • Containerized Data Workflows: Familiarity with Docker and version control systems (Git) for managing reproducible data engineering environments
  • Geospatial Data Integration: Experience ingesting and harmonizing multi-source geospatial data (public datasets, sensor data, satellite or environmental datasets)
  • Data Quality & Validation: Experience implementing data validation, testing, and quality assurance processes within data pipelines
  • Geospatial Analytics & Visualization: Ability to support spatial analysis, mapping workflows, and geospatial insight generation for technical and non-technical stakeholders
Read More
Arrow Right

Data Platform Engineer

We’re looking for a Data Platform Engineer (d/f/m) who enjoys working with data ...
Location
Location
Germany , Berlin
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience building scalable, reliable data solutions and bring a platform mindset
  • Solid programming skills in a JVM language or Python, and comfortable with SQL
  • Knowledge of cloud fundamentals and hands‑on experience (GCP, e.g., BigQuery, Dataproc, Cloud Run, IAM)
  • Hands‑on experience with infrastructure and operations practices and tooling—e.g., IaC (Terraform), CI/CD (GitHub Actions)—and operating services reliably in production
  • Strong data quality & governance mindset (schema evolution, data quality checks, data contracts, metadata, access control)
  • AI literacy and curiosity, ideally with exposure to app development and LLM integration patterns (e.g., RAG, vector stores, MCP) and preparing LLM‑ready datasets
Job Responsibility
Job Responsibility
  • Design, build, and evolve a resilient, future‑proof cloud data platform
  • Collaborate with Product, Data Science, and Analytics to understand needs and deliver platform capabilities
  • Drive operational excellence by integrating monitoring, alerting, FinOps, and observability best practices
  • Help us move faster on AI readiness by enabling platform integrations for AI use cases and supporting LLM‑ready data
  • Shape the future of our data platform by contributing to architecture discussions and code reviews, and influencing key technical decisions
  • Raise our standards by standardizing services and tooling, and producing clear documentation and communication
What we offer
What we offer
  • 28 days of paid time off
  • €50 monthly transportation/mobility allowance
  • Development budget and access to coaching
  • Up to 12 (non-birth parent) or 20 (birth parent) weeks of fully paid parental leave
  • Online and offline library
  • Attractive base salary and participation in our annual incentive plans
  • Work from anywhere - up to 20 days per year
  • 24/7 Employee Assistance Programme for you and your immediate family
  • Fulltime
Read More
Arrow Right

Data Platform Engineer

Job Description
Location
Location
United States , Parsippany
Salary
Salary:
180000.00 USD / Year
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of Total IT experience, including 5+ years of experience in data platform engineering
  • Strong hands-on experience with AWS services such as RDS, Redshift, DMS, and Lambda
  • Proficiency with Infrastructure-as-Code tools including Terraform and AWS CloudFormation
  • Experience with IBM CDC replication & proficiency with Kafka
  • Strong experience in Couchbase cluster management
  • Capable of performing version upgrades, security patching, and performance tuning.
  • Experience building and maintaining Jenkins-based CI/CD pipelines
  • Experience in integrating applications with third party encryption tools like voltage
  • AWS IAM services experience.
  • DBA experience with SQL/NoSQL databases
Job Responsibility
Job Responsibility
  • Design, deploy, and manage scalable data platforms in AWS, including RDS, Redshift, DMS, and Lambda-based data solutions
  • Administer and optimize Couchbase clusters, including version upgrades, patching, performance tuning, and high-availability configurations.
  • Support and enhance OCI cloud data services as part of a broader multi-cloud strategy
  • Manage database services including RDS, Redshift, and associated data migration/replication pipelines
  • Maintain CI/CD pipelines leveraging Jenkins for data platform deployments
  • Implement and maintain Infrastructure-as-Code solutions using Terraform and AWS CloudFormation
  • Develop and maintain robust data replication pipelines using IBM CDC and Kafka.
  • Troubleshoot networking and distributed system issues impacting data services
  • Fulltime
Read More
Arrow Right

Data Platform Engineer

We are looking for a skilled Data Platform Engineer to join our team on a long-t...
Location
Location
United States , Cleveland
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A minimum of 3–5 years of experience managing data platforms, analytics platforms, or cloud-based data services
  • Proficiency in Linux, including command-line operations and troubleshooting
  • Hands-on experience with Kubernetes and containerized application deployments
  • Familiarity with cloud environments such as Amazon Web Services (AWS) or Microsoft Azure
  • Experience with platform monitoring, alerting tools, and providing production support
  • Proven ability to support enterprise-scale or large-scale environments
Job Responsibility
Job Responsibility
  • Oversee the daily administration and operational support of cloud-based analytics platforms
  • Install, configure, monitor, and troubleshoot platform components and services to ensure optimal performance
  • Manage deployments within Kubernetes environments, addressing any related issues
  • Monitor system health and integrate tools for logging, alerting, and observability
  • Resolve performance, connectivity, and access issues to maintain system reliability
  • Configure and manage data source connections and platform integrations
  • Identify and mitigate potential capacity or performance risks by recommending improvements
  • Collaborate with internal teams, including data, engineering, and infrastructure, to meet organizational goals
  • Provide user support in a customer-facing or internal capacity, addressing technical concerns effectively
What we offer
What we offer
  • Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance
  • Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan
Read More
Arrow Right

Data Platform Engineer

We’re looking for a Data Platform Engineer (d/f/m) who enjoys working with data ...
Location
Location
Germany , Berlin
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience building scalable, reliable data solutions and bring a platform mindset
  • Solid programming skills in a JVM language or Python
  • Comfortable with SQL
  • Knowledge of cloud fundamentals and hands‑on experience (we work with GCP, e.g., BigQuery, Dataproc, Cloud Run, IAM)
  • Hands‑on experience with infrastructure and operations practices and tooling—e.g., IaC (Terraform), CI/CD (GitHub Actions)—and operating services reliably in production
  • Strong data quality & governance mindset (schema evolution, data quality checks, data contracts, metadata, access control)
  • AI literacy and curiosity, ideally with exposure to app development and LLM integration patterns (e.g., RAG, vector stores, MCP) and preparing LLM‑ready datasets
Job Responsibility
Job Responsibility
  • Design, build, and evolve a resilient, future‑proof cloud data platform that enables internal teams to produce and consume high‑quality data products
  • Collaborate with Product, Data Science, and Analytics to understand needs and deliver platform capabilities
  • Drive operational excellence by integrating monitoring, alerting, FinOps, and observability best practices
  • Help us move faster on AI readiness by enabling platform integrations for AI use cases and supporting LLM‑ready data
  • Shape the future of our data platform by contributing to architecture discussions and code reviews
  • Raise our standards by standardizing services and tooling, and producing clear documentation and communication
What we offer
What we offer
  • 28 days of paid time off
  • €50 monthly transportation/mobility allowance
  • Development budget and access to coaching
  • Up to 12 (non-birth parent) or 20 (birth parent) weeks of fully paid parental leave
  • Online and offline library
  • Attractive base salary and participation in our annual incentive plans
  • Work from anywhere - up to 20 days per year
  • 24/7 Employee Assistance Programme for you and your immediate family
  • Fulltime
Read More
Arrow Right

Data Platform Engineer

This role belongs to the Knowledge Platform Team, as a senior data platform engi...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
airwallex.com Logo
Airwallex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Around 5+ years of relevant experience as a data engineer
  • Bachelor's or Master's degree in CS/CE/CIS (or equivalent experience)
  • Knowledge of Kotlin / Java / Scala / Python / SQL
  • Knowledge of Kafka, Data Lake, Spark, Flink, DBT, Spring Boot, Hadoop, BigQuery, and Snowflake is preferred
  • Ability to work with senior/leader data platform engineers to design, build, and operate distributed systems and establish overarching data architecture
  • Possess strong working knowledge of Real-time/Batch processing systems
  • Experience with working data at PB scale
Job Responsibility
Job Responsibility
  • Design, build and maintain scalable and reliable batch and stream data pipelines for internal analytics and operational use cases
  • Participate in building data ingestion frameworks connecting internal systems with the centralized data platform using tools like Kafka, Flink, or Spark
  • Collaborate with senior engineers to define and maintain internal data engineering tools, standards, and practices
  • Contribute to automation and reliability improvements that reduce data latency and improve platform scalability
  • Assist with integration of external (third-party) data sources and handle data quality and consistency concerns
  • Work cross-functionally with product, engineering, and BI teams to translate business requirements into engineering solutions
  • Take the lead in system design
  • Drive medium and large-scale projects that create an impact across the entire team
  • Provide dotted-line guidance to Data Platform Engineer II(s) to support them in driving project delivery
What we offer
What we offer
  • Competitive salary plus valuable equity
  • Collaborative open office space with a fully stocked kitchen
  • Regular team-building events
  • Freedom to be creative
  • Fulltime
Read More
Arrow Right