Data Platform Engineer Job at Aurora Innovation (Pittsburgh)

Senior Principal Data Platform Software Engineer

We’re looking for a Sr Principal Data Platform Software Engineer (P70) to be a k...

Location

Salary:

239400.00 - 312550.00 USD / Year

Atlassian

Expiration Date

Until further notice

Requirements

15+ years in Data Engineering, Software Engineering, or related roles, with substantial exposure to big data ecosystems
Demonstrated experience building and operating data platforms or large‑scale data services in production
Proven track record of building services from the ground up (requirements → design → implementation → deployment → ongoing ownership)
Hands‑on experience with AWS, GCP (e.g., compute, storage, data, and streaming services) and cloud‑native architectures
Practical experience with big data technologies, such as Databricks, Apache Spark, AWS EMR, Apache Flink, or StarRocks
Strong programming skills in one or more of: Kotlin, Scala, Java, Python
Experience leading cross‑team technical initiatives and influencing senior stakeholders
Experience mentoring Staff/Principal engineers and lifting the technical bar for a team or org
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience

Job Responsibility

Design, develop and own delivery of high quality big data and analytical platform solutions aiming to solve Atlassian’s needs to support millions of users with optimal cost, minimal latency and maximum reliability
Improve and operate large‑scale distributed data systems in the cloud (primarily AWS, with increasing integration with GCP and Kubernetes‑based microservices)
Drive the evolution of our high-performance analytical databases and its integrations with products, cloud infrastructures (AWS and GCP) and isolated cloud environments
Help define and uplift engineering and operational standards for petabyte scale data platforms, with sub‑second analytic queries and multi‑region availability (coding guidelines, code review practices, observability, incident response, SLIs/SLOs)
Partner across multiple product and platform teams (including Analytics, Marketplace/Ecosystem, Core Data Platform, ML Platform, Search, and Oasis/FedRAMP) to deliver company‑wide initiatives that depend on reliable, high‑quality data
Act as a technical mentor and multiplier, raising the bar on design quality, code quality, and operational excellence across the broader team
Design and implement self‑healing, resilient data platforms with strong observability, fault tolerance, and recovery characteristics
Own the long‑term architecture and technical direction of Atlassian’s product data platform with projects that are directly tied to Atlassian’s company-level OKRs
Be accountable for the reliability, cost efficiency, and strategic direction of Atlassian’s product analytical data platform
Partner with executives and influence senior leaders to align engineering efforts with Atlassian’s long-term business objectives

What we offer

health and wellbeing resources
paid volunteer days

Fulltime

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...

Location

United Arab Emirates , Dubai

Salary:

Not provided

NorthBay

Expiration Date

Until further notice

Requirements

8+ years of experience in data engineering and data platform development
Strong hands-on experience with: AWS Glue
Amazon EMR (Spark)
AWS Lambda
Apache Airflow (MWAA)
Amazon EC2
Amazon CloudWatch
Amazon Redshift
Amazon DynamoDB
AWS DataZone

Job Responsibility

Design, develop, and optimize scalable data pipelines using AWS native services
Lead the implementation of batch and near-real-time data processing solutions
Architect and manage data ingestion, transformation, and storage layers
Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
Orchestrate complex data workflows using Apache Airflow (MWAA)
Develop and manage serverless data processing using AWS Lambda
Design and optimize data warehouses using Amazon Redshift
Implement and manage NoSQL data models using Amazon DynamoDB
Utilize AWS DataZone for data governance, cataloging, and access management
Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch

Fulltime

Senior Data Platform Engineer

We are looking for an experienced data engineer to join our platform engineering...

Location

United States

Salary:

141000.00 - 225600.00 USD / Year

Axon

Expiration Date

Until further notice

Requirements

5+ years of experience in data engineering, software engineering with a data focus, data science, or a related role
Knowledge of designing data pipelines from a variety of source (e.g. streaming, flat files, APIs)
Proficiency in SQL and experience with relational databases (e.g., PostgreSQL)
Experience with real-time data processing frameworks (e.g., Apache Kafka, Spark Streaming, Flink, Pulsar, Redpanda)
Strong programming skills in common data-focused languages (e.g., Python, Scala)
Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Prefect, Temporal)
Familiarity with AWS-based data solutions
Strong understanding of data warehousing concepts and technologies (Snowflake)
Experience documenting data dependency maps and data lineage
Strong communication and collaboration skills

Job Responsibility

Design, implement, and maintain scalable data pipelines and infrastructure
Collaborate with software engineers, product managers, customer success managers, and others across the business to understand data requirements
Optimize and manage our data storage solutions
Ensure data quality, reliability, and security across the data lifecycle
Develop and maintain ETL processes and frameworks
Work with stakeholders to define data availability SLAs
Create and manage data models to support business intelligence and analytics

What we offer

Competitive salary and 401k with employer match
Discretionary time off
Paid parental leave for all
Medical, Dental, Vision plans
Fitness Programs
Emotional & Development Programs
Snacks in our offices

Data Platform Engineer

Data Platform Engineers at Adyen build the foundational layer of tooling and pro...

Location

Netherlands , Amsterdam

Salary:

Not provided

Adyen

Expiration Date

Until further notice

Requirements

Fluency in Python
Experience developing and maintaining distributed data and compute systems like Spark, Trino, Druid, etc
Experience developing and maintaining DevOps pipelines and development ecosystems
Experience developing and maintaining real-time and batch data pipelines (via Kafka, Spark streaming)
Experience with Kubernetes ecosystem (k8s, docker), and/or Hadoop ecosystems (Hive, Yarn, HDFS, Kerberos)
Team player with strong communication skills
Ability to work closely with diverse stakeholders

Job Responsibility

Develop and maintain scalable and high performance big data platforms
Work with distributed systems in all shapes and flavors (databases, filesystems, compute, etc.)
Identify opportunities to improve continuous release and deployment environments
Build or deploy tools to enhance data discoverability through the collection and presentation of metadata
Introduce and extend tools to enhance the quality of our data, platform-wide
Explore and introduce technologies and practices to reduce the time to insight for analysts and data scientists
Develop streaming processing applications and frameworks
Build the foundational layer of tooling and processes for on-premise Big Data Platforms
Collaborate with data engineers and ML scientists and engineers to build and roll-out tools
Develop and operate multiple big data platforms

Senior Data Engineer - Platform Enablement

SoundCloud empowers artists and fans to connect and share through music. Founded...

Location

United States , New York; Atlanta; East Coast

Salary:

160000.00 - 210000.00 USD / Year

SoundCloud

Expiration Date

Until further notice

Requirements

7+ years of experience in data engineering, analytics engineering, or similar roles
Expert-level SQL skills, including performance tuning, advanced joins, CTEs, window functions, and analytical query design
Proven experience with Apache Airflow (designing DAGs, scheduling, task dependencies, monitoring, Python)
Familiarity with event-driven architectures and messaging systems (Pub/Sub, Kafka, etc.)
Knowledge of data governance, schema management, and versioning best practices
Understanding observability practices: logging, metrics, tracing, and incident response
Experience deploying and managing services in cloud environments, preferably GCP, AWS
Excellent communication skills and a collaborative mindset

Job Responsibility

Develop and optimize SQL data models and queries for analytics, reporting, and operational use cases
Design and maintain ETL/ELT workflows using Apache Airflow, ensuring reliability, scalability, and data integrity
Collaborate with analysts and business teams to translate data needs into efficient, automated data pipelines and datasets
Own and enhance data quality and validation processes, ensuring accuracy and completeness of business-critical metrics
Build and maintain reporting layers, supporting dashboards and analytics tools (e.g. Looker, or similar)
Troubleshoot and tune SQL performance, optimizing queries and data structures for speed and scalability
Contribute to data architecture decisions, including schema design, partitioning strategies, and workflow scheduling
Mentor junior engineers, advocate for best practices and promote a positive team culture

What we offer

Comprehensive health benefits including medical, dental, and vision plans, as well as mental health resources
Robust 401k program
Employee Equity Plan
Generous professional development allowance
Creativity and Wellness benefit
Flexible vacation and public holiday policy where you can take up to 35 days of PTO annually
16 paid weeks for all parents (birthing and non-birthing), regardless of gender, to welcome newborns, adopted and foster children
Various snacks, goodies, and 2 free lunches weekly when at the office

Fulltime

Senior Software Engineer, Data Platform

We are looking for a foundational member of the Data Team to enable Skydio to ma...

Location

United States , San Mateo

Salary:

180000.00 - 240000.00 USD / Year

Skydio

Expiration Date

Until further notice

Requirements

5+ years of professional experience
2+ years in software engineering
2+ years in data engineering with a bias towards getting your hands dirty
Deep experience with Databricks building pipelines, managing datasets, and developing dashboards or analytical applications
Proven track record of operating scalable data platforms, defining company-wide patterns that ensure reliability, performance, and cost effectiveness
Proficiency in SQL and at least one modern programming language (we use Python)
Comfort working across the full data stack — from ingestion and transformation to orchestration and visualization
Strong communication skills, with the ability to collaborate effectively across all levels and functions
Demonstrated ability to lead technical direction, mentor teammates, and promote engineering excellence and best practices across the organization
Familiarity with AI-assisted data workflows, including tools that accelerate data transformations or enable natural-language interfaces for analytics

Job Responsibility

Design and scale the data infrastructure that ingests live telemetry from tens of thousands of autonomous drones
Build and evolve our Databricks and Palantir Foundry environments to empower every Skydian to query data, define jobs, and build dashboards
Develop data systems that make our products truly data-driven — from predictive analytics that anticipate hardware failures, to 3D connectivity mapping, to in-depth flight telemetry analysis
Create and integrate AI-powered tools for data analysis, transformation, and pipeline generation
Champion a data-driven culture by defining and enforcing best practices for data quality, lineage, and governance
Collaborate with autonomy, manufacturing, and operations teams to unify how data flows across the company
Lead and mentor data engineers, analysts, and stakeholders across Skydio
Ensure platform reliability by implementing robust monitoring, observability, and contributing to the on-call rotation for critical data systems

What we offer

Equity in the form of stock options
Comprehensive benefits packages
Relocation assistance may also be provided for eligible roles
Paid vacation time
Sick leave
Holiday pay
401K savings plan

Fulltime

Senior Data Engineer – Data Engineering & AI Platforms

We are looking for a highly skilled Senior Data Engineer (L2) who can design, bu...

Location

India , Chennai, Madurai, Coimbatore

Salary:

Not provided

OptiSol Business Solutions

Expiration Date

Until further notice

Requirements

Strong hands-on expertise in cloud ecosystems (Azure / AWS / GCP)
Excellent Python programming skills with data engineering libraries and frameworks
Advanced SQL capabilities including window functions, CTEs, and performance tuning
Solid understanding of distributed processing using Spark/PySpark
Experience designing and implementing scalable ETL/ELT workflows
Good understanding of data modeling concepts (dimensional, star, snowflake)
Familiarity with GenAI/LLM-based integration for data workflows
Experience working with Git, CI/CD, and Agile delivery frameworks
Strong communication skills for interacting with clients, stakeholders, and internal teams

Job Responsibility

Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms
Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers
Work closely with solutioning and pre-sales teams for technical evaluations and client-facing discussions
Lead squads of L0/L1 engineers—ensuring delivery quality, mentoring, and guiding career growth
Develop cloud-native data engineering solutions using Python, SQL, PySpark, and modern data frameworks
Ensure data reliability, performance, and maintainability across the pipeline lifecycle—from development to deployment
Support long-term ODC/T&M projects by demonstrating expertise during technical discussions and interviews
Integrate emerging GenAI tools where applicable to enhance data enrichment, automation, and transformations

What we offer

Opportunity to work at the intersection of Data Engineering, Cloud, and Generative AI
Hands-on exposure to modern data stacks and emerging AI technologies
Collaboration with experts across Data, AI/ML, and cloud practices
Access to structured learning, certifications, and leadership mentoring
Competitive compensation with fast-track career growth and visibility

Fulltime

Quality Engineer - AI and Data Platforms

This is a pioneering Quality Engineer role at the intersection of data engineeri...

Location

United Kingdom , Manchester

Salary:

44000.00 - 66000.00 GBP / Year

Matillion

Expiration Date

Until further notice

Requirements

Solid foundation in data engineering: including SQL, ETL/ELT design, and specific experience building data pipelines and managing data movement
Strong practical AI experience: you have used, experimented with, and are an advocate for an AI-first approach to quality engineering
Proficiency in coding in Java or JavaScript to navigate the codebase and implement quality frameworks
Demonstrated Autonomy, Curiosity, and Problem-solving skills, with a willingness to look at challenges in a different way and ask for assistance as needed
Experience in managing end-to-end testing of SaaS applications, including developing and maintaining efficient test automation tooling

Job Responsibility

Leveraging AI and agentic solutions, including our agentic AI product Maia, to accelerate investigation, generate test cases, and increase quality assurance across the Data Productivity Cloud
Performing root cause analysis on pipeline stability issues, particularly identifying why DPC pipelines run out of memory (OOM) within the agents
Building pipelines to automate every process, solutionizing problems to increase overall team and product productivity
Acting as a crucial bridge by collaborating extensively with various teams, raising problems, and ensuring that fixes are implemented effectively
Adopting, implementing, and championing shift-left testing practices across the team, leading an automation-first approach

What we offer

Company Equity
30 days holiday + bank holidays
5 days paid volunteering leave
Health insurance
Life Insurance
Pension
Access to mental health support

Fulltime

Data Platform Engineer

Aurora Innovation

Location:
United States , Pittsburgh

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
January 18, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Data Platform Engineer

Senior Principal Data Platform Software Engineer