Software Engineer, Data Engine Job at YC Work at a Startup (San Francisco)

Senior Principal Data Platform Software Engineer

We’re looking for a Sr Principal Data Platform Software Engineer (P70) to be a k...

Location

Salary:

239400.00 - 312550.00 USD / Year

Atlassian

Expiration Date

Until further notice

Requirements

15+ years in Data Engineering, Software Engineering, or related roles, with substantial exposure to big data ecosystems
Demonstrated experience building and operating data platforms or large‑scale data services in production
Proven track record of building services from the ground up (requirements → design → implementation → deployment → ongoing ownership)
Hands‑on experience with AWS, GCP (e.g., compute, storage, data, and streaming services) and cloud‑native architectures
Practical experience with big data technologies, such as Databricks, Apache Spark, AWS EMR, Apache Flink, or StarRocks
Strong programming skills in one or more of: Kotlin, Scala, Java, Python
Experience leading cross‑team technical initiatives and influencing senior stakeholders
Experience mentoring Staff/Principal engineers and lifting the technical bar for a team or org
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience

Job Responsibility

Design, develop and own delivery of high quality big data and analytical platform solutions aiming to solve Atlassian’s needs to support millions of users with optimal cost, minimal latency and maximum reliability
Improve and operate large‑scale distributed data systems in the cloud (primarily AWS, with increasing integration with GCP and Kubernetes‑based microservices)
Drive the evolution of our high-performance analytical databases and its integrations with products, cloud infrastructures (AWS and GCP) and isolated cloud environments
Help define and uplift engineering and operational standards for petabyte scale data platforms, with sub‑second analytic queries and multi‑region availability (coding guidelines, code review practices, observability, incident response, SLIs/SLOs)
Partner across multiple product and platform teams (including Analytics, Marketplace/Ecosystem, Core Data Platform, ML Platform, Search, and Oasis/FedRAMP) to deliver company‑wide initiatives that depend on reliable, high‑quality data
Act as a technical mentor and multiplier, raising the bar on design quality, code quality, and operational excellence across the broader team
Design and implement self‑healing, resilient data platforms with strong observability, fault tolerance, and recovery characteristics
Own the long‑term architecture and technical direction of Atlassian’s product data platform with projects that are directly tied to Atlassian’s company-level OKRs
Be accountable for the reliability, cost efficiency, and strategic direction of Atlassian’s product analytical data platform
Partner with executives and influence senior leaders to align engineering efforts with Atlassian’s long-term business objectives

What we offer

health and wellbeing resources
paid volunteer days

Fulltime

Software Engineer (Data Engineering)

We are seeking a Software Engineer (Data Engineering) who can seamlessly integra...

Location

India , Hyderabad

Salary:

Not provided

NStarX

Expiration Date

Until further notice

Requirements

4+ years in Data Engineering and AI/ML roles
Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field
Python, SQL, Bash, PySpark, Spark SQL, boto3, pandas
Apache Spark on EMR (driver/executor model, sizing, dynamic allocation)
Amazon S3 (Parquet) with lifecycle management to Glacier
AWS Glue Catalog and Crawlers
AWS Step Functions, AWS Lambda, Amazon EventBridge
CloudWatch Logs and Metrics, Kinesis Data Firehose (or Kafka/MSK)
Amazon Redshift and Redshift Spectrum
IAM (least privilege), Secrets Manager, SSM

Job Responsibility

Design, build, and maintain scalable ETL and ELT pipelines for large-scale data processing
Develop and optimize data architectures supporting analytics and ML workflows
Ensure data integrity, security, and compliance with organizational and industry standards
Collaborate with DevOps teams to deploy and monitor data pipelines in production environments
Build predictive and prescriptive models leveraging AI and ML techniques
Develop and deploy machine learning and deep learning models using TensorFlow, PyTorch, or Scikit-learn
Perform feature engineering, statistical analysis, and data preprocessing
Continuously monitor and optimize models for accuracy and scalability
Integrate AI-driven insights into business processes and strategies
Serve as the technical liaison between NStarX and client teams

What we offer

Competitive salary and performance-based incentives
Opportunity to work on cutting-edge AI and ML projects
Exposure to global clients and international project delivery
Continuous learning and professional development opportunities
Competitive base + commission
Fast growth into leadership roles

Fulltime

Software Engineer – Data

We are seeking a skilled Software Engineer with expertise in data engineering an...

Location

Ireland , Dublin 1

Salary:

65000.00 EUR / Year

Solas IT Recruitment

Expiration Date

Until further notice

Requirements

Strong experience in data engineering with Azure or AWS
Hands-on expertise with Databricks, Delta Lake, Data Factory, and NoSQL databases
Proficiency in Python, Scala, or SQL for data workflows
Solid understanding of ETL/ELT patterns and big data processing

Job Responsibility

Develop and maintain scalable ETL/ELT pipelines for data transformation
Manage Data Lakes and big data frameworks, ensuring performance and security
Utilize Azure tools such as Data Factory, Databricks, and Delta Lake
Collaborate with analytics teams to deliver curated datasets
Optimize NoSQL databases and leverage Apache Spark for big data processing

What we offer

pension
healthcare
dental
25 days annual leave
Hybrid working model for flexibility
Opportunities for professional development and cutting-edge projects

Fulltime

Senior Rust Software Engineer - Data Classification

As a Senior Engineer on the Data Classification team, you’ll design and developm...

Location

Israel , Tel Aviv

Salary:

Not provided

Palo Alto Networks

Expiration Date

Until further notice

Requirements

BSc in Computer Science with 5+ years, or MSc with 3+ years, or equivalent military experience
Experience with systems-level languages (C++, C, Go, etc.)
Deep understanding of memory management
Strong understanding of application and OS interaction
Experience with multi-threaded and multi-process development with a performance focus
Familiarity with CI/CD pipelines and cloud infra - Have the ability to “make stuff work" on top of writing good code

Job Responsibility

Develop solutions for data security and classification using Rust, Python & Golang
Contribute to feature development (design, implementation, testing, deployment)
Collaborate with cross-functional teams for product and infrastructure integration
Innovate solutions for high-scale data operations
Serve as a leader, improving the work of others
Generate ideas and participate in brainstorming
Identify and push for team improvements

Fulltime

Senior Software Engineer, Data Platform

We are looking for a foundational member of the Data Team to enable Skydio to ma...

Location

United States , San Mateo

Salary:

180000.00 - 240000.00 USD / Year

Skydio

Expiration Date

Until further notice

Requirements

5+ years of professional experience
2+ years in software engineering
2+ years in data engineering with a bias towards getting your hands dirty
Deep experience with Databricks building pipelines, managing datasets, and developing dashboards or analytical applications
Proven track record of operating scalable data platforms, defining company-wide patterns that ensure reliability, performance, and cost effectiveness
Proficiency in SQL and at least one modern programming language (we use Python)
Comfort working across the full data stack — from ingestion and transformation to orchestration and visualization
Strong communication skills, with the ability to collaborate effectively across all levels and functions
Demonstrated ability to lead technical direction, mentor teammates, and promote engineering excellence and best practices across the organization
Familiarity with AI-assisted data workflows, including tools that accelerate data transformations or enable natural-language interfaces for analytics

Job Responsibility

Design and scale the data infrastructure that ingests live telemetry from tens of thousands of autonomous drones
Build and evolve our Databricks and Palantir Foundry environments to empower every Skydian to query data, define jobs, and build dashboards
Develop data systems that make our products truly data-driven — from predictive analytics that anticipate hardware failures, to 3D connectivity mapping, to in-depth flight telemetry analysis
Create and integrate AI-powered tools for data analysis, transformation, and pipeline generation
Champion a data-driven culture by defining and enforcing best practices for data quality, lineage, and governance
Collaborate with autonomy, manufacturing, and operations teams to unify how data flows across the company
Lead and mentor data engineers, analysts, and stakeholders across Skydio
Ensure platform reliability by implementing robust monitoring, observability, and contributing to the on-call rotation for critical data systems

What we offer

Equity in the form of stock options
Comprehensive benefits packages
Relocation assistance may also be provided for eligible roles
Paid vacation time
Sick leave
Holiday pay
401K savings plan

Fulltime

Software Engineer, Data Engineering

Join us in building the future of finance. Our mission is to democratize finance...

Location

Canada , Toronto

Salary:

124000.00 - 145000.00 CAD / Year

Robinhood

Expiration Date

Until further notice

Requirements

3+ years of professional experience building end-to-end data pipelines
Hands-on software engineering experience, with the ability to write production-level code in Python for user-facing applications, services, or systems (not just data scripting or automation)
Expert at building and maintaining large-scale data pipelines using open source frameworks (Spark, Flink, etc)
Strong SQL (Presto, Spark SQL, etc) skills
Experience solving problems across the data stack (Data Infrastructure, Analytics and Visualization platforms)
Expert collaborator with the ability to democratize data through actionable insights and solutions

Job Responsibility

Help define and build key datasets across all Robinhood product areas. Lead the evolution of these datasets as use cases grow
Build scalable data pipelines using Python, Spark and Airflow to move data from different applications into our data lake
Partner with upstream engineering teams to enhance data generation patterns
Partner with data consumers across Robinhood to understand consumption patterns and design intuitive data models
Ideate and contribute to shared data engineering tooling and standards
Define and promote data engineering best practices across the company

What we offer

bonus opportunities
equity
benefits

Fulltime

Senior Software Engineer, Data Engineering

Join us in building the future of finance. Our mission is to democratize finance...

Location

United States , Menlo Park

Salary:

146000.00 - 198000.00 USD / Year

Robinhood

Expiration Date

Until further notice

Requirements

5+ years of professional experience building end-to-end data pipelines
Hands-on software engineering experience, with the ability to write production-level code in Python for user-facing applications, services, or systems (not just data scripting or automation)
Expert at building and maintaining large-scale data pipelines using open source frameworks (Spark, Flink, etc)
Strong SQL (Presto, Spark SQL, etc) skills
Experience solving problems across the data stack (Data Infrastructure, Analytics and Visualization platforms)
Expert collaborator with the ability to democratize data through actionable insights and solutions

Job Responsibility

Help define and build key datasets across all Robinhood product areas. Lead the evolution of these datasets as use cases grow
Build scalable data pipelines using Python, Spark and Airflow to move data from different applications into our data lake
Partner with upstream engineering teams to enhance data generation patterns
Partner with data consumers across Robinhood to understand consumption patterns and design intuitive data models
Ideate and contribute to shared data engineering tooling and standards
Define and promote data engineering best practices across the company

What we offer

Market competitive and pay equity-focused compensation structure
100% paid health insurance for employees with 90% coverage for dependents
Annual lifestyle wallet for personal wellness, learning and development, and more
Lifetime maximum benefit for family forming and fertility benefits
Dedicated mental health support for employees and eligible dependents
Generous time away including company holidays, paid time off, sick time, parental leave, and more
Lively office environment with catered meals, fully stocked kitchens, and geo-specific commuter benefits
Bonus opportunities
Equity

Fulltime

Senior Software Engineer, Core Data

As a Senior Software Engineer on our Core Data team, you will take a leading rol...

Location

United States

Salary:

190000.00 - 220000.00 USD / Year

Pomelo Care

Expiration Date

Until further notice

Requirements

5+ years of experience building high-quality, scalable data systems and pipelines
Expert-level proficiency in SQL and Python, with a deep understanding of data modeling and transformation best practices
Hands-on experience with dbt for data transformation and Dagster, Beam, Dataflow or similar tools for pipeline orchestration
Experience with modern data stack tools and cloud platforms, with a strong understanding of data warehouse design principles
A track record of delivering elegant and maintainable solutions to complex data problems that drive real business impact

Job Responsibility

Build and maintain elegant data pipelines that orchestrate ingestion from diverse sources and normalize data for company-wide consumption
Lead the design and development of robust, scalable data infrastructure that enables our clinical and product teams to make data-driven decisions, using dbt, Dagster, Beam and Dataflow
Write clean, performant SQL and Python to transform raw data into actionable insights that power our platform
Architect data models and transformations that support both operational analytics and new data-driven product features
Mentor other engineers, providing technical guidance on data engineering best practices and thoughtful code reviews, fostering a culture of data excellence
Collaborate with product, clinical and analytics teams to understand data needs and ensure we are building infrastructure that unlocks the most impactful insights
Optimize data processing workflows for performance, reliability and cost-effectiveness

What we offer

Competitive healthcare benefits
Generous equity compensation
Unlimited vacation
Membership in the First Round Network (a curated and confidential community with events, guides, thousands of Q&A questions, and opportunities for 1-1 mentorship)

Fulltime

Software Engineer, Data Engine

YC Work at a Startup

Location:
United States , San Francisco

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Additional Information:

Job Posted:
January 16, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Software Engineer, Data Engine