CrawlJobs Logo

Senior/Staff Software Engineer - Data Platform

Perplexity

Location Icon

Location:
United States , San Francisco, Seattle, New York City

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

250000.00 - 385000.00 USD / Year

Job Description:

Perplexity is looking for experienced Data Platform Engineers to design, build, and scale the foundational data systems that power our product, AI research, analytics, and decision-making at scale. In this role, you will develop and own critical infrastructure for batch and streaming data processing, data orchestration, reliability, and developer experience across the data stack. You’ll work closely with engineering and data science teams to ensure data is accurate, timely, discoverable, and trustworthy, while enabling teams to move fast without sacrificing correctness or scale. This is a high-impact, senior/staff-level role where you will shape architecture, set standards, and drive long-term technical direction for Perplexity’s data ecosystem.

Job Responsibility:

  • Design and operate large-scale batch and streaming data pipelines supporting product features, AI training/evaluation, analytics, and experimentation
  • Build and evolve event-driven and streaming systems (e.g., Kafka/Kinesis/PubSub-style architectures) for real-time ingestion, transformation, and delivery
  • Own batch processing frameworks for backfills, aggregations, and offline computation
  • Lead the design and operation of data orchestration systems (e.g., Airflow, Dagster, or equivalent), including scheduling, dependency management, retries, SLAs, and observability
  • Establish strong guarantees around data correctness, freshness, lineage, and recoverability
  • Design systems that handle scale, partial failure, and evolving schemas
  • Build self-serve data platforms that empower engineers, data scientists, and analysts to safely create and operate pipelines
  • Improve developer experience for data work through better abstractions, tooling, documentation, and paved paths
  • Set standards for data modeling, testing, validation, and deployment
  • Drive architectural decisions across data infrastructure for storage, compute, orchestration, and APIs
  • Partner closely with engineering and data science teams to align data systems with evolving requirements
  • Mentor engineers, review designs, and raise the technical bar across the organization

Requirements:

  • 5+ years (Senior) or 8+ years (Staff) of software engineering experience
  • Strong experience building production data infrastructure systems
  • Hands-on experience with batch and/or streaming data processing at scale
  • Deep familiarity with data orchestration systems (Airflow, Dagster, or similar)
  • Proficiency in Python and at least one additional backend language (Go, TypeScript, etc.)
  • Strong systems thinking: you understand tradeoffs across reliability, latency, cost, and complexity
  • Experience supporting ML/AI workflows, training pipelines, or evaluation systems
  • Familiarity with data quality, lineage, observability, and governance tooling
  • Prior ownership of internal platforms used by many teams
What we offer:
  • Equity
  • Health
  • Dental
  • Vision
  • Retirement
  • Fitness
  • Commuter and dependent care accounts

Additional Information:

Job Posted:
February 21, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior/Staff Software Engineer - Data Platform

Senior/Staff Java Backend Engineer

Join the Lab Automation Project and help build the core backend services and UIs...
Location
Location
Mexico , Guadalajara
Salary
Salary:
Not provided
zoolatech.com Logo
Zoolatech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience working in backend software development roles
  • Experience with Java, Spring, and Spring Boot
  • Experience in a micro service environment
  • Experience with Kubernetes and Docker
  • Experience with AWS Data Stores (RDS, Elastic Cache, MQ, S3)
  • Experience with CI/CD ( Jenkins, ArgoCD, Github actions )
  • Experience with Agile methodologies and tools ( Jira, Sprints, etc.. )
  • Mindset of fulfilling the dreams of the Product, Design and the end user.
  • Communicate conscientiously with your work colleagues
Job Responsibility
Job Responsibility
  • Design, Build, and Test Java Spring Boot backend services built with micro architecture principles
  • Design, Build and Test data stores in AWS used by the backend services ( Postgres, Redis, MQ, Kafka, etc.. ) as well as the data layers which directly interact with the data stores.
  • Design, Build, and Test inter service communication mechanisms (Message Buses, SDK’s, and APIs)
  • Create and Modify Backend Services running within a Kubernetes Cluster. Adjust the cluster’s ingress points, namespaces, config maps, and operators as necessary to optimize platform performance, security, and efficiency
  • Accurately Estimate and Track large projects
  • Provide constructive feedback in code reviews and incorporate feedback received
  • Create architecture design documents and clearly present ideas to the team
  • Create and maintain documentation for backend services including APIs, system architecture, etc.
  • Operate in the local developer environment, (Docker/Gradle/IDE )
  • Operate within an Agile environment (Sprints, Jira)
What we offer
What we offer
  • Paid Vacation
  • Holidays Day Off
  • Sick Days
  • Bereavement Leave
  • Sport Compensation
  • English Classes
  • Food Vouchers
  • Training Compensation
  • Maternity and Paternity Leave
  • Savings Fund
Read More
Arrow Right

Senior/Staff Java Backend Engineer

Join the Lab Automation Project and help build the core backend services and UIs...
Location
Location
Salary
Salary:
Not provided
zoolatech.com Logo
Zoolatech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience working in backend software development roles
  • Experience with Java, Spring, and Spring Boot
  • Experience in a micro service environment
  • Experience with Kubernetes and Docker
  • Experience with AWS Data Stores (RDS, Elastic Cache, MQ, S3)
  • Experience with CI/CD ( Jenkins, ArgoCD, Github actions )
  • Experience with Agile methodologies and tools ( Jira, Sprints, etc.. )
  • Mindset of fulfilling the dreams of the Product, Design and the end user
  • Communicate conscientiously with your work colleagues
Job Responsibility
Job Responsibility
  • Design, Build, and Test Java Spring Boot backend services built with micro architecture principles
  • Design, Build and Test data stores in AWS used by the backend services ( Postgres, Redis, MQ, Kafka, etc.. ) as well as the data layers which directly interact with the data stores
  • Design, Build, and Test inter service communication mechanisms (Message Buses, SDK’s, and APIs)
  • Create and Modify Backend Services running within a Kubernetes Cluster. Adjust the cluster’s ingress points, namespaces, config maps, and operators as necessary to optimize platform performance, security, and efficiency
  • Accurately Estimate and Track large projects
  • Provide constructive feedback in code reviews and incorporate feedback received
  • Create architecture design documents and clearly present ideas to the team
  • Create and maintain documentation for backend services including APIs, system architecture, etc.
  • Operate in the local developer environment, (Docker/Gradle/IDE)
  • Operate within an Agile environment (Sprints, Jira)
What we offer
What we offer
  • Paid Vacation
  • Sick Days
  • Floating Holidays
  • Sport/Insurance Compensation
  • English Classes
  • Charity
  • Training Compensation
Read More
Arrow Right
New

Director, Engineering

As Director of Engineering, you will play a key leadership role, guiding teams b...
Location
Location
Canada , Toronto
Salary
Salary:
200000.00 CAD / Year
flywheeldigital.com Logo
Flywheel Digital
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experienced engineering leader with 7+ years in software engineering roles
  • 3+ years managing engineering teams (including managers and senior/staff engineers) in a SaaS, ecommerce, or tech-driven environment
  • Strong technical background in web-based platforms and data-intensive systems
  • Hands-on experience with Python, Django, Flask, ReactJS, Airflow, and cloud platforms (GCP, AWS, or Azure) is a plus
  • Proven track record of building, scaling, and operating high-availability, data-driven products
  • Excellent collaborator and communicator, able to work across teams and functions and clearly articulate technical concepts to non-technical audiences
  • Passionate about people development, with a history of mentoring and growing engineers and technical leaders
  • Customer-focused and data-driven, with a bias for action and a commitment to delivering business value
  • Experienced in scaling systems that ingest and process large volumes of data
  • Committed to fostering an inclusive, high-performance engineering culture
Job Responsibility
Job Responsibility
  • Lead and mentor multiple engineering teams responsible for core platform components, ensuring a collaborative and high-performance culture
  • Drive engineering execution and delivery—establishing clear goals, processes, and best practices to ensure timely, high-quality product releases
  • Collaborate with cross-functional leaders (Product, Design, Data, QA) to align technical execution with business goals and customer needs
  • Guide architectural and technical decisions to ensure our platforms are reliable, scalable, secure, and cost-effective
  • Promote engineering excellence through code reviews, design reviews, and fostering a culture of continuous improvement and learning
  • Attract, hire, and develop top engineering talent, with a focus on building a diverse and inclusive team
  • Support operational excellence by driving incident management, technical debt remediation, and platform reliability initiatives
  • Represent engineering in strategic planning, roadmap discussions, and executive forums as needed
What we offer
What we offer
  • Flexible vacation time
  • Great learning and development opportunities
  • Benefits that help you live your best life
  • Parental leave and benefits
  • Volunteering opportunities
  • Employee Resource Groups (ERGs)
  • Fulltime
Read More
Arrow Right
New

Senior Software Engineering Manager - Home Energy

The Senior Software Engineering Manager for the GM Home Energy team is responsib...
Location
Location
United States , Austin, Texas; Warren, Michigan
Salary
Salary:
Not provided
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, Software Engineering, Electrical/Computer Engineering, or related technical field, or equivalent experience
  • 12+ years of experience developing and delivering cutting-edge enterprise-grade applications, including cloud-native systems
  • At least 3+ of those years should include leading multiple teams or a large, complex team as a software engineering manager or equivalent
  • Demonstrated experience leading engineering organizations of roughly 10–20+ engineers (ICs and/or managers), including hiring, performance management, coaching, and organizational design
  • Strong hands-on background in building sophisticated, scalable, secure software systems on cloud platforms (preferably Azure), including experience with: Event streaming and messaging (Azure Event Hub, Kafka, Pulsar)
  • Caching technologies (Redis)
  • Modern web and/or mobile stacks and REST/GraphQL APIs
  • Demonstrated expert knowledge of modern software development practices (Agile/Scrum, SDLC, CI/CD, test automation, observability)
  • Proven ability to facilitate productive engagement and trade-off decisions between engineering, product, design, and business stakeholders
  • Track record of delivering complex, integrated solutions in an interconnected environment, ideally involving CRM, billing, data platforms, or external partner integrations (e.g., utilities, installers, grid partners)
Job Responsibility
Job Responsibility
  • Define and drive the technical strategy and execution roadmap for Home Energy platforms (mobile apps, web portals, APIs, event streams, and data services) in support of GM Energy objectives
  • Be a technology expert across software architecture, infrastructure, build and deployment pipelines, observability, and engineering processes for multiple teams
  • Lead the delivery of exceptional, secure, and resilient software using multiple languages and technologies (e.g., modern web/mobile stacks, cloud-native services, event streaming, data platforms)
  • Ensure your teams meet or exceed reliability, performance, security, and compliance expectations for customer-facing and partner-facing energy products
  • Build, lead, and retain multiple high-performing engineering teams (e.g., mobile, full-stack, data/integration) aligned to Energy Engagement business outcomes
  • Mentor and develop technical talent—from new college hires to senior/staff engineers and first-line managers—creating clear growth paths and succession plans
  • Own workforce planning and staffing decisions for your area, in partnership with HR, aligned to overall org plans and GM’s strategic priorities
  • Foster a culture of ownership, psychological safety, accountability, and continuous learning that turns challenging, ambiguous ideas into robust production solutions
  • Partner closely with product management, design, GM Energy business stakeholders, and other internal and external engineering organizations to align on priorities, scope, and value delivery
  • Have a broad, enterprise-wide view of the business and strong appreciation for strategy, processes, capabilities, enablers, and governance across business domains
What we offer
What we offer
  • Company Vehicle: Upon successful completion of a motor vehicle report review, you will be eligible to participate in a company vehicle evaluation program, through which you will be assigned a General Motors vehicle to drive and evaluate
  • This job may be eligible for relocation benefits
  • Fulltime
Read More
Arrow Right

Engineering Manager II, U4B

Engineering Manager – Uber for Business (U4B) Platform. Lead and scale multiple ...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of software engineering experience
  • 2+ years in engineering management or technical leadership roles
  • Strong technical background in object-oriented programming languages (e.g., Go, Java, C++, C#)
  • Experience building and operating large-scale distributed systems serving millions of users
  • Hands-on experience with distributed storage systems and databases (SQL or NoSQL, e.g., MySQL, Cassandra)
  • Proven ability to lead multiple teams through complex problem spaces
  • Strong communication skills and the ability to influence across organizational boundaries
Job Responsibility
Job Responsibility
  • Lead and manage multiple engineering teams responsible for building, evolving, and operating the U4B B2B platform
  • Own delivery and execution for critical platform initiatives
  • Partner with senior/staff engineers to drive architectural decisions, technical strategy, and long-term platform evolution
  • Ensure platform reliability, scalability, and performance across high-volume transaction flows
  • Drive prioritization and planning
  • Collaborate cross-functionally with Product, Design, Data, Operations, and Business stakeholders
  • Build and grow high-performing teams through hiring, coaching, performance management, and career development
  • Champion engineering excellence
  • Own incident management and operational health
  • Fulltime
Read More
Arrow Right
New

Senior/Staff Engineering Director

The College Board is seeking a Senior/Staff Engineering Director to lead the Cor...
Location
Location
United States of America
Salary
Salary:
170000.00 - 200000.00 USD / Year
edtechjobs.io Logo
EdTech Jobs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of progressive experience in software engineering, including significant experience leading leaders (Engineering Managers, Senior Engineers, or equivalent)
  • Proven experience setting technical direction and overseeing the delivery of large-scale, cloud-based applications and platforms, preferably using AWS and modern web technologies
  • A strong background in software architecture and system design
  • Demonstrated success building, mentoring, and retaining diverse, high-performing engineering teams at scale
  • Experience operating at the intersection of technology and business
  • Exceptional communication skills
  • Strong operational mindset, including experience managing budgets, vendor relationships, delivery risk, and long-term technical health
  • A leadership style grounded in trust, inclusion, and accountability
  • Ability to travel 3–5 times per year to NYC or Reston, VA
  • Authorization to work in the United States
Job Responsibility
Job Responsibility
  • Provide senior technical leadership for a defined area of the Core Assessment Platforms
  • Guide Engineering Managers, Principal and Staff Engineers in evaluating solution options, making architectural tradeoffs, and managing technical risk and debt
  • Identify and prioritize near-term technical improvements
  • Establish and uphold shared engineering standards
  • Serve as an escalation point for complex, cross-team technical decisions
  • Stay informed on relevant technologies
  • Lead multiple engineering teams through experienced Engineering Managers
  • Partner with Engineering Managers to ensure teams are appropriately staffed
  • Foster a culture of trust, accountability, and continuous improvement
  • Actively support diversity, equity, and inclusion
What we offer
What we offer
  • A meaningful career
  • A supportive team
  • A comprehensive package
  • Fair and competitive compensation
  • Salary adjustment by location
  • Open, transparent conversations about compensation and benefits
  • Fulltime
Read More
Arrow Right
New

Senior/Staff Software Engineer

We're hiring Senior and Staff Software Engineers to help build the platform that...
Location
Location
United States
Salary
Salary:
150000.00 - 200000.00 USD / Year
homebound.com Logo
Homebound
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of professional software engineering experience (10+ for Staff)
  • Track record of shipping products that land real world impact
  • Built and delivered full-stack features across modern web technologies
  • Actively using AI coding tools (Claude Code, Cursor, etc.) in your daily workflow
  • Demonstrated leadership and ownership
  • Designed systems that balance quick iterations with long-term reliability and maintainability
  • Partnered with product, design, and non-technical stakeholders to define requirements, make tradeoffs, and deliver outcomes
Job Responsibility
Job Responsibility
  • Design, build, and deliver features across the platform
  • Write and deploy high-quality, production-grade code daily
  • Work with product to translate messy, real-world processes into clean, reliable software
  • Raise the bar across engineering
  • Contribute to architecture decisions, API contracts, and data models that shape how our systems scale and evolve
What we offer
What we offer
  • Offers Equity
  • Fulltime
Read More
Arrow Right

Senior/Staff Platform Consultant - Data and BI Specialist

10Pearls is seeking a highly skilled Data & BI Specialist to support data-driven...
Location
Location
Pakistan , Karachi; Lahore; Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in IT or related discipline. (Software Engineering preferred)
  • 3+ years of hands-on experience in data analysis, BI development, or data engineering roles
  • Strong experience working with ETL pipelines, data transformations, and data modeling concepts
  • Proficiency in at least one BI / data visualization tool such as Qlik Sense, Power BI, Tableau, or similar
  • Solid command of SQL and experience working with relational databases (e.g., PostgreSQL, MySQL, SQL Server)
  • Experience integrating and consuming data from APIs and external data sources
  • Strong analytical and problem-solving skills with attention to detail
  • Ability to manage multiple priorities and work effectively under time constraints
  • Self-driven learner with a passion for data, analytics, and continuous improvement
  • Excellent written and verbal communication skills, with the ability to explain data insights to non-technical audiences
Job Responsibility
Job Responsibility
  • Lead the design, development, and maintenance of Business Intelligence solutions, ensuring scalability, reliability, and performance
  • Own and manage end-to-end BI workflows, including data ingestion, transformation (ETL), data modeling, and reporting layers
  • Ensure high standards of data quality, accuracy, and governance across all BI assets and reports
  • Collaborate closely with stakeholders, product teams, and leadership to translate business requirements into actionable insights and analytical solutions
  • Proactively identify data gaps, reporting inefficiencies, and technical risks, and propose scalable improvements
  • Apply best practices in BI development, including performance tuning, documentation, and version control
  • Support business decision-making by delivering meaningful dashboards, reports, and ad-hoc analysis with clear insights
  • Diagnose and resolve data and reporting issues in production environments
  • Embrace a consulting mindset by recommending data-driven approaches that align technical solutions with business objectives
  • Mentor junior team members by sharing BI best practices, analytical techniques, and tooling knowledge
Read More
Arrow Right