CrawlJobs Logo

Senior/Staff Software Engineer - Data Platform

United States, San Francisco, Seattle, New York City 250000.00 - 385000.00 USD / Year · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

Perplexity is looking for experienced Data Platform Engineers to design, build, and scale the foundational data systems that power our product, AI research, analytics, and decision-making at scale. In this role, you will develop and own critical infrastructure for batch and streaming data processing, data orchestration, reliability, and developer experience across the data stack. You’ll work closely with engineering and data science teams to ensure data is accurate, timely, discoverable, and trustworthy, while enabling teams to move fast without sacrificing correctness or scale. This is a high-impact, senior/staff-level role where you will shape architecture, set standards, and drive long-term technical direction for Perplexity’s data ecosystem.

Job Responsibility

  • Design and operate large-scale batch and streaming data pipelines supporting product features, AI training/evaluation, analytics, and experimentation
  • Build and evolve event-driven and streaming systems (e.g., Kafka/Kinesis/PubSub-style architectures) for real-time ingestion, transformation, and delivery
  • Own batch processing frameworks for backfills, aggregations, and offline computation
  • Lead the design and operation of data orchestration systems (e.g., Airflow, Dagster, or equivalent), including scheduling, dependency management, retries, SLAs, and observability
  • Establish strong guarantees around data correctness, freshness, lineage, and recoverability
  • Design systems that handle scale, partial failure, and evolving schemas
  • Build self-serve data platforms that empower engineers, data scientists, and analysts to safely create and operate pipelines
  • Improve developer experience for data work through better abstractions, tooling, documentation, and paved paths
  • Set standards for data modeling, testing, validation, and deployment
  • Drive architectural decisions across data infrastructure for storage, compute, orchestration, and APIs
  • Partner closely with engineering and data science teams to align data systems with evolving requirements
  • Mentor engineers, review designs, and raise the technical bar across the organization

Requirements

  • 5+ years (Senior) or 8+ years (Staff) of software engineering experience
  • Strong experience building production data infrastructure systems
  • Hands-on experience with batch and/or streaming data processing at scale
  • Deep familiarity with data orchestration systems (Airflow, Dagster, or similar)
  • Proficiency in Python and at least one additional backend language (Go, TypeScript, etc.)
  • Strong systems thinking: you understand tradeoffs across reliability, latency, cost, and complexity
  • Experience supporting ML/AI workflows, training pipelines, or evaluation systems
  • Familiarity with data quality, lineage, observability, and governance tooling
  • Prior ownership of internal platforms used by many teams

What we offer

  • Equity
  • Health
  • Dental
  • Vision
  • Retirement
  • Fitness
  • Commuter and dependent care accounts

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior/Staff Software Engineer - Data Platform

8 matching positions

Senior/Staff Software Engineer, Search & Retrieval Infrastructure

We are hiring a senior/staff software engineer to help design and build core com...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
pinecone.io Logo
Pinecone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Systems Expertise: Architectural Depth: You have a proven track record (typically 6+ years) of shipping production-grade backends for large-scale systems
  • Systems Expertise: Data Engineering Savvy: You’re comfortable building high-throughput indexing pipelines that handle both the messy world of unstructured data and the rigid world of structured schemas
  • AI & Retrieval: Retrieval Intuition: You understand that search is more than just a keyword match. You have direct experience (or deep theoretical knowledge) in semantic search, vector databases, hybrid retrieval strategies, or with traditional search engines like Elastic or OpenSearch
  • AI & Retrieval: RAG & Orchestration: You understand the nuances of Retrieval-Augmented Generation (RAG) patterns, from embedding pipelines and hybrid search techniques to how query planning and metadata filtering can make or break an LLM's performance
  • Technical: Language Fluency: You are an expert in at least one major language like Go, Rust, C++, Java, or Python
  • Technical: Infrastructure: Familiarity and experience with modern infrastructure tools, such as Kubernetes, cloud-native architectures, and observability frameworks, as well as infrastructure-as-code tools like Terraform or Pulumi
  • Ownership & Impact: Product Thinking: You don't just build to spec
  • you build for the user. You can design clean, intuitive APIs that both human developers and autonomous agents will love
  • Ownership & Impact: Ambiguity Navigator: You’re comfortable in a high-growth environment. You prefer owning a problem over executing a ticket
Job Responsibility
Job Responsibility
  • Design and build scalable platform components leveraging advanced retrieval via query planning, semantic and hybrid search, metadata-aware search, and LLM generation
  • Design and build optimized indexing pipelines for structured and unstructured data
  • Build backend services for semantic and hybrid retrieval, knowledge graph construction, and retrieval orchestration
  • Improve retrieval quality through evaluation and observability frameworks
  • Design APIs for internal and external user and agentic consumers
  • Optimize latency, throughput and cost across large-scale inference and retrieval workloads
  • Drive technical direction for reliability and security
  • Fulltime
Read More
Arrow Right

Senior/Staff Software Engineer

We're hiring Senior and Staff Software Engineers to help build the platform that...
Location
Location
United States
Salary
Salary:
150000.00 - 200000.00 USD / Year
homebound.com Logo
Homebound
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of professional software engineering experience (10+ for Staff)
  • Track record of shipping products that land real world impact
  • Built and delivered full-stack features across modern web technologies
  • Actively using AI coding tools (Claude Code, Cursor, etc.) in your daily workflow
  • Demonstrated leadership and ownership
  • Designed systems that balance quick iterations with long-term reliability and maintainability
  • Partnered with product, design, and non-technical stakeholders to define requirements, make tradeoffs, and deliver outcomes
Job Responsibility
Job Responsibility
  • Design, build, and deliver features across the platform
  • Write and deploy high-quality, production-grade code daily
  • Work with product to translate messy, real-world processes into clean, reliable software
  • Raise the bar across engineering
  • Contribute to architecture decisions, API contracts, and data models that shape how our systems scale and evolve
What we offer
What we offer
  • Offers Equity
  • Fulltime
Read More
Arrow Right

Senior/Staff Platform Consultant - Data and BI Specialist - Afternoon Shift

10Pearls is seeking a highly skilled Data & BI Specialist to support data-driven...
Location
Location
Pakistan , Karachi, Lahore, Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in IT or related discipline (Software Engineering preferred)
  • 3+ years of hands-on experience in data analysis, BI development, or data engineering roles
  • Strong experience working with ETL pipelines, data transformations, and data modeling concepts
  • Proficiency in at least one BI / data visualization tool such as Qlik Sense, Power BI, Tableau, or similar
  • Solid command of SQL and experience working with relational databases (e.g., PostgreSQL, MySQL, SQL Server)
  • Experience integrating and consuming data from APIs and external data sources
  • Strong analytical and problem-solving skills with attention to detail
  • Ability to manage multiple priorities and work effectively under time constraints
  • Self-driven learner with a passion for data, analytics, and continuous improvement
  • Excellent written and verbal communication skills, with the ability to explain data insights to non-technical audiences
Job Responsibility
Job Responsibility
  • Lead the design, development, and maintenance of Business Intelligence solutions, ensuring scalability, reliability, and performance
  • Own and manage end-to-end BI workflows, including data ingestion, transformation (ETL), data modeling, and reporting layers
  • Ensure high standards of data quality, accuracy, and governance across all BI assets and reports
  • Collaborate closely with stakeholders, product teams, and leadership to translate business requirements into actionable insights and analytical solutions
  • Proactively identify data gaps, reporting inefficiencies, and technical risks, and propose scalable improvements
  • Apply best practices in BI development, including performance tuning, documentation, and version control
  • Support business decision-making by delivering meaningful dashboards, reports, and ad-hoc analysis with clear insights
  • Diagnose and resolve data and reporting issues in production environments
  • Embrace a consulting mindset by recommending data-driven approaches that align technical solutions with business objectives
  • Mentor junior team members by sharing BI best practices, analytical techniques, and tooling knowledge
Read More
Arrow Right

Senior/Staff Platform Consultant - Data and BI Specialist

10Pearls is seeking a highly skilled Data & BI Specialist to support data-driven...
Location
Location
Pakistan , Karachi; Lahore; Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in IT or related discipline. (Software Engineering preferred)
  • 3+ years of hands-on experience in data analysis, BI development, or data engineering roles
  • Strong experience working with ETL pipelines, data transformations, and data modeling concepts
  • Proficiency in at least one BI / data visualization tool such as Qlik Sense, Power BI, Tableau, or similar
  • Solid command of SQL and experience working with relational databases (e.g., PostgreSQL, MySQL, SQL Server)
  • Experience integrating and consuming data from APIs and external data sources
  • Strong analytical and problem-solving skills with attention to detail
  • Ability to manage multiple priorities and work effectively under time constraints
  • Self-driven learner with a passion for data, analytics, and continuous improvement
  • Excellent written and verbal communication skills, with the ability to explain data insights to non-technical audiences
Job Responsibility
Job Responsibility
  • Lead the design, development, and maintenance of Business Intelligence solutions, ensuring scalability, reliability, and performance
  • Own and manage end-to-end BI workflows, including data ingestion, transformation (ETL), data modeling, and reporting layers
  • Ensure high standards of data quality, accuracy, and governance across all BI assets and reports
  • Collaborate closely with stakeholders, product teams, and leadership to translate business requirements into actionable insights and analytical solutions
  • Proactively identify data gaps, reporting inefficiencies, and technical risks, and propose scalable improvements
  • Apply best practices in BI development, including performance tuning, documentation, and version control
  • Support business decision-making by delivering meaningful dashboards, reports, and ad-hoc analysis with clear insights
  • Diagnose and resolve data and reporting issues in production environments
  • Embrace a consulting mindset by recommending data-driven approaches that align technical solutions with business objectives
  • Mentor junior team members by sharing BI best practices, analytical techniques, and tooling knowledge
Read More
Arrow Right

Senior/Staff Platform Consultant (Native iOS)

10Pearls is hiring iOS Engineers for a critical, client-facing engagement. This ...
Location
Location
Pakistan , Karachi; Lahore; Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, Software Engineering, Information Technology, or related field
  • 5+ years of professional experience developing native iOS applications using Swift
  • Strong command of iOS SDK, Xcode, and Apple Human Interface Guidelines, with experience delivering production-grade iOS apps
  • Hands-on experience building production apps using SwiftUI, with solid UIKit fundamentals
  • Strong understanding of iOS app architecture patterns such as MVVM and/or Clean Architecture
  • Experience integrating RESTful APIs, handling authentication flows, and implementing robust networking and error-handling strategies
  • Proficiency with concurrency and asynchronous programming using GCD and/or Swift Concurrency (async/await)
  • Experience with local persistence solutions such as Core Data, Realm, SQLite, or similar
  • Working knowledge of unit testing and UI testing frameworks such as XCTest and XCUITest
  • Experience with Git-based workflows, pull requests, and code review practices
Job Responsibility
Job Responsibility
  • Design, develop, and maintain native iOS applications using Swift with a focus on performance, reliability, and user experience
  • Collaborate with product, design, backend, and QA teams to understand requirements, refine user stories, and deliver end-to-end features
  • Implement scalable app architectures (e.g., MVVM/Clean Architecture) and ensure maintainable, testable codebases
  • Integrate RESTful APIs, handle data parsing, error handling, retries, and offline/edge-case scenarios
  • Develop reusable UI components using SwiftUI as the primary framework, with the ability to integrate UIKit where required
  • Write unit tests and UI tests, participate in code reviews, and continuously improve engineering standards and development workflows
  • Optimize app performance by profiling, reducing memory leaks, improving startup time, and ensuring smooth UI rendering
  • Integrate third-party SDKs and iOS capabilities such as push notifications, deep linking, keychain, background tasks, and location services as needed
  • Contribute to CI/CD and release processes, including App Store deployments, certificates/provisioning profiles, and versioning practices
  • Monitor production health using logging and analytics tools, troubleshoot defects, and drive timely resolutions in collaboration with stakeholders
  • Fulltime
Read More
Arrow Right

Senior/Staff Platform Consultant (Native iOS)

10Pearls is hiring iOS Engineers for a critical, client-facing engagement. This ...
Location
Location
Pakistan , Karachi; Lahore; Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, Software Engineering, Information Technology, or related field
  • 5+ years of professional experience developing native iOS applications using Swift
  • Strong command of iOS SDK, Xcode, and Apple Human Interface Guidelines, with experience delivering production-grade iOS apps
  • Hands-on experience building production apps using SwiftUI, with solid UIKit fundamentals
  • Strong understanding of iOS app architecture patterns such as MVVM and/or Clean Architecture
  • Experience integrating RESTful APIs, handling authentication flows, and implementing robust networking and error-handling strategies
  • Proficiency with concurrency and asynchronous programming using GCD and/or Swift Concurrency (async/await)
  • Experience with local persistence solutions such as Core Data, Realm, SQLite, or similar
  • Working knowledge of unit testing and UI testing frameworks such as XCTest and XCUITest
  • Experience with Git-based workflows, pull requests, and code review practices
Job Responsibility
Job Responsibility
  • Design, develop, and maintain native iOS applications using Swift with a focus on performance, reliability, and user experience
  • Collaborate with product, design, backend, and QA teams to understand requirements, refine user stories, and deliver end-to-end features
  • Implement scalable app architectures (e.g., MVVM/Clean Architecture) and ensure maintainable, testable codebases
  • Integrate RESTful APIs, handle data parsing, error handling, retries, and offline/edge-case scenarios
  • Develop reusable UI components using SwiftUI as the primary framework, with the ability to integrate UIKit where required
  • Write unit tests and UI tests, participate in code reviews, and continuously improve engineering standards and development workflows
  • Optimize app performance by profiling, reducing memory leaks, improving startup time, and ensuring smooth UI rendering
  • Integrate third-party SDKs and iOS capabilities such as push notifications, deep linking, keychain, background tasks, and location services as needed
  • Contribute to CI/CD and release processes, including App Store deployments, certificates/provisioning profiles, and versioning practices
  • Monitor production health using logging and analytics tools, troubleshoot defects, and drive timely resolutions in collaboration with stakeholders
  • Fulltime
Read More
Arrow Right

Senior/Staff Platform Consultant (Native iOS)

10Pearls is hiring iOS Engineers for a critical, client-facing engagement. This ...
Location
Location
Pakistan , Karachi; Lahore; Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, Software Engineering, Information Technology, or related field
  • 5+ years of professional experience developing native iOS applications using Swift
  • Strong command of iOS SDK, Xcode, and Apple Human Interface Guidelines, with experience delivering production-grade iOS apps
  • Hands-on experience building production apps using SwiftUI, with solid UIKit fundamentals
  • Strong understanding of iOS app architecture patterns such as MVVM and/or Clean Architecture
  • Experience integrating RESTful APIs, handling authentication flows, and implementing robust networking and error-handling strategies
  • Proficiency with concurrency and asynchronous programming using GCD and/or Swift Concurrency (async/await)
  • Experience with local persistence solutions such as Core Data, Realm, SQLite, or similar
  • Working knowledge of unit testing and UI testing frameworks such as XCTest and XCUITest
  • Experience with Git-based workflows, pull requests, and code review practices
Job Responsibility
Job Responsibility
  • Design, develop, and maintain native iOS applications using Swift with a focus on performance, reliability, and user experience
  • Collaborate with product, design, backend, and QA teams to understand requirements, refine user stories, and deliver end-to-end features
  • Implement scalable app architectures (e.g., MVVM/Clean Architecture) and ensure maintainable, testable codebases
  • Integrate RESTful APIs, handle data parsing, error handling, retries, and offline/edge-case scenarios
  • Develop reusable UI components using SwiftUI as the primary framework, with the ability to integrate UIKit where required
  • Write unit tests and UI tests, participate in code reviews, and continuously improve engineering standards and development workflows
  • Optimize app performance by profiling, reducing memory leaks, improving startup time, and ensuring smooth UI rendering
  • Integrate third-party SDKs and iOS capabilities such as push notifications, deep linking, keychain, background tasks, and location services
  • Contribute to CI/CD and release processes, including App Store deployments, certificates/provisioning profiles, and versioning practices
  • Monitor production health using logging and analytics tools, troubleshoot defects, and drive timely resolutions
  • Fulltime
Read More
Arrow Right

Senior/Staff Software Consultant - Golang/C++

We are seeking a highly skilled Backend Engineer with strong expertise in real-t...
Location
Location
Pakistan , Lahore; Karachi; Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on backend development experience using Go and/or C++
  • Strong expertise in real-time media streaming, including one or more of the following: RTP / SRTP
  • WebRTC (MUST-HAVE)
  • WebRTC SFU implementation
  • Deep understanding of video/audio processing, with experience using FFmpeg, GStreamer, or similar frameworks
  • Understanding of networking concepts, including TCP, UDP, ICE, STUN/TURN, and WebSockets
  • Strong understanding of concurrency, asynchronous programming, and performance tuning
  • Experience building and consuming RESTful and WebSocket APIs
  • Hands-on experience with message queues such as Kafka, NATS, or RabbitMQ
  • Experience working with cloud platforms (AWS, GCP, Azure)
Job Responsibility
Job Responsibility
  • Design, develop, and maintain high-performance backend services using Go or C++
  • Build and optimize real-time microservices that support low-latency communication across a distributed architecture
  • Develop and enhance WebSocket, REST, and real-time APIs used by client-facing applications
  • Work extensively with media streaming technologies, including RTP, SRTP, WebRTC, and related protocols
  • Implement and optimize WebRTC SFUs (Selective Forwarding Units) for scalable audio/video streaming
  • Integrate and optimize media workflows using tools and libraries such as FFmpeg and GStreamer
  • Work with databases such as MySQL, Redis, MongoDB, and design efficient data models for real-time workloads
  • Ensure backend services meet high standards of security, reliability, and performance using modern DevOps and SRE practices
  • Collaborate closely with Frontend, DevOps, and Product teams to deliver end-to-end features
  • Write clean, well-documented, and maintainable code following best engineering practices
Read More
Arrow Right