CrawlJobs Logo

Senior Principal Data Platform Software Engineer

239400.00 - 312550.00 USD / Year · Job Posted December 27, 2025
Apply Position
Job Link Share

Job Description

We’re looking for a Sr Principal Data Platform Software Engineer (P70) to be a key technical leader in the Product Data Platform org. In this role, you will be joining a strong cross-geo team of engineers to design and operate data platform capabilities that power Atlassian’s product analytics and ML experiences.

Job Responsibility

  • Design, develop and own delivery of high quality big data and analytical platform solutions aiming to solve Atlassian’s needs to support millions of users with optimal cost, minimal latency and maximum reliability
  • Improve and operate large‑scale distributed data systems in the cloud (primarily AWS, with increasing integration with GCP and Kubernetes‑based microservices)
  • Drive the evolution of our high-performance analytical databases and its integrations with products, cloud infrastructures (AWS and GCP) and isolated cloud environments
  • Help define and uplift engineering and operational standards for petabyte scale data platforms, with sub‑second analytic queries and multi‑region availability (coding guidelines, code review practices, observability, incident response, SLIs/SLOs)
  • Partner across multiple product and platform teams (including Analytics, Marketplace/Ecosystem, Core Data Platform, ML Platform, Search, and Oasis/FedRAMP) to deliver company‑wide initiatives that depend on reliable, high‑quality data
  • Act as a technical mentor and multiplier, raising the bar on design quality, code quality, and operational excellence across the broader team
  • Design and implement self‑healing, resilient data platforms with strong observability, fault tolerance, and recovery characteristics
  • Own the long‑term architecture and technical direction of Atlassian’s product data platform with projects that are directly tied to Atlassian’s company-level OKRs
  • Be accountable for the reliability, cost efficiency, and strategic direction of Atlassian’s product analytical data platform
  • Partner with executives and influence senior leaders to align engineering efforts with Atlassian’s long-term business objectives
  • Lead cross-organizational initiatives that have a lasting impact on Atlassian’s growth and innovation

Requirements

  • 15+ years in Data Engineering, Software Engineering, or related roles, with substantial exposure to big data ecosystems
  • Demonstrated experience building and operating data platforms or large‑scale data services in production
  • Proven track record of building services from the ground up (requirements → design → implementation → deployment → ongoing ownership)
  • Hands‑on experience with AWS, GCP (e.g., compute, storage, data, and streaming services) and cloud‑native architectures
  • Practical experience with big data technologies, such as Databricks, Apache Spark, AWS EMR, Apache Flink, or StarRocks
  • Strong programming skills in one or more of: Kotlin, Scala, Java, Python
  • Experience leading cross‑team technical initiatives and influencing senior stakeholders
  • Experience mentoring Staff/Principal engineers and lifting the technical bar for a team or org
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience

Nice to have

  • Experience with StarRocks or similar MPP/OLAP analytical databases in production
  • Experience with streaming and batch architectures (e.g., event streams, CDC, real‑time analytics) and when to use each
  • Familiarity with data lakes and table formats (e.g., Iceberg, Delta Lake) and columnar formats such as Parquet
  • Exposure to data governance, security, privacy, and compliance (e.g., FedRAMP‑like environments) for large‑scale data platforms
  • Experience optimizing cost, performance, and reliability for petabyte‑scale data systems
  • Familiarity with observability tooling (metrics, tracing, logging) for data platforms
  • Experience contributing to technical strategy and multi‑year roadmaps for data platforms

What we offer

  • health and wellbeing resources
  • paid volunteer days

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Principal Data Platform Software Engineer

8 matching positions

Senior Software Engineer / Principal Software Engineer - Copilot CLI

Within GitHub and Microsoft CoreAI, the Copilot CLI team builds GitHub's coding ...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years
Job Responsibility
Job Responsibility
  • Take ownership of critical product and platform areas of the Copilot CLI and shared agent runtime
  • Set a high technical and quality bar for agentic systems and developer-facing tooling
  • Design and ship performant, reliable terminal experiences that developers depend on for daily work
  • Use data, benchmarks, and direct user feedback to guide iteration and investment
  • Collaborate across org boundaries to enable other teams to build agentic products on top of a shared foundation
  • Influence architecture, technical direction, and engineering standards beyond your immediate team
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, Trusted Data Platform

As a Principal Software Engineer, you will be a technical leader and hands-on co...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related technical field
  • 10+ years of experience in backend software development, focusing on distributed systems and storage solutions
  • 5+ years of experience working with AWS storage services (S3, DynamoDB, EBS, EFS, FSx, Glacier)
  • Strong expertise in system design, architecture, and scalability for large-scale storage solutions
  • Proficiency in at least one major backend programming language (Kotlin, Java, Go, Rust, or Python)
  • Experience designing and implementing highly available, fault-tolerant, and cost-efficient storage architectures
  • Deep understanding of distributed systems, replication strategies, sharding, and caching
  • Knowledge of data security, encryption best practices, and compliance requirements (SOC2, GDPR, HIPAA)
  • Experience leading engineering teams, mentoring senior engineers, and driving technical roadmaps
  • Proficiency with observability tools, performance monitoring, and troubleshooting at scale
Job Responsibility
Job Responsibility
  • Designing and optimizing high-scale, distributed storage systems built on AWS storage technologies
  • Shaping the architecture, performance, and reliability of backend storage solutions that power critical applications at scale
  • Designing, implementing, and optimizing backend storage services that support high throughput, low latency, and fault tolerance
  • Working closely with senior engineers, architects, and cross-functional teams to drive scalability, availability, and efficiency improvements in large-scale storage solutions
  • Leading technical deep dives, architecture reviews, and root cause analyses to resolve complex production issues related to storage performance, consistency, and durability
  • Driving best practices in distributed system design, security, and cloud cost optimization
  • Mentoring senior engineers, contributing to technical roadmaps, and helping shape the long-term storage strategy
  • Collaborating with Site Reliability Engineers (SREs) to implement observability, monitoring, and disaster recovery strategies, ensuring high availability and compliance with industry standards
  • Advocating for automation, Infrastructure-as-Code (IaC), and DevOps best practices, leveraging tools like Terraform, AWS CloudFormation, Kubernetes (EKS), and CI/CD pipelines to enable scalable deployments and operational excellence
What we offer
What we offer
  • Atlassians can choose where they work – whether in an office, from home, or a combination of the two
  • Atlassians have more control over supporting their family, personal goals, and other priorities
  • We can hire people in any country where we have a legal entity
  • Interviews and onboarding are conducted virtually
  • Whatever your preference - working from home, an office, or in between - you can choose the place that's best for your work and your lifestyle
Read More
Arrow Right

Principal Data Genai Platform Engineer - Senior Vice President

Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of relevant experience in enterprise application development, data engineering, or AI platform engineering, with a strong track record of leadership in regulated environments
  • 8+ years of experience leading multi-team Agile organizations (20+ engineers), including managing distributed and hybrid AI-assisted teams
  • Advanced expertise in Python, PySpark, and Databricks ecosystem for large-scale data processing and ELT/ETL pipelines
  • Proven experience architecting and implementing enterprise AI/GenAI platforms, including agentic AI frameworks, LLM integrations, and prompt engineering
  • Hands-on experience with AI-assisted development tools such as Devin.AI and GitHub Copilot and integrating them into engineering workflows
  • Strong experience with microservices architecture, APIs, and cloud-native deployment (Kubernetes/OpenShift)
  • Strong experience with event-driven architectures and streaming platforms (Kafka)
  • Deep understanding of data architecture, data mesh, data federation, and regulatory data requirements
  • Exceptional leadership, communication, stakeholder management, and decision-making capabilities
  • Experience with cloud platforms (AWS, Azure, GCP, Databricks) and modern data ecosystems
Job Responsibility
Job Responsibility
  • Lead multiple agile scrum teams comprising ~15+ engineers, including hybrid teams of human engineers and AI-assisted development (Devin.AI, Copilot), ensuring delivery excellence and alignment with business priorities
  • Define and execute the enterprise strategy for Python engineering, AI agent platforms, and full-stack data applications, aligned with Retail and Wealth Risk objectives
  • Serve as the senior architect and technical authority for enterprise-scale AI agents, data engineering pipelines, and microservices-based applications, ensuring scalability, resilience, and security
  • Drive the adoption and operationalization of AI Product Development Lifecycle (AI PDLC), including model governance, evaluation, deployment, monitoring, and compliance with Model Risk Management (MRM)
  • Lead development of high-volume data pipelines and data federation layers using PySpark, Databricks, Kafka, and Data Mesh architecture to support regulatory reporting (CCAR, FDIC) and risk analytics
  • Architect and oversee GenAI agent ecosystems using LLMs (Google ADK, Gemini/Flash), implementing Human-in-the-Loop (HITL) frameworks to ensure explainability, auditability, and compliance
  • Drive AI-augmented software development lifecycle, integrating tools such as Devin.AI, GitHub Copilot, and MCP platforms through advanced prompt engineering and governance guardrails
  • Lead microservices and cloud-native architecture using FastAPI/Spring Boot, Kubernetes/OpenShift, and CI/CD pipelines, ensuring high availability and performance
  • Drive engineering efficiency and standardization by reusing and repurposing enterprise-level frameworks, platforms, and tools, reducing duplication and accelerating delivery across teams
  • Ensure all engineering solutions incorporate data governance and non-functional requirements, including Data Quality (DQ), data lineage, data tracing, and auditability, aligned with enterprise governance processes and regulatory expectations
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer

Zuora, Inc. seeks Senior Principal Software Engineer to: Define scalable, mainta...
Location
Location
United States , Foster City
Salary
Salary:
213512.00 - 352000.00 USD / Year
zuora.com Logo
Zuora
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Computer or Electrical Engineering, Information Systems or Technology, or related field
  • 7 years of progressive, post bachelor’s experience as Software Engineer or in a related position
  • 7 years of experience with each of the following: Systems architecture, deployment automation, system monitoring, and infrastructure optimization
  • 7 years of experience with each of the following: Developing, troubleshooting, and improving automation of billing and payment systems
  • 7 years of experience with each of the following: Infrastructure design and implementation of billing and payments platforms
  • 7 years of experience with each of the following: AWS, Terraform, Puppet
  • 7 years of experience with each of the following: Java, Anisble, Bash, Python
  • 7 years of experience with each of the following: Jenkins, Linux, K8S
Job Responsibility
Job Responsibility
  • Define scalable, maintainable, and high-performance solutions
  • Serve as primary architect for various projects executing the design, implementation, and management of the Billing Staging, Sandbox, and Production environments
  • Implement and maintain high-availability solutions to ensure Billing system reliability and uptime
  • Handle product versioning, release workflows, and coordinate deployments across multiple environments
  • Handle internal migration of data between environments for billing applications
  • Participate in cross-team design reviews and provide technical oversight to improve execution and system robustness
What we offer
What we offer
  • bonus/variable compensation
  • equity
  • comprehensive benefits
  • Fulltime
Read More
Arrow Right

Principal Software Engineer - Senior Vice President

Engineer the future of global finance. At Citi, our Tech team doesn’t just suppo...
Location
Location
United States , Jersey City
Salary
Salary:
176720.00 - 265080.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of hands-on professional software development experience
  • Experience of designing distributed systems, microservices, micro-frontend UIs
  • Experience of using cloud services such as AWS and distributed systems such as Kafka, Kubernetes, S3, DynamoDB, MongoDB or any other NoSQL database
  • Experience of following TDD and passionate about clean code principles
  • Proficiency in programming in Java, Python, JavaScript or React
  • Solid understanding and experience of using data structures, algorithms and SQL
  • Able to independently work in fast paced and rapidly changing environment
  • Bachelor’s degree in computer science or engineering field involving software programming or systems engineering
Job Responsibility
Job Responsibility
  • Engineer the future of global finance
  • Help shape global markets
  • Build systems that matter
  • Influence economies
  • Drive innovation
  • Mentor and continuous learning
  • Work on margin and collateral domain transformation
  • Build technical solutions to complex business problems
  • Shape the future of product
  • Work towards fully automated platform
What we offer
What we offer
  • Medical
  • dental & vision coverage
  • 401(k)
  • Life, accident, and disability insurance
  • Wellness programs
  • Paid time off packages including planned time off (vacation), unplanned time off (sick leave), and paid holidays
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer — Layer 7 Security

The Layer 7 security team is seeking a Senior Principal Software Engineer to lea...
Location
Location
United States , Santa Clara
Salary
Salary:
147000.00 - 237500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s, Master’s, or Ph.D. in Computer Science or related technical field, or equivalent practical/military experience
  • 12+ years of professional software engineering experience, including significant time in senior technical leadership roles
  • Expert-level proficiency in C and strong proficiency in Go
  • Extensive experience developing in Unix/Linux environments
  • Proven experience designing and building large-scale, high-performance distributed systems
  • Deep expertise in networking fundamentals, including TCP/IP internals and network security technologies
  • Advanced experience with multi-threaded, multi-process, and multi-core system design
  • Strong foundation in data structures, algorithms, and systems-level performance optimization
  • Demonstrated ability to lead architecture and deliver complex, cross-functional initiatives
  • Strong communication skills with the ability to influence technical and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Lead the architecture, design, and development of advanced Layer 7 security capabilities within next-generation firewall platforms
  • Drive the development of highly scalable, real-time, distributed cloud security systems
  • Define and implement robust, high-performance, and maintainable system architectures
  • Set technical direction for critical components, ensuring scalability, reliability, and security
  • Partner with product management, security research, and platform teams to translate complex requirements into executable designs
  • Lead end-to-end execution across the software development lifecycle, from concept through deployment and sustainment
  • Establish and enforce engineering best practices, including code quality, performance optimization, and secure development
  • Mentor senior and junior engineers, and elevate the technical capabilities of the organization
  • Identify architectural, tooling, and process gaps and drive improvements at an organizational level
  • Serve as a technical authority for debugging, performance tuning, and complex system challenges
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer — Layer 7 Security

The Layer 7 security team is seeking a Senior Principal Software Engineer to lea...
Location
Location
United States , Santa Clara
Salary
Salary:
170000.00 - 277000.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s, Master’s, or Ph.D. in Computer Science or related technical field, or equivalent practical/military experience
  • 12+ years of professional software engineering experience, including significant time in senior technical leadership roles
  • Expert-level proficiency in C and strong proficiency in Go
  • Extensive experience developing in Unix/Linux environments
  • Proven experience designing and building large-scale, high-performance distributed systems
  • Deep expertise in networking fundamentals, including TCP/IP internals and network security technologies
  • Advanced experience with multi-threaded, multi-process, and multi-core system design
  • Strong foundation in data structures, algorithms, and systems-level performance optimization
  • Demonstrated ability to lead architecture and deliver complex, cross-functional initiatives
  • Strong communication skills with the ability to influence technical and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Lead the architecture, design, and development of advanced Layer 7 security capabilities within next-generation firewall platforms
  • Drive the development of highly scalable, real-time, distributed cloud security systems
  • Define and implement robust, high-performance, and maintainable system architectures
  • Set technical direction for critical components, ensuring scalability, reliability, and security
  • Partner with product management, security research, and platform teams to translate complex requirements into executable designs
  • Lead end-to-end execution across the software development lifecycle, from concept through deployment and sustainment
  • Establish and enforce engineering best practices, including code quality, performance optimization, and secure development
  • Mentor senior and junior engineers, and elevate the technical capabilities of the organization
  • Identify architectural, tooling, and process gaps and drive improvements at an organizational level
  • Serve as a technical authority for debugging, performance tuning, and complex system challenges
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer - AI Governance

As a Senior Principal Software Engineer, you will serve as a technical leader fo...
Location
Location
United States , San Francisco
Salary
Salary:
165000.00 - 220000.00 USD / Year
onetrust.com Logo
OneTrust
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Engineering, or related technical or business field
  • 12+ years of professional software engineering/development experience
  • Strong expertise in Java/J2EE, Spring, design patterns, microservices architecture, and cloud-native distributed systems
  • Proven experience building production-grade agentic AI systems with robust tool-use, guardrails, and observability for enterprise-scale workloads
  • Solid understanding of RAG pipelines, agent workflows, model orchestration, and evaluation practices
  • Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
  • Experience with elastic search and data streaming tools like Kafka
  • Good understanding of web services and SOA related standards like REST/OAuth/JSON
  • Moderate understanding of code and script (Python, Bash)
  • Good experience with SQL and NoSQL databases
Job Responsibility
Job Responsibility
  • Lead the design and development of Java/Python microservices and shared libraries integrating with AI platforms for OneTrust's AI Governance product
  • Design, build, and test cloud-native applications deployed on Microsoft Azure using Core Java, REST, and the Spring ecosystem
  • Build features with RAG, agent workflows, and model orchestration
  • Own technical design for critical systems, ensuring scalability, security, and reliability
  • Maintain strong automated unit/integration test coverage and engineering standards
  • Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team's discussions on system architecture and component design
  • Partner with Product, UX, and Customer Success to understand customer AI use cases and governance needs
  • Lead architecture discussions and technical planning
  • Drive alignment across teams on platform design and priorities
  • Contribute to sprint planning and delivery
What we offer
What we offer
  • Comprehensive healthcare coverage
  • flexible PTO
  • equity RSUs
  • annual performance bonus opportunities
  • retirement account support
  • 14+ weeks of paid parental leave
  • career development opportunities
  • company-paid privacy certification exam fees
  • Fulltime
Read More
Arrow Right