Senior Principal Data Engineer Job at Atlassian (San Francisco)

Senior Principal Engineer Core Data Platform

As an engineer well into your career, we know you're an expert at what you do an...

Location

United States , Seattle; San Francisco; Mountain View

Salary:

198300.00 - 318600.00 USD / Year

Atlassian

Expiration Date

Until further notice

Requirements

Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related technical field
12+ years of experience in backend software development, with a focus on distributed systems and large-scale storage solutions
8+ years of experience designing and managing highly available, large-scale storage architectures in cloud environments
5+ years of hands-on experience working with AWS storage services (S3, EBS, EFS, FSx, Glacier, DynamoDB)
Proficiency in system design, performance optimization, and cost-efficient architecture for exabyte-scale storage
Expertise in at least one major backend programming language (Kotlin, Java, Go, Rust, or Python)
Experience leading technical strategy and architectural decisions in large, multi-team engineering organizations
Strong understanding of distributed systems principles, including consistency models, replication, sharding, and consensus algorithms (Raft, Paxos)
Deep knowledge of security best practices, including encryption, access control (IAM), and compliance standards (SOC2, GDPR, HIPAA)
Experience mentoring senior engineers and driving high-impact engineering initiatives

Job Responsibility

Collaborate with partner teams and internal customers to help define technical direction and OKRs for the Core Data platform organization
Regularly tackle the largest and most complex problems on the team, from technical design to implementation and launch
Partner across engineering teams to take on company-wide initiatives spanning multiple projects
Routinely tackle complex architecture challenges and apply architectural standards and start using them on new projects
Work across senior engineering and product leaders to build strategy and design solutions to earn customers trust and business
Own key OKRs and end-to-end outcomes of critical projects in a microservices environment
Champion best practices and innovative techniques for scalability, reliability, and performance optimizations
Own engineering and operational excellence for the health of our systems and processes
Proactively drive opportunities for continuous improvements and own key operational metrics
Continually drive developer productivity initiatives to ensure that we unleash the potential of our own teams

What we offer

health coverage
paid volunteer days
wellness resources

Fulltime

Principal Data Engineer

Our Principal Data Engineers are responsible for leading and delivering strategi...

Location

United Kingdom , Bristol; London; Manchester; Swansea

Salary:

100000.00 - 115000.00 GBP / Year

Made Tech

Expiration Date

Until further notice

Requirements

Understanding of the issues and challenges that the public sector faces in delivering services that make the best use of data and digital capabilities, transforming legacy infrastructure, and taking an innovative and user-centric approach
Ability to innovate and take learnings from the commercial sector, other countries and advances in technology and apply them to UK Public Sector challenges to create tangible solutions for our clients
Experience building trusted advisor relationships with senior client stakeholders within the public sector.
Experience of building and leading high performing, consulting teams and creating the leveraged engagements to provide a cost-effective, profitable, successful client-facing delivery
Leadership of bids and solution shaping to produce compelling proposals that help Made Tech win new business and grow the industry
Experience of managing third-party partnerships and suppliers (in conjunction with Made Tech colleagues) to provide a consolidated and seamless delivery team to clients.
Experience in delivering complex and difficult engagements that span multiple capabilities for user-facing digital and data services in the public sector
Experience in identifying opportunities based on client needs and developing targeted solutions to progress the development of the opportunity
Experience of working with sales professionals and commercial responsibility for strategic organisational goals.
Experience working directly with customers and users within a technology consultancy

Job Responsibility

Collaborate with clients to understand their needs, provide solution advice in your role as a trusted advisor and shape solutions that leverage Made Tech's wider capabilities and credentials
Assess project performance as a part of the billable delivery team, Quality Assure (QA) the deliverables and outcomes, and ensure client satisfaction. Coach and mentor team members as well as providing direction to enable them to achieve their engagement outcomes and to develop their careers
Act as a Technical Authority of the Data & AI capability to provide oversight and ensure alignment with internal and industry best practices. Ensure engagement experience is captured and used to improve standards and contribute to Made Tech knowledge
Participate in business development activities, including bids and pre-sales within the account, industry and practice. Coach team members on their contributions and oversee the relevant technical aspects of the proposal submission
Undertake people management responsibilities, including performance reviews and professional development of your engagement and practice colleagues
Serve as a thought leader within Made Tech, our account engagements and the wider public sector and represent the company at industry events

What we offer

30 days of paid annual leave + bank holidays
Flexible Parental Leave
Remote Working
Paid counselling as well as financial and legal advice
Flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan
Optional social and wellbeing calendar of events

Fulltime

Principal Data Engineer

We are seeking an experienced Principal Data Engineer to define, lead, and scale...

Location

United Kingdom , Thame; Leeds

Salary:

80000.00 - 100000.00 GBP / Year

PEXA UK

Expiration Date

Until further notice

Requirements

Broad experience as a Data Engineer including technical leadership
Broad cloud experience, ideally both Azure and AWS
Deep expertise in PySpark and distributed data processing at scale
Extensive experience designing and optimising in Databricks
Advanced SQL optimisation and schema design for analytical workloads
Strong understanding of data security, privacy, and GDPR/PII compliance
Experience implementing and leading data governance frameworks
Proven experience leading the design and operation of a complex data platform
Track record of mentoring engineers and raising technical standards
Ability to influence senior stakeholders and align data initiatives with wider business goals

Job Responsibility

Design and oversee scalable, performant, and secure architectures on Databricks and distributed systems
Anticipate scaling challenges and ensure platforms are future-proof
Lead the design and development of robust, high-performance data pipelines using PySpark and Databricks
Define and ensure testing frameworks for data workflows
Ensure end-to-end data quality from raw ingestion to curated, trusted datasets powering analytics
Establish and enforce best practices for data governance, lineage, metadata, and security controls
Ensure compliance with GDPR and other regulatory frameworks
Act as a technical authority and mentor, guiding data engineers
Influence cross-functional teams to align on data strategy, standards, and practices
Partner with product, engineering, and business leaders to prioritise and deliver high-impact data initiatives

Fulltime

Senior ML Data Engineer

As a Senior Data Engineer, you will play a pivotal role in our AI/ML workstream,...

Location

Poland , Warsaw

Salary:

Not provided

Awin Global

Expiration Date

Until further notice

Requirements

Bachelor or Master’s degree in data science, data engineering, Computer Science with focus on math and statistics / Master’s degree is preferred
At least 5 years experience as AI/ML data engineer undertaking above task and accountabilities
Strong foundation in computer science principes and statistical methods
Strong experience with cloud technology (AWS or Azure)
Strong experience with creation of data ingestion pipeline and ET process
Strong knowledge of big data tool such as Spark, Databricks and Python
Strong understanding of common machine learning techniques and frameworks (e.g. mlflow)
Strong knowledge of Natural language processing (NPL) concepts
Strong knowledge of scrum practices and agile mindset
Strong Analytical and Problem-Solving Skills with attention to data quality and accuracy

Job Responsibility

Design and maintain scalable data pipelines and storage systems for both agentic and traditional ML workloads
Productionise LLM- and agent-based workflows, ensuring reliability, observability, and performance
Build and maintain feature stores, vector/embedding stores, and core data assets for ML
Develop and manage end-to-end traditional ML pipelines: data prep, training, validation, deployment, and monitoring
Implement data quality checks, drift detection, and automated retraining processes
Optimise cost, latency, and performance across all AI/ML infrastructure
Collaborate with data scientists and engineers to deliver production-ready ML and AI systems
Ensure AI/ML systems meet governance, security, and compliance requirements
Mentor teams and drive innovation across both agentic and classical ML engineering practices
Participate in team meetings and contribute to project planning and strategy discussions

What we offer

Flexi-Week and Work-Life Balance: We prioritise your mental health and well-being, offering you a flexible four-day Flexi-Week at full pay and with no reduction to your annual holiday allowance. We also offer a variety of different paid special leaves as well as volunteer days
Remote Working Allowance: You will receive a monthly allowance to cover part of your running costs. In addition, we will support you in setting up your remote workspace appropriately
Pension: Awin offers access to an additional pension insurance to all employees in Germany
Flexi-Office: We offer an international culture and flexibility through our Flexi-Office and hybrid/remote work possibilities to work across Awin regions
Development: We’ve built our extensive training suite Awin Academy to cover a wide range of skills that nurture you professionally and personally, with trainings conveniently packaged together to support your overall development
Appreciation: Thank and reward colleagues by sending them a voucher through our peer-to-peer program

Senior Principal Data Platform Software Engineer

We’re looking for a Sr Principal Data Platform Software Engineer (P70) to be a k...

Location

Salary:

239400.00 - 312550.00 USD / Year

Atlassian

Expiration Date

Until further notice

Requirements

15+ years in Data Engineering, Software Engineering, or related roles, with substantial exposure to big data ecosystems
Demonstrated experience building and operating data platforms or large‑scale data services in production
Proven track record of building services from the ground up (requirements → design → implementation → deployment → ongoing ownership)
Hands‑on experience with AWS, GCP (e.g., compute, storage, data, and streaming services) and cloud‑native architectures
Practical experience with big data technologies, such as Databricks, Apache Spark, AWS EMR, Apache Flink, or StarRocks
Strong programming skills in one or more of: Kotlin, Scala, Java, Python
Experience leading cross‑team technical initiatives and influencing senior stakeholders
Experience mentoring Staff/Principal engineers and lifting the technical bar for a team or org
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience

Job Responsibility

Design, develop and own delivery of high quality big data and analytical platform solutions aiming to solve Atlassian’s needs to support millions of users with optimal cost, minimal latency and maximum reliability
Improve and operate large‑scale distributed data systems in the cloud (primarily AWS, with increasing integration with GCP and Kubernetes‑based microservices)
Drive the evolution of our high-performance analytical databases and its integrations with products, cloud infrastructures (AWS and GCP) and isolated cloud environments
Help define and uplift engineering and operational standards for petabyte scale data platforms, with sub‑second analytic queries and multi‑region availability (coding guidelines, code review practices, observability, incident response, SLIs/SLOs)
Partner across multiple product and platform teams (including Analytics, Marketplace/Ecosystem, Core Data Platform, ML Platform, Search, and Oasis/FedRAMP) to deliver company‑wide initiatives that depend on reliable, high‑quality data
Act as a technical mentor and multiplier, raising the bar on design quality, code quality, and operational excellence across the broader team
Design and implement self‑healing, resilient data platforms with strong observability, fault tolerance, and recovery characteristics
Own the long‑term architecture and technical direction of Atlassian’s product data platform with projects that are directly tied to Atlassian’s company-level OKRs
Be accountable for the reliability, cost efficiency, and strategic direction of Atlassian’s product analytical data platform
Partner with executives and influence senior leaders to align engineering efforts with Atlassian’s long-term business objectives

What we offer

health and wellbeing resources
paid volunteer days

Fulltime

Senior ML Data Engineer

As a Senior Data Engineer, you will play a pivotal role in our AI/ML workstream,...

Location

Salary:

Not provided

Awin Global

Expiration Date

Until further notice

Requirements

Bachelor or Master’s degree in data science, data engineering, Computer Science with focus on math and statistics / Master’s degree is preferred
At least 5 years experience as AI/ML data engineer undertaking above task and accountabilities
Strong foundation in computer science principes and statistical methods
Strong experience with cloud technology (AWS or Azure)
Strong experience with creation of data ingestion pipeline and ET process
Strong knowledge of big data tool such as Spark, Databricks and Python
Strong understanding of common machine learning techniques and frameworks (e.g. mlflow)
Strong knowledge of Natural language processing (NPL) concepts
Strong knowledge of scrum practices and agile mindset

Job Responsibility

Design and maintain scalable data pipelines and storage systems for both agentic and traditional ML workloads
Productionise LLM- and agent-based workflows, ensuring reliability, observability, and performance
Build and maintain feature stores, vector/embedding stores, and core data assets for ML
Develop and manage end-to-end traditional ML pipelines: data prep, training, validation, deployment, and monitoring
Implement data quality checks, drift detection, and automated retraining processes
Optimise cost, latency, and performance across all AI/ML infrastructure
Collaborate with data scientists and engineers to deliver production-ready ML and AI systems
Ensure AI/ML systems meet governance, security, and compliance requirements
Mentor teams and drive innovation across both agentic and classical ML engineering practices
Participate in team meetings and contribute to project planning and strategy discussions

What we offer

Flexi-Week and Work-Life Balance: We prioritise your mental health and well-being, offering you a flexible four-day Flexi-Week at full pay and with no reduction to your annual holiday allowance. We also offer a variety of different paid special leaves as well as volunteer days
Remote Working Allowance: You will receive a monthly allowance to cover part of your running costs. In addition, we will support you in setting up your remote workspace appropriately
Pension: Awin offers access to an additional pension insurance to all employees in Germany
Flexi-Office: We offer an international culture and flexibility through our Flexi-Office and hybrid/remote work possibilities to work across Awin regions
Development: We’ve built our extensive training suite Awin Academy to cover a wide range of skills that nurture you professionally and personally, with trainings conveniently packaged together to support your overall development
Appreciation: Thank and reward colleagues by sending them a voucher through our peer-to-peer program

Principal Consulting AI / Data Engineer

As a Principal Consulting AI / Data Engineer, you will design, build, and optimi...

Location

Australia , Sydney

Salary:

Not provided

DyFlex Solutions

Expiration Date

Until further notice

Requirements

Proven expertise in delivering enterprise-grade data engineering and AI solutions in production environments
Strong proficiency in Python and SQL, plus experience with Spark, Airflow, dbt, Kafka, or Flink
Experience with cloud platforms (AWS, Azure, or GCP) and Databricks
Ability to confidently communicate and present at C-suite level, simplifying technical concepts into business impact
Track record of engaging senior executives and influencing strategic decisions
Strong consulting and stakeholder management skills with client-facing experience
Background in MLOps, ML pipelines, or AI solution delivery highly regarded
Degree in Computer Science, Engineering, Data Science, Mathematics, or a related field

Job Responsibility

Design, build, and maintain scalable data and AI solutions using Databricks, cloud platforms, and modern frameworks
Lead solution architecture discussions with clients, ensuring alignment of technical delivery with business strategy
Present to and influence executive-level stakeholders, including boards, C-suite, and senior directors
Translate highly technical solutions into clear business value propositions for non-technical audiences
Mentor and guide teams of engineers and consultants to deliver high-quality solutions
Champion best practices across data engineering, MLOps, and cloud delivery
Build DyFlex’s reputation as a trusted partner in Data & AI through thought leadership and client advocacy

What we offer

Work with SAP’s latest technologies on cloud as S/4HANA, BTP and Joule, plus Databricks, ML/AI tools and cloud platforms
A flexible and supportive work environment including work from home
Competitive remuneration and benefits including novated lease, birthday leave, salary packaging, wellbeing programme, additional purchased leave, and company-provided laptop
Comprehensive training budget and paid certifications (Databricks, SAP, cloud platforms)
Structured career advancement pathways with opportunities to lead large-scale client programs
Exposure to diverse industries and client environments, including executive-level engagement

Fulltime

Senior Principal Data Scientist

You will be part of a world-class Data Science team that leverages data to drive...

Location

United States

Salary:

193500.00 - 303150.00 USD / Year

Atlassian

Expiration Date

Until further notice

Requirements

Proven track record of driving projects or programs that have had a significant impact on business strategy and performance
Excels at advising, presenting to and serving as a thought partner to senior executives
10+ years of experience in Data Science or related fields
Expertise in SQL and another data manipulation programming language (e.g., Python, R)
Proficiency in at least one visualization tool (e.g., Tableau, R-Shiny, Looker)
Expertise in applying a broad variety of statistical concepts (e.g. regressions, A/B tests, clustering, probability) to business problems and a strong sense of when to adapt/combine approaches to suit the problem at hand
Experience leading and mentoring teams, with a focus on achieving strategic objectives

Job Responsibility

Identify key business challenges and develop strategic initiatives for your cross-functional business partners, be a trusted strategic partner, and build credibility
Influence Atlassian Intelligence product strategy and roadmaps, and drive impactful change through the structure and clarity of your analysis and recommendations
Lead and prioritize multiple workstreams and/or large complex data science programs. In collaboration with your data science team and your business partners, you will be making informed decisions about priorities, timing, and resourcing
Drive best practice techniques for communicating complex, unfamiliar, challenging, and/or difficult information, including the development and use of frameworks and conceptual models
Lead the evolution of data assets in your team. Coordinate with and influence other data science and engineering teams working on Atlassian Intelligence to ensure alignment of metrics, measurement, and analysis methodologies
Leverage broader industry knowledge to establish frameworks to measure customer engagement with and quality of Atlassian intelligence features
Actively share your work and knowledge to benefit work done across data science
Proactively enable your data science team to address business needs and navigate change and ambiguity
Use your experience and expertise to identify, solve, and bridge gaps/problems across data science and drive programs of work impacting organizational processes that scale Atlassian

What we offer

health coverage
paid volunteer days
wellness resources
benefits
bonuses
commissions
equity

Fulltime

Senior Principal Data Engineer

Atlassian

Location:
United States , San Francisco

Category:
IT - Software Development

Contract Type:
Employment contract

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
April 30, 2025

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Senior Principal Data Engineer

Senior Principal Engineer Core Data Platform

Principal Data Engineer

Principal Data Engineer

Senior ML Data Engineer

Senior Principal Data Platform Software Engineer

Senior ML Data Engineer

Principal Consulting AI / Data Engineer

Senior Principal Data Scientist

Senior Principal Data Engineer

Atlassian

Location:United States , San Francisco

Category:IT - Software Development

Contract Type:Employment contract

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:April 30, 2025

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Senior Principal Data Engineer

Senior Principal Engineer Core Data Platform

Principal Data Engineer

Principal Data Engineer

Senior ML Data Engineer

Senior Principal Data Platform Software Engineer

Senior ML Data Engineer

Principal Consulting AI / Data Engineer

Senior Principal Data Scientist

Location:
United States , San Francisco

Category:
IT - Software Development

Contract Type:
Employment contract

Job Posted:
April 30, 2025