Principal Software Engineer - Data Platform Job at Arcesium (New York)

Senior Principal Data Platform Software Engineer

We’re looking for a Sr Principal Data Platform Software Engineer (P70) to be a k...

Location

Salary:

239400.00 - 312550.00 USD / Year

Atlassian

Expiration Date

Until further notice

Requirements

15+ years in Data Engineering, Software Engineering, or related roles, with substantial exposure to big data ecosystems
Demonstrated experience building and operating data platforms or large‑scale data services in production
Proven track record of building services from the ground up (requirements → design → implementation → deployment → ongoing ownership)
Hands‑on experience with AWS, GCP (e.g., compute, storage, data, and streaming services) and cloud‑native architectures
Practical experience with big data technologies, such as Databricks, Apache Spark, AWS EMR, Apache Flink, or StarRocks
Strong programming skills in one or more of: Kotlin, Scala, Java, Python
Experience leading cross‑team technical initiatives and influencing senior stakeholders
Experience mentoring Staff/Principal engineers and lifting the technical bar for a team or org
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience

Job Responsibility

Design, develop and own delivery of high quality big data and analytical platform solutions aiming to solve Atlassian’s needs to support millions of users with optimal cost, minimal latency and maximum reliability
Improve and operate large‑scale distributed data systems in the cloud (primarily AWS, with increasing integration with GCP and Kubernetes‑based microservices)
Drive the evolution of our high-performance analytical databases and its integrations with products, cloud infrastructures (AWS and GCP) and isolated cloud environments
Help define and uplift engineering and operational standards for petabyte scale data platforms, with sub‑second analytic queries and multi‑region availability (coding guidelines, code review practices, observability, incident response, SLIs/SLOs)
Partner across multiple product and platform teams (including Analytics, Marketplace/Ecosystem, Core Data Platform, ML Platform, Search, and Oasis/FedRAMP) to deliver company‑wide initiatives that depend on reliable, high‑quality data
Act as a technical mentor and multiplier, raising the bar on design quality, code quality, and operational excellence across the broader team
Design and implement self‑healing, resilient data platforms with strong observability, fault tolerance, and recovery characteristics
Own the long‑term architecture and technical direction of Atlassian’s product data platform with projects that are directly tied to Atlassian’s company-level OKRs
Be accountable for the reliability, cost efficiency, and strategic direction of Atlassian’s product analytical data platform
Partner with executives and influence senior leaders to align engineering efforts with Atlassian’s long-term business objectives

What we offer

health and wellbeing resources
paid volunteer days

Fulltime

Principal Software Engineer, Financial Data Platform & GenSearch Agent

At AlphaSense, GenSearch is a production, customer-facing generative AI system d...

Location

United States

Salary:

246000.00 - 339000.00 USD / Year

AlphaSense

Expiration Date

Until further notice

Requirements

12+ years building and operating production systems
Experience operating at a Staff or Principal level
Proven ability to simplify complex systems and reduce architectural entropy
Strong background in distributed systems and performance optimization
Experience building AI-integrated systems (LLM orchestration, tool usage, retrieval, evaluation)
Comfortable working across backend systems and modern frontend frameworks (e.g., React)
Experienced designing APIs and durable service contracts
Effective at driving cross-team technical initiatives

Job Responsibility

Improve AI & Performance
Optimize orchestration between LLM workflows, structured datasets, and services
Introduce performance benchmarks, observability standards, and SLO discipline
Improve reliability and correctness of AI-backed financial responses
Simplify Architecture
Reduce fragmentation across datasets and services
Partner with data platform teams to define scalable dataset integration patterns
Remove legacy complexity while continuing to ship
Build & Evolve Web Products
Contribute directly to backend and frontend systems powering financial data experiences

Fulltime

Principal Software Engineer--Web data platform

We are looking for a talented and experienced Principal Software Engineer to joi...

Location

China , Beijing

Salary:

Not provided

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
7+ years of professional software development experience
Proficiency in at least one high-level programming language including but not limited to: C++, C#, Java, Golang or Rust
Good communication, collaboration and problem-solving skills
Fluent English speaking and writing
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Job Responsibility

Design the architecture of Crawler system, ensuring scalability, efficiency, performance and quality
Implement features in a distributed and scalable environment using data to guide and measure success
Develop and execute unit, integration, and performance tests to ensure the system is reliable, robust, and meets quality standards
Debug and mitigate incidents in live production environments
Stay up to date with the latest industry trends and technologies and proactively suggest improvements to the existing system
Collaborate closely with cross-functional teams, including product managers and other engineers, to align development goals with business objectives

Fulltime

Principal Software Engineer--Web data platform

We are looking for a highly motivated and experienced platform engineer to join ...

Location

China , Beijing

Salary:

Not provided

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Solid foundation in distributed systems, concurrency, networking, and system design
Excellent communication, collaboration, and problem‑solving skills
Fluency in English (spoken and written)

Job Responsibility

Design and architect large‑scale distributed pipelines to ensure scalability, robustness, performance, and cost efficiency
Implement new features and system improvements in highly distributed, parallelized environments, using data to measure and validate impact
Develop and maintain comprehensive test coverage, including unit, integration, and performance tests, ensuring production-grade reliability
Debug, triage, and mitigate issues in live production environments handling massive data flows
Continuously improve the system architecture, proposing and driving enhancements based on industry best practices and emerging technologies
Collaborate cross‑functionally with engineers, PMs, and partner teams to align technical execution with business and product objectives
Contribute to engineering excellence, operational rigor, and incident‑free execution for mission‑critical pipelines that support Bing’s web data ecosystem

Fulltime

Principal Software Engineer, Trusted Data Platform

As a Principal Software Engineer, you will be a technical leader and hands-on co...

Location

India , Bangalore

Salary:

Not provided

Atlassian

Expiration Date

Until further notice

Requirements

Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related technical field
10+ years of experience in backend software development, focusing on distributed systems and storage solutions
5+ years of experience working with AWS storage services (S3, DynamoDB, EBS, EFS, FSx, Glacier)
Strong expertise in system design, architecture, and scalability for large-scale storage solutions
Proficiency in at least one major backend programming language (Kotlin, Java, Go, Rust, or Python)
Experience designing and implementing highly available, fault-tolerant, and cost-efficient storage architectures
Deep understanding of distributed systems, replication strategies, sharding, and caching
Knowledge of data security, encryption best practices, and compliance requirements (SOC2, GDPR, HIPAA)
Experience leading engineering teams, mentoring senior engineers, and driving technical roadmaps
Proficiency with observability tools, performance monitoring, and troubleshooting at scale

Job Responsibility

Designing and optimizing high-scale, distributed storage systems built on AWS storage technologies
Shaping the architecture, performance, and reliability of backend storage solutions that power critical applications at scale
Designing, implementing, and optimizing backend storage services that support high throughput, low latency, and fault tolerance
Working closely with senior engineers, architects, and cross-functional teams to drive scalability, availability, and efficiency improvements in large-scale storage solutions
Leading technical deep dives, architecture reviews, and root cause analyses to resolve complex production issues related to storage performance, consistency, and durability
Driving best practices in distributed system design, security, and cloud cost optimization
Mentoring senior engineers, contributing to technical roadmaps, and helping shape the long-term storage strategy
Collaborating with Site Reliability Engineers (SREs) to implement observability, monitoring, and disaster recovery strategies, ensuring high availability and compliance with industry standards
Advocating for automation, Infrastructure-as-Code (IaC), and DevOps best practices, leveraging tools like Terraform, AWS CloudFormation, Kubernetes (EKS), and CI/CD pipelines to enable scalable deployments and operational excellence

What we offer

Atlassians can choose where they work – whether in an office, from home, or a combination of the two
Atlassians have more control over supporting their family, personal goals, and other priorities
We can hire people in any country where we have a legal entity
Interviews and onboarding are conducted virtually
Whatever your preference - working from home, an office, or in between - you can choose the place that's best for your work and your lifestyle

Senior Software Engineer / Principal Software Engineer - Copilot CLI

Within GitHub and Microsoft CoreAI, the Copilot CLI team builds GitHub's coding ...

Location

United States , Redmond

Salary:

119800.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years

Job Responsibility

Take ownership of critical product and platform areas of the Copilot CLI and shared agent runtime
Set a high technical and quality bar for agentic systems and developer-facing tooling
Design and ship performant, reliable terminal experiences that developers depend on for daily work
Use data, benchmarks, and direct user feedback to guide iteration and investment
Collaborate across org boundaries to enable other teams to build agentic products on top of a shared foundation
Influence architecture, technical direction, and engineering standards beyond your immediate team

What we offer

Certain roles may be eligible for benefits and other compensation

Fulltime

Principal Data Platform Engineer Vice President

We are seeking an exceptionally skilled and motivated Principal Data Platform En...

Location

United States , Irving; Jacksonville

Salary:

125760.00 - 188640.00 USD / Year

Citi

Expiration Date

Until further notice

Requirements

6+ years of relevant experience in Apps Development or systems analysis role with extensive Python and/or big data expertise
Python/Pyspark Mastery
Big Data Technologies & Platforms: Extensive experience (8+ years) architecting, designing, implementing, and managing solutions within distributed data processing platforms, specifically with the Hadoop ecosystem (preferably Cloudera distributions). Proficient in leveraging key big data components such as distributed file systems (e.g., HDFS), data warehousing solutions (e.g., Hive), data transformation frameworks (e.g., Pig), and data ingestion tools (e.g., Sqoop), alongside hands-on experience with NoSQL databases (preferably MongoDB)
ETL Architecture & Development: Proven ability to architect, design, and implement highly scalable data pipelines. Extensive experience leveraging industry-standard ETL tools and frameworks for efficient data extraction, transformation, and loading into various relational databases and data warehouses, coupled with a strategic vision and planning experience for migrating to cloud-native, serverless ETL solutions
Data Architecture & Strategic Modeling: Understanding of advanced data modeling principles and practical experience in data warehouse design and development, ensuring data integrity, scalability, security, and optimal performance
AI-Powered Development: Ability to leverage advanced AI tools, such as Devin, for efficient code refactoring, optimization, and identifying potential code improvements, thereby enhancing code quality and developer productivity
DevOps, Version Control & Containerization: CI/CD pipelines, Git, Docker and Kubernetes
Extensive experience system analysis and in programming of software applications
Experience in managing and implementing successful projects
Subject Matter Expert (SME) in at least one area of Applications Development

Job Responsibility

Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency

What we offer

medical, dental & vision coverage
401(k)
life, accident, and disability insurance
wellness programs
paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays

Fulltime

Principal Engineer Software (Data Plane Applications)

Prisma Access™ provides protection straight from the cloud to make access to the...

Location

United States , Santa Clara

Salary:

147000.00 - 237500.00 USD / Year

Palo Alto Networks

Expiration Date

Until further notice

Requirements

10+ years of experience in developing and troubleshooting dataplane applications
Required hands-on programming experience in Python and Go
Strong Data structures/Algorithms
Strong analytical skills, problem solving and debugging skills
Experience with building applications in the cloud
In-depth understanding of Operating System principles and OS like Linux/Unix
In-depth understanding of networking concepts and TCP/IP stack, TLS
Exposure to building Microservices
Enjoys working with many different teams with strong collaboration and communication skills
Solid foundation in design, data structures, and algorithms, and strong analytical and debugging skills

Job Responsibility

Design, develop and implement highly scalable software features and infrastructure on our next-generation security platform ready for cloud native deployment from inception to completion
Work with different development and quality assurance groups to achieve the best quality
Profile, optimize and tune systems software (management/control/dataplane) for efficient cloud operation
Work with DevOps and the Technical Support teams to troubleshoot customer issues
Work with other software development teams to apply PanOS features on Prisma Access
Interview, mentor and coach new team members

Fulltime

Select Country

Principal Software Engineer - Data Platform

Job Description

Job Responsibility

Requirements

What we offer

Looking for more opportunities?