CrawlJobs Logo

Principal Software Engineer, AI Cloud

United States, Seattle 232000.00 - 319000.00 USD / Year · Job Posted February 20, 2026
Apply Position
Job Link Share

Job Description

At Docker, we make app development easier so developers can focus on what matters. Our remote-first team spans the globe, united by a passion for innovation and great developer experiences. With over 20 million monthly users and 20 billion image pulls, Docker is the #1 tool for building, sharing, and running apps—trusted by startups and Fortune 100s alike. We’re growing fast and just getting started. Come join us for a whale of a ride! Docker is building AI Cloud, the next evolution of our developer platform—a unified, multi-cloud service that seamlessly connects local development with global-scale deployment. Docker’s AI Cloud extends the power of Docker Desktop and Hub into the cloud, enabling developers to build, ship, and run applications securely and efficiently. As a Principal Software Engineer, you will define the technical vision and lead the design and implementation of Docker AI Cloud’s distributed systems. As a key member of the AI Cloud leadership team, you will partner with principal engineers across the company to architect scalable, reliable, and secure infrastructure that supports millions of developers and thousands of enterprises.

Job Responsibility

  • Define and drive the long-term technical strategy for Docker AI Cloud’s control and data plane services
  • Architect highly available, multi-region systems capable of operating seamlessly across multiple cloud providers
  • Design APIs and service abstractions that integrate Docker Desktop, Hub, and enterprise cloud services
  • Establish standards for reliability, scalability, and observability across the Docker AI Cloud platform
  • Lead cross-functional technical discussions and influence architectural decisions company-wide
  • Design and implement distributed systems for workload orchestration, service discovery, and lifecycle management
  • Build and operate control plane components that manage multi-tenant workloads and cloud networking
  • Develop infrastructure that delivers predictable performance, intelligent scaling, and automated failover
  • Ensure security, data integrity, and compliance across Docker’s global infrastructure footprint
  • Partner with platform and product teams to deliver developer-friendly APIs and cloud experiences
  • Align technical direction with Docker’s business objectives for cloud growth and developer platform unification
  • Evaluate emerging technologies (e.g., service meshes, container orchestration, edge computing) and guide adoption
  • Drive initiatives that reduce latency, optimize cost, and improve cross-cloud performance
  • Define metrics and SLAs for Docker AI Cloud’s reliability and scalability
  • Mentor senior, staff and principal engineers, fostering technical excellence and growth across teams
  • Lead design reviews and guide critical production system decisions
  • Drive a culture of operational excellence, ownership, and innovation
  • Collaborate with engineering and product leadership to align priorities and resource planning

Requirements

  • 10+ years of software engineering experience, including 3+ years in technical leadership roles (Staff or Principal level)
  • Proven experience designing and building highly scalable distributed systems in production environments
  • Deep understanding of cloud infrastructure (AWS, Azure, GCP, or OCI), including compute, networking, and storage primitives
  • Proficiency in Go, Rust, or Java
  • Expertise in Kubernetes, microservices, and service mesh architectures
  • Strong foundation in observability, CI/CD, and infrastructure-as-code (Terraform, Pulumi, or CloudFormation)
  • Experience operating high-availability (99.99%+) production systems
  • Exceptional communication skills and ability to influence across technical and business domains
  • Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience

Nice to have

  • Experience designing multi-cloud or cross-cloud abstractions and orchestration layers
  • Knowledge of container lifecycle management, networking, and policy enforcement
  • Prior experience in developer infrastructure, PaaS, or hyperscale SaaS environments
  • Background contributing to open source or developer-focused platforms is a plus

What we offer

  • Freedom & flexibility
  • fit your work around your life
  • Designated quarterly Whaleness Days plus end of year Whaleness break
  • Home office setup
  • we want you comfortable while you work
  • 16 weeks of paid Parental leave
  • Technology stipend equivalent to $100 net/month
  • PTO plan that encourages you to take time to do the things you enjoy
  • Training stipend for conferences, courses and classes
  • Equity
  • we are a growing start-up and want all employees to have a share in the success of the company
  • Docker Swag
  • Medical benefits, retirement and holidays vary by country
  • Remote-first culture, with offices in Seattle and Paris

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Principal Software Engineer, AI Cloud

8 matching positions

Senior Software Engineer and Principal Software Engineer - Power Point AI Team

The PowerPoint team is embarking on an exciting new chapter - evolving a product...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 8+ years of experience in backend service engineering, including work on high-scale infrastructures
  • Proficiency in one or more systems programming languages such as C#, C++
  • 1+ years of experience in software engineering, designing and developing systems (and APIs) that deploy and integrate with AI models
  • 2+ years of experience working with rich telemetry, making data driven decisions, and carrying out rapid experimentation
  • 2+ years of experience building software for scale, performance, and reliability
  • Academic or industry experience with building, finetuning, deploying or building eval-driven systems utilizing the models (any category)
Job Responsibility
Job Responsibility
  • Lead design and delivery of complex, scalable AI features ensuring resilience and exceptional user experience
  • Drive technical strategy and architecture decisions across multiple services, influencing partner teams and aligning with compliance and security requirements
  • Champion modern engineering practices, including AI-driven approaches, automation, and cloud-native patterns, across the full development lifecycle
  • Mentor and guide engineers, fostering technical excellence and continuous improvement in security, reliability, and performance
  • Collaborate cross-org to solve challenging technical problems, streamline processes, and reduce operational costs while improving live-site health
  • Design and implement scalable backend services optimized for machine learning workflows and large language model integration
  • Develop and maintain evaluation-driven systems that leverage text and multimodal inputs (e.g., images) to power visual-creation experiences
  • Build and optimize APIs and infrastructure to support high-performance model inference and experimentation at scale
  • Collaborate with product, ML, and design teams to integrate models into user-facing features, ensuring seamless functionality and performance
  • Conduct model evaluations and experiments, analyze results, and iterate on improvements to enhance accuracy and user experience
  • Fulltime
Read More
Arrow Right

Principal Software Engineer (Cloud Network and AI Security)

Location
Location
United States , Santa Clara
Salary
Salary:
147000.00 - 237500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong expertise in programming languages such as C, Python, and Go
  • Proficiency in low-level linux systems programming technologies
  • Familiarity with cloud service architectures, including compute, networking, load-balancers, and identity management
  • Experience with cloud deployments on platforms such as Azure, AWS, and GCP
  • Experience with network virtualization technologies such as DPDK, XDP
  • Strong knowledge in network security fields such as stateful firewall, packet processing, and network ACL
  • Strong scripting skills in bash and Python
  • Familiarity with Terraform/CFT/PowerShell ARM templates
  • BS/MS degree in Computer Science, Computer Engineering, Electrical Engineering or equivalent or equivalent military experience
  • 7+ years of related engineering experience
Job Responsibility
Job Responsibility
  • Design and implement new features and integrations for virtualization features across diverse cloud environments and deployments
  • Engage in all phases of the product development cycle from concept definition, design, through implementation, and testing
  • Develop comprehensive functional specifications, evaluate task requirements and timelines, and contribute to design, development, debugging, and support processes
  • Hands-on experience with virtualization technologies, various hypervisors, system software, and networking
What we offer
What we offer
  • Restricted stock units
  • Bonus
  • Fulltime
Read More
Arrow Right

Senior/ Principal Engineer Software - Data & AI Security (Cortex Cloud)

In this role, you will be dedicated to safeguarding our clients’ data within the...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on software engineering experience, with deep expertise in at least one of the following: Kotlin/Java, Python, or Go
  • Experience working with different cloud services on at least one major cloud provider (AWS, Azure, GCP)
  • Proven experience designing and building large-scale, scalable cloud-based applications
  • Expertise in microservices architecture, including technologies like Kubernetes, Docker, GKE, EKS, or AKS
  • Experience with relational or NoSQL databases (e.g., MYSQL, PostgreSQL, MongoDB) and ORMs (e.g., JPA, Hibernate)
  • Bachelor of Science in Computer Science or equivalent practical experience (e.g., elite software unit in the military)
Job Responsibility
Job Responsibility
  • Drive innovation by designing and implementing impactful solutions that address client needs, contributing to the full feature development lifecycle from design to deployment
  • Take ownership of specific feature segments, ensuring high-quality code and robust functionality through meticulous attention to detail and a focus on execution
  • Proactively collaborate and exchange information with cross-functional teams, including product and infrastructure, to ensure seamless integration and alignment on shared objectives
  • Challenge the status quo by generating innovative ideas and actively participating in brainstorming sessions to foster product and architectural improvements
  • Actively engage in technical discussions, openly sharing knowledge and learning from others to solve complex problems and elevate team expertise
  • Design and build highly scalable, resilient, and secure cloud-based applications and microservices
  • Contribute to an agile and dynamic engineering culture, demonstrating a strong drive and outstanding communication skills to deliver results efficiently
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer ( Cloud Infrastructure and Platform Engineering )

Your Career At Palo Alto Networks, Secure Cloud and AI infrastructure is the fou...
Location
Location
United States , Santa Clara
Salary
Salary:
Not provided
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS, MS, or PhD in Computer Science or a related technical field, or equivalent experience
  • 9+ years of relevant software engineering experience, with a proven track record of technical leadership and innovation
  • Demonstrated experience defining and leading large-scale, cross-organizational technical initiatives from concept to completion
  • Experience building and scaling platforms that serve thousands of engineers in complex environments
  • Strong foundation in application and infrastructure security, including secrets management, supply chain security, and secure-by-default platform design
  • Recognized expertise in developer platforms, cloud-native infrastructure, container orchestration technologies (e.g Kubernetes) and CI/CD
  • Deep proficiency with a major cloud platform (GCP preferred), including IAM, managed databases, networking, and Workload Identity
  • Experience designing and maintaining Infrastructure as Code (e.g. Terraform) at scale, including module architecture and state management
  • Expertise in authentication/authorization systems: OAuth 2.0, OIDC, token lifecycle management, and zero-trust patterns
  • Hands-on experience applying AI/ML/GenAI to solve complex software engineering problems
Job Responsibility
Job Responsibility
  • Define the Vision: Architect and own the technical roadmap for AI-enhanced developer tools and infrastructure in CIPE at Palo Alto Networks
  • Evaluate and Execute Solutions: Lead the design and implementation of novel systems that leverage Large Language Models (LLMs), static/dynamic analysis, and machine learning to create a world-class, intelligent developer experience
  • Drive Organization-Wide Impact: You are a builder, so you won't just stop at ideation. Beyond concepts, ensure your builds show step-change improvements in key engineering metrics like including code velocity, review cycle time, test effectiveness, incident reduction, and overall feature launches
  • Lead Cross-Functional Initiatives: Spearhead complex, cross-functional projects that require influencing and aligning multiple engineering organizations and their leadership
  • Enable Secure Innovation: Develop foundational AI platforms that empower teams to prototype, deploy, and scale threat-intelligent cloud features, embedding Palo Alto Networks' security natively
  • Serve as Technical Authority: Act as the go-to expert on AI-augmented cloud platforms, mentoring senior engineers and infusing industry-leading practices into our high-stakes ecosystem
  • Innovate at Enterprise Scale: Address intricate challenges in multi-cloud environments (AWS, Azure, GCP, and OCI) supporting thousands of microservices, secure workloads, and global threat detection pipelines
What we offer
What we offer
  • restricted stock units
  • bonus
  • Fulltime
Read More
Arrow Right

Principal Software Engineer- AI

Project Sophia is a new generation business application, built ground up from ma...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design, implement, and ship AI-first product capabilities end-to-end from rapid prototype to production, spanning LLM-powered services, retrieval/grounding pipelines, and intelligent UX experiences
  • Shape and evolve full-stack architecture, integrating front-end experiences, back-end services, and AI orchestration layers
  • Collaborate with design, research, and platform teams to adapt or fine-tune LLMs/SLMs and multimodal models for real-world customer scenarios
  • Build agentic, tool-using, and multimodal workflows that reason across data and services
  • Drive engineering excellence, including secure-by-design principles, accessibility compliance, automated testing, and high-quality code craftsmanship
  • Define and apply evaluation frameworks for AI systems, using telemetry, experimentation, and continuous feedback loops
  • Drive live-site reliability and operational excellence, participating in On-Call rotations
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer - AI Governance

As a Senior Principal Software Engineer, you will serve as a technical leader fo...
Location
Location
United States , San Francisco
Salary
Salary:
165000.00 - 220000.00 USD / Year
onetrust.com Logo
OneTrust
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Engineering, or related technical or business field
  • 12+ years of professional software engineering/development experience
  • Strong expertise in Java/J2EE, Spring, design patterns, microservices architecture, and cloud-native distributed systems
  • Proven experience building production-grade agentic AI systems with robust tool-use, guardrails, and observability for enterprise-scale workloads
  • Solid understanding of RAG pipelines, agent workflows, model orchestration, and evaluation practices
  • Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
  • Experience with elastic search and data streaming tools like Kafka
  • Good understanding of web services and SOA related standards like REST/OAuth/JSON
  • Moderate understanding of code and script (Python, Bash)
  • Good experience with SQL and NoSQL databases
Job Responsibility
Job Responsibility
  • Lead the design and development of Java/Python microservices and shared libraries integrating with AI platforms for OneTrust's AI Governance product
  • Design, build, and test cloud-native applications deployed on Microsoft Azure using Core Java, REST, and the Spring ecosystem
  • Build features with RAG, agent workflows, and model orchestration
  • Own technical design for critical systems, ensuring scalability, security, and reliability
  • Maintain strong automated unit/integration test coverage and engineering standards
  • Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team's discussions on system architecture and component design
  • Partner with Product, UX, and Customer Success to understand customer AI use cases and governance needs
  • Lead architecture discussions and technical planning
  • Drive alignment across teams on platform design and priorities
  • Contribute to sprint planning and delivery
What we offer
What we offer
  • Comprehensive healthcare coverage
  • flexible PTO
  • equity RSUs
  • annual performance bonus opportunities
  • retirement account support
  • 14+ weeks of paid parental leave
  • career development opportunities
  • company-paid privacy certification exam fees
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer - AI Governance

As a Senior Principal Software Engineer, you will serve as a technical leader fo...
Location
Location
United States , Atlanta
Salary
Salary:
165000.00 - 220000.00 USD / Year
onetrust.com Logo
OneTrust
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Engineering, or related technical or business field
  • 12+ years of professional software engineering/development experience
  • Strong expertise in Java/J2EE, Spring, design patterns, microservices architecture, and cloud-native distributed systems
  • Proven experience building production-grade agentic AI systems with robust tool-use, guardrails, and observability for enterprise-scale workloads
  • Solid understanding of RAG pipelines, agent workflows, model orchestration, and evaluation practices
  • Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
  • Experience with elastic search and data streaming tools like Kafka
  • Good understanding of web services and SOA related standards like REST/OAuth/JSON
  • Moderate understanding of code and script (Python, Bash)
  • Good experience with SQL and NoSQL databases
Job Responsibility
Job Responsibility
  • Lead the design and development of Java/Python microservices and shared libraries integrating with AI platforms for OneTrust’s AI Governance product
  • Design, build, and test cloud-native applications deployed on Microsoft Azure using Core Java, REST, and the Spring ecosystem
  • Build features with RAG, agent workflows, and model orchestration
  • Own technical design for critical systems, ensuring scalability, security, and reliability
  • Maintain strong automated unit/integration test coverage and engineering standards
  • Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team’s discussions on system architecture and component design
  • Partner with Product, UX, and Customer Success to understand customer AI use cases and governance needs
  • Lead architecture discussions and technical planning
  • Drive alignment across teams on platform design and priorities
  • Contribute to sprint planning and delivery
What we offer
What we offer
  • Comprehensive healthcare coverage
  • Flexible PTO
  • Equity RSUs
  • Annual performance bonus opportunities
  • Retirement account support
  • 14+ weeks of paid parental leave
  • Career development opportunities
  • Company-paid privacy certification exam fees
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, AI

We are seeking a visionary and hands-on Principal AI Engineer to be the foundati...
Location
Location
India , Delhi
Salary
Salary:
Not provided
alpha-sense.com Logo
AlphaSense
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of professional software engineering experience, with a proven track record of building complex, data-intensive, backend systems
  • Deep expertise (5+ years) in building and scaling production-grade services using modern backend frameworks such as FastAPI, Django, Sanic, Spring Boot or similar
  • Significant, hands-on experience (3+ years) in the complete lifecycle of AI/ML models: from experimentation and prototyping to deploying, monitoring, and iterating on them in a high-volume cloud environment
  • Mastery in designing large-scale distributed systems, demonstrating strong knowledge of asynchronous patterns, streaming/queuing/caching strategies, and robust observability (logging, metrics, tracing)
  • Exceptional communication and leadership skills. You can articulate complex technical concepts to diverse audiences and have the ability to influence engineering direction across multiple teams without direct authority
Job Responsibility
Job Responsibility
  • Spearhead AI Innovation: Act as the chief technical authority on AI, you will research, evaluate, and prototype cutting-edge solutions using Large Language Models (LLMs), Computer Vision, and other machine learning techniques to solve our most complex data extraction challenges
  • Architect for Scale: Design and build robust, highly scalable, and cost-effective AI services and data processing pipelines. Your architecture will be the backbone for processing millions of documents daily with high reliability and throughput
  • Tackle Real-World AI Challenges: Go beyond theory to systematically solve the practical problems of production AI. This includes managing LLM latency and variance, developing sophisticated prompt engineering strategies, and building fault-tolerant, defensive systems that perform consistently
  • Be a Force Multiplier: Act as the key technical mentor and thought leader for our large engineering team and drive some mission-critical initiatives to production
Read More
Arrow Right