CrawlJobs Logo

Principal Software Engineering - AI Frameworks

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
United States , Redmond

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

139900.00 - 274800.00 USD / Year

Job Description:

Are you looking for opportunities to deliver innovations to hundreds of millions of users that impact their daily life? Do you want to be part of a fast-cycle, highly competitive, and hardcore AI/ML frameworks team with ambitious goals to advance AI technology? The AI Frameworks team at Microsoft develops software that pushes the cutting edge of performance and experience in machine learning in production and research. We bridge the gap between the latest state-of-the-art AI models and hardware eco-systems. We build software to enable running AI models everywhere, from the world’s fastest super cloud computers, to servers, desktops, mobile phones, IoT devices, and internet browsers. The framework we develop is powering AI experience for all major Microsoft products, such as Windows, Office, Microsoft 365, Bing, SQL Server, VSCode, Cognitive Service, Copilot+ PC, and many others. As the Principal Software Engineer on our team, you would have the opportunity to work on: ONNX: an open standard format for representing AI models, enabling AI developers to work on AI models with a variety of frameworks, tools, runtimes, and compilers. ONNX Runtime: ONNX based cross-platform, high performance ML inferencing and training accelerator. Foundry Local: an on-device AI inference solution offering performance, privacy, customization, and cost advantages. It integrates seamlessly into your existing workflows and applications through an intuitive CLI, SDK, and REST API. We value our team members’ happiness and encourage everyone to constantly learn new things and take risks. We collaborate closely and openly to accomplish big things together while having fun. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Job Responsibility:

  • Partnering with appropriate stakeholders to determine user requirements for one or more complex scenarios
  • Providing technical leadership for the identification of dependencies and the development of design documents for a product, application, service, or platform
  • Leading by example and mentoring others to produce extensible and maintainable code used across the company
  • Leveraging deep subject-matter expertise of cross-product features with appropriate stakeholders (e.g., project managers) to lead multiple product's project plans, release plans, and work items
  • Holding accountability as a Designated Responsible Individual (DRI), mentoring engineers across products/solutions, working on-call to monitor system/product/service for degradation, downtime, or interruptions
  • Proactively seeking new knowledge and adapts to new trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale and shares knowledge with other engineers
  • Embodying our Culture and Values

Requirements:

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Experience developing Inference software stack
  • Experience working on systems performance optimization
  • Working with Open-Source code

Nice to have:

  • Experience developing Inference software stack
  • Experience working on systems performance optimization
  • Working with Open-Source code

Additional Information:

Job Posted:
February 05, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Principal Software Engineering - AI Frameworks

Principal Software Engineer – AI Platform

At Snorkel, we believe meaningful AI doesn’t start with the model, it starts wit...
Location
Location
United States , Redwood City; San Francisco
Salary
Salary:
275000.00 - 300000.00 USD / Year
snorkel.ai Logo
Snorkel AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or related field
  • 12+ years of experience in designing and building customer-facing software systems for cloud-native applications
  • Deep experience with AI/ML frameworks and pipelines
  • Experience at high-growth technology startups
  • Experience building software products for large enterprise customers
  • Experience with architecting and developing production web-scale systems (including monitoring, telemetry, performance, reliability, triage, and debuggability)
  • Deep experience with Python, distributed computing, and cloud platforms
  • Passion for promoting technical communication, mentorship, and improving engineering culture
Job Responsibility
Job Responsibility
  • Work across teams and across the stack to deliver major new features and infrastructure
  • Improve our practices and culture
  • Align Engineering on a shared technical vision
  • Be a key technical advisor to company leadership
  • Act as a mentor and role model for every engineer
  • Think years ahead about how Snorkel AI can deliver on its technical mission to democratize AI through data
  • Take on the biggest, most ambiguous, and most rewarding challenges that arise
  • Fulltime
Read More
Arrow Right

Principal Frontend Software Engineer - Design Systems & AI

We’re looking for a passionate Principal Engineer (P60) to join the Design Syste...
Location
Location
Australia
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A strong interest in AI, especially in generative approaches for frontend code that adheres to design systems and frontend standards
  • Systems thinking and experience architecting and maintaining large-scale systems (100+ packages, content, standards, etc.)
  • Proven Tech Lead experience: You’ve led complex technical initiatives and mentored other engineers
  • Experience with Javascript (ES6), HTML5, CSS and experience with modern Javascript frameworks (e.g., React, AngularJS, Vue)
  • Bachelor's or Master's degree (preferably a Computer Science degree or equivalent experience)
  • Extensive experience with modern testing frameworks (e.g., Jest, Cypress, Mocha, Chai)
  • Strong comfortability with the JavaScript language and ecosystem
  • Experience in design system best practices
Job Responsibility
Job Responsibility
  • Lead the technical vision and architecture for AI-driven design system solutions, ensuring scalability, reliability, and compliance with Atlassian’s frontend standards
  • Drive the development of generative AI tools that produce frontend code aligned with our design system and accessibility requirements
  • Tackle the challenges of maintaining and evolving a system of 100+ packages, including content, standards, and tooling
  • Mentor and guide engineers across the team, fostering a culture of technical excellence and innovation
  • Collaborate with cross-functional partners to deliver impactful solutions that elevate the user experience for millions of Atlassian customers
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
Read More
Arrow Right

Principal AI Engineer

We are looking for a Principal AI Engineer to lead the design and deployment of ...
Location
Location
United States
Salary
Salary:
200000.00 - 300000.00 USD / Year
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of software engineering experience
  • at least 3 years in applied LLM or agentic AI systems (2023–present)
  • proven success in deploying LLM-powered products used by real users at scale
  • deep backend & systems engineering expertise with Python, distributed systems, and scalable APIs
  • familiarity with LangChain, LlamaIndex, or similar orchestration frameworks
  • experience with RAG pipelines, vector DBs, embedding models, and semantic search tuning
  • experience managing performance across cloud providers (e.g., AWS Bedrock, OpenAI, Anthropic, etc.)
  • demonstrated experience building multi-step agents, planning workflows, chaining reasoning steps, and integrating APIs with agent memory/state
  • comfort with advanced prompting strategies, few-shot and chain-of-thought reasoning, and embedding retrieval setups
  • strong understanding of AI system evaluation, human ratings, A/B experimentation, and feedback loop pipelines
Job Responsibility
Job Responsibility
  • Architect and lead the development of multi-agent systems capable of long-horizon planning, reasoning, and API orchestration
  • build reusable agentic components that integrate deeply into sales and marketing processes
  • own and evolve our in-house platform for scalable, low-latency, and cost-efficient LLM and agent deployments
  • lead design of interfaces powered by natural language understanding and retrieval-augmented generation (RAG)
  • build embedding-based, intent-aware search and personalization systems tuned to business user needs
  • drive innovation in personalized outreach generation using context-aware generation pipelines
  • tune inference pipelines, caching layers, and model selection logic for high-scale, cost-aware performance
  • define and drive robust offline and online testing methodologies (A/B, sandboxing, human evals) across agents and LLM flows
  • architect human-in-the-loop systems and telemetry to improve accuracy, UX, and explainability over time
What we offer
What we offer
  • equity
  • company bonus or sales commissions/bonuses
  • 401(k) plan
  • at least 10 paid holidays per year
  • flex PTO
  • parental leave
  • employee assistance program
  • wellbeing benefits
  • global travel coverage
  • life/AD&D/STD/LTD insurance
  • Fulltime
Read More
Arrow Right

Principal Software Engineer

Architect and deliver version 2 of our AI claims management platform. Design and...
Location
Location
United States , New York
Salary
Salary:
270000.00 - 300000.00 USD / Year
evolutioniq.com Logo
EvolutionIQ
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10-15+ years in software development
  • at least five years in a leadership or principal role
  • proven track record of architecting and delivering large-scale, critical systems into production
  • extensive expertise in scalable cloud architecture, relational database design, and building multi-tenant backend systems
  • deep understanding of processing unstructured data and working with large-scale datasets and LLMs
  • expert in Python and other relevant technologies
  • skilled in technical documentation, code reviews, and applying state-of-the-art engineering practices
  • deep understanding of insurance-related data challenges preferred
  • strong collaborator with exceptional communication skills
  • an inspirational technical leader with a track record of success in high-stakes projects
Job Responsibility
Job Responsibility
  • Provide strategic technical guidance across the engineering organization, leading the development and implementation of complex software solutions
  • architect scalable, secure, and high-performance systems that integrate cutting-edge AI and ML capabilities, focusing on unstructured data and LLMs
  • act as a top contributor, rapidly turning ideas into thoughtful designs with multiple options, pros, and cons, and swiftly implementing frameworks
  • mentor junior engineers, fostering their growth and aligning the team with the technical vision
  • partner directly with leadership, including the CTO and VPs, to align on technical strategy and deliver impactful solutions
  • ensure reliable and successful deliveries to enterprise clients
  • drive first-principles thinking to solve 0-to-1 problems
What we offer
What we offer
  • Medical, dental, vision, short & long-term disability, life insurance and AD&D, and 401k matching
  • additional family, wellness, and pet benefits
  • paid time off and sick leave
  • 100% paid parental leave (16 weeks for primary caregivers and 12 weeks for secondary caregivers)
  • flexible schedule for new parents returning to work
  • catered lunches
  • happy hours
  • pet-friendly spaces
  • monthly technology stipend
  • $1,000/year for each employee for professional development
  • Fulltime
Read More
Arrow Right

Principal Forward Deployed Engineer, AI

As a Principal Forward Deployed Engineer (FDE) at Atlassian, you’ll be at the fo...
Location
Location
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field
  • 10+ years of experience in backend software development
  • 5+ years of experience delivering impactful AI/ML solutions in production environments, including experience as a founding or forward-deployed engineer in 0-to-1 product development
  • Deep expertise in applied AI/ML, including generative AI, LLMs, and agent-based frameworks
  • Proficiency in Python, JavaScript, or similar languages, and experience with APIs, microservices, and enterprise integration
  • Demonstrated ability to solve complex, ambiguous problems and thrive in rapidly changing environments
  • Strong communication and collaboration skills, with experience influencing cross-functional teams without formal authority
  • Experience with AI risk assessment, data privacy, and compliance (e.g., GDPR)
  • Strategic and innovative thinking, with a track record of aligning technical solutions to business goals
Job Responsibility
Job Responsibility
  • Lead the design, development, and deployment of AI/ML-powered solutions tailored to customer needs, leveraging frameworks such as TensorFlow, PyTorch, and agent-based platforms (e.g., LangChain, LlamaIndex)
  • Architect and implement robust application integrations using Python, JavaScript, or similar languages, with a focus on APIs, microservices, and enterprise-scale systems
  • Drive data-driven solution development by analyzing complex datasets to extract insights and inform product direction
  • Champion the adoption of AI-augmented workflow automation within customer environments, maximizing business value and operational efficiency
  • Oversee the end-to-end deployment of AI solutions into production, ensuring continuous evaluation, monitoring, and improvement
  • Navigate risk and compliance requirements, including AI risk assessment, data privacy (GDPR), and regulatory frameworks
  • Mentor and guide junior engineers, fostering a culture of innovation, collaboration, and continuous learning
  • Communicate complex technical concepts clearly to both technical and non-technical stakeholders, creating concise artifacts for peers, partners, and leadership
  • Align technical solutions with business objectives, setting a clear vision for technological progress and measurable results
What we offer
What we offer
  • Health and wellbeing resources
  • Paid volunteer days
Read More
Arrow Right

Principal AI Engineer

At JFrog, we’re reinventing DevOps to help the world’s greatest companies innova...
Location
Location
Israel , Netanya/Tel Aviv
Salary
Salary:
Not provided
jfrog.com Logo
JFrog
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A bachelor's degree or higher in Computer Science, Data Science, or a related field
  • Proven experience in software development
  • Proficiency in LLM-related tools, processes, and frameworks, including OpenAI Models and APIs, Hugging Face Transformers, LangChain, vector databases, and prompt management tools like PromptPerfect/PromptBase and Guardrails
  • Experience with cloud platforms, such as AWS, Google Cloud, or Azure
  • Proficiency in Python programming
  • Experience deploying LLM-based applications in a production environment
  • Excellent problem-solving and analytical skills
  • Experience with CI / CD tools
  • Strong communication skills and the ability to collaborate effectively in a team
Job Responsibility
Job Responsibility
  • Recommend and test agentic productivity tools
  • Collaborate with key organizational stakeholders to understand AI requirements and design end-to-end AI productivity solutions
  • Explore and experiment with novel ML and AI techniques and architectures to drive DevX and productivity innovation
  • Evaluate and recommend ML and AI tools and frameworks to enhance productivity and effectiveness
  • Provide technical guidance and mentorship to development teams on AI and ML technologies and practices
  • Define meaningful KPIs and closely monitor cost
Read More
Arrow Right

Principal QA Automation Engineer w/ AI experience

We seek a Principal QA Automation Engineer with a strong background in Cypress, ...
Location
Location
Argentina , Gran Buenos Aires; Capital Federal; Mar del Plata
Salary
Salary:
Not provided
basicagency.com Logo
BASIC/DEPT®
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of hands-on experience with Cypress for UI and end-to-end automation testing
  • Expert-level proficiency in TypeScript, JavaScript and Python
  • Proven experience testing AI-powered or machine learning applications, including AI model validation techniques
  • Strong understanding of AWS services (e.g., Lambda, S3, SQS, CloudWatch, ECS/EKS) and how to validate applications deployed in cloud environments
  • Experience with threaded/multi-agent AI tools and how they impact test design and validation
  • Familiarity with version control (Git), containerization (Docker), and CI/CD pipelines (e.g., GitHub Actions, Jenkins, or CircleCI)
  • Strong communication, leadership, and mentoring skills
Job Responsibility
Job Responsibility
  • Lead the design and implementation of end-to-end test automation frameworks using Cypress with TypeScript
  • Define quality strategies for applications with AI/ML components, including deterministic and non-deterministic testing approaches
  • Collaborate with engineering, DevOps, and AI/ML teams to ensure quality across AI-infused features in production environments
  • Build and scale testing strategies for threaded AI applications running in AWS cloud infrastructure
  • Integrate automated tests into CI/CD pipelines to support frequent, reliable deployments
  • Mentor and guide mid- and senior-level QA engineers, setting best practices and driving a culture of quality-first development
  • Evaluate and introduce new tools, libraries, and frameworks to improve test coverage, performance, and developer experience
  • Participate in architectural discussions to ensure testability and reliability are baked into software designs from the start
  • Analyze test results, track quality metrics, and communicate risk and coverage to stakeholders
What we offer
What we offer
  • Premium healthcare through OSDE for the employee and their immediate family members
  • Mendel prepaid card with a monthly allowance for grocery purchases
  • Monthly reimbursements for Wi-Fi/electricity expenses
  • Monthly reimbursements for training/English classes
  • 100% covered “Plan Total” membership at Sportclub
  • Access to a our benefits platform through Bonda
  • A flexible vacation policy
  • Fulltime
Read More
Arrow Right

Principal Engineer

As a Principal Engineer at Aignostics, you will play a crucial role in shaping t...
Location
Location
Germany , Berlin
Salary
Salary:
Not provided
aignostics.com Logo
Aignostics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced degree in Computer Science, Software Engineering, or a related field
  • 10+ years of software development experience, with at least 5 years in senior technical leadership roles
  • Proven track record of driving technical excellence and innovation in organizations with 50+ engineers
  • Excellent communication skills, able to articulate complex technical concepts to both technical and non-technical stakeholders
  • Solid background in large scale systems and software architecture, design patterns, and clean coding
  • Extensive experience in designing and implementing large-scale, distributed and event-driven systems
  • Extensive experience with data processing at scale
  • Extensive expertise in multiple programming languages and frameworks
  • Deep understanding of cloud technologies (GCP, AWS), containerization and orchestration (Kubernetes)
  • Familiarity with DevSecOps and MLOps practices, complex CI/CD pipelines, and infrastructure as code
Job Responsibility
Job Responsibility
  • Own the technical direction and architectural integrity of our platform
  • Advise our CTO and Sr. Vice President of Engineering on the technical vision of Aignostics
  • Align our technical strategy with business objectives to provide a competitive advantage
  • Resolve technical conflicts across teams and harmonize technologies to unlock synergies
  • Advise product management on technical feasibility, cost, and risks of complex product features
  • Drive technical design, planning, and integration of our platform across systems
  • Provide technical guidance in system design reviews for all teams
  • Educate senior and mid-level engineers to bring them up to the next level
  • Demonstrate long-term thinking and utmost technical excellence in your individual contributions
  • Lead the technical strategic planning and execution across the TechOrg's quarterly roadmap
What we offer
What we offer
  • Cutting-edge AI research and development, with involvement of Charité, TU Berlin and our other partners
  • Work with a welcoming, diverse and highly international team of colleagues
  • Opportunity to take responsibility and grow your role within the startup
  • Expand your skills by benefitting from our Learning & Development yearly budget of 1,000 € (plus 2 L&D days), language classes and internal development programs
  • Mentoring program, you’ll learn from great experts
  • Flexible working hours and teleworking policy
  • Enjoy your well-deserved time off within our 30 paid vacations days per year
  • We are family & pet friendly and support flexible parental leave options
  • Pick a subsidized membership of your choice among public transport, sports and well-being
  • Enjoy our social gatherings, lunches, and off-site events for a fun and inclusive work environment
  • Fulltime
Read More
Arrow Right