CrawlJobs Logo

Software Engineer Core AI

United States, Cambridge 84200.00 - 165200.00 USD / Year · Job Posted January 31, 2026
Apply Position
Job Link Share

Job Description

Are you passionate about shaping the future of cloud development? Join the Azure App Service team—part of DevDiv—where we’re reimagining how developers build and scale applications in a mobile-first, cloud-first world. You’ll be part of a team that delivers platform innovations powering web, mobile, and serverless workloads across Microsoft’s public and private cloud offerings. As a Software Engineer in the Azure App Service team, you’ll design and build scalable, multi-tenant cloud services that support a wide range of runtimes including .NET, Node.js, Python, and PHP. You’ll work on high-density hosting platforms, container-based and serverless architectures, and developer productivity features like CI/CD, staging environments, and automatic patching. You’ll also leverage AI coding tools such as GitHub Copilot, Azure OpenAI, and internal agents to accelerate development, improve code quality, and enhance incident resolution. This opportunity will allow you to: Accelerate your career growth by solving complex engineering challenges in distributed systems. Deepen your understanding of platform-as-a-service (PaaS), serverless computing, and AI-assisted development. Hone your skills in cloud-native development, DevOps automation, and performance optimization.

Job Responsibility

  • With guidance, learns to create and implement code for a product, service, or feature reusing code as applicable
  • Acts as a Designated Responsible Individual (DRI) in monitoring system/product feature/service for degradation, downtime, or interruptions for simple problems, and recommends actions to restore system/product/service by following the playbook
  • Reviews current developments and proactively seeks new knowledge that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale
  • Embody our culture and values

Requirements

  • Bachelor's Degree in Computer Science, or related technical discipline with proven experience coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years

Nice to have

  • Bachelor's Degree in Computer Science, or related technical field AND 1+ year(s) technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Rust, or Python OR Master's Degree in Computer Science or related technical field with proven experience coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Rust, or Python OR equivalent experience
  • Proven experience in distributed cloud services and the developer customer

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer Core AI

8 matching positions

Senior and Principal Software Engineer - Core AI

Core AI is at the forefront of Microsoft’s mission to redefine how software is b...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C++, C#, Go, Java, or Python
  • OR equivalent experience
  • 6+ years technical engineering experience designing and delivering highly available, large-scale cloud services and distributed systems
  • Experience building AI or ML related applications
  • 1+ years of technical engineering experience with machine learning or Artificial Intelligence (AI) systems
Job Responsibility
Job Responsibility
  • Design, implement and deliver AI services to support product offerings for large-scale agent observability
  • Collaborate closely with product management and partner teams to align technical direction with business goals
  • Take end-to-end responsibility for the development lifecycle and production readiness of the services you build and drive the team’s DevOps culture
  • Engage with customers to gather feedback and resolve complex issues
  • Understand Microsoft businesses and collaborate with stakeholders towards cohesive, end-to-end experiences for Microsoft customers
  • Innovate on technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Core AI

The Experimentation Platform (ExP) team powers Microsoft’s end-to-end experiment...
Location
Location
China , Beijing
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in software engineering OR equivalent experience
  • Strong coding skills in one or more languages: C#, Java, Scala, Python, or C++
  • Proven ability to design and deliver components of large distributed systems or data platforms
  • Solid understanding of data structures, algorithms, distributed system fundamentals, and debugging complex systems
  • Fast learner with strong communication skills and the ability to work effectively across teams
Job Responsibility
Job Responsibility
  • Design and build components of the experimentation platform, including large-scale data pipelines, metrics/analysis authoring, distributed workflows, and critical experiment lifecycle services
  • Develop high-performance and reliable systems using C#, .NET, Spark pipelines, Azure services, and modern data/compute frameworks
  • Integrate AI-driven agents and automation to improve debugging, monitoring, validation, and self-service capabilities for experiment owners
  • Optimize efficiency, cost, resource utilization, and pipeline throughput across a global fleet
  • Improve platform fundamentals including observability, reliability, test automation and recovery workflows
  • Collaborate with PMs, data scientists, platform engineers, and partner teams (across global Microsoft engineering centers) to design scalable solutions
  • Participate in code reviews, incident response, performance tuning, and architectural discussions
  • Engineer features with a strong focus on quality, transparency, resiliency, and operational excellence
  • Fulltime
Read More
Arrow Right

Staff Software Engineer, Core AI

As a Staff AI Engineer on our Core AI team, you will be a cornerstone of FloQast...
Location
Location
United States , San Jose
Salary
Salary:
164000.00 - 246000.00 USD / Year
floqast.com Logo
FloQast
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of professional software engineering experience
  • 4+ years focused on building backend for production applications
  • Mastery of Python
  • Familiarity with some AI application frameworks, context engineering, and scalable system design for AI products
  • Expertise in designing products that integrate with multiple technologies, APIs, and data sources in cloud-native environments (AWS preferred)
  • Strong desire to develop deep hands-on experience with LLM APIs, retrieval-augmented generation (RAG), conversational AI, document processing, and MCP integrations
  • Proven ability to lead tech product initiatives, establish technical standards and communicate complex system designs to both technical and business stakeholders
Job Responsibility
Job Responsibility
  • Architect and lead development of production AI products including intelligent chatbots, document processing systems, and agentic workflows using Python and modern AI frameworks
  • Design and implement our centralized AI platform including model routing, provider management, vector search, and AI application frameworks with seamless MCP (Model Context Protocol) integrations
  • Build scalable AI products that integrate with diverse technologies including accounting systems, document repositories, and external APIs while maintaining robust monitoring and observability
  • Master context engineering and system design for AI applications, ensuring optimal information retrieval, context assembly, and multi-turn conversation management
  • Collaborate with Product, Engineering, and Security teams to ensure AI products are robust, compliant, and aligned with business objectives in the regulated accounting space
  • Provide technical leadership and mentorship to the growing AI team, establishing best practices for AI product development, deployment, and governance
What we offer
What we offer
  • Medical
  • Dental
  • Vision
  • Family Forming benefits
  • Life & Disability Insurance
  • Unlimited Vacation
  • Fulltime
Read More
Arrow Right

Software Engineer 2 - Core AI

The Experimentation Platform (ExP) team powers Microsoft’s end-to-end experiment...
Location
Location
China , Beijing
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in software engineering OR equivalent experience
  • Strong coding skills in one or more languages: C#, Java, Scala, Python, or C++
  • Proven ability to design and deliver components of large distributed systems or data platforms
  • Solid understanding of data structures, algorithms, distributed system fundamentals, and debugging complex systems
  • Fast learner with strong communication skills and the ability to work effectively across teams
Job Responsibility
Job Responsibility
  • Design and build components of the experimentation platform, including large-scale data pipelines, metrics/analysis authoring, distributed workflows, and critical experiment lifecycle services
  • Develop high-performance and reliable systems using C#, .NET, Spark pipelines, Azure services, and modern data/compute frameworks
  • Integrate AI-driven agents and automation to improve debugging, monitoring, validation, and self-service capabilities for experiment owners
  • Optimize efficiency, cost, resource utilization, and pipeline throughput across a global fleet
  • Improve platform fundamentals including observability, reliability, test automation and recovery workflows
  • Collaborate with PMs, data scientists, platform engineers, and partner teams (across global Microsoft engineering centers) to design scalable solutions
  • Participate in code reviews, incident response, performance tuning, and architectural discussions
  • Engineer features with a strong focus on quality, transparency, resiliency, and operational excellence
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Managed AI - AI model LifeCycle

The Senior Software Engineer for the Model LifeCycle team will contribute to bui...
Location
Location
United States , San Francisco
Salary
Salary:
172425.00 - 209000.00 USD / Year
crusoe.ai Logo
Crusoe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field
  • Experience delivering production-ready features
  • Familiarity with essential cloud-based services (e.g., compute, storage, networking)
  • Familiarity with Generative AI (Large Language Models, Multimodal)
  • Experience with AI infrastructure components (training, inference)
  • 4-5+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function
Job Responsibility
Job Responsibility
  • Implement and maintain systems for fine-tuning large foundation models (SFT, PEFT, LoRA, adapters), including multi-node orchestration, checkpointing, failure recovery, and cost-efficient scaling
  • Implement and maintain end-to-end training pipelines for Large Language Models
  • Implement components for distillation and reinforcement learning pipelines (e.g., preference optimization, policy optimization, reward modeling)
  • Develop and maintain core agent execution infrastructure
  • Implement features for dataset, model, and experiment management, focusing on versioning, lineage, evaluation, and reproducible fine-tuning
  • Work closely with Senior Engineers and Principal Engineers, as well as product and platform teams, to implement system abstractions and APIs
  • Contribute to technical discussions on training runtimes, scheduling, storage, and model lifecycle management
  • Engage with the open-source LLM ecosystem
What we offer
What we offer
  • Restricted Stock Units
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Fulltime
Read More
Arrow Right

Staff Software Engineer, Managed AI - AI Platform

Be a part of the AI revolution with sustainable technology at Crusoe. Here, you'...
Location
Location
United States , San Francisco, CA; Sunnyvale, CA
Salary
Salary:
208725.00 - 253000.00 USD / Year
crusoe.ai Logo
Crusoe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced degree in Computer Science/Engineering
  • 8-10+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function
  • Experience with distributed systems, cloud services (compute, storage, networking, database), and delivering early-stage projects quickly
  • Experience with Generative AI (LLMs, Multimodal) and familiar with AI infrastructure (training, inference, ETL pipelines)
  • Proficient with container runtimes (e.g., Kubernetes), microservices, REST APIs, gRPC, and the full software development lifecycle including CI/CD
Job Responsibility
Job Responsibility
  • Lead the design and implementation of core AI services, including: Resilient fault-tolerant queues for efficient task distribution
  • Model catalogs for managing and versioning AI models
  • Scheduling mechanisms optimized for cost and performance
  • Architect and scale infrastructure to handle millions of API requests per second
  • Implement robust monitoring and alerting to ensure system health and 24/7 availability
  • Collaborate closely with product management, business strategy, and other engineering teams to define the AI platform roadmap
  • Influence the long-term vision and architectural decisions of the platform
  • Contribute to open-source AI frameworks and actively participate in the AI community
  • Prototype and rapidly iterate on emerging technologies and new features
What we offer
What we offer
  • Restricted Stock Units in a fast growing, well-funded technology company
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Managed AI - AI Platform

Be a part of the AI revolution with sustainable technology at Crusoe. Here, you'...
Location
Location
United States , San Francisco, CA; Sunnyvale, CA
Salary
Salary:
172425.00 - 209000.00 USD / Year
crusoe.ai Logo
Crusoe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced degree in Computer Science/Engineering
  • 4-5+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function
  • Experience with distributed systems, cloud services (compute, storage, networking, database), and delivering early-stage projects quickly
  • Experience with Generative AI (LLMs, Multimodal) and familiar with AI infrastructure (training, inference, ETL pipelines)
  • Proficient with container runtimes (e.g., Kubernetes), microservices, REST APIs, gRPC, and the full software development lifecycle including CI/CD
Job Responsibility
Job Responsibility
  • Lead the design and implementation of core AI services, including: Resilient fault-tolerant queues for efficient task distribution
  • Model catalogs for managing and versioning AI models
  • Scheduling mechanisms optimized for cost and performance
  • Architect and scale infrastructure to handle millions of API requests per second
  • Implement robust monitoring and alerting to ensure system health and 24/7 availability
  • Collaborate closely with product management, business strategy, and other engineering teams to define the AI platform roadmap
  • Influence the long-term vision and architectural decisions of the platform
  • Contribute to open-source AI frameworks and actively participate in the AI community
  • Prototype and rapidly iterate on emerging technologies and new features
What we offer
What we offer
  • Restricted Stock Units
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Fulltime
Read More
Arrow Right

Ai-first Core It Software Engineering: Software, Ml & Data

This is a Unified Application for our AI-First IT Transformation portfolio. We r...
Location
Location
United States , Santa Clara
Salary
Salary:
Not provided
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3-5+ years of experience in Software Engineering, Data Science, or Machine Learning (Staff level)
  • 6-8+ years (Senior Staff)
  • 8-12+ years (Principal level)
  • Expert-level server-side development (Python, Java, Go) OR deep expertise in statistical modeling, ML algorithms, and LLM fine-tuning
  • Direct experience with RAG architectures, LLM APIs, and Vector Databases (e.g., Pinecone, Milvus)
  • Hands-on experience with Kubernetes, CI/CD, and distributed systems for large-scale AI deployment
Job Responsibility
Job Responsibility
  • Lead the hands-on development of core Enterprise IT Business software leveraging AI components and LLM infrastructure with both traditional and Generative AI model deployment
  • Build and industrialize agentic AI systems and multi-agent frameworks, ensuring secure and effective use of GenAI technologies at the platform level
  • Design and implement robust foundational data pipelines, perform advanced statistical analysis, and develop new ML models to drive autonomous system behavior
  • Design large-scale, distributed AI/ML systems optimized for low latency, high throughput, and developer-friendliness (Inference optimization)
  • Establish evaluation frameworks to measure AI quality (accuracy, hallucination rates) and overall system reliability across the Enterprise AI Factory
  • Fulltime
Read More
Arrow Right