CrawlJobs Logo

Software Engineer 2 - AI

United States, Redmond 100600.00 - 199000.00 USD / Year · Job Posted March 02, 2026
Apply Position
Job Link Share

Job Description

The Customer Experience AI (CxAI) group within Dynamics 365 is pioneering next-generation AI-powered customer experience solutions. We build intelligent, scalable, multi-modal contact center applications, leveraging conversational AI, large language models (LLMs), and predictive analytics. Our mission is to transform customer engagement through automation, personalization, and responsible AI practices, integrating Dynamics 365, Office 365, and Microsoft cloud services.

Job Responsibility

  • Design, develop, and deploy AI/ML models for customer interaction scenarios including chatbots, voice agents, and sentiment analysis
  • Integrate LLMs, Retrieval-Augmented Generation (RAG), and advanced analytics into customer service workflows
  • Collaborate with data scientists, AI researchers, and engineering teams to deliver innovative solutions
  • Ensure high reliability, scalability, and adherence to responsible AI practices
  • Monitor and improve model performance and customer outcomes
  • Troubleshoot live site issues and optimize AI-driven workflows
  • Work closely with Program Managers and cross-functional teams to deliver customer-centric features

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Master’s degree in Computer Science or a related technical field AND 2+ years of professional software engineering experience, OR Bachelor’s degree in Computer Science or a related technical field AND 3+ years of professional software engineering experience, including proficiency in one or more of the following languages: C, C++, C#, Java, JavaScript, or Python, OR equivalent practical experience
  • 3+ years of experience designing, building, and maintaining production services and web applications
  • 2+ years of experience developing features using conversational AI technologies, including natural language processing (NLP) and speech systems
  • 2+ years of experience working with large language models (LLMs) and retrieval‑augmented generation (RAG) architectures, including applying Responsible AI principles within established frameworks
  • Experience with model integration patterns such as prompt engineering, tool/function calling, and evaluation of LLM based systems
  • Working knowledge of search, retrieval, or vector databases used in RAG based solutions
  • Problem solving skills and a demonstrated ability to learn new technologies quickly

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer 2 - AI

8 matching positions

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
  • Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
  • Experience building data lake or data engineering products, tools, or pipelines
  • Familiarity with container-based architectures (Docker, Kubernetes)
  • Ability to debug complex distributed systems on Linux and/or Windows platforms
Job Responsibility
Job Responsibility
  • Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
  • Use AI tools and coding best practices across the development lifecycle
  • Design data refresh, scheduling, and query optimisation features with minimal supervision
  • Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
  • Coach junior engineers through code reviews
  • Debug complex issues in distributed systems running on Azure, Linux, and Windows
  • Run live site operations on a rotational, on-call basis
  • Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
  • Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features
  • Fulltime
Read More
Arrow Right

Software Engineer II and Sr. Software Engineer - AI Frameworks

The AI Frameworks team at Microsoft develops software that pushes the cutting ed...
Location
Location
United States , Mountain View
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, or related technical discipline AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design, implement, and test a function or component for our AI/ML frameworks and tools
  • Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems
  • Interacting and collaborating with our partners both internal and external
  • Interacting with and providing tech support for our customers/users
  • Embody our Culture and Values
  • Fulltime
Read More
Arrow Right

Software Engineer II and Senior Software Engineer - AI Compilers

The AI Frameworks team at Microsoft develops the AI software used to train and d...
Location
Location
United States , Mountain View
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Invent and implement innovative compiler features and advanced optimization passes, leveraging tools such as LLVM, MLIR, Torch Dynamo, and Triton
  • Develop code generation techniques for new hardware platforms
  • Design and develop cutting edge AI software in C++ and Python
  • Optimize AI workloads
  • Design new programming abstractions for AI
  • Collaborate broadly across multiple disciplines from hardware architects to ML developers
  • Identify requirements, plan and design solutions, estimate effort, and schedule deliverables
  • Help establish and drive the adoption of outstanding coding standards and patterns and help enhance our inclusive engineering culture
  • Embody Microsoft's culture and values
  • Fulltime
Read More
Arrow Right

Senior Software Engineer and Principal Software Engineer - Power Point AI Team

The PowerPoint team is embarking on an exciting new chapter - evolving a product...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 8+ years of experience in backend service engineering, including work on high-scale infrastructures
  • Proficiency in one or more systems programming languages such as C#, C++
  • 1+ years of experience in software engineering, designing and developing systems (and APIs) that deploy and integrate with AI models
  • 2+ years of experience working with rich telemetry, making data driven decisions, and carrying out rapid experimentation
  • 2+ years of experience building software for scale, performance, and reliability
  • Academic or industry experience with building, finetuning, deploying or building eval-driven systems utilizing the models (any category)
Job Responsibility
Job Responsibility
  • Lead design and delivery of complex, scalable AI features ensuring resilience and exceptional user experience
  • Drive technical strategy and architecture decisions across multiple services, influencing partner teams and aligning with compliance and security requirements
  • Champion modern engineering practices, including AI-driven approaches, automation, and cloud-native patterns, across the full development lifecycle
  • Mentor and guide engineers, fostering technical excellence and continuous improvement in security, reliability, and performance
  • Collaborate cross-org to solve challenging technical problems, streamline processes, and reduce operational costs while improving live-site health
  • Design and implement scalable backend services optimized for machine learning workflows and large language model integration
  • Develop and maintain evaluation-driven systems that leverage text and multimodal inputs (e.g., images) to power visual-creation experiences
  • Build and optimize APIs and infrastructure to support high-performance model inference and experimentation at scale
  • Collaborate with product, ML, and design teams to integrate models into user-facing features, ensuring seamless functionality and performance
  • Conduct model evaluations and experiments, analyze results, and iterate on improvements to enhance accuracy and user experience
  • Fulltime
Read More
Arrow Right

Software Engineer 2 (AI)

Microsoft AI Asia Platform Team builds the foundational infrastructure powering ...
Location
Location
China , Beijing
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Solid multi-language programming and vibe-coding proficiency: Production-level experience with Rust, C++, C#, and Python (expertise in at least two required, familiarity with all four preferred)
  • Systems engineering fundamentals: Deep understanding of concurrency, memory management, performance optimization, and distributed systems architecture
  • Agent architecture knowledge: Solid grasp of modern agent paradigms (ReAct, CoT, Function Calling, Agent State Management) with hands-on implementation experience
  • LLM infrastructure foundation: Understanding of Transformer inference mechanics, experience with serving frameworks (vLLM, TensorRT-LLM, Triton, or custom stacks)
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Agent Runtime Development: Design and implement high-throughput runtime systems supporting Tool Use, Function Calling, and multi-agent orchestration at scale
  • LLM Serving Infrastructure: Optimize inference stacks including request scheduling, KV cache management, continuous batching, speculative decoding, and model parallelism
  • AI Developer Tooling: Develop AI-assisted development tools and applications (similar to Claude Code, OpenClaw) to boost engineering / work productivity
  • Platform Abstraction: Transform experimental agent capabilities into reusable platform APIs, SDKs, and managed services for upstream product teams
  • Fulltime
Read More
Arrow Right

Software Engineer 2 - C++ + AI

Would you like to work on the team that powers the most popular operating system...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Proficiency in C++ and/or C# and strong problem-solving skills
Job Responsibility
Job Responsibility
  • Build and maintain input pipeline components
  • Implement enhancements to improve responsiveness and correctness
  • Investigate and fix input-related reliability or latency issues
  • Fulltime
Read More
Arrow Right

Software Engineer 2 - Core AI

The Experimentation Platform (ExP) team powers Microsoft’s end-to-end experiment...
Location
Location
China , Beijing
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in software engineering OR equivalent experience
  • Strong coding skills in one or more languages: C#, Java, Scala, Python, or C++
  • Proven ability to design and deliver components of large distributed systems or data platforms
  • Solid understanding of data structures, algorithms, distributed system fundamentals, and debugging complex systems
  • Fast learner with strong communication skills and the ability to work effectively across teams
Job Responsibility
Job Responsibility
  • Design and build components of the experimentation platform, including large-scale data pipelines, metrics/analysis authoring, distributed workflows, and critical experiment lifecycle services
  • Develop high-performance and reliable systems using C#, .NET, Spark pipelines, Azure services, and modern data/compute frameworks
  • Integrate AI-driven agents and automation to improve debugging, monitoring, validation, and self-service capabilities for experiment owners
  • Optimize efficiency, cost, resource utilization, and pipeline throughput across a global fleet
  • Improve platform fundamentals including observability, reliability, test automation and recovery workflows
  • Collaborate with PMs, data scientists, platform engineers, and partner teams (across global Microsoft engineering centers) to design scalable solutions
  • Participate in code reviews, incident response, performance tuning, and architectural discussions
  • Engineer features with a strong focus on quality, transparency, resiliency, and operational excellence
  • Fulltime
Read More
Arrow Right

Solution Engineer - Cloud & AI Software, Dev Tools, and AI

Are you passionate about application development and excited by the opportunity ...
Location
Location
United States , Multiple Locations
Salary
Salary:
85100.00 - 203600.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, Information Technology, or related field AND 2+ years technical pre-sales or technical consulting experience OR Master's Degree in Computer Science, Information Technology, or related field AND 1+ year(s) technical pre-sales or technical consulting experience OR 3+ years technical pre-sales or technical consulting experience OR equivalent experience
  • Candidates must have authorization to work in the United States that does not now or in the future require employer sponsorship
  • 6+ years technical pre-sales, technical consulting, or technology delivery, or related experience OR equivalent experience
  • 4+ years experience with cloud and hybrid, or on premises infrastructures, architecture designs, migrations, industry standards, and/or technology management
  • Experience with cloud-native development: APIs, containers, microservices, event-driven design
  • Experience engaging enterprise development teams, including developers, architects, and technical decision makers
  • Proficiency in modern languages like JavaScript/TypeScript, Python, C#, or Java, and frameworks such as .NET, Node.js, or React
  • Hands-on expertise with GitHub, Visual Studio Code, CI/CD, DevOps, and platform engineering (e.g., observability, security, performance)
  • Proven ability to lead technical engagements (e.g., hackathons, PoCs, MVPs) that drive production-scale outcomes
Job Responsibility
Job Responsibility
  • Drive technical sales with decision makers using demos and PoCs to influence solution design and enable production deployments
  • Lead hands-on engagements—hackathons, code-with sessions, and architecture workshops—to accelerate adoption of Microsoft’s developer tools and cloud platforms
  • Build trusted relationships with developers and platform leads as well as AI decision makers to co-designing secure, scalable architectures and solutions
  • Resolve technical blockers and objections, collaborating with engineering to share insights and improve products
  • Maintain deep expertise in GitHub, Visual Studio, AI-assisted dev tools, Foundry SDK, CI/CD, DevOps, and cloud-native development (APIs, containers, microservices)
  • Represent Microsoft through thought leadership in developer communities and customer forums
  • Fulltime
Read More
Arrow Right