CrawlJobs Logo

Software Engineer II

United States, Redmond Employment contract 102100.00 - 202200.00 USD / Year · Job Posted June 29, 2026
Apply Position
Job Link Share

Job Description

Microsoft is leading the AI transformation. For the first time, organizations can leverage digital intelligence on demand to improve business outcomes and empower employees. Agents are at the center of this transformation—operating autonomously, collaborating with humans and other agents, supporting decisions, and spanning every business process. The Copilot, Agents, and Platform (CAP) organization powers mission-critical Microsoft 365 and Dynamics 365 services, including BizChat, Work IQ, Agent 365, and the agent runtime for the next era of work. Together, we are building the platform that will power Microsoft's AI experiences for decades to come. The Team We are the M365 Core AI Inferencing Engineering team within CAP. Every major technology shift—from PCs to mobile and from on-premises to cloud—has fundamentally changed how products are built. AI is driving the next transformation, and GPU management has become critical infrastructure for this new era. Our mission is to build and operate mission-critical, hyperscale, high-performance, cost-efficient, and compliant AI infrastructure that powers Microsoft's Large Language Model (LLM) services across Microsoft 365, Business & Industry Copilot, and other AI-powered products. We are a growing team of software engineers, architects, applied scientists, and product managers from diverse backgrounds and experiences. We collaborate across Microsoft to solve challenging problems at scale and help teams deliver innovative AI experiences. We embrace AI in every aspect of our work and are driven by customer focus, technical excellence, creativity, teamwork, accountability, agility, and continuous learning. The Candidate We are looking for a Software Engineer II to help build the future of AI infrastructure at Microsoft. This is an opportunity to work on cutting-edge AI technologies at a scale and impact that is difficult to find anywhere else. You will partner with teams across CAP and Microsoft to build the AI inferencing platform that enables engineers and applied scientists to rapidly develop AI-powered innovations using the latest models and technologies in a compliant, reliable, and cost-efficient manner. Are you passionate about shaping the AI-first era? Do you enjoy solving complex technical challenges that impact millions of users? Do you thrive in a fast-paced environment where engineers take end-to-end ownership and collaborate closely to deliver results? Join us and help build the AI inferencing platform that enables Microsoft's engineers and data scientists to do their best work while powering the next generation of AI experiences. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Job Responsibility

  • Lead the design, implementation, and delivery of LLM API management service for millions of customers
  • Maniacally manage cost and availability – set the benchmark for the industry
  • Coach your team for building and running large scale platforms and experiences that get used by hundreds of millions of users every day
  • Work independently and collaboratively with other product teams across Power Platform, BizApps, and Microsoft

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice to have

  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Solid coding skills in Python and/or C#, .Net
  • Solid technical expertise, met by proficiency in implementing 2 or more of the following or equivalent areas: 4+ years building and running high scale services
  • Experience with LLMs, orchestrators, embedding models, and vector databases
  • Implementation of Distributed Systems
  • Implementation of Message based architecture
  • High scale OLTP or OLAP storage implementations
  • Experience leading and delivering projects that span multiple engineering organizations

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer II

8 matching positions

New

Software Engineer II

If you’re excited by the challenge of shaping the future of AI, the AI Platform ...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's / Master’s Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C#, Java, or Python OR equivalent experience
  • Experience with day-to-day AI agents and tool use
  • Experience writing production code in building internet scale services and distributed systems
  • Ability to debug, read code and work on a large and increasing codebase
  • Excellent communication and presentation skills
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check
Job Responsibility
Job Responsibility
  • Collaborate with data scientists and other developers to create necessary abstractions, infrastructure, interfaces and implement features to train, test, validate, scale and optimize for machine learning algorithms
  • Drive incorporation of customer-inspired innovations into software
  • Take holistic ownership of features
  • Independently use appropriate AI agents, skills, and practices across the software development lifecycle
  • Work with appropriate internal stakeholders to understand customer/user requirements for a set of features
  • Create a clear test strategy that ensures solution quality, executes test plans, and builds testable code
  • Create extensible and maintainable product feature code for minimal defects
  • Review product feature code to ensure it contains the correct test coverage and follows team standards
  • Implement debugging tools, tests, logs, and telemetry to verify assumptions
  • Strive for automation within production deployment aiming for zero-touch when possible
  • Fulltime
Read More
Arrow Right
New

Software Engineer II

Microsoft is a company where passionate innovators come to collaborate, envision...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 2+ years of experience building and supporting distributed cloud services with production grade
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Must pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Work with senior engineers to create highly scalable, performant and maintainable code that can power the next generation of storage layer for planet scale databases
  • Participate in code reviews to ensure coding standards are followed
  • Consider diagnosability, reliability, and maintainability when reviewing code, and understand when code is ready to be shared or delivered
  • Help Identify performance and scalability issues
  • Maintain operations of live service as issues arise on a rotational, on-call basis
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right
New

Software Engineer II

Join us at Seismic, a cutting-edge technology company leading the way in the Saa...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
seismic.com Logo
Seismic
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of professional experience in data engineering or a backend-heavy software engineering role
  • Expert-level Python coding skills (Must Have)
  • Deep, hands-on experience (Must Have) with LangChain or LangGraph
  • Proven experience (Must Have) implementing and tuning Vector Databases for high-volume RAG pipelines
  • Strong understanding of traditional data modeling, ETL/ELT processes, and working with SQL/NoSQL databases
  • Solid grasp of embedding models, tokenization, and modern information retrieval techniques
  • Thrive in fast-paced environments and enjoy staying updated with the rapidly evolving landscape of GenAI and search technologies
Job Responsibility
Job Responsibility
  • Architect AI Data Pipelines: Design and maintain robust data ingestion and transformation pipelines tailored for LLM training, fine-tuning, and Retrieval-Augmented Generation (RAG)
  • Build Agentic Workflows: Utilize LangGraph to develop complex, state-managed AI agents and cyclical workflows that enhance automated user interactions
  • Optimize RAG Systems: Architect the retrieval layer of our AI applications, implementing efficient document embedding strategies and semantic search
  • Manage Vector Infrastructure: Implement and optimize Vector Databases (e.g., Pinecone, Weaviate, or Milvus) to ensure high-performance data retrieval and storage
  • Scale Data Models: Create scalable data schemas that support both structured and unstructured data, ensuring seamless integration with our AI services
  • Performance Engineering: Identify and resolve latency bottlenecks in data retrieval and embedding generation to ensure real-time AI responsiveness
  • Collaborate Cross-Functionally: Partner with AI Researchers and Product Managers to transition experimental AI prototypes into production-ready data products
  • Fulltime
Read More
Arrow Right

Software Engineer II

Rapid7 is seeking a Software Engineer II to join our Labs team within the Securi...
Location
Location
United Kingdom , Belfast
Salary
Salary:
Not provided
rapid7.com Logo
Rapid7
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years working in a professional software engineering environment
  • Proficiency in one or more industry standard languages such as Python, Go, Java, C#, or Ruby
  • Familiarity with modern engineering tools including Kubernetes, Terraform, Jenkins, and Spinnaker
  • Understanding of internet protocols and the related cybersecurity implications
  • Experience working with AWS services such as S3, EC2, IAM, and RDS (PostgreSQL)
  • Ability to collaborate with cross-functional teams regardless of location to drive impact and positive customer outcomes
  • Commitment to holding self and others responsible for driving outcomes and meeting commitments
  • Passion for developing your craft and continuous learning to elevate personal and professional impact
  • Clear communication of objectives and rationale to foster commitment from teammates
  • Experience with data-driven workflows using tools like Airflow, EMR, Glue, or Spark
Job Responsibility
Job Responsibility
  • Monitor and improve core research projects including our vulnerability intelligence service, Project Sonar, and Project Lorelei
  • Maintain and enhance RESTful APIs that back internet telemetry research tools
  • Contribute to the evolution of overall telemetry research effort to develop richer data generation capabilities
  • Partner with the Manager of Software Engineering to develop long-term vision and strategy for core projects
  • Execute technical improvements across the stack using Python, Django, and other object-oriented languages
  • Manage cloud-based infrastructures utilizing Kubernetes (EKS), Terraform, and various AWS services
  • Develop and refine presentation layers for internet telemetry to ensure high-quality data visualization
  • Drive agile software development principles including high test coverage and CI/CD workflows
  • Fulltime
Read More
Arrow Right

Software Engineer II

Microsoft is a company where passionate innovators come to collaborate, envision...
Location
Location
United States , Redmond
Salary
Salary:
102100.00 - 202200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python. OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Collaborates with stakeholders to determine user requirements.
  • Drives design documentation and dependency identification.
  • Builds, optimizes, debugs, refactors, and maintains high-quality code.
  • Designs and runs experiments to evaluate effectiveness of changes.
  • Partners with PMs to deliver project and release plans.
  • Acts as DRI and participates in on-call rotations.
  • Proactively adopts new technologies to improve reliability, performance, and observability.
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation.
Read More
Arrow Right

Software Engineer II

Microsoft is a company where passionate innovators come to collaborate, envision...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, or related technical discipline AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Must pass Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design, develop, and maintain backend platform services built on Azure Service Fabric serving enterprise-scale workloads
  • Collaborate with cross-functional teams to deliver reliable, high-performance distributed systems for capacity management and workload orchestration
  • Contribute to deployment infrastructure using Ev2, ARM templates, and CI/CD pipelines for safe and efficient rollouts across global Azure regions
  • Investigate and resolve complex production issues using telemetry, Kusto queries, and structured debugging methodologies
  • Participate in code reviews, design discussions, and on-call rotations to ensure platform reliability and quality
  • Drive continuous improvement in engineering practices, test coverage, and operational excellence
  • Fulltime
Read More
Arrow Right

Software Engineer II

Microsoft is a company where passionate innovators come to collaborate, envision...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, or related technical discipline AND 4+ years technical engineering experience with coding in languages including, but not limited to C#, Java, React, or Python
  • OR equivalent experience
  • Experience in data integration or migrations or ELT or ETL tooling is mandatory
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Build cloud scale products with focus on efficiency, reliability and security
  • Build and maintain end-to-end Build, Test and Deployment pipelines
  • Deploy and manage massive Hadoop, Spark and other clusters
  • Contribute to the architecture & design of the products
  • Triaging issues and implementing solutions to restore service with minimal disruption to the customer and business
  • Perform root cause analysis, trend analysis and post-mortems
  • Owning the components and driving them end to end, all the way from gathering requirements, development, testing, deployment to ensuring high quality and availability post deployment
  • Fulltime
Read More
Arrow Right

Software Engineer II

The Azure Hyperscale Networking team is growing to meet the challenges posed by ...
Location
Location
United States , Multiple Locations
Salary
Salary:
102100.00 - 219200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Works with appropriate stakeholders to determine user requirements for a set of features
  • Contributes to the identification of dependencies, and the development of design documents for a product area with little oversight
  • Creates and implements code for a product, service, or feature, reusing code as applicable
  • Contributes to efforts to break down larger work items into smaller work items and provides estimation
  • Acts as a Designated Responsible Individual (DRI) working on-call to monitor system/product feature/service for degradation, downtime, or interruptions and gains approval to restore system/product/service for simple problems
  • Remains current in skills by investing time and effort into staying abreast of current developments that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale
  • Fulltime
Read More
Arrow Right