CrawlJobs Logo

Senior Software Engineer - CoreAI Model Inference & Serving

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
United States , Redmond

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

119800.00 - 234700.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

Join our team within CoreAI, where we are building the AI data-plane that powers all LLM inferencing workloads across Microsoft and Azure customers—from cutting-edge startups to Fortune 500 enterprises. Our converged AI fabric delivers inference capabilities for all LLMs in Microsoft catalog, including OpenAI, Anthropic, Mistral, Cohere, Llama, and more. As a Senior Software Engineer, you will shape the future of one of the largest and fastest-growing services in Azure, foundational to Microsoft’s AI strategy. Our mission is to serve models at scale—reliably, efficiently, and with ultra-low latency—enabling a rich set of AI-powered product experiences. This is a rapidly evolving space with immense opportunities to learn, innovate, and drive industry-wide impact!

Job Responsibility:

  • Be a hands-on technical leader, designing, coding, and shipping core serving systems, smart routing, and request distribution for a broad portfolio of LLMs
  • Build large-scale AI services and platform capabilities that power new products and customer experiences
  • Drive cutting-edge innovation in AI systems alongside world-class engineers and cross-functional partners
  • Lead through architecture, code reviews, mentorship, and technical excellence while staying close to implementation
  • Improve reliability, scalability, observability, efficiency, and performance across mission-critical services

Requirements:

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, or Java
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • 4+ years of design and problem-solving experience, with understanding of system performance, scalability, and engineering best practices
  • Understanding of distributed systems specifically in request serving at scale
  • (e.g. inferencing, L7 gateways, high-performance storage, distributed databases across global-scale infrastructure)
  • Demonstrated experience in building high-quality, reliable systems at scale
  • Experience using modern AI-assisted development tools and workflows to move faster, improve quality, and amplify engineering impact
  • Customer-obsessed approach to problem solving, with empathy and a drive to deliver impactful solutions

Additional Information:

Job Posted:
April 03, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
Microsoft Corporation - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Software Engineer - CoreAI Model Inference & Serving

New

Property Manager / Property Administrator

If you are a dedicated professional ready for a new challenge as a Property Mana...
Location
Location
Canada , Etobicoke
Salary
Salary:
55000.00 - 95000.00 CAD / Year
https://www.randstad.com Logo
Randstad
Expiration Date
May 04, 2026
Flip Icon
Requirements
Requirements
  • Have 3+ years of experience as a Property Manager and Administrator
  • Demonstrate proficiency in software such as Yardi, MRI, or Property Vista
  • Be able to commute to work on-site or hybrid within West Toronto
  • Possess a strong understanding of the Residential Tenancies Act or commercial structures
  • Show an eagle eye for detail when reviewing legal and financial records
Job Responsibility
Job Responsibility
  • Support property operations by coordinating with vendors and managing maintenance schedules
  • Abstract key lease information to ensure critical dates and renewals are accurately tracked
  • Act as the primary liaison for tenants and owners within the West Toronto portfolio
  • Oversee financial administration including rent collection and accounts payable
  • Maintain digital property databases like Yardi or MRI with high accuracy
  • Facilitate tenant onboarding by coordinating move-ins and managing insurance certificates
What we offer
What we offer
  • You explore competitive salary ranges that reflect the 2026 cost of living
  • You work with a recruiter who understands your specific technical expertise
  • You get real-time market updates on the latest Canada salary trends
  • You gain access to priority-fill roles requiring an immediate start
  • You join a specialized network where your expertise is matched with the right portfolio
  • Fulltime
Read More
Arrow Right
New

Dental Field Service Engineer

We are recruiting for a Dental Field Service Engineer with transferable skills a...
Location
Location
United Kingdom , Stirling
Salary
Salary:
33000.00 - 45000.00 GBP / Year
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experienced Dental Field Service Engineer
  • Transferable skills
  • Field-based experience
Job Responsibility
Job Responsibility
  • Deliver, install and validate new equipment
  • Carry out scheduled maintenance, site surveys and advise the customer of any additional costs incurred
  • Attend breakdowns and resolve issues through to completion of repair
  • Provide technical assistance to customers, office staff and fellow engineers
  • Accurately record data and complete internal/customer reports via an IT tablet
  • Assist customers with advice in all areas of engineering, equipment performance and regulatory compliance
  • Promote equipment sales and contract consolidation options available to the customer
What we offer
What we offer
  • Discretionary company performance related bonus
  • Comprehensive discount portal including gym memberships, shopping savings and days out
  • SmartPay loan scheme – with no interest applied
  • Cycle to Work scheme
  • Enhanced holiday entitlement – 33 days including bank holidays
  • Option to purchase additional annual leave
  • An extra day off for your birthday
  • Company pension scheme
  • Dental plan
  • Company sick pay, life assurance, and enhanced maternity/paternity pay
  • Fulltime
Read More
Arrow Right
New

Retail Merchandiser

Winston Retail is seeking a passionate, detail-driven merchandiser. You'll play ...
Location
Location
United States , Ponca City
Salary
Salary:
16.00 - 18.00 USD / Hour
winstonretail.com Logo
Winston Retail
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in retail merchandising or a related field is preferred
  • Familiarity with planograms and visual directives is essential
  • A keen eye for detail and creativity in presenting apparel and hardline merchandise
  • Strong communication skills, both verbal and written
  • Ability to lift to 25 pounds and stand for the entire shift
  • Smartphones are required for reporting: IOS: Use an iPhone 11 or newer, Android: Use a 2020 or newer device with an OS no more than four versions behind the latest
Job Responsibility
Job Responsibility
  • Develop and implement effective merchandising strategies that align with company and store standards
  • Execute planograms to optimize product placement and maximize sales with apparel and hardline merchandise
  • Communicate effectively with team members and store management regarding merchandising needs
  • Ability to work independently and as part of a team in different store settings
  • Manage monthly scheduling to ensure store visits and merchandising deliverables are completed by assigned deadlines, demonstrating strong time management and accountability
  • Submit store visit reports, including taking before and after photos and writing feedback, using our Winston App on a smart device
What we offer
What we offer
  • Competitive hourly rate
  • Paid online training
  • Flexible schedule
  • Wellness benefits
  • Opportunities for advancement
Read More
Arrow Right
New

Litigation Support Analyst

We are looking for a skilled Litigation Support Analyst to provide technical exp...
Location
Location
United States , Wilmington
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 2 years of experience in litigation support or related roles
  • Proven ability to manage multiple projects simultaneously and meet strict deadlines
  • Solid understanding of the litigation process and familiarity with eDiscovery tools
  • Proficiency in reading and modifying data/image load files
  • Experience in creating and maintaining eDiscovery review software platforms
  • Skilled in training and supporting legal teams on eDiscovery platforms such as Relativity, Everlaw, Disco, or similar tools
  • familiarity with Nuix Discover is a plus
  • Outstanding verbal and written communication skills to effectively collaborate with teams and clients
  • Strong analytical skills with a background in fraud detection, investigation, and data analysis
Job Responsibility
Job Responsibility
  • Develop, maintain, and troubleshoot eDiscovery software and databases to support litigation processes
  • Process incoming data and images by organizing and loading them into litigation databases
  • Collect, analyze, and prepare electronic data for review and production purposes
  • Design and implement search terms and filters to streamline document review workflows
  • Perform rigorous quality control checks and prepare documents for production
  • Collaborate with legal teams to coordinate project-specific workflows and ensure smooth execution
  • Train and assist legal teams in utilizing various eDiscovery platforms effectively
  • Utilize fraud investigation techniques and data analysis to identify inconsistencies and ensure compliance
  • Apply advanced fraud analytics to detect and prevent fraudulent activities during litigation
  • Contribute to the refinement of anti-fraud measures within eDiscovery processes
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • eligible to enroll in our company 401(k) plan
Read More
Arrow Right
New

Central Support Chef

We are recruiting for a Central Support Chef to work with our fantastic team cov...
Location
Location
United Kingdom , Aldershot, Guildford & along the A3
Salary
Salary:
35000.00 GBP / Year
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Full UK driving licence
  • Access to own vehicle
  • Chef management experience (ideally from secondary education)
  • Passion for food and service
  • Craft skills to support in the kitchen
  • Self-motivated
  • Resilient
  • Highly organised
  • Understanding of how to prioritise effectively
Job Responsibility
Job Responsibility
  • Assist with the training and development of onsite chefs
  • Cover sickness across sites
  • Be part of the mobilisation team
  • Support the operations manager across their portfolio of sites
What we offer
What we offer
  • Free meals on shift
  • Uniform
  • Pension
  • Other great company benefits
  • Mileage claimed back
  • Staff discount scheme at over 850 retailers
  • Monthly opportunities for the best teams to win shopping vouchers
  • Fulltime
Read More
Arrow Right
New

Warehouse Inventory Coordinator

Are you an experienced warehouse professional with a keen eye for detail and a d...
Location
Location
Canada , Aurora
Salary
Salary:
24.00 - 27.00 CAD / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
May 22, 2026
Flip Icon
Requirements
Requirements
  • Minimum of 3+ years of experience in Inventory Control or a relevant warehouse coordination role
  • Valid experience (or recently expired certification) on both Cherry Picker and Raymond Reach forklifts
  • Ability to lift up to 50 lbs and perform physically demanding tasks in a warehouse environment
  • Proven track record of working with SAP for inventory management
  • Residing in or near Aurora, Ontario, with access to reliable transportation
  • High school diploma or equivalent
  • mechanical background is highly preferred
  • Availability to work full-time hours with occasional overtime as required
Job Responsibility
Job Responsibility
  • Efficiently operate a Cherry Picker and Raymond Reach truck to allocate and handle inventory safely
  • Maintain high levels of inventory accuracy by comparing physical stock against SAP records
  • Execute the daily cycle count process and investigate any identified discrepancies
  • Manage warehouse space effectively by redirecting excess inventory and optimizing storage unit placement
  • Verify pallet tag quantities, part numbers, and storage locations, reporting issues to the Warehouse Manager
  • Perform manual material handling and organization to ensure an efficient workflow
  • Assist in the assembly of products using hand tools, with a willingness to undergo technical training
  • Coordinate with 3PL (Third-Party Logistics) and external logistics partners for inbound and outbound flow
  • Track and update shipments within the system, ensuring all data records are precise and up to date
  • Act as a team player by supporting colleagues in various warehouse tasks as required
What we offer
What we offer
  • Competitive pay rate of $23/hr - $26/hr based on experience
  • Straight day shift: Monday to Friday, 7:30 am – 4:00 pm (No rotating shifts!)
  • Direct permanent hire from day one—no bridge period
  • Comprehensive company benefits package and 5% RRSP matching program
  • 3 weeks of paid vacation to start
  • 5% annual bonus opportunity based on performance
  • Opportunities for professional growth and advancement into leadership roles
  • Working for a global leader in the pump industry with a stable and growing local presence
  • Fulltime
Read More
Arrow Right
New

BizTalk Functional Analyst II

We are seeking an experienced BizTalk Functional Consultant to support our BizTa...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
arrow.com Logo
Arrow Electronics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong understanding of BizTalk Server concepts (or ability to bridge business needs to technical architecture)
  • Experience working in a functional/BA role within integration projects
  • Proven ability to gather and document functional and non-functional requirements
  • Familiarity with EDI, XML, XSLT, WSDL, SOAP, REST APIs, etc., from a functional perspective
  • Experience in process mapping and using tools like Visio or Lucidchart
  • Basic knowledge of SQL for querying and understanding data flows (optional but preferred)
  • Experience working in Agile or hybrid environments
  • Excellent communication and stakeholder management skills
  • Bachelor’s degree in Computer Science, Information Systems, Business Administration, or related field
Job Responsibility
Job Responsibility
  • Collaborate with business users to gather and analyze integration requirements
  • Document business processes, data flows, and interface requirements related to BizTalk integrations
  • Translate business needs into functional specifications for the BizTalk development team
  • Facilitate workshops and meetings with business and technical stakeholders
  • Provide functional oversight and testing support for BizTalk interfaces and workflows
  • Participate in UAT (User Acceptance Testing) and provide feedback to developers
  • Coordinate with external vendors or third-party systems for interface integration
  • Ensure compliance with enterprise integration standards and governance
  • Provide post-implementation support and issue resolution
  • Fulltime
Read More
Arrow Right
New

Monitoring Technician

Looking for a hands-on job where every day is different? At HSL Compliance, we’r...
Location
Location
United Kingdom , London; Hertfordshire; Essex
Salary
Salary:
12.71 - 14.51 GBP / Hour
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A full UK driving licence (essential)
  • Reliability and strong work ethic
  • Confidence to work independently (once trained)
  • Good communication and customer service skills
  • Willingness to learn new skills and grow with us
Job Responsibility
Job Responsibility
  • Travel to different sites each day (company vehicle provided after training)
  • Carry out simple checks, testing and monitoring of water systems (full training given)
  • Perform cleaning and maintenance tasks to keep systems safe
  • Record results on a mobile device
  • Talk with clients and tenants in a friendly, professional way
  • Manage your own time and schedule site visits
What we offer
What we offer
  • Full training & career development – no experience required
  • Opportunities to gain industry-recognised qualifications
  • Paid overtime (including travel time from when you leave home)
  • 22 days annual leave + bank holidays (+ option for 3 extra unpaid days)
  • Company pension scheme & sick pay scheme
  • Free eye test every 2 years
  • Access to Kinhub (wellbeing & financial support services)
  • Discounts with hundreds of retailers via Reward Gateway
  • Fulltime
Read More
Arrow Right
Remote jobs Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog Salaries About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy