Principal Software Engineer - CoreAI Model Inference & Serving Job at Microsoft Corporation (Redmond)

Principal Software Engineer, CoreAI Workload Engines

The CoreAI Workloads team builds the foundational inference engines and APIs tha...

Location

United States , Redmond

Salary:

139900.00 - 331200.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field and 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python, or equivalent experience
Proven ability to design and operate large-scale, production inference services with high reliability and performance requirements, and to ship performance improvements safely via disciplined experimentation
Strong skills in performance analysis: benchmarking, profiling, diagnosing regressions, and turning results into concrete engine/runtime changes
Strong problem-solving skills and the ability to debug complex, cross layer systems issues
Demonstrated technical leadership, including mentoring engineers, driving cross-team architectural alignment, and leveraging AI tools and AI-assisted workflows to accelerate engineering velocity and quality
Hands-on experience with Kubernetes (building and operating services on k8s), including debugging production issues and designing platform abstractions (e.g., custom resources/controllers) and scheduling-aware deployments (e.g., node affinity, taints/tolerations, resource requests/limits)
Strong collaboration and communication skills, with the ability to work across organizational boundaries

Job Responsibility

Optimize inference engines for OpenAI and open-source models by implementing and shipping performance/efficiency improvements across runtime, scheduling, and serving paths (latency, throughput, utilization, availability, and cost)
Run experiments end-to-end: formulate hypotheses, implement engine changes (including Python/PyTorch integration points where relevant), analyze results, and ship improvements behind guardrails
Build and use experimentation capabilities for large-scale AI inference (experiment lifecycle, tracking, metric modeling, comparability standards, automated analysis) so the team can iterate quickly and safely
Own serving availability and efficiency for Azure OpenAI Service workloads through tiered experimentation, lean segmentation, and multi-modal utilization across heterogeneous fleets—turning findings into shipped engine improvements
Design and evolve inference serving architectures to improve utilization and latency using techniques such as disaggregated serving, multi-token prediction, KV offload/retrieval, and quantization—validated via staged rollouts and production guardrails
Extend AI infrastructure abstractions to support elastic, heterogeneous inference engines reliably at scale (e.g., dynamic scaling across model families, modalities, and workload classes while maintaining isolation and SLOs)
Tune and scale inference engines across NVIDIA GPU generations (A100, H100, H200) for state-of-the-art OpenAI models, focusing on serving efficiency, utilization, and reliability (not hardware bring-up)
Partner with networking and storage teams to leverage high-performance interconnects (e.g., RDMA/InfiniBand-class fabrics such as RoCE over IB) for distributed inference, without owning low-level kernel/driver enablement
Drive end-to-end features from design through production: observability, diagnostics, performance regression detection, and operational excellence for inference serving
Influence platform architecture and technical direction across teams through design reviews, clear metrics, and technical leadership focused on experimentation velocity and production reliability

Fulltime

Principal Product Manager/Architect - Foundry Inference Platform (CoreAI)

We are seeking a Principal Product Manager/Architect to define and guide the tec...

Location

United States , Redmond

Salary:

163000.00 - 296400.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree AND 10+ years experience in product/service/program management or software development OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements
Microsoft Cloud Background Check

Job Responsibility

1. Product Reliability: Own the product direction for Microsoft Foundry inference, with a primary mandate to make the platform the most reliable enterprise inferencing service available. This includes defining architectural standards for global serving, multi-region resiliency, automated failover, and platform-managed disaster recovery
Drive architectural alignment across global routing, capacity pooling, observability, and control plane abstractions to ensure consistent availability, predictable recovery behavior, and simplified customer operations at scale
Partner with engineering, infrastructure, and security leaders to ensure reliability targets, SLAs, SLOs and recovery objectives are designed into the platform by default
2. GPU Fleet Efficiency & Capacity: Set the product direction for GPU fleet efficiency and capacity management, guiding platform-level design decisions that maximize utilization, minimize fragmentation, and accelerate timetomonetization of new hardware and models
This includes shaping the architecture for global capacity pooling, intelligent scheduling, fungibility across workloads, automated demand forecasting, and softwaredefined allocation
The Product Manager/Architect is expected to influence architectural investments across inference utilization, model serving, and hardware/system performance
3. Strategic Customer & Innovation Engagement: Act as a senior technical advisor and architect for Foundry’s most innovative and strategic customers
Engage directly with customers on deep technical challenges, including largescale model migrations, reliabilitysensitive production deployments, and advanced serving architectures
Support competitive and strategic initiatives by articulating Foundry’s architectural advantages, turning bespoke requests into scalable features
4. Cross-Company Technical Leadership: Serve as a unifying architectural voice across product management, engineering, infrastructure, and partner teams

Fulltime

New

IT Training Lead

The IT Training Lead will drive technology learning and user adoption across the...

Location

United States , Delray Beach

Salary:

Not provided

Robert Half

Expiration Date

Until further notice

Requirements

Experience in IT training, instructional design, technical enablement, or learning and development
Strong knowledge of Microsoft 365
Excellent communication, facilitation, and content development skills
Ability to translate technical concepts into practical, user-friendly training.

Job Responsibility

Design, develop, and deliver IT training programs in instructor-led, virtual, and self-paced formats
Take lead in the Microsoft Copilot and AI training strategy, including onboarding, advanced use cases, responsible AI usage, and ongoing enablement
Partner with IT leadership to support new technology rollouts, system upgrades, and digital transformation initiatives
Create and maintain training content, including videos, guides, tutorials, and job aids
Identify skill gaps and develop targeted learning solutions to improve adoption and productivity
Gather feedback and measure training effectiveness to continuously improve programs.

New

K Kitchen Representative

The position includes, but is not limited to, the following essential job duties...

Location

United States , New Albany

Salary:

Not provided

Circle K

Expiration Date

Until further notice

Requirements

Excellent communication skills
Team player who can work well with others or independently
Acts with integrity
keeps commitments
Contagious positive attitude
Focuses on achieving results while having fun
Frequently bend, twist at waist, kneel, squat, stand, and walk
Occasionally climb and descend ladders
Tolerate extreme cold and hot temperatures and work in and around fryers, ovens, grills, coolers, freezers, sharp objects, and loud noises
Reach, grasp, and manipulate objects with hands for entire shift, including reaching for objects overhead

Job Responsibility

Provides excellent guest service in a fast and friendly manner
Maintains a clean restaurant environment by cleaning and performing general housekeeping duties
Prepares and serves food items in accordance with all Brand, Company, and health department regulations
Ensures product quality, food safety, and operational standards are met
Keeps accurate cash, sales, and inventory control records
Follows all government laws and safety codes
Completes reports on all incidents following our 5-minute rule policy
Lives our Company values: One Team, Do the Right Thing, Takes Ownership, Play to Win

What we offer

Medical, Dental, Vision, Term Life and AD&D plans
Flexible spending and health savings accounts (FT)
Vacation paid time off
Company holidays paid at time and a half
Matching 401(k)
Tuition Reimbursement
Stock Purchase Plan
Employee Discount Program
Discount Meal Benefit
Wellness Plan

New

K Kitchen Representative

Location

United States , Decatur

Salary:

Not provided

Circle K

Expiration Date

Until further notice

Requirements

Excellent communication skills
Team player who can work well with others or independently
Acts with integrity
keeps commitments
Contagious positive attitude
Focuses on achieving results while having fun
Frequently bend, twist at waist, kneel, squat, stand, and walk
Occasionally climb and descend ladders
Tolerate extreme cold and hot temperatures and work in and around fryers, ovens, grills, coolers, freezers, sharp objects, and loud noises
Reach, grasp, and manipulate objects with hands for entire shift, including reaching for objects overhead

Job Responsibility

Provides excellent guest service in a fast and friendly manner
Maintains a clean restaurant environment by cleaning and performing general housekeeping duties
Prepares and serves food items in accordance with all Brand, Company, and health department regulations
Ensures product quality, food safety, and operational standards are met
Keeps accurate cash, sales, and inventory control records
Follows all government laws and safety codes
Completes reports on all incidents following our 5-minute rule policy
Lives our Company values: One Team, Do the Right Thing, Takes Ownership, Play to Win

What we offer

Medical, Dental, Vision, Term Life and AD&D plans
Flexible spending and health savings accounts (FT)
Vacation paid time off
Company holidays paid at time and a half
Matching 401(k)
Tuition Reimbursement
Stock Purchase Plan
Employee Discount Program
Discount Meal Benefit
Wellness Plan

New

Restaurant Assistant Manager

This position assists the Restaurant Manager (RM) with daily operations of the r...

Location

United States , Holly Springs

Salary:

Not provided

Circle K

Expiration Date

Until further notice

Requirements

Full time required
availability during all hours of operation and at least one hour pre-opening and post-closing required
Valid state Driver's License required
Excellent communication skills
Motivates, coaches, and leads team members
Acts with integrity
keeps commitments
Contagious positive attitude
Focuses on achieving results while having fun
Ability to gain control during stressful situations

Job Responsibility

Assists the Restaurant Manager with daily operations of the restaurant and supervises the team in their absence
Leads and coaches Restaurant Team Members and partners with the management team to maintain the Company and Brand operational standards
Provides excellent guest service in a fast and friendly manner
coaches and corrects team
Conducts second interviews for team members and shift leads
Maintains a clean restaurant environment by cleaning and performing general housekeeping duties
Assigns shift duties to team members and follows up to ensure completion
Directs team and ensures all food items are prepared and served in accordance with all Brand, Company, and health department regulations
Coaches team members to follow guidelines for food preparation and production management
Cascades relevant information to team members and assists with new product training

What we offer

Unlimited tip pooling
Medical, Dental, Vision, Term Life and AD&D plans
Flexible spending and health savings accounts
Short-Term Disability
Vacation paid time off
Company holidays paid at time and a half
Matching 401(k)
Tuition Reimbursement
Stock Purchase Plan
Employee Discount Program

Fulltime

New

Plant Operator - Crushing and Screen

Are you an experienced and ticketed Machine Operator looking for stable, high-ho...

Location

Australia , Petrie

Salary:

42.00 - 52.00 AUD / Hour

Randstad

Expiration Date

July 09, 2026

Requirements

Proven Experience working in a quarry, concrete recycling, or heavy industrial yard
Current tickets for Front-End Loader (LL) and Excavator (LE)
Truck License: Heavy Rigid (HR) or higher is highly regarded
Reliability with strong work ethic and punctuality
Own reliable vehicle and current driver's license

Job Responsibility

Safe and efficient operation of heavy machinery in a fast-paced recycling and quarry environment
Operating Front-End Loaders
Operating Excavators utilized as material handlers
Operating Moxy (Articulated Dump Trucks) and other yard machinery as required
Assisting with daily machinery pre-starts, basic maintenance, and ensuring the yard runs smoothly
Adhering strictly to site health and safety protocols

What we offer

Top Rates: $42.00 to $52.00 per hour + overtime penalties
Big Hours: Consistent 40 to 55-hour work weeks
Career Progression: Pathway from casual to permanent full-time employment within 3-6 months
Local Work: Convenient Brisbane Northside location (Petrie)
Immediate Start

Fulltime

Graduate Student Instructors

Location

United States , Ann Arbor

Salary:

Not provided

University of Michigan

Expiration Date

Until further notice

Requirements

Enrolled in good standing as a graduate student at the University of Michigan
Available to teach the scheduled section times
Have previously taken at least 1 philosophy course (or equivalent course) in this general area as an undergraduate or graduate student, and have demonstrated expertise and interest in subject area
Experience with Canvas
If the language of instruction at a student's undergraduate institution was not English, they must be evaluated by the English Language Institute (ELI) for English proficiency and either pass the GSI-OET or have this test waived by the ELI before they can be eligible for a GSI appointment in LS&A.

Job Responsibility

Attend all lectures and exams for your preferred course
Run discussion sections as scheduled
Hold at least 2 office hours each week
Grade assignments, per lead faculty instruction
Meet weekly with the lead instructor, and respond promptly to emails
Additional items listed in fraction calculation form

Parttime

Select Country

Principal Software Engineer - CoreAI Model Inference & Serving

Job Description

Job Responsibility

Requirements

Nice to have

Looking for more opportunities?