Senior Software Engineer - CoreAI Model Inference & Serving Job at Microsoft Corporation (Redmond)

Senior Software Engineer, CoreAI Workload Engines

The CoreAI Workloads team builds the foundational inference engines and APIs tha...

Location

United States , Redmond

Salary:

119800.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field and 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python, or equivalent experience.
Proven ability to design and operate large-scale, production inference services with high reliability and performance requirements, and to ship performance improvements safely via disciplined experimentation.
Strong skills in performance analysis: benchmarking, profiling, diagnosing regressions, and turning results into concrete engine/runtime changes.
Strong problem-solving skills and the ability to debug complex, cross layer systems issues.
Demonstrated technical leadership, including mentoring engineers, driving cross-team architectural alignment, and leveraging AI tools and AI-assisted workflows to accelerate engineering velocity and quality.
Hands-on experience with Kubernetes (building and operating services on k8s), including debugging production issues and designing platform abstractions (e.g., custom resources/controllers) and scheduling-aware deployments (e.g., node affinity, taints/tolerations, resource requests/limits).
Strong collaboration and communication skills, with the ability to work across organizational boundaries.

Job Responsibility

Optimize inference engines for OpenAI and open-source models by implementing and shipping performance/efficiency improvements across runtime, scheduling, and serving paths (latency, throughput, utilization, availability, and cost).
Run experiments end-to-end: formulate hypotheses, implement engine changes (including Python/PyTorch integration points where relevant), analyze results, and ship improvements behind guardrails.
Build and use experimentation capabilities for large-scale AI inference (experiment lifecycle, tracking, metric modeling, comparability standards, automated analysis) so the team can iterate quickly and safely.
Own serving availability and efficiency for Azure OpenAI Service workloads through tiered experimentation, lean segmentation, and multi-modal utilization across heterogeneous fleets—turning findings into shipped engine improvements.
Design and evolve inference serving architectures to improve utilization and latency using techniques such as disaggregated serving, multi-token prediction, KV offload/retrieval, and quantization—validated via staged rollouts and production guardrails.
Extend AI infrastructure abstractions to support elastic, heterogeneous inference engines reliably at scale (e.g., dynamic scaling across model families, modalities, and workload classes while maintaining isolation and SLOs).
Tune and scale inference engines across NVIDIA GPU generations (A100, H100, H200) for state-of-the-art OpenAI models, focusing on serving efficiency, utilization, and reliability (not hardware bring-up).
Partner with networking and storage teams to leverage high-performance interconnects (e.g., RDMA/InfiniBand-class fabrics such as RoCE over IB) for distributed inference, without owning low-level kernel/driver enablement.
Drive end-to-end features from design through production: observability, diagnostics, performance regression detection, and operational excellence for inference serving.
Influence platform architecture and technical direction across teams through design reviews, clear metrics, and technical leadership focused on experimentation velocity and production reliability.

What we offer

Benefits and other compensation

Fulltime

Principal Product Manager/Architect - Foundry Inference Platform (CoreAI)

We are seeking a Principal Product Manager/Architect to define and guide the tec...

Location

United States , Redmond

Salary:

163000.00 - 296400.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree AND 10+ years experience in product/service/program management or software development OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements
Microsoft Cloud Background Check

Job Responsibility

1. Product Reliability: Own the product direction for Microsoft Foundry inference, with a primary mandate to make the platform the most reliable enterprise inferencing service available. This includes defining architectural standards for global serving, multi-region resiliency, automated failover, and platform-managed disaster recovery
Drive architectural alignment across global routing, capacity pooling, observability, and control plane abstractions to ensure consistent availability, predictable recovery behavior, and simplified customer operations at scale
Partner with engineering, infrastructure, and security leaders to ensure reliability targets, SLAs, SLOs and recovery objectives are designed into the platform by default
2. GPU Fleet Efficiency & Capacity: Set the product direction for GPU fleet efficiency and capacity management, guiding platform-level design decisions that maximize utilization, minimize fragmentation, and accelerate timetomonetization of new hardware and models
This includes shaping the architecture for global capacity pooling, intelligent scheduling, fungibility across workloads, automated demand forecasting, and softwaredefined allocation
The Product Manager/Architect is expected to influence architectural investments across inference utilization, model serving, and hardware/system performance
3. Strategic Customer & Innovation Engagement: Act as a senior technical advisor and architect for Foundry’s most innovative and strategic customers
Engage directly with customers on deep technical challenges, including largescale model migrations, reliabilitysensitive production deployments, and advanced serving architectures
Support competitive and strategic initiatives by articulating Foundry’s architectural advantages, turning bespoke requests into scalable features
4. Cross-Company Technical Leadership: Serve as a unifying architectural voice across product management, engineering, infrastructure, and partner teams

Fulltime

Data Engineer

Design, build, and maintain scalable data pipelines and ETL/ELT processes. Devel...

Location

United States , Austin

Salary:

Not provided

Robert Half

Expiration Date

Until further notice

Requirements

3+ years of experience in data engineering, data integration, or a related role
Strong proficiency in SQL and experience working with large, complex datasets
Experience building and maintaining ETL/ELT data pipelines
Proficiency in at least one programming language (Python, Java, Scala, or similar)
Hands‑on experience with data warehouses and data platforms (Snowflake, Redshift, BigQuery, Databricks, etc.)
Experience working in cloud environments (AWS, Azure, or GCP)
Familiarity with data modeling, schema design, and performance optimization
Experience integrating data from APIs, databases, and streaming sources
Strong problem‑solving and troubleshooting skills related to data pipelines and performance
Ability to collaborate with data analysts, data scientists, and business stakeholders

Job Responsibility

Design, build, and maintain scalable data pipelines and ETL/ELT processes
Develop and manage data architectures such as data warehouses, data lakes, and lakehouses
Ingest and integrate data from multiple sources (databases, APIs, streaming platforms)
Ensure data quality, integrity, and reliability across systems
Optimize data processing, storage, and query performance
Collaborate with data analysts, data scientists, and business teams to support analytics and reporting needs
Implement automation for data workflows, monitoring, and error handling
Troubleshoot and resolve data pipeline issues and performance bottlenecks
Support batch and real‑time data processing frameworks
Document data models, pipelines, and data engineering processes

What we offer

medical
vision
dental
life and disability insurance
enrollment in company 401(k) plan

Data Engineer

We are seeking a Data Engineer with strong experience in Microsoft Azure and Dat...

Location

United States , Jacksonville

Salary:

Not provided

Robert Half

Expiration Date

Until further notice

Requirements

5+ years of Data Engineering experience
Hands-on experience with Azure Databricks
Experience with Azure services such as: Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Azure SQL Database
Strong SQL development skills
Experience with Python, PySpark, or Spark
Experience building and maintaining ETL/ELT pipelines
Understanding of data warehousing concepts and dimensional modeling
Experience working with large datasets in cloud environments

Job Responsibility

Design, develop, and maintain scalable data pipelines in Azure and Databricks
Build and optimize ETL/ELT processes for structured and unstructured data
Develop and support data lake, data warehouse, and analytics solutions
Integrate data from multiple internal and external sources
Collaborate with business analysts, data scientists, and stakeholders to understand data requirements
Ensure data quality, integrity, security, and governance standards are met
Monitor and troubleshoot data workflows and performance issues
Create and maintain technical documentation and data models
Support reporting and analytics initiatives by delivering reliable datasets

What we offer

medical
vision
dental
life and disability insurance
401(k) plan

High Court Enforcement Officer (Certificated)

Certificated High Court Enforcement Officer – Field Agent Enforcement Services |...

Location

United Kingdom , Lancaster

Salary:

200.00 - 250.00 GBP / Day

360 Resourcing Solutions

Expiration Date

Until further notice

Requirements

Certificated Enforcement Agent and hold a valid certificate
Full UK driving licence and access to a vehicle with business insurance
ULEZ-compliant vehicle (for London assignments if applicable)
Clean DBS check
Satisfactory credit history (CCJs accepted where repayment arrangements exist)
Excellent communication, negotiation, and conflict management skills
Strong planning, problem-solving, and reporting abilities
Ability to work independently while collaborating with teams and clients
Understanding of energy, utilities, or enforcement operations is advantageous
Experience in enforcement, security, debt recovery, or other customer-facing and field-based roles requiring negotiation, resilience, and professionalism is highly desirable.

Job Responsibility

Enforce court writs on behalf of clients and local authorities
Recover debts or seize goods where appropriate, with professionalism
Negotiate and agree payment arrangements with empathy and clarity
Maintain detailed case records and meet performance targets
Represent Engage Services and Marston Holdings with integrity, discretion, and fairness
Must be Certified, with valid certificate and on The Certificated Enforcement Agent

What we offer

Daily OTE £200+ (based on skills and experience)
Flexible working arrangement: A minimum commitment of 2 days per week, at 8 hours per day, with the freedom to select your preferred working days
Training & continuous professional development provided
UK-wide opportunities, allocated within your agreed postcode area
Career progression: Explore diverse roles within Engage Services
Supportive environment: Full guidance, resources, and mentoring

Parttime

Care Worker - Evenings and Weekends

Choices Homecare are seeking compassionate Domiciliary Care Workers for our loca...

Location

United Kingdom , Wakefield

Salary:

13.82 GBP / Hour

360 Resourcing Solutions

Expiration Date

Until further notice

Requirements

Caring, compassionate approach
commitment to putting people first
excellent communication and teamwork skills
experience preferred but not essential – full training provided
UK Driving licence and own vehicle is essential within certain routes/locations
alternative weekend availability

Job Responsibility

Supporting individuals with personal care needs such as washing, dressing, and toileting
assisting with medication administration and documentation in line with care plans
preparing meals and assisting with eating and drinking where required
promoting independence and encouraging service users to engage in daily living tasks
building positive relationships with individuals and their families
supporting emotional well-being and recognising signs of distress or changes in behaviour
maintaining accurate records and communicating effectively with colleagues and supervisors
ensuring a clean, safe, and comfortable environment in the home
respecting confidentiality and always maintaining professional boundaries

What we offer

Flexible Working: Full-time, part time or permanent contracts with flexibility to accommodate work-life balance
Comprehensive Training: Optimo learning academy - Ongoing training and development
Career Progression: Opportunities for career advancement
Supportive Team Environment
Employee Assistance Program
Reward Gateway
£500 Refer-a-Friend Scheme

Parttime

Mobile Associate - Retail Sales

This role supports retail operations by engaging customers and facilitating thei...

Location

United States , Kimball

Salary:

18.00 - 20.00 USD / Hour

T-Mobile

Expiration Date

Until further notice

Requirements

High School Diploma/GED (Required)
6 months of customer service and/or sales experience, Retail environment. (Preferred)
Change Agility (Required)
Communication (Required)
Customer Problem Solving (Required)
Customer Service (Required)
Engaging People (Required)
Multitasking (Required)
Sales (Required)
Teamwork Orientation (Required)

Job Responsibility

Develop proficiency in customer service and sales to deliver personalized technology and service solutions that meet individual needs
Utilize digital tools to demonstrate network coverage, service plans, and product features to enhance customer understanding and engagement
Complete required training to build knowledge of retail processes, systems, and wireless technology innovations
Collaborate with colleagues across channels to support a seamless customer experience and contribute to team initiatives
Also responsible for other duties/projects as assigned by business management as needed

What we offer

Competitive base salary
Annual stock grant
Employee stock purchase plan
401(k)
Free year-round money coaches
Medical insurance
Dental insurance
Vision insurance
Flexible spending account
Paid time off

Parttime

Receptionist

About Us Metropolitan Gaming is about more than the games or the buzz of the ven...

Location

United Kingdom , Manchester

Salary:

25480.00 GBP / Year

360 Resourcing Solutions

Expiration Date

Until further notice

Requirements

Aged 18 or above
right to work in the UK
flexible scheduling for nights, evenings, weekends, and shifts
ability to spend large portion of shift on feet working directly with the public

Job Responsibility

Meet and greet customers, assisting with any queries
Ensure all customers are dealt with in an efficient and courteous manner
Look for opportunities to engage with customers, explaining benefits of player rewards and assisting sign up followed by demonstration of player rewards journey
Receive and log telephone calls and other communications to the venue

What we offer

Discounts and perks across travel, retail, hospitality and wellbeing
Company pension scheme and life insurance cover
Discount on Food and non-alcoholic beverages across all venues
Season ticket loan and cycle to work scheme
Refer a friend bonus reward

Fulltime

Select Country

Senior Software Engineer - CoreAI Model Inference & Serving

Job Description

Job Responsibility

Requirements

Looking for more opportunities?