CrawlJobs Logo

Technical Solution Management Specialist - AI Evaluation, Research, and Technical Architecture Func.

United States, Redmond 97600.00 - 188400.00 USD / Year · Job Posted June 29, 2026
Apply Position
Job Link Share

Job Description

With more than 45,000 employees and partners worldwide, the Customer Experience and Success (CE&S) organization is on a mission to empower customers to accelerate business value through differentiated customer experiences that leverage Microsoft's products and services, ignited by our people and culture. We drive cross-company alignment and execution, ensuring that we consistently exceed customers' expectations in every interaction, whether in-product, digital, or human-centered. CE&S is responsible for all up services across the company, including consulting, customer success, and support across Microsoft's portfolio of solutions and products. Join CE&S and help us accelerate AI transformation for our customers and the world. As part of the Experience Innovation Office team within CE&S, you'll help set the operational strategy and drive execution for technology initiatives impacting our front-line customer-facing roles, including Support Engineers, Supervisors, Customer Success Managers, and Professional Services professionals. You'll be part of a group that connects business strategy to delivery execution, optimizing systems for efficiency and impact, and ensuring our organization is ready for the future of AI-powered customer engagement. We are looking for a Technical Solution Management Specialist (TSM) - AI Evaluation, Research, and Technical Architecture Function to help establish the XIO AI Innovation Lab as a focused pre 0-to-1 research, validation, and handoff capability for CE&S AI innovation. This role is responsible for translating emerging AI signals, customer needs, Nebula/KM opportunities, and frontier technology patterns into validated research, reference architectures, evaluation plans, and Test Kitchen-ready Proof of Concept candidates. The TSM will implement a unified framework for hypothesis-driven research, comprehensive evaluation, rigorous testing, safe experimentation, and reusable publication while working closely with portfolio, engineering, data science, business, governance, and prototyping teams. This role will be pivotal in transforming how CE&S evaluates early AI opportunities by ensuring candidate solutions are researched, responsibly evaluated, technically grounded, and packaged for downstream prototyping or product engagement only when the evidence supports it. The TSM will work at the intersection of technology, business, research, and governance, driving innovation while safeguarding customer and employee experiences. The primary work location for this position is Redmond, Washington, with a hybrid work requirement of three days per week in the office. However, this role is also open to candidates located anywhere in the United States and may be performed remotely. Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Job Responsibility

  • Define and communicate a future-state vision for AI evaluation, research quality, and technical architecture across the XIO AI Innovation Lab.
  • Develop and maintain technical blueprints for research, validation, evaluation, experimentation, and Test Kitchen-ready handoff capabilities.
  • Define and maintain related processes and playbooks for scaling pre 0-to-1 motions using the lab flow: Signal -> Research -> Validation -> Research Paper -> PoC Candidate -> Test Kitchen.
  • Influence technical roadmaps for consistent product evaluation frameworks and tooling.
  • Track best practices, Microsoft product updates, frontier AI research, and emerging AI trends to inform lab strategy and publication direction.
  • Ensure alignment of evaluation frameworks with business priorities and Responsible AI standards.
  • Build and scale multi-dimensional evaluation approaches for diverse lab-stage AI workloads, including chatbots, customer self-service agents, predictive models, and generative tools.
  • Develop automated testing frameworks, including synthetic scenario generation, adversarial stress-testing, and batch evaluation.
  • Implement lab-appropriate experimentation patterns, including offline evaluation, synthetic scenario testing, feature-flagged trials where appropriate, and monitoring plans for downstream PoC owners.
  • Partner with engineering, data science, and prototyping teams to integrate evaluation tools into prototype scaffolds, CI/CD pipelines where relevant, and Test Kitchen handoff plans.
  • Develop reference architectures, data needs assessments, secure data pipeline considerations, hosting-model options, and reusable solution patterns for candidate AI solutions.
  • Package validated research into PoC candidate artifacts with value proposition, evidence, architecture, evaluation plan, governance considerations, and owner model.
  • Coordinate across business, technical, and governance teams to ensure successful delivery of evaluation programs.
  • Help establish and operate the XIO AI Innovation Lab as a lightweight research and validation capability, acting as a consultant and trainer for project teams.
  • Drive organizational adoption of best practices, shared infrastructure, common metrics, research publication standards, and Test Kitchen handoff discipline.
  • Support focused leadership alignment, research reviews, Demo Showcase updates, and handoffs to prototyping or product teams without slowing early-stage research autonomy.
  • Apply UX research principles to understand lived experiences and translate insights into actionable improvements for AI solutions.
  • Collaborate with domain experts, support engineers, CSU/account managers/CSAMs, and business owners to define success criteria and evaluation rubrics.
  • Lead direct customer and field-team engagements and collect performance metrics to inform continuous improvement and readiness for PG engagement.
  • Integrate Responsible AI evaluations, safety, ethics, and compliance checks into all testing and experimentation processes.
  • Manage gate reviews, documentation, risk findings, and RAI oversight appropriate to lab-stage research and Test Kitchen handoff readiness.
  • Foster a culture of 'fail fast, learn fast' with accountability and continuous improvement.
  • Embody our culture and values.

Requirements

  • Bachelor's Degree AND 4+ years experience in technical program management, preferably in AI, machine learning, research, data science, technical architecture, or customer experience domains. OR equivalent experience.
  • 2+ years of experience managing cross-functional and/or cross-team projects.

Nice to have

  • Bachelor's Degree AND 8+ years experience in technical program management, preferably in AI, machine learning, research, data science, technical architecture, or customer experience domains
  • OR product development
  • OR equivalent experience.
  • 6+ years of experience managing cross-functional and/or cross-team projects.
  • 1+ year(s) of experience reading and/or writing code (e.g., sample documentation, product demos).
  • Proven track record of AI evaluation, testing methodologies, and performance metrics.
  • Experience with automated testing pipelines, synthetic data generation, and A/B experimentation.
  • Familiarity with Responsible AI frameworks, governance, and compliance standards.
  • Demonstrated ability to produce research papers, decision-grade technical artifacts, reference architectures, or reusable solution patterns.
  • Ability to adapt strategy based on emerging technology trends, frontier AI research, customer signals, and industry research.
  • Comfort operating in ambiguous pre 0-to-1 environments and moving work from research to prototype-ready handoff.

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Technical Solution Management Specialist - AI Evaluation, Research, and Technical Architecture Func.

8 matching positions

New

Support Worker

Job Description: Support Worker Pay: £14.50 Refer a Friend Scheme - £250 award...
Location
Location
United Kingdom , Leeds
Salary
Salary:
14.50 GBP / Hour
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Have experience supporting individuals with autism and mental health needs
  • Understand trauma-informed care approaches
  • Can provide consistent, calm and reassuring support
  • Are able to recognise and respond sensitively to anxiety and compulsive behaviours
  • Can follow structured care plans and risk management strategies
  • Are confident working alongside external professionals where required
  • Experience in complex care, mental health, forensic or psychiatric settings
  • A strong understanding of autism and person-centred support
  • Ability to build trusting, therapeutic relationships
  • Confidence in working within structured support plans
Job Responsibility
Job Responsibility
  • Supporting a young woman with a diagnosis of Autism Spectrum Condition and Obsessive Compulsive Disorder (OCD), alongside a background of mental health and trauma-related needs
  • Enabling individuals to meet their personal goals, develop life and coping skills, form and maintain relationships and manage all aspects of daily life including personal care and medication, following PBS plans, care plans and risk assessments
  • Help build confidence and independence in daily living
  • Help express herself through creative and enjoyable activities
  • Help maintain emotional wellbeing and stability
  • Help engage safely in the community, including leisure activities
  • Help develop routines and structure that meet her needs
  • Help feel safe, understood and valued within her home
What we offer
What we offer
  • £250 when you introduce a Friend (Refer a Friend Scheme)
  • Competitve Pay
  • Pension Enrolment
  • Standard Sick Pay
  • Free training
  • Weekly pay
  • Paid holiday
  • Ongoing Training / Coaching throughout your role
  • Opportunities to progress & develop
  • Fulltime
Read More
Arrow Right
New

HR Generalist

We are looking for an HR Generalist to support day-to-day human resources operat...
Location
Location
United States , Olathe
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Prior experience in human resources and payroll administration is required
  • Familiarity with employee benefits coordination is strongly preferred
  • Proficiency with payroll platforms, including ADP or similar systems, and Microsoft Office is required
  • Strong organizational skills with the ability to manage multiple responsibilities independently
  • Clear written and verbal communication skills with a thoughtful approach to employee interactions
  • Ability to handle sensitive information with a high level of confidentiality and sound judgment
  • Careful attention to detail and consistent follow-through in completing assignments.
Job Responsibility
Job Responsibility
  • Administer payroll activities accurately and on schedule while maintaining organized employee records and related documentation
  • Coordinate employee benefits support, including enrollments, updates, and responses to routine questions from staff members
  • Lead onboarding tasks for new hires by preparing paperwork, facilitating orientation steps, and helping employees transition smoothly into the organization
  • Maintain HR policies, forms, and internal procedures to support compliance and consistent employment practices
  • Provide day-to-day employee relations support by addressing concerns appropriately and escalating sensitive matters when needed
  • Partner with leadership across both companies to assist with HR operations and workforce administration for a small employee population
  • Use payroll and Microsoft Office systems to track information, prepare reports, and manage HR-related administrative processes
  • Handle confidential personnel information with discretion while ensuring follow-through on deadlines and outstanding items.
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Client Engagement Coordinator

We’re searching for a fun, go-getter who thrives in a fast paced environment, ge...
Location
Location
United States , Dallas
Salary
Salary:
21.00 USD / Hour
smartcitylocating.com Logo
Smart City Locating
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High School Diploma or equivalent required
  • Associate's Degree recommended
  • 2+ years of experience in a customer experience, social media, or marketing role preferred
  • Experience managing inbound client communications preferred
  • Proficient in Google G-Suite
  • Proficient with CRM tools
  • Proficient with Apple products
  • Proficient with all social media platforms
  • Proficient in phone etiquette
Job Responsibility
Job Responsibility
  • Create a badass first impression and foster a fun, relevant brand personality through every interaction
  • Take ownership of managing communications for internal and external inquiries over social media and other channels
  • Manage lead distribution process
  • Qualify all inbound leads
  • Manage all assigned platforms
  • Uphold conversion targets
  • Uphold response time expectations
  • Solve client problems effectively
  • Act as a liaison between agents and their customers
  • Work cross departmentally & with leadership to identify issues and collaborate to find potential solutions
What we offer
What we offer
  • Eligibility for Bonus(es)
  • Eligibility for medical, dental, and vision coverage
  • 401(k) plan
  • Eligibility for company-paid life insurance
  • Short & long term disability
  • Parental leave
  • Flexible PTO
  • Company-Recognized Paid Holidays
  • Fulltime
Read More
Arrow Right
New

Support Worker

Are you passionate about making a genuine difference in a young person's life? W...
Location
Location
United Kingdom , Bracknell
Salary
Salary:
13.00 - 18.02 GBP / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
July 16, 2026
Flip Icon
Requirements
Requirements
  • Resilient, patient, and empathetic nature with a passion for supporting young people
  • Excellent communication skills and the ability to handle challenging situations calmly
  • Prior experience in health and social care, youth work, or supported living is a plus, but a great attitude and values-driven approach are most important
Job Responsibility
Job Responsibility
  • Prioritise Safety & Wellbeing: Ensure the physical and emotional safety of our young people remains paramount during this transition period
  • Build Independence: Mentor residents in developing everyday life skills (cooking, budgeting, managing appointments)
  • Support Pathways: Help young people engage with our unique apprenticeship and trade skill programmes to prepare them for independent living
  • Be a Trusted Adult: Provide a listening ear, set positive boundaries, and act as a reliable role model
What we offer
What we offer
  • Dedicated Consultants with experience in education
  • Recommend a friend bonus worth up to £300
  • online training
  • DBS and application support
  • Free parking
Read More
Arrow Right
New

Accounts Receivable Clerk/Jr. Accountant

We are looking for an Accounts Receivable Clerk/Jr. Accountant to support accura...
Location
Location
United States , Los Angeles
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 5 years of experience in accounts receivable and general accounting functions
  • Practical knowledge of billing, cash applications, account reconciliation, and commercial collections
  • Understanding of bookkeeping practices, accounting principles, and standard office procedures
  • Proficiency with Excel, Word, and accounting software such as Dynamics NAV or similar systems
  • Ability to investigate discrepancies, resolve payment-related issues, and maintain a high level of accuracy
  • Strong written and verbal communication skills for effective interaction with clients and internal teams
  • Well-developed organizational skills with the ability to manage multiple deadlines and shifting priorities
  • Bachelor's degree in Accounting is preferred, but equivalent practical experience will be considered
Job Responsibility
Job Responsibility
  • Build strong relationships with clients and respond to billing-related questions in a timely manner
  • Oversee the accuracy of invoicing records and keep customer billing information current within the accounting system
  • Prepare invoices, apply incoming payments, manage cash activity, and complete reporting tasks in line with contractual terms and required timelines
  • Review customer accounts to identify outstanding balances, payment delays, short payments, and other account discrepancies, then take appropriate follow-up action
  • Maintain organized receivable files and supporting documentation to ensure complete and accurate account records
  • Process customer remittances according to company procedures and assist with deposit preparation and cash receipt documentation
  • Research account issues, resolve client concerns, and coordinate any necessary account corrections or adjustments
  • Support collection activities by following up on overdue balances and helping implement effective recovery efforts
  • Contribute to month-end and year-end close by assisting with reconciliations, reporting, and other accounting support tasks
  • Analyze account activity and prepare recurring metrics and summaries for management review
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Temp Admin

We are currently recruiting for an experienced Administrator to join a prominent...
Location
Location
Australia , Sydney
Salary
Salary:
37.13 AUD / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
July 10, 2026
Flip Icon
Requirements
Requirements
  • Proven experience within a corporate administration or data entry role
  • Strong attention to detail and the ability to work efficiently under minimal supervision
  • High level of reliability and the capacity to commence work immediately
  • Full working rights in Australia (Working Holiday Visa holders are welcome to apply)
Job Responsibility
Job Responsibility
  • Processing and reviewing incoming credit application submissions
  • Conducting high-volume, accurate data entry and digital filing
  • Ensuring all submission documentation meets compliance and accuracy standards
  • Providing general administrative support to ensure efficient workflow management
  • Fulltime
Read More
Arrow Right
New

Accounts Receivable Clerk

We are looking for a detail-oriented Accounts Receivable Clerk to join a constru...
Location
Location
United States , Greenville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in accounts receivable, billing, or commercial collections
  • Ability to speak directly with customers about invoices, payment status, and account resolution
  • Strong customer service skills with the ability to handle sensitive financial conversations professionally
  • Self-motivated approach with the ability to think through issues and identify practical solutions
  • Working knowledge of Microsoft Office Suite, including Word, Outlook, and Excel
  • Comfortable using Excel for basic reporting tasks such as data entry, sorting, and filtering
  • Ability to manage multiple priorities accurately in a permanent work environment
Job Responsibility
Job Responsibility
  • Manage accounts receivable activities by preparing, issuing, and tracking customer invoices in a timely manner
  • Communicate with customers regarding outstanding balances and work professionally to resolve payment concerns or delays
  • Review account status and help coordinate flexible payment arrangements when customers need alternative solutions
  • Escalate complex collection matters through the appropriate process and collaborate with internal team members on next steps
  • Use Microsoft Word, Excel, and Outlook to organize information, generate reports, and maintain clear communication records
  • Update spreadsheets and reporting files by sorting, filtering, and entering receivables data accurately
  • Support billing-related processes and maintain documentation for customer contracts using Adobe-based files and records
  • Deliver a high level of customer service while building positive business relationships that support timely collections
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Store Supervisor

Location
Location
United Kingdom , Waltham Cross
Salary
Salary:
14279.20 - 14379.20 GBP / Year
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Someone who takes a huge pride in what they do
  • Retail Management/supervisory experience would be desirable
  • Flexible (your availability will be discussed at interview stage)
Job Responsibility
Job Responsibility
  • Ensure every customer receives excellent first class service, with a warm, friendly and helpful approach
  • Coach and support your team to the same customer service standard
  • Working in a busy and fast paced environment
  • Making sure that the shop floor looks great at all times
What we offer
What we offer
  • Holidays starting at 28 days which will increase to 33 days after 5 years service
  • Profit Share Scheme
  • 25% Discount on all our product range
  • Birthday Holiday
  • Opportunities for Progression and Development
  • Workplace pension including life cover
  • Access to services of the Retail Trust for emotional support, grants, legal and financial advice
  • Parttime
Read More
Arrow Right