Research Scientist, AI Controls and Monitoring Job at Scale (San Francisco)

Senior Generative AI Data Scientist

The Citi Innovation Lab is a leader in creating new ideas, innovative technology...

Location

Israel , Tel Aviv

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Ph.D., master’s or equivalent experience in a relevant field (Computer Science, Machine Learning, etc.)
Very strong experience in Machine Learning, delivering complex solutions to production
Proven hands-on experience in data science and Natural Language Processing (NLP), Natural Language Understanding (NLU) and Natural Language Generation (NLG)
Strong proven delivery track record
In-depth knowledge of deep learning frameworks such as TensorFlow, PyTorch, and other open sources libraries / APIs or similar
Proficiency in programming languages such as Python
Excellent problem-solving skills and the ability to think creatively
Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams
Publications and contributions to the AI research community are a plus
Experience in high tech or financial industry is beneficial but not mandatory.

Job Responsibility

Hands-On Leadership: Lead by example and actively contribute to the development and delivery of generative AI solutions, driving innovation and excellence within the team
Monitoring Ongoing Research: Stay actively engaged in monitoring ongoing research efforts, keeping abreast of emerging trends, and ensuring that the Generative AI team remains at the forefront of the field
Model Delivery to Production: Take a hands-on approach to ensure AI models are successfully deployed into production environments, meeting high-quality standards and performance benchmarks
Strategy Implementation: Execute the strategy for generative AI research and development, aligning it with the bank's overarching goals and objectives
Research and Development: Lead and participate in research activities to explore and advance state-of-the-art generative AI techniques, including GANs, VAEs, and other relevant technologies
Cross-Functional Collaboration: Ability to collaborate effectively with various teams, including product managers, engineers, and data scientists, to integrate AI technologies into products and services
Quality Control: Ensure the quality and performance of generative AI models, conducting rigorous testing and evaluation
Stakeholder Engagement: Work closely with business stakeholders across the bank to drive the adoption of generative AI and Large Language Models, identifying opportunities for innovation and value creation
Regulatory Compliance: Ensure that AI initiatives meet regulatory requirements while pushing the boundaries of technology innovation.

Fulltime

Senior Research Engineer

As a Senior Research Engineer at Microsoft, you will advance Microsoft’s mission...

Location

United States , Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor’s degree in Computer Science, Engineering, Mathematics, Statistics, Physics, or a related field and 4 or more years in applied ML or AI research and product engineering
OR Master’s degree and 3 or more years in applied ML or AI research and product engineering
OR PhD in a relevant field and 2 or more years with generative AI, LLMs, or related ML algorithms
Ability to meet Microsoft, customer and/or government security screening requirements
Microsoft Cloud Background Check upon hire/transfer and every two years thereafter

Job Responsibility

Bringing State-of-the-Art Research to Products
Design and implement AI systems using foundation models, prompt engineering, retrieval-augmented generation, multi-agent architectures, and classic ML
Fine-tune large language models on domain-specific data and evaluate via offline and online methods such as A/B testing, telemetry, and shadow deployments
Build and harden prototypes into production-ready services using robust software engineering and MLOps practices
Drive original research and thought leadership (whitepapers, internal notes, patents)
convert insights into shipped capabilities
Research Translation: Continuously review emerging work
identify high-potential methods and adapt them to Microsoft problem spaces
End-to-End System Development
ML Design & Architecture: Own end-to-end pipeline from data prep, training, evaluation, deployment, and feedback loops

Fulltime

New

Data Scientist/Machine Learning Engineer

The ML Solutions team is seeking a Data Scientist/Machine Learning Engineer to d...

Location

India , Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

8 to 13 years of Strong hands-on experience in Machine Learning, delivering complex solutions to production
Experience with Generative AI technologies essential
Understanding of concepts like supervised, unsupervised, clustering, embedding
Knowledge of NLP, Name Entity Recognition, Computer Vision, Transformers, Large Language Models
In-depth knowledge of deep learning and Generative AI frameworks such as, Langchain, Lang Graph, Crew AI or similar
Experience with and other open-source frameworks/ libraries/ APIs like Hugging Face Transformers, Spacy, Pandas, scikit-learn, NumPy, OpenCV
Experience in using Machine Learning/Deep Learning: XGBoost, LightGBM, TensorFlow, PyTorch, Keras
Proficiency in Python Software Development, following Object-Oriented design patterns and best practices
Strong background in mathematics: linear algebra, probability, statistics, and optimization
Experience with evaluation, scoring with framework like ML Flow

Job Responsibility

Hands-On Execution and Delivery: Actively contribute to the development and delivery of AI solutions, driving innovation and excellence within the team. Take a hands-on approach to ensure AI models are successfully deployed into production environments, meeting high-quality standards and performance benchmarks
Mentoring Young Talents: Mentoring team, guiding data analysts/ML engineers from concept to production. This involves fostering technical growth, providing project oversight, and ensuring adherence to best practices, ultimately building a high-performing and innovative team
Quality Control: Ensure the quality and performance of generative AI models, conducting rigorous testing and evaluation
Research and Development: Participate in research activities to explore and advance state-of-the-art generative AI techniques. Stay actively engaged in monitoring ongoing research efforts, keeping abreast of emerging trends, and ensuring that the Generative AI team remains at the forefront of the field
Cross-Functional Collaboration: Collaborate effectively with various teams, including product managers, engineers, and data scientists, to integrate AI technologies into products and services

Fulltime

ML Ops Engineer

The MLOps Engineer will work closely with the Data Science, Analytics, and Data ...

Location

United States

Salary:

127000.00 - 160550.00 USD / Year

Zelis

Expiration Date

Until further notice

Requirements

2–5 years of experience in ML Ops, ML Engineering, or a related role with a focus on production-level model monitoring, automation, and deployment
Strong experience with ML observability tools or custom-built monitoring systems
Experience with monitoring LLMs and Generative AI models, including prompt evaluation, hallucination tracking, and agent behavior auditing
Experience in deploying and managing ML workloads using containerization and orchestration platforms such as Docker, Kubernetes, Kubeflow, or TensorFlow Extended
Familiarity with AutoML pipelines and workflow management tools (e.g., MLflow, SageMaker Autopilot)
Experience working in cloud environments, preferably AWS (e.g., SageMaker, S3, Lambda, ECS/EKS)
Understanding of ML lifecycle tools (e.g., MLflow, SageMaker Pipelines) and CI/CD practices
Strong security and compliance awareness, particularly related to model/data governance (e.g., HIPAA, GDPR)
Proficiency in Python and key data libraries (Pandas, Numpy, Matplotlib, etc.)
Advanced SQL skills and experience with Snowflake or similar data warehousing platforms

Job Responsibility

Build and maintain monitoring infrastructure for conventional machine learning models, with capabilities for performance tracking, drift detection, and alerting
Research, evaluate, and implement monitoring strategies and tools for Generative AI systems, including LLMs and Agentic AI architectures
Collaborate with ML Engineers, Data Scientists, and DevOps teams to deploy, manage, and monitor models in production
Develop and support scalable, secure, and automated data pipelines using Snowflake, SQL, and Python for training, serving, and monitoring ML and GenAI models
Leverage AutoML tools and frameworks (e.g., MLflow, Kubeflow, SageMaker Autopilot) to streamline experimentation and deployment
Design dashboards and reporting systems to visualize model health metrics and surface key operational insights
Ensure auditability, reproducibility, and compliance for model performance and data flow in production environments, with consideration for regulatory standards like GDPR and HIPAA
Maintain CI/CD workflows and version-controlled codebases (e.g., Git) for ML infrastructure and pipelines
Utilize containerization and orchestration technologies (e.g., Docker) to manage scalable ML infrastructure
Leverage tools such as Streamlit and Python visualization libraries to present insights from model and data monitoring

What we offer

401k plan with employer match
flexible paid time off
holidays
parental leaves
life and disability insurance
health benefits including medical, dental, vision, and prescription drug coverage

Fulltime

Senior Software Engineer

As a Senior Research Engineer at Microsoft, you will advance Microsoft’s mission...

Location

India , Hyderabad

Salary:

Not provided

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor’s degree in Computer Science, Engineering, Mathematics, Statistics, Physics, or a related field and 4 or more years in applied ML or AI research and product engineering
Master’s degree and 3 or more years in applied ML or AI research and product engineering
PhD in a relevant field and 2 or more years with generative AI, LLMs, or related ML algorithms
Proficiency in Python and at least one deep learning framework such as PyTorch, JAX, or TensorFlow
Experience deploying Fine Tuned LLMs or multimodal models in live production environments
Experience shipping and maintaining production AI systems
Ability to meet Microsoft, customer, and government security screening requirements
Microsoft Cloud Background Check upon hire or transfer and every two years thereafter

Job Responsibility

Bringing State-of-the-Art Research to Products
Design and implement AI systems using foundation models, prompt engineering, retrieval-augmented generation, multi-agent architectures, and classic ML
Fine-tune large language models on domain-specific data and evaluate via offline and online methods such as A/B testing, telemetry, and shadow deployments
Build and harden prototypes into production-ready services using robust software engineering and MLOps practices
Drive original research and thought leadership (whitepapers, internal notes, patents)
convert insights into shipped capabilities
Research Translation: Continuously review emerging work
identify high-potential methods and adapt them to Microsoft problem spaces
End-to-End System Development
ML Design & Architecture: Own end-to-end pipeline from data prep, training, evaluation, deployment, and feedback loops

Fulltime

New

Senior Research Engineer

As a Senior Research Engineer at Microsoft, you will help advance Microsoft’s mi...

Location

United States , Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR equivalent experience
Proficiency in Python and at least one deep learning framework such as PyTorch, JAX, or TensorFlow
Experience deploying Fine Tuned LLMs or multimodal models in live production environments
Experience shipping and maintaining production AI systems
Ability to meet Microsoft, customer and/or government security screening requirements
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Job Responsibility

Build AI-First Contact Center Experiences
Bringing State-of-the-Art Research to Products
Design and implement AI systems using foundation models, prompt engineering, retrieval-augmented generation, multi-agent architectures, and classic ML
Fine-tune large language models on domain-specific data and evaluate via offline and online methods such as A/B testing, telemetry, and shadow deployments
Build and harden prototypes into production-ready services using robust software engineering and MLOps practices
Drive original research and thought leadership (whitepapers, internal notes, patents)
convert insights into shipped capabilities
Research Translation: Continuously review emerging work
identify high-potential methods and adapt them to Microsoft problem spaces
Partner with product teams to improve customer and agent outcomes

Fulltime

Senior Research Engineer

As a Senior Research Engineer at Microsoft, you will advance Microsoft’s mission...

Location

United States , Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
3+ years of experience using Python and at least one deep learning framework such as PyTorch, JAX, or TensorFlow
Experience deploying Fine Tuned LLMs or multimodal models in live production environments
Experience shipping and maintaining production AI systems
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Job Responsibility

Bringing State-of-the-Art Research to Products: Design and implement AI systems using foundation models, prompt engineering, retrieval-augmented generation, multi-agent architectures, and classic ML
Fine-tune large language models on domain-specific data and evaluate via offline and online methods such as A/B testing, telemetry, and shadow deployments
Build and harden prototypes into production-ready services using robust software engineering and MLOps practices
Drive original research and thought leadership (whitepapers, internal notes, patents)
convert insights into shipped capabilities
Research Translation: Continuously review emerging work
identify high-potential methods and adapt them to Microsoft problem spaces
End-to-End System Development: ML Design & Architecture: Own end-to-end pipeline from data prep, training, evaluation, deployment, and feedback loops
Identify and resolve model quality gaps, latency issues, and scale bottlenecks using PyTorch, or TensorFlow
Operate CI/CD and MLOps workflows including model versioning, retraining, evaluation, and monitoring

Fulltime

Senior Research Engineer

As a Senior Research Engineer at Microsoft, you will advance Microsoft’s mission...

Location

United States , Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Experience deploying Fine Tuned LLMs or multimodal models in live production environments
Experience shipping and maintaining production AI systems
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Job Responsibility

Bringing State-of-the-Art Research to Products
Design and implement AI systems using foundation models, prompt engineering, retrieval-augmented generation, multi-agent architectures, and classic ML
Fine-tune large language models on domain-specific data and evaluate via offline and online methods such as A/B testing, telemetry, and shadow deployments
Build and harden prototypes into production-ready services using robust software engineering and MLOps practices
Drive original research and thought leadership (whitepapers, internal notes, patents)
convert insights into shipped capabilities
Research Translation: Continuously review emerging work
identify high-potential methods and adapt them to Microsoft problem spaces
End-to-End System Development
ML Design & Architecture: Own end-to-end pipeline from data prep, training, evaluation, deployment, and feedback loops

Fulltime

Research Scientist, AI Controls and Monitoring

Scale

Location:
United States , San Francisco ▼
New York

Category:
Research and Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
March 22, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Research Scientist, AI Controls and Monitoring

Senior Generative AI Data Scientist

Senior Research Engineer

Data Scientist/Machine Learning Engineer

ML Ops Engineer

Senior Software Engineer

Senior Research Engineer

Senior Research Engineer

Senior Research Engineer

Research Scientist, AI Controls and Monitoring

Scale

Location:United States , San Francisco ▼New York

Category:Research and Development

Contract Type:Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:March 22, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Research Scientist, AI Controls and Monitoring

Senior Generative AI Data Scientist

Senior Research Engineer

Data Scientist/Machine Learning Engineer

ML Ops Engineer

Senior Software Engineer

Senior Research Engineer

Senior Research Engineer

Senior Research Engineer

Location:
United States , San Francisco ▼
New York

Category:
Research and Development

Contract Type:
Not provided

Job Posted:
March 22, 2026