Senior AI Scientist (LLM), Randstad

Senior AI Scientist (LLM)

Randstad

Location:
Singapore, Singapore

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

10000.00 - 16000.00 SGD / Month

Save Job

Apply Position

Job Description:

I am currently working with a company focusing on AI, LLM and Computer Vision. Salary structure: Base + bonus! Hybrid working arrangement- 2 days office, 3 days WFH. Office location at CBD. 4 rounds of interview to offer stage.

Job Responsibility:

Design and implement robust frameworks to evaluate the performance of generative AI systems, including text and multi-modal models for Large Language Models (LLMs), including but not limited to GPT-based models, BERT, T5, and other state-of-the-art architectures
Perform technical AI evaluations, benchmarking and “red-team” tests on LLM model, including assessing them for robustness in performance, embedded biases, vulnerability to jailbreaks and prompt injection attacks
Work with stakeholders to design strong LLM models, custom evaluation approaches and a suite of technical and analytical AI evaluation frameworks and tools
Define and refine metrics for evaluating model performance, such as perplexity, BLEU, ROUGE, accuracy, coherence, factual consistency, and bias detection
Lead efforts in curating and managing large, high-quality datasets for evaluating LLMs

Requirements:

Min 5 years of total working experience with min 2 years in building and deploying LLMs
Strong experience in evaluating LLMs using metrics such as perplexity, BLEU, ROUGE, and human-centered evaluation techniques
Proven track record of managing and analyzing large, complex language datasets, including text preprocessing and tokenization
Solid programming skills in Python and experience building automated pipelines for continuous model evaluation

What we offer:

bonus
Hybrid working arrangement- 2 days office, 3 days WFH

Additional Information:

Job Posted:
May 27, 2025

Expiration:
June 28, 2025

Employment Type:

Fulltime

Work Type:

Hybrid work

View All Jobs In This Company

Job Link Share:

Welcome to CrawlJobs.com –
Your Global Job Discovery Platform

At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.