CrawlJobs Logo

Senior Databricks ML & AI Engineer

· Job Posted June 29, 2026
Apply Position
Job Link Share

Requirements

  • 5+ years of hands-on Machine Learning Engineering, MLOps, or AI Engineering experience within enterprise production environments
  • Extensive experience designing and deploying Databricks Lakehouse solutions using Delta Lake, Unity Catalog, MLflow, Databricks SQL, Workflows, and Delta Live Tables
  • Strong programming expertise in Python, PySpark, Pandas, NumPy, and modern software engineering best practices
  • Experience building, training, deploying, and monitoring machine learning models using PyTorch, TensorFlow, scikit-learn, XGBoost, or similar ML frameworks
  • Proven experience implementing end-to-end MLOps pipelines including experiment tracking, model registry, automated retraining, model deployment, and production monitoring
  • Hands-on experience developing Generative AI (GenAI) and Large Language Model (LLM) solutions, including RAG architectures, prompt engineering, LangChain, LlamaIndex, or Databricks Mosaic AI
  • Experience implementing Vector Search, embeddings, semantic search, and AI retrieval pipelines using Databricks or similar vector database technologies
  • Strong understanding of Apache Spark internals, distributed computing, performance tuning, partitioning, memory management, and large-scale data processing
  • Experience with cloud platforms including AWS, Azure, or Google Cloud Platform, supporting enterprise AI and machine learning workloads
  • Experience implementing CI/CD pipelines, GitHub Actions, Azure DevOps, Databricks Asset Bundles, and modern DevOps automation practices
  • Hands-on experience with Docker, Kubernetes, Terraform, or Pulumi supporting Infrastructure-as-Code and scalable AI platform deployments
  • Experience working with Delta Lake optimization, Unity Catalog governance, data lineage, access controls, and enterprise data governance practices
  • Strong experience monitoring model performance, model drift, data quality, observability, and production SLAs using tools such as Prometheus, Grafana, or Databricks Lakehouse Monitoring
  • Demonstrated ability to collaborate with Data Scientists and Data Engineers to productionize AI and machine learning solutions while conducting code reviews, architecture reviews, and technical mentoring
  • Experience supporting modern AI ecosystems including Feature Store, Databricks Model Serving, Kafka, Spark Structured Streaming, Lakehouse Architecture, and responsible AI or ML governance practices

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Databricks ML & AI Engineer

8 matching positions

Senior Staff Data Engineer- ML & AI Platform

At Marktplaats, data is at the heart of everything we do, but Intelligence is wh...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience with a specific focus on the intersection of Data Engineering, MLOps, and AI Infrastructure
  • Deep knowledge of Spark internals, structured streaming, and performance tuning for large-scale data processing
  • Proven experience architecting end-to-end ML platforms for Traditional ML (Classic MLOps) while actively enabling the organization on Generative AI concepts
  • Strong background in building automated pipelines and ensuring system observability
  • Practical experience building infrastructure for Large Language Models, including managing the complexity of chaining models and tools
  • Solid experience serving models at low latency and high concurrency using containerized solutions
  • Ability to speak the language of AI/ML Engineers and effectively bridge the gap between experimental code and production systems
  • Expert level Python
  • Experience with PyTorch, Terraform, Terragrunt, Docker, Kubernetes, GitHub Actions, Datadog
  • Experience with Databricks AI Stack: MLflow, Mosaic AI, Unity Catalog, Feature Store, Databricks Model Serving, Vector Databases
Job Responsibility
Job Responsibility
  • Lead the evolution of our Machine Learning & AI Platform, designing the architecture for AI Agents and establishing patterns for Vector Databases
  • Act as a first mover: validate new Databricks features and integrate them into the platform
  • Write the guidelines for GenAI development, helping teams transition from notebook experiments to production-grade LLM applications
  • Design the Feature Store, manage the Model Registry, and set up the infrastructure for Vector Search and RAG (Retrieval Augmented Generation) workflows
  • Elevate the technical bar of the team, mentoring Staff and Senior engineers on design patterns, code quality, and architectural decisions
  • Translate complex requirements from ML Engineers and Data Scientists into robust engineering tickets and infrastructure roadmaps
What we offer
What we offer
  • An attractive Base Salary
  • Participation in our Short Term Incentive plan (annual bonus)
  • Work From Anywhere: Enjoy up to 20 days a year of working from anywhere
  • A 24/7 Employee Assistance Program for you and your family
  • Fulltime
Read More
Arrow Right

Senior Staff Data Engineer- ML & AI Platform

At Marktplaats, data is at the heart of everything we do, but Intelligence is wh...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience with a specific focus on the intersection of Data Engineering, MLOps, and AI Infrastructure
  • Deep knowledge of Spark internals, structured streaming, and performance tuning for large-scale data processing
  • Proven experience architecting end-to-end ML platforms for Traditional ML (Classic MLOps) while actively enabling the organization on Generative AI concepts
  • Strong background in building automated pipelines and ensuring system observability
  • Practical experience building infrastructure for Large Language Models, including managing the complexity of chaining models and tools
  • Solid experience serving models at low latency and high concurrency using containerized solutions
  • Ability to speak the language of AI/ML Engineers and effectively bridge the gap between experimental code and production systems
Job Responsibility
Job Responsibility
  • Lead the evolution of our Machine Learning & AI Platform, designing the architecture for AI Agents and establishing patterns for Vector Databases
  • Act as a first mover, validate new Databricks features and integrate them into the platform
  • Write the guidelines for GenAI development, helping teams transition from notebook experiments to production-grade LLM applications
  • Design the Feature Store, manage the Model Registry, and set up the infrastructure for Vector Search and RAG (Retrieval Augmented Generation) workflows
  • Elevate the technical bar of the team, mentoring Staff and Senior engineers on design patterns, code quality, and architectural decisions
  • Translate complex requirements from ML Engineers and Data Scientists into robust engineering tickets and infrastructure roadmaps
What we offer
What we offer
  • An attractive Base Salary
  • Participation in our Short Term Incentive plan (annual bonus)
  • Work From Anywhere: Enjoy up to 20 days a year of working from anywhere
  • A 24/7 Employee Assistance Program for you and your family
  • A collaborative environment with an opportunity to explore your potential and grow
  • Fulltime
Read More
Arrow Right

Senior AI Engineer

As a leader in cybersecurity, Rapid7 is expanding our global AI footprint and is...
Location
Location
United Kingdom , Belfast
Salary
Salary:
Not provided
rapid7.com Logo
Rapid7
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven expertise in building and deploying AI systems in production using Python and modern ML frameworks
  • Hands-on experience with tools such as: scikit-learn, PyTorch, or TensorFlow for model development
  • AWS Bedrock, Sagemaker, HuggingFace, or equivalent cloud AI stacks
  • CrewAI or other orchestration frameworks for agentic AI systems
  • Pandas, NumPy, Airflow, or Databricks for data engineering and workflow automation
  • Understanding of model lifecycle management, including monitoring, retraining, and versioning
  • Ability to evaluate trade-offs between model performance, latency, and interpretability
  • Strong written & verbal communication with the ability to convey complex ideas clearly to both technical and non-technical audiences
Job Responsibility
Job Responsibility
  • Develop and ship high-quality AI systems that deliver measurable customer value
  • Lead the technical implementation of specific AI projects, from prototyping through deployment
  • Collaborate closely with product, data science, and platform teams to design, build, and ship AI-powered features that deliver measurable customer and business value
  • Contribute to the development of best practices for model experimentation, evaluation, and observability
  • Mentor and support team members in areas like architecture, model design, and debugging
  • Maintain awareness of emerging AI methods relevant to cybersecurity and share learnings internally
  • Fulltime
Read More
Arrow Right

ML Engineer Senior - GenAI Solutions

As a Senior Machine Learning Engineer at NTT DATA, you will work alongside exper...
Location
Location
Italy , Milano
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 5 years of production experience working in Data Science or Software Engineering
  • Deep knowledge of math, probability, statistics and algorithms
  • At least 6/12 months of experience in Generative AI deployment and underlying architecture handling
  • Vector Database knowledge is well appreciated
  • Understanding of data structures, data modeling and software architecture
  • Fluent in a at least two mainstream programming language (Python, Scala, Java, C++)
  • Experience in building an infrastructure for technical users, such as Data Scientist, ML practitioners or data consumers/producers
  • Strong knowledge of Spark, Databricks is a strong plus
  • Experience developing/deploying ML solutions in one of the public cloud platforms and on a Cross-cloud base, Snowflake knowledge is a plus
  • Deep knowledge with machine learning frameworks (such as Keras or PyTorch)
Job Responsibility
Job Responsibility
  • Apply hands-on Generative AI capabilities, preferably on Azure/GCP and on-premise GenAI architectures and MLOps
  • Leverage a strong mathematical background
  • Work on classification, information retrieval, clustering and optimization problems
  • Establish scalable, efficient and automated processes for large-scale data analysis
  • Contribute to model development, model validation and model implementation
  • Identify business opportunities
  • Design and create new data pipelines from scratch, from experiments to production deployment
  • Manage multiple projects
  • Lead ML Engineers
  • Connect with stakeholders
  • Fulltime
Read More
Arrow Right

AI Engineer Senior Advisor

NTT DATA is a $30 billion business and technology services leader, serving 75% o...
Location
Location
Mexico , Guadalajara
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Data Science, Computer Science, Engineering, Mathematics, Statistics, or related quantitative field
  • 2-4 years of professional experience in machine learning or data engineering roles
  • Solid understanding of machine learning algorithms and experience applying them to real-world problems
  • Proficiency in Python and SQL
  • experience with PySpark or similar big data tools is a plus
  • Familiarity with machine learning frameworks such as TensorFlow or PyTorch
  • Experience with cloud platforms and ML tools like AWS Sagemaker or Databricks preferred but not required
  • Ability to work collaboratively in a team and communicate technical concepts clearly
Job Responsibility
Job Responsibility
  • Develop and implement machine learning models such as recommendation engines, customer segmentation, and predictive analytics to support customer-centric business initiatives
  • Collaborate with data scientists and engineers to translate business requirements into technical solutions
  • Write clean, maintainable, and production-quality code primarily in Python, PySpark, and SQL
  • Assist in building and maintaining data pipelines and workflows using Spark, Airflow, or similar tools
  • Participate in model validation, testing, and deployment processes
  • Communicate findings and model insights effectively to both technical and non-technical stakeholders
  • Work in an agile environment alongside product managers, data scientists, and engineers to deliver data-driven products
  • Fulltime
Read More
Arrow Right

Senior AI Engineer

Location
Location
Australia , South Bank
Salary
Salary:
Not provided
fctgcareers.com Logo
Flight Centre Brand
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Tertiary qualifications in Computer Science, Software Engineering, Data Science or a related field or equivalent practical experience
  • Proven experience deploying and operating production-grade agentic AI systems, LLM-powered applications, or ML pipelines with commercial impact
  • Strong Python programming skills and deep knowledge of modern AI/ML frameworks (e.g. LangGraph, LlamaIndex, PyTorch, scikitlearn)
  • Solid understanding of classical machine learning, including supervised learning (classification, regression), unsupervised learning (clustering, dimensionality reduction), and time-series forecasting, with hands-on experience taking models to production
  • Strong experience with Azure cloud services (Azure ML, Azure DevOps, Azure Container Services, Azure Function Apps) and Databricks
Job Responsibility
Job Responsibility
  • Lead the design, development, and productionisation of agentic AI workflows, LLM-powered applications, and multi-agent systems
  • Productionise classical ML models (e.g. classification, regression, time-series forecasting), ensuring they meet production-grade standards for reliability, monitoring, and retraining
  • Own and evolve end-to-end MLOps and LLMOps pipelines including CI/CD, model registry, drift detection, retraining, and automated evaluation
  • Build and maintain scalable ML infrastructure on Azure and Databricks including feature engineering pipelines and data platform integrations
  • Architect and build AI agent workflows, endpoints, gateways, and orchestration layers enabling secure tool usage, structured reasoning, and multi-agent collaboration
  • Deploy and optimise AI workloads on Kubernetes and cloud-native Azure environments
  • Define and enforce engineering quality standards through code reviews, design reviews, and technical documentation
What we offer
What we offer
  • Individualised Learning & Development pathway options
  • Access to 'LinkedIn Learning' for ongoing skills development: over 24,500 courses in over 20 languages
  • Exclusive Staff Discounts: Accessible via our employee-only portal with 350+ of Australia’s leading retailers, health and wellness discounts, financial planning advice, employee share plan and more
  • Travel Discounts: Including family and friends - flights, hotels, tours, cruises, travel insurance and more
  • Brightness of Future: Career opportunities in a network of brands and businesses across the globe - we promote from within
  • Corporate Health Discounts: Access exclusive discounts on health insurance plans for you and your family with our partner, BUPA, access to internal gym
  • Mental Health: Support and Employee Assistance Program for staff and family
  • Social: Regular awards nights, social team-building and industry events, with the opportunity to attend global conferences (Bangkok in 2026)
  • Giving Back: Corporate Social Responsibility program supporting nominated charities through Workplace Giving, volunteering and fundraising
  • paid parental and volunteer leave
  • Fulltime
Read More
Arrow Right

Senior AI Engineer

Senior AI Engineer – (Manager) BIP xTech. Role Purpose: As a Senior AI Engineer,...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
businessintegrationpartners.com Logo
Business Integration Partners
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years’ experience delivering AI and ML solutions in production environments
  • Demonstrated experience delivering GenAI and LLM-based solutions from prototype through to production
  • Strong Python engineering skills, with a focus on quality, testing, and maintainability
  • Solid foundations in machine learning concepts, evaluation techniques, and statistical fundamentals
  • Experience working with Databricks and one or more major cloud platforms (Azure, AWS, or GCP)
  • Strong understanding of security-by-design, including access control, secrets management, and secure networking
  • Ability to align AI solutions with governance, compliance, and Responsible AI requirements
  • Proven experience leading delivery and coordinating multidisciplinary engineering teams
Job Responsibility
Job Responsibility
  • Design, develop, and deploy production-grade AI and ML solutions, including GenAI and LLM-enabled systems
  • Shape AI solution architectures, selecting appropriate patterns (e.g. batch vs streaming, RAG, feature stores, model serving)
  • Lead AI/ML workstreams end-to-end, including planning, delivery governance, and stakeholder management
  • Mentor and support AI engineers, data scientists, and software engineers, fostering high engineering standards and collaboration
  • Implement secure, scalable deployment patterns aligned with governance, compliance, and Responsible AI expectations
  • Embed monitoring, evaluation, and continuous improvement across AI solutions
  • Collaborate closely with Data Engineers, Cloud/Data Architects, and Software Engineers to deliver coherent platforms
  • Contribute to pre-sales, discovery, and proposal development by shaping solution options and delivery approaches
  • Build strong relationships with clients and partners, acting as a trusted technical advisor
What we offer
What we offer
  • Hybrid working
  • Opportunity to work at the forefront of applied AI delivery within a growing Centre of Excellence
  • A culture that encourages innovation, collaboration, and ownership
  • Fulltime
Read More
Arrow Right

Senior AI & Data Engineer

The Senior AI & Data Engineer is an individual contributor role that acts as the...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Data Science, AI/ML, Engineering, Mathematics, or a related technical discipline
  • PhD is a plus
  • 7 – 10 years of hands-on experience in AI/ML engineering, applied data science, or LLM engineering roles
  • Proven track record of delivering production AI systems
  • Deep expertise with at least two major LLM platforms (Claude, GPT, Gemini, or equivalent)
  • Significant experience with Collibra or an equivalent enterprise data governance platform
  • Demonstrated experience leading cross-functional AI initiatives and mentoring junior engineers
  • Strong ML fundamentals alongside modern generative AI skills
  • Experience with responsible AI practices, including fairness auditing, explainability, and content safety, is strongly preferred
Job Responsibility
Job Responsibility
  • Serve as the dual AI & data SME for the team and organization
  • Define and uphold engineering standards, design patterns, and best practices across both AI and data engineering disciplines
  • Lead technical discovery for new AI and data use cases
  • Participate in and lead cross-functional initiatives where AI and data strategy intersect
  • Mentor and upskill the Applied AI Engineer and AI Data Engineer
  • Architect and deliver complex agentic AI systems
  • Design and implement advanced RAG architectures
  • Lead LLM evaluation frameworks
  • Assess and implement LLM fine-tuning and alignment strategies
  • Own LLM integration architecture
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
Read More
Arrow Right