CrawlJobs Logo

Data & AI Engineer

Belgium, Diegem · Job Posted January 26, 2026
Apply Position
Job Link Share

Job Description

As a Data & AI Engineer at NTT DATA, you will design and implement scalable data solutions on Azure and Databricks. This role requires 3-7 years of experience in data/AI engineering, with a strong focus on Python, PySpark, and SQL. A bachelor's or master's degree in Computer Science or a related field is preferred, along with relevant certifications.

Job Responsibility

  • Build reliable batch/stream pipelines in Databricks (Python/PySpark, SQL) with Delta Lake and Unity Catalog
  • Implement best practices for code quality, testing, documentation, lineage, and cost‑efficient performance
  • Design and deliver GenAI solutions using Azure AI Foundry (projects, prompt flow/evaluation), Azure OpenAI (chat/completions, tool/function calling), and Azure AI Search (indexing, vector search, semantic ranking) with robust RAG patterns
  • Instrument evaluation, grounding, safety checks, and quality metrics for AI features
  • Use MLflow for experiment tracking, model packaging, and deployment
  • standardize environments and feature stores where relevant
  • Build CI/CD for data and AI workloads (e.g., Azure DevOps/GitHub Actions) and implement monitoring & observability (logs, metrics, drift)
  • Provision Azure and Databricks resources with Terraform (modular design, workspaces/state, policies, service principals, Key Vault)
  • Apply RBAC, secrets management, data masking, and governance (Unity Catalog / Purview) with privacy‑by‑design and compliance best practices
  • Partner with product owners, architects, and SMEs to translate use‑cases into simple, secure, cost‑aware solutions
  • Contribute to reference architectures, reusable components, and engineering standards

Requirements

  • 3–7+ years in data/AI engineering (or equivalent impact) delivering production systems on Azure
  • Python (production code, packaging, testing)
  • PySpark
  • SQL
  • Databricks (Repos/Workflows, Delta Lake, Unity Catalog, MLflow)
  • Azure AI Foundry (projects, prompt/eval flows, model endpoints)
  • Azure AI Search (index design, vector embeddings, skillsets/indexers, semantic search)
  • Azure OpenAI (prompt design, grounding, safety filters, function/tool calling, evaluation)
  • Terraform (AzureRM + Databricks providers), modular patterns, pipelines, approvals
  • Git & CI/CD (Azure DevOps or GitHub), code reviews, trunk‑based or GitFlow

Nice to have

  • Azure Data Factory / Fabric pipelines, Synapse, Power BI for hand‑offs to analytics
  • Vector databases (e.g., Azure AI Search vectors, PostgreSQL pgvector), RAG optimization techniques (chunking, retrieval, ranking)
  • Airflow orchestration, Docker/AKS, serverless (Azure Functions), FastAPI for serving
  • Data governance (Microsoft Purview), cost management, FinOps practices
  • Domain exposure to regulated environments and GDPR data protection
  • BSc/MSc in Computer Science, Data/AI, or similar (or equivalent experience)
  • Microsoft: Azure Data Engineer Associate, Azure AI Engineer Associate
  • Databricks: Lakehouse Fundamentals / Data Engineer / Machine Learning certifications
  • HashiCorp: Terraform Associate

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data & AI Engineer

8 matching positions

Senior Data Engineer – Data Engineering & AI Platforms

We are looking for a highly skilled Senior Data Engineer (L2) who can design, bu...
Location
Location
India , Chennai, Madurai, Coimbatore
Salary
Salary:
Not provided
optisolbusiness.com Logo
OptiSol Business Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on expertise in cloud ecosystems (Azure / AWS / GCP)
  • Excellent Python programming skills with data engineering libraries and frameworks
  • Advanced SQL capabilities including window functions, CTEs, and performance tuning
  • Solid understanding of distributed processing using Spark/PySpark
  • Experience designing and implementing scalable ETL/ELT workflows
  • Good understanding of data modeling concepts (dimensional, star, snowflake)
  • Familiarity with GenAI/LLM-based integration for data workflows
  • Experience working with Git, CI/CD, and Agile delivery frameworks
  • Strong communication skills for interacting with clients, stakeholders, and internal teams
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms
  • Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers
  • Work closely with solutioning and pre-sales teams for technical evaluations and client-facing discussions
  • Lead squads of L0/L1 engineers—ensuring delivery quality, mentoring, and guiding career growth
  • Develop cloud-native data engineering solutions using Python, SQL, PySpark, and modern data frameworks
  • Ensure data reliability, performance, and maintainability across the pipeline lifecycle—from development to deployment
  • Support long-term ODC/T&M projects by demonstrating expertise during technical discussions and interviews
  • Integrate emerging GenAI tools where applicable to enhance data enrichment, automation, and transformations
What we offer
What we offer
  • Opportunity to work at the intersection of Data Engineering, Cloud, and Generative AI
  • Hands-on exposure to modern data stacks and emerging AI technologies
  • Collaboration with experts across Data, AI/ML, and cloud practices
  • Access to structured learning, certifications, and leadership mentoring
  • Competitive compensation with fast-track career growth and visibility
  • Fulltime
Read More
Arrow Right

Network Systems Engineer - Data Center AI Network Engineer

We are the Data Center Network Services team within Cisco IT that supports netwo...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
duo.com Logo
Duo Security
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor of Engineering or Technology with a minimum of 10 years of experience in designing, deploying, operating and managing scalable DC network infrastructure (using Nexus OS)
  • Experience in technologies like Routing, Switching, Nexus, VPC, VDC, VLAN, VXLAN, BGP
  • Experience on handling incident, problem and change management
  • Familiarity with DevOps principles, comfortable with Agile practices
Job Responsibility
Job Responsibility
  • You will design, develop, test and deploy DC network capabilities within Data Center Network
  • You are engaging and comfortable collaborating with fellow engineers across multiple disciplines as well as internal clients
  • You will create innovative, high-quality capabilities enabling our clients to have the best possible experience
What we offer
What we offer
  • Our benefits are designed to support every aspect of your life: from your well-being to your time away to your family
Read More
Arrow Right
New

Sr Staff Software Engineer (Data & Ai Platform)

We are looking for a talented and experienced Sr Staff Software Engineer to join...
Location
Location
Israel , Petah Tikva
Salary
Salary:
Not provided
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field
  • At least 5 years of experience with Python
  • Minimum of 2 years of hands-on experience with AWS
  • Proven experience with the full Software Development Life Cycle (SDLC), including design, development, testing, and deployment
  • Excellent problem-solving skills and strong attention to detail
  • Ability to manage multiple projects simultaneously and strong organizational skills
Job Responsibility
Job Responsibility
  • Define and implement best practices for the R&D platform
  • Collaborate with internal and external stakeholders to understand requirements and deliver high-quality solutions
  • Work on edge technologies and cloud platforms to enhance our services
  • Participate in all phases of the SDLC, including design, development, testing, and deployment
  • Ensure high ROI on deliverables by optimizing processes and solutions
  • Share knowledge and best practices across the company to promote a culture of continuous improvement
  • Fulltime
Read More
Arrow Right
New

Senior Engineer - AI & Data Science

Location
Location
Poland
Salary
Salary:
15025.00 - 22500.00 PLN / Month
https://www.hsbc.com Logo
HSBC
Expiration Date
July 11, 2026
Flip Icon
Requirements
Requirements
  • Strong experience in delivering Data Science and similar solutions
  • Knowledge of ingestion and data preparation techniques, especially for use in AI solutions
  • Experience working with Cloud based APIs for Large Language Models is highly desirable
  • Very good Python skills and strong object-oriented programming concepts
  • Strong knowledge of software engineering architecture concepts for the build of multi-tier solutions that include user interfaces, data, workflow, and controls
  • Strong knowledge of technology and support practices to maintain a production grade user system, including testing practices
  • Strong experience working with developer tools and frameworks such as GitHub, Agile practices, Source control and branching concepts
  • Understanding of how Large Language Models work
  • Knowledge of web UI coding frameworks such as React, NodeJS, Angular, is desirable
  • Strong knowledge and experience of modern Agile and project management practices
Job Responsibility
Job Responsibility
  • Develop Python-based solutions for Global Finance business teams, including but not limited to Generative AI
  • Research and develop new techniques in data science, Generative AI and related areas to improve the quality of outputs
  • Perform detailed testing of prompts and data inputs and outputs
  • Maintain the codebase including frontend, backend, and algorithms in a engineering global team environment
  • Understand and implement appropriate governance and controls required
  • Face off to the business and other stakeholders, including but not limited to the business line teams, Global Finance Analytics, Transformation, Change/Project Management, IT, Governance teams
  • Contribute towards overall strategy development for the team
  • Work closely with the Quantitative Analytics teams to build software solutions that are practical, workable and comply with accounting, regulatory or other requirements
What we offer
What we offer
  • Additional bonuses for recognition awards
  • Multisport card
  • Private medical care
  • Life insurance
  • One-time reimbursement of home office set-up (up to 800 PLN)
  • Cafeteria platform
  • Employee assistance program
  • Additional contributions to PPK scheme
  • Corporate parties & events
  • CSR initiatives
  • Fulltime
Read More
Arrow Right

Lead Data Engineer - AI Search

We are looking for a Lead Data Engineer — AI Search (all genders) to join Valtec...
Location
Location
France , Paris
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of professional software engineering experience in enterprise environments
  • Strong expertise in Google Cloud Platform (GCP) and AI ecosystems
  • Experience with AI Search, conversational AI, and generative AI integrations
  • Strong application architecture, API design, and enterprise integration experience
  • Solid understanding of cloud-native, microservices, and event-driven architectures
  • Experience with CI/CD pipelines, software quality, observability, and cloud security best practices
  • Experience working with Kubernetes and Infrastructure as Code
  • Technical leadership experience, including mentoring engineers and guiding technical decisions
  • Ability to collaborate across architecture, engineering, cloud, and data teams
  • Strong communication and stakeholder management skills
Job Responsibility
Job Responsibility
  • Define detailed technical design, components, interfaces, and integration patterns
  • Lead development teams and enforce engineering standards and best practices
  • Coordinate architecture, cloud/platform, data, QA, and business stakeholders
  • Ensure delivery quality through testing, observability, and application security practices
  • Guide teams on GCP and AI Search implementation patterns
  • Lead technical discovery, estimation, and solution design workshops
  • Identify technical risks and propose mitigation strategies early
  • Ensure scalable, reliable, and production-ready AI solutions
  • Contribute hands-on in complex and high-impact technical areas
  • Support industrialization and operationalization of AI and search use cases
What we offer
What we offer
  • Flexibility, with remote and hybrid work options (country-dependent)
  • Career advancement, with international mobility and professional development programs
  • Learning and development, with access to cutting-edge tools, training and industry experts
  • Fulltime
Read More
Arrow Right

AI Data Engineer

We are looking for a technically sharp and detail-oriented Data Engineer to join...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Information Systems, Data Engineering, Mathematics, or a related discipline
  • 4 – 5 years of hands-on experience in data engineering, ETL development, or analytics engineering roles
  • Demonstrable experience with Databricks and/or Microsoft Fabric in a production environment
  • Proficiency in Power BI report and semantic model development
  • Exposure to Collibra or equivalent data governance / cataloguing platforms is strongly preferred
  • Strong SQL and Python skills
  • PySpark experience is required
  • Familiarity with Azure cloud services and DevOps practices for data pipeline deployment
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Databricks (PySpark / Delta Live Tables), and Microsoft Fabric Data Factory
  • Transform raw, multi-source data into clean, conformed, and analytics-ready datasets following Medallion Architecture principles (Bronze → Silver → Gold)
  • Develop and optimize SQL and PySpark-based transformation logic for structured, semi-structured, and unstructured data
  • Implement incremental load patterns, merge/upsert logic, and slowly changing dimension (SCD) strategies to support historical data tracking
  • Collaborate with the AI Engineers to prepare high-quality feature datasets for ML and LLM use cases
  • Define, implement, and monitor data quality rules including completeness, accuracy, consistency, timeliness, and uniqueness checks
  • Administer and extend the Collibra data governance platform — including business glossary management, data lineage documentation, and stewardship workflows
  • Build automated data quality validation frameworks using tools such as Great Expectations, dbt tests, or Unity Catalog data quality constraints in Databricks
  • Triage and resolve data quality incidents, root-cause data anomalies, and communicate impact to stakeholders proactively
  • Maintain metadata catalogues and ensure all critical datasets have documented ownership, lineage, and classification
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

Senior AI & Data Engineer

The Senior AI & Data Engineer is an individual contributor role that acts as the...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Data Science, AI/ML, Engineering, Mathematics, or a related technical discipline
  • PhD is a plus
  • 7 – 10 years of hands-on experience in AI/ML engineering, applied data science, or LLM engineering roles
  • Proven track record of delivering production AI systems
  • Deep expertise with at least two major LLM platforms (Claude, GPT, Gemini, or equivalent)
  • Significant experience with Collibra or an equivalent enterprise data governance platform
  • Demonstrated experience leading cross-functional AI initiatives and mentoring junior engineers
  • Strong ML fundamentals alongside modern generative AI skills
  • Experience with responsible AI practices, including fairness auditing, explainability, and content safety, is strongly preferred
Job Responsibility
Job Responsibility
  • Serve as the dual AI & data SME for the team and organization
  • Define and uphold engineering standards, design patterns, and best practices across both AI and data engineering disciplines
  • Lead technical discovery for new AI and data use cases
  • Participate in and lead cross-functional initiatives where AI and data strategy intersect
  • Mentor and upskill the Applied AI Engineer and AI Data Engineer
  • Architect and deliver complex agentic AI systems
  • Design and implement advanced RAG architectures
  • Lead LLM evaluation frameworks
  • Assess and implement LLM fine-tuning and alignment strategies
  • Own LLM integration architecture
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
Read More
Arrow Right

Senior/ Principal Backend Engineer - Data & AI Security (Cortex Cloud)

At Palo Alto Networks®, we’re united by a shared mission—to protect our digital ...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on software engineering experience, with deep expertise in at least one of the following: Kotlin/Java, Python, or Go
  • Experience working with different cloud services on at least one major cloud provider (AWS, Azure, GCP)
  • Proven experience designing and building large-scale, scalable cloud-based applications
  • Expertise in microservices architecture, including technologies like Kubernetes, Docker, GKE, EKS, or AKS
  • Experience with relational or NoSQL databases (e.g., MYSQL, PostgreSQL, MongoDB) and ORMs (e.g., JPA, Hibernate)
  • Bachelor of Science in Computer Science or equivalent practical experience (e.g., elite software unit in the military).
Job Responsibility
Job Responsibility
  • Drive innovation by designing and implementing impactful solutions that address client needs, contributing to the full feature development lifecycle from design to deployment
  • Take ownership of specific feature segments, ensuring high-quality code and robust functionality through meticulous attention to detail and a focus on execution
  • Proactively collaborate and exchange information with cross-functional teams, including product and infrastructure, to ensure seamless integration and alignment on shared objectives
  • Challenge the status quo by generating innovative ideas and actively participating in brainstorming sessions to foster product and architectural improvements
  • Actively engage in technical discussions, openly sharing knowledge and learning from others to solve complex problems and elevate team expertise
  • Design and build highly scalable, resilient, and secure cloud-based applications and microservices
  • Contribute to an agile and dynamic engineering culture, demonstrating a strong drive and outstanding communication skills to deliver results efficiently.
  • Fulltime
Read More
Arrow Right