CrawlJobs Logo

Senior Python Engineer (Data Engineering & AI Agents)

Poland; Spain; United Kingdom · Job Posted June 30, 2026
Apply Position
Job Link Share

Job Description

Our client is a leading global investment management company headquartered in London. It manages over $228 billion in assets and serves institutional investors, pension funds, wealth managers, and other sophisticated clients worldwide. The firm specializes in quantitative investing, alternative investments, systematic trading strategies, and technology-driven asset management. Data science, machine learning, and AI are core components of its investment and research processes. As part of our collaboration we will focus on two foundational capabilities required to enable safe and scalable AI adoption across the enterprise: Agentic Security and AI-Ready Data Foundations. What project we have for you We build the data foundations that make AI useful and safe inside regulated financial firms. The value of AI is capped by the data its agents can reach: if an agent cannot find, interpret, trace or be correctly permissioned against data, the capability is useless, or worse, unsafe. Your job is to close that gap. This is a hands-on senior role for an excellent Python engineer with strong data-engineering skills who is genuinely comfortable building with AI agents. You will design and build the catalogue, semantic, entitlement and analytical layers that turn large on-premise data estates into something agents can use.

Job Responsibility

  • Build production-grade Python services and data pipelines over large data stores (columnar / time-series and relational), and the queries that join across them
  • Select and implement the right query or analytical engine for each workload, rather than defaulting to one
  • Build catalogue, metadata, lineage and semantic layers that make data discoverable and consistently understood across teams
  • Implement access control that travels with the data: fusing sensitivity and licensing scope, enforced at the point of use, including for AI agents
  • Build agent-facing data access: retrieval (RAG), vector search, and APIs / MCP servers, with permissions applied before context reaches the model
  • Apply LLMs pragmatically to data work (metadata generation, classification, entity resolution) with humans in the loop and evaluate the quality of what the agents produce
  • Help keep data trustworthy: establish golden sources, deduplication and data-quality checks at the source
  • Contribute to discovery and solutioning: assessing current state, weighing build-vs-adopt, and shaping pragmatic, costed plans

Requirements

  • 6+ years building production software in Python, with strong engineering fundamentals (testing, performance, clean design)
  • Solid data engineering: SQL, columnar formats (e.g. Parquet), pipeline design, and handling datasets large enough that naive approaches don’t scale
  • Hands-on experience with at least one analytical or query engine (e.g. DuckDB, Trino, Spark, ClickHouse)
  • Real experience building LLM / agent applications: retrieval (RAG), vector databases, and tool / function calling
  • A working understanding of data governance: cataloguing, metadata, lineage, and access control (RBAC / ABAC)
  • An instinct for data quality and trustworthy "golden" sources

Nice to have

  • Financial services / capital markets experience (market data, positions, reference data, time-series stores)
  • Experience in on-premise / regulated environments and their constraints (data residency, auditability, "golden copy never moves")
  • Familiarity with semantic layers / knowledge graphs and entity resolution
  • Exposure to policy-as-code (e.g. OPA) or data-access platforms
  • Awareness of how AI agents are secured: identity, scoped access, evaluation and monitoring
  • Consulting or client-facing / pre-sales experience

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Python Engineer (Data Engineering & AI Agents)

8 matching positions

Senior Python Engineer (Data Engineering & AI Agents)

Our client is a leading global investment management company headquartered in Lo...
Location
Location
Poland; Spain; United Kingdom
Salary
Salary:
Not provided
Intellias
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years building production software in Python, with strong engineering fundamentals (testing, performance, clean design)
  • Solid data engineering: SQL, columnar formats (e.g. Parquet), pipeline design, and handling datasets large enough that naive approaches don't scale
  • Hands-on experience with at least one analytical or query engine (e.g. DuckDB, Trino, Spark, ClickHouse)
  • Real experience building LLM / agent applications: retrieval (RAG), vector databases, and tool / function calling
  • A working understanding of data governance: cataloguing, metadata, lineage, and access control (RBAC / ABAC)
  • An instinct for data quality and trustworthy golden sources
Job Responsibility
Job Responsibility
  • Build production-grade Python services and data pipelines over large data stores (columnar / time-series and relational), and the queries that join across them
  • Select and implement the right query or analytical engine for each workload, rather than defaulting to one
  • Build catalogue, metadata, lineage and semantic layers that make data discoverable and consistently understood across teams
  • Implement access control that travels with the data: fusing sensitivity and licensing scope, enforced at the point of use, including for AI agents
  • Build agent-facing data access: retrieval (RAG), vector search, and APIs / MCP servers, with permissions applied before context reaches the model
  • Apply LLMs pragmatically to data work (metadata generation, classification, entity resolution) with humans in the loop and evaluate the quality of what the agents produce
  • Help keep data trustworthy: establish golden sources, deduplication and data-quality checks at the source
  • Contribute to discovery and solutioning: assessing current state, weighing build-vs-adopt, and shaping pragmatic, costed plans
  • Fulltime
Read More
Arrow Right

Senior Python Engineer (Data Engineering & AI Agents)

Our client is a leading global investment management company headquartered in Lo...
Location
Location
Poland; Spain; United Kingdom
Salary
Salary:
Not provided
Intellias
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years building production software in Python, with strong engineering fundamentals (testing, performance, clean design)
  • Solid data engineering: SQL, columnar formats (e.g. Parquet), pipeline design, and handling datasets large enough that naive approaches don't scale
  • Hands-on experience with at least one analytical or query engine (e.g. DuckDB, Trino, Spark, ClickHouse)
  • Real experience building LLM / agent applications: retrieval (RAG), vector databases, and tool / function calling
  • A working understanding of data governance: cataloguing, metadata, lineage, and access control (RBAC / ABAC)
  • An instinct for data quality and trustworthy 'golden' sources
Job Responsibility
Job Responsibility
  • Build production-grade Python services and data pipelines over large data stores (columnar / time-series and relational), and the queries that join across them
  • Select and implement the right query or analytical engine for each workload, rather than defaulting to one
  • Build catalogue, metadata, lineage and semantic layers that make data discoverable and consistently understood across teams
  • Implement access control that travels with the data: fusing sensitivity and licensing scope, enforced at the point of use, including for AI agents
  • Build agent-facing data access: retrieval (RAG), vector search, and APIs / MCP servers, with permissions applied before context reaches the model
  • Apply LLMs pragmatically to data work (metadata generation, classification, entity resolution) with humans in the loop and evaluate the quality of what the agents produce
  • Help keep data trustworthy: establish golden sources, deduplication and data-quality checks at the source
  • Contribute to discovery and solutioning: assessing current state, weighing build-vs-adopt, and shaping pragmatic, costed plans
Read More
Arrow Right

Ai Engineer Ii & Senior Ai Engineer - Getting Customers Ready For Ai

Security represents the most critical priorities for our customers in a world aw...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Must pass the Microsoft background and Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design, build, and improve AI-powered solutions, including machine learning models, LLM-based applications, RAG systems, and agentic workflows that solve customer and business challenges
  • Develop and operate scalable data pipelines, ETL processes, training datasets, and AI infrastructure to support model development, deployment, and lifecycle management
  • Deploy, monitor, and optimize AI systems using MLOps practices, leveraging telemetry and feedback to improve performance, reliability, security, and scalability
  • Transform large-scale, multi-source data into contextual intelligence, automation, and decision-support capabilities that drive customer and business outcomes
  • Build and integrate AI capabilities into applications, services, APIs, and platforms to deliver end-to-end customer experiences
  • Contribute to AI readiness initiatives through frameworks, metrics, telemetry, and solutions that help customers securely adopt and operationalize AI technologies
  • Demonstrate a builder mindset by rapidly prototyping, experimenting, and iterating on AI solutions while navigating ambiguity and evolving requirements
  • Partner across engineering, data science, product, and customer teams to translate complex problems into practical, AI-driven solutions
  • Write maintainable, well-tested code and contribute to engineering excellence through documentation, operational rigor, governance, and adherence to security, compliance, and Responsible AI practices
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Senior AI Engineer (AI Agents & Applied LLMs)

We are looking for a Senior AI Engineer to design, build, and scale intelligent ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
infogrowth.in Logo
InfoGrowth
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in software engineering, machine learning, or AI-related roles
  • Strong experience with Python (required)
  • familiarity with JavaScript/TypeScript is a plus
  • Hands-on experience with LLMs, prompt engineering, and AI frameworks (LangChain, LlamaIndex, etc.)
  • Experience building production-grade APIs and services
  • Knowledge of vector databases (Pinecone, FAISS, Weaviate, etc.)
  • Solid understanding of data structures, algorithms, and system design
  • Experience deploying AI systems on cloud platforms (AWS, GCP, or Azure)
Job Responsibility
Job Responsibility
  • Design and develop AI agents capable of reasoning, planning, and executing tasks autonomously
  • Build and deploy LLM-powered applications using models such as GPT, Claude, or open-source LLMs
  • Integrate AI systems with APIs, databases, tools, and third-party services
  • Optimize prompts, workflows, and agent architectures for accuracy, performance, and cost
  • Lead end-to-end AI projects from concept to production
  • Collaborate closely with product managers, designers, and backend teams
  • Establish best practices for AI safety, evaluation, monitoring, and governance
  • Mentor junior engineers and conduct technical reviews
  • Fulltime
Read More
Arrow Right

Senior AI Engineer (Agentic AI / LLM Engineering)

We’re partnering with a rapidly growing, innovation-focused organization that is...
Location
Location
United States
Salary
Salary:
Not provided
zeektek.com Logo
Zeektek
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in software engineering, data engineering, or AI/ML engineering
  • Hands-on experience building applications using LLMs (e.g., GPT, open-source models)
  • Experience with agentic AI frameworks (e.g., LangChain, AutoGen, CrewAI, or similar)
  • Strong programming skills in Python
  • Experience working with large datasets and distributed data platforms
  • Familiarity with Databricks or similar modern data platforms
  • Experience building production-grade AI systems (not just POCs)
  • Strong understanding of prompt engineering and LLM optimization techniques
Job Responsibility
Job Responsibility
  • Design and build agentic AI systems leveraging large language models (LLMs)
  • Develop scalable AI solutions using modern data and AI platforms (Databricks preferred)
  • Translate business problems into production-ready AI workflows and applications
  • Collaborate with product and architecture teams to define AI use cases and technical approaches
  • Implement and optimize: Prompt engineering strategies
  • Token usage and cost efficiency
  • Model performance and response quality
  • Work with large-scale datasets to support training, fine-tuning, and inference workflows
  • Contribute to the development of AI engineering standards, frameworks, and best practices
  • Partner with data science teams to integrate models into production environments
What we offer
What we offer
  • Weekly Direct Deposit
  • 401K Matching
  • Competitive medical, dental and vision insurance
  • Consistent communication throughout your project
  • ZeekTek Referral Program
Read More
Arrow Right

Senior AI Engineer (Agents)

We are looking for an experienced and exceptional Senior AI Engineer (Agents) to...
Location
Location
Singapore
Salary
Salary:
Not provided
workato.com Logo
Workato
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, or a related field, or equivalent practical experience
  • 5+ years in backend software development using modern programming languages (e.g., Python (strongly preferred!), Golang or Java)
  • Demonstrated experience building production AI systems including chatbots, virtual assistants, and automated support agents using LLMs (OpenAI, Anthropic, open-source models)
  • Expertise in natural language understanding (NLU) and intent classification for customer query interpretation, entity extraction, and conversation flow management
  • Expertise in building knowledge bases and FAQ systems with dynamic content retrieval and self-learning capabilities from support interactions
  • Experience implementing multi-channel support automation across chat, email, voice, and messaging platforms with consistent context handling
  • Deep knowledge of REST API design and integration patterns
  • Experience working with PostgreSQL and ClickHouse, or similar relational and analytical databases
  • Strong understanding of software architecture, scalability, security, and system design
Job Responsibility
Job Responsibility
  • Design and implement advanced AI/ML systems with a focus on LLMs, AI Agents, and retrieval-augmented generation (RAG) architectures
  • Build conversational AI interfaces that handle multi-turn customer interactions, maintain context across sessions, and seamlessly escalate to human agents when necessary
  • Build production-grade AI pipelines for data processing, model training, fine-tuning, and serving at scale
  • Implement feedback loops and continuous learning systems that incorporate customer satisfaction metrics, agent corrections, and conversation outcomes to improve model performance over time
  • Create analytics dashboards and reporting tools to track automation effectiveness, identify common customer pain points, and measure key performance indicators like resolution time, containment rate, and customer satisfaction scores
  • Lead technical initiatives for AI system integration into existing products and services
  • Collaborate with data scientists and ML researchers to implement and productionize new AI approaches and models
Read More
Arrow Right

Senior AI & Data Engineer

The Senior AI & Data Engineer is an individual contributor role that acts as the...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Data Science, AI/ML, Engineering, Mathematics, or a related technical discipline
  • PhD is a plus
  • 7 – 10 years of hands-on experience in AI/ML engineering, applied data science, or LLM engineering roles
  • Proven track record of delivering production AI systems
  • Deep expertise with at least two major LLM platforms (Claude, GPT, Gemini, or equivalent)
  • Significant experience with Collibra or an equivalent enterprise data governance platform
  • Demonstrated experience leading cross-functional AI initiatives and mentoring junior engineers
  • Strong ML fundamentals alongside modern generative AI skills
  • Experience with responsible AI practices, including fairness auditing, explainability, and content safety, is strongly preferred
Job Responsibility
Job Responsibility
  • Serve as the dual AI & data SME for the team and organization
  • Define and uphold engineering standards, design patterns, and best practices across both AI and data engineering disciplines
  • Lead technical discovery for new AI and data use cases
  • Participate in and lead cross-functional initiatives where AI and data strategy intersect
  • Mentor and upskill the Applied AI Engineer and AI Data Engineer
  • Architect and deliver complex agentic AI systems
  • Design and implement advanced RAG architectures
  • Lead LLM evaluation frameworks
  • Assess and implement LLM fine-tuning and alignment strategies
  • Own LLM integration architecture
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
Read More
Arrow Right

Senior AI Data Engineer

The Senior AI Data Engineer (Applications Development Technology Lead Analyst - ...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of professional experience in software development with a focus on AI, machine learning, or agent-based systems
  • Strong proficiency in Python, SQL
  • Solid understanding of core AI concepts, including knowledge representation, automated planning, decision-making under uncertainty, and multi-agent systems
  • Experience with machine learning frameworks (e.g., TensorFlow, PyTorch) and relevant libraries (e.g., Scikit-Learn, NumPy, Pandas)
  • Familiarity with large language models (LLMs) and their application in agentic systems
  • Familiarity with specific agent frameworks (e.g., LangChain, AutoGen, CrewAI, RAG) or research in multi-agent reinforcement learning
  • Experience in designing and implementing APIs for AI services
  • Experience with software development best practices, including version control (Git), CI/CD pipelines, testing, and code reviews
  • Excellent analytical and problem-solving skills
  • Strong written and verbal communication skills
Job Responsibility
Job Responsibility
  • Design and implement intelligent agents, including their perception, reasoning, planning, and action execution modules
  • Develop scalable and robust architectures for agentic systems
  • Integrate various machine learning models to enhance agent capabilities and decision-making
  • Develop agents that can automate complex tasks, optimize workflows, and solve real-world problems
  • Utilize and contribute to agentic AI frameworks and development tools
  • Design and implement metrics and evaluation strategies for agent performance
  • Stay abreast of the latest advancements in AI
  • Work closely with cross-functional teams
  • Create comprehensive technical documentation
  • Appropriately assess risk when business decisions are made
  • Fulltime
Read More
Arrow Right