CrawlJobs Logo

Data Engineer - Automation & AI

riverflex.com Logo

Riverflex

Location Icon

Location:
United Arab Emirates , Abu Dhabi or Dubai

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

Riverflex is partnering with a leading financial institution in the UAE on a strategic Proof of Concept focused on increasing data engineering productivity through automation and AI. We are seeking a Data Engineer – Automation & AI with strong GenAI and agent-based experience to own this PoC end-to-end, applying AI- and agent-assisted techniques to the design, migration, and development of AWS-based data pipelines. This role is explicitly focused on accelerating data engineering ways of working using AI, not solely on building pipelines. You will act as the internal lead on how AI should be applied in day-to-day data engineering, working closely with the partner’s Data Lead and embedded with the on-site engineering team. A key part of the scope is translating legacy SQL and stored procedures into modern AWS Glue pipelines, while defining practical AI patterns, tool and guardrails that scale beyond the PoC.

Job Responsibility:

  • Data engineering & pipeline delivery: Design, build, and evolve AWS Glue–based data pipelines using Spark and SQL
  • Translate legacy SQL scripts and stored procedures into AWS Glue pipelines
  • Ensure migrated and newly built pipelines meet agreed standards for correctness, performance, and maintainability
  • AI-driven engineering acceleration: Apply Generative AI and agent-based techniques to accelerate data engineering tasks, including code generation/refactoring, pipeline dev. and standardisation
  • Own the design and implementation of AI-assisted tooling that integrates directly into day-to-day engineering workflows
  • Codify successful patterns, reusable tools, and recommended ways of working for scaling beyond the PoC
  • AI tooling & experimentation: Work hands-on with Python and LLM APIs to build pragmatic, internal DE tools
  • Design effective prompts & interaction patterns for code generation & transformation
  • Evaluate and work with enterprise-grade AI platforms (e.g. AWS Bedrock, Azure AI Foundry) using GPT-4 / Claude-class models
  • Define practical rules of thumb and guardrails (e.g. where automation works, where it breaks down, where human intervention is required)
  • Collaboration & ways-of-working: Work closely with data and platform engineers to (dis)prove automation hypotheses and identify where AI adds real productivity gains vs. noise
  • Document outcomes and recommendations from the PoC and provide clear guidance on how AI should (and should not) be used in data engineering at scale

Requirements:

  • 6+ years of experience in data engineering or closely related engineering roles
  • Proven experience owning and shaping data engineering solutions, not only implementing individual pipelines
  • Strong hands-on experience with AWS-based data engineering, including: AWS Glue (jobs, transformations, orchestration), Spark (batch processing and transformations), Advanced SQL (complex logic, optimisation, performance tuning), End-to-end pipeline and workflow design
  • Solid (Python) engineering experience, including building reusable components and internal tooling
  • Demonstrated, practical experience applying Generative AI in engineering workflows, such as: Working with LLM APIs (e.g. AWS Bedrock, Azure AI Foundry, OpenAI), Prompt design for code generation, refactoring, and transformation, Understanding the limitations, failure modes, and risks of LLM-based automation
  • Experience designing AI-assisted engineering workflows or tools, for example: API-based services (e.g. FastAPI), MCP (or agent)-like orchestration patterns
  • Able to balance short-term PoC delivery with longer-term capability building
  • Experience in financial services or other regulated environments is a strong advantage
  • Ability to be based in the UAE for a minimum of 3 months, working full-time on-site (Abu Dhabi or Dubai)

Additional Information:

Job Posted:
January 10, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data Engineer - Automation & AI

Data Engineer – AI Insights

We are looking for an experienced Data Engineer with AI Insights to design and d...
Location
Location
United States
Salary
Salary:
Not provided
thirdeyedata.ai Logo
Thirdeye Data
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of Data Engineering experience with exposure to AI/ML workflows
  • Advanced expertise in Python programming and SQL
  • Hands-on experience with Snowflake (data warehousing, schema design, performance tuning)
  • Experience building scalable ETL/ELT pipelines and integrating structured/unstructured data
  • Familiarity with LLM and RAG workflows, and how data supports these AI applications
  • Experience with reporting/visualization tools (Tableau)
  • Strong problem-solving, communication, and cross-functional collaboration skills
Job Responsibility
Job Responsibility
  • Develop and optimize ETL/ELT pipelines using Python, SQL, and Snowflake to ensure high-quality data for analytics, AI, and LLM workflows
  • Build and manage Snowflake data models and warehouses, focusing on performance, scalability, and security
  • Collaborate with AI/ML teams to prepare datasets for model training, inference, and LLM/RAG-based solutions
  • Automate data workflows, validation, and monitoring for reliable AI/ML execution
  • Support RAG pipelines and LLM data integration, enabling AI-driven insights and knowledge retrieval
  • Partner with business and analytics teams to transform raw data into actionable AI-powered insights
  • Contribute to dashboarding and reporting using Tableau, Power BI, or equivalent tools
  • Fulltime
Read More
Arrow Right

AI Automation Engineer Internship

TapNation is a French company founded in 2019, specializing in mobile game publi...
Location
Location
France , Paris
Salary
Salary:
Not provided
tap-nation.io Logo
TapNation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Looking for an internship
  • Passion for AI
  • Comfortable speaking English (required)
  • Team player and adaptable
  • Proactive and full of ideas
  • Good analytical skills and know how to prioritize
  • Organized and patient
Job Responsibility
Job Responsibility
  • Deconstruct key company workflows across all departments (Product, User Acquisition, Monetization, Creatives, Data, Tech, etc.)
  • Identify where and how AI can boost efficiency, creativity, and decision-making by mapping current processes, identifying bottlenecks, repetitive tasks, or decision flows
  • Prototype and test AI-powered tools using platforms like ChatGPT, Claude, Notion AI, Make, etc
  • Implement pilot automations by working closely with department leads to move from manual to AI-augmented workflows
  • Analyze and document workflows across all departments
  • Create clear documentation, tutorials, and best practices for internal use
What we offer
What we offer
  • Remote policy: up to 1 to 2 days remote per week
  • Morning Pereire offices in Paris 17e (including fitness room)
  • Meal tickets: 15 tickets per month at 10.00€ per ticket with the Swile Card
  • Transport: 50% covered by us
  • 1 paid rest day per month
  • Fulltime
Read More
Arrow Right

Ai Automation Engineer

Help transform how Pomelo operates by identifying manual processes and automatin...
Location
Location
United States
Salary
Salary:
160000.00 - 220000.00 USD / Year
pomelocare.com Logo
Pomelo Care
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong foundation in computer science
  • At least two years of experience building and shipping high-quality software
  • Hands-on experience with AI/ML tools, LLMs and API integrations for automation
  • Ability to quickly build both frontend interfaces and backend services using modern frameworks
  • Act as a high-trust owner of systems that may handle sensitive data or business-critical logic
  • Stay updated on the latest AI models and tools, and apply that knowledge to cross-functional automation projects
Job Responsibility
Job Responsibility
  • Develop and maintain internal tools and systems that automate existing work and increase employee productivity using AI
  • Use AI as much as possible to automate your own process of creating this software
  • Collaborate with teams across the business to understand pain points and identify high-impact automation opportunities, then ensuring that they are adopted and deliver obvious value
  • Rapidly prototype small AI-enabled utilities or automations and deploy them into production swiftly
  • Supervise AI choices in architecture and technologies and debug complex systems when AI cannot handle them
What we offer
What we offer
  • Competitive healthcare benefits
  • Generous equity compensation
  • Unlimited vacation
  • Membership in the First Round Network (a curated and confidential community with events, guides, thousands of Q&A questions, and opportunities for 1-1 mentorship)
  • Fulltime
Read More
Arrow Right

Senior Data Engineer – Data Engineering & AI Platforms

We are looking for a highly skilled Senior Data Engineer (L2) who can design, bu...
Location
Location
India , Chennai, Madurai, Coimbatore
Salary
Salary:
Not provided
optisolbusiness.com Logo
OptiSol Business Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on expertise in cloud ecosystems (Azure / AWS / GCP)
  • Excellent Python programming skills with data engineering libraries and frameworks
  • Advanced SQL capabilities including window functions, CTEs, and performance tuning
  • Solid understanding of distributed processing using Spark/PySpark
  • Experience designing and implementing scalable ETL/ELT workflows
  • Good understanding of data modeling concepts (dimensional, star, snowflake)
  • Familiarity with GenAI/LLM-based integration for data workflows
  • Experience working with Git, CI/CD, and Agile delivery frameworks
  • Strong communication skills for interacting with clients, stakeholders, and internal teams
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms
  • Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers
  • Work closely with solutioning and pre-sales teams for technical evaluations and client-facing discussions
  • Lead squads of L0/L1 engineers—ensuring delivery quality, mentoring, and guiding career growth
  • Develop cloud-native data engineering solutions using Python, SQL, PySpark, and modern data frameworks
  • Ensure data reliability, performance, and maintainability across the pipeline lifecycle—from development to deployment
  • Support long-term ODC/T&M projects by demonstrating expertise during technical discussions and interviews
  • Integrate emerging GenAI tools where applicable to enhance data enrichment, automation, and transformations
What we offer
What we offer
  • Opportunity to work at the intersection of Data Engineering, Cloud, and Generative AI
  • Hands-on exposure to modern data stacks and emerging AI technologies
  • Collaboration with experts across Data, AI/ML, and cloud practices
  • Access to structured learning, certifications, and leadership mentoring
  • Competitive compensation with fast-track career growth and visibility
  • Fulltime
Read More
Arrow Right

Quality Engineer - AI and Data Platforms

This is a pioneering Quality Engineer role at the intersection of data engineeri...
Location
Location
United Kingdom , Manchester
Salary
Salary:
44000.00 - 66000.00 GBP / Year
matillion.com Logo
Matillion
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid foundation in data engineering: including SQL, ETL/ELT design, and specific experience building data pipelines and managing data movement
  • Strong practical AI experience: you have used, experimented with, and are an advocate for an AI-first approach to quality engineering
  • Proficiency in coding in Java or JavaScript to navigate the codebase and implement quality frameworks
  • Demonstrated Autonomy, Curiosity, and Problem-solving skills, with a willingness to look at challenges in a different way and ask for assistance as needed
  • Experience in managing end-to-end testing of SaaS applications, including developing and maintaining efficient test automation tooling
Job Responsibility
Job Responsibility
  • Leveraging AI and agentic solutions, including our agentic AI product Maia, to accelerate investigation, generate test cases, and increase quality assurance across the Data Productivity Cloud
  • Performing root cause analysis on pipeline stability issues, particularly identifying why DPC pipelines run out of memory (OOM) within the agents
  • Building pipelines to automate every process, solutionizing problems to increase overall team and product productivity
  • Acting as a crucial bridge by collaborating extensively with various teams, raising problems, and ensuring that fixes are implemented effectively
  • Adopting, implementing, and championing shift-left testing practices across the team, leading an automation-first approach
What we offer
What we offer
  • Company Equity
  • 30 days holiday + bank holidays
  • 5 days paid volunteering leave
  • Health insurance
  • Life Insurance
  • Pension
  • Access to mental health support
  • Fulltime
Read More
Arrow Right

AI-First Automation Engineer

Instawork is on a mission to create meaningful economic opportunities for skille...
Location
Location
United States , San Francisco
Salary
Salary:
120000.00 - 150000.00 USD / Year
instawork.com Logo
Instawork
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 1+ years of experience in AI model development and proficient in testing, evaluating and setting model quality standards
  • 2+ years of experience in QA automation
  • BS or MS in Computer Science or related field
  • Programming experience in Python + Javascript or similar language
  • Thorough knowledge of automation testing frameworks, tools and release processes
  • Self-motivated, especially in learning new software tools and best practices in software quality assurance
  • Startup mentality: self-starter, multi-tasker, proactive and flexible
  • Good communication and interpersonal skills
  • You straddle a fine line between QA, software and DevOps engineering
Job Responsibility
Job Responsibility
  • Develop customized AI models for QA data and conduct prompt engineering analysis
  • Implement and evolve QA processes to get effective test signals and scale testing efforts across multiple products
  • Build advanced automation architecture and integrate AI tools, thereby reducing manual intensive repetitive tasks
  • Transform our automation by integrating cutting-edge AI tools and methodologies, creating smarter, faster, and more resilient frameworks that elevate our efficiency and coverage standards
  • Help solve cross-platform testing challenges and contribute impactful ideas to improve quality
  • Build a self-optimizing QA system that scales with the growth of our products
  • Partner with engineering and infrastructure teams to leverage automation for scalable solutions to prevent regressions and ensure reliability of products
What we offer
What we offer
  • Variety of medical, dental, and vision plans with coverage beginning on the date of hire
  • Flexible paid time off
  • At least 8 paid company holidays annually
  • Phone stipend
  • Commuter stipend
  • Supplemental pay on qualified leaves
  • Employee health savings accounts (HSA) contribution
  • Flexible spending plans
  • 401K plan
  • Perkspot - discount program through Lumity
  • Fulltime
Read More
Arrow Right

Data & AI Impact Consultant Engineer

As a Data Consultant, you are a cornerstone of our Data & AI Business Unit – tec...
Location
Location
Belgium
Salary
Salary:
Not provided
https://www.inetum.com Logo
Inetum
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience in data engineering or analytics projects
  • Good knowledge of Dutch and English (French is an asset)
  • Familiar with Azure stack (Data Factory, Synapse, Storage, Purview, Functions) and/or Databricks
  • Structural and flexible thinking
  • Interest in AI and its role in modern data products (prompt engineering, GenAI, monitoring, automation)
  • Ability to create business impact and understand outcomes
  • Team-oriented mindset
Job Responsibility
Job Responsibility
  • Design and build modern data platforms (Azure, Databricks, Data Fabric) with focus on reusability and AI-readiness
  • Deliver customer- and future-oriented value
  • Help colleagues grow through coaching, feedback, or knowledge sharing
  • Provide consultancy with solution-oriented approach
  • Take initiative in client development, talent growth, or community engagement
What we offer
What we offer
  • Company car
  • Fuel/charging card
  • Group insurance
  • Hospitalization coverage
  • 32 days of annual leave
  • Hybrid working options
  • Satellite offices
  • Continuous learning & development
  • Training and certification programs
  • Fulltime
Read More
Arrow Right

Data & AI Impact Consultant Engineer

Data Consultant role in Data & AI Business Unit, designing and building modern d...
Location
Location
Belgium
Salary
Salary:
Not provided
https://www.inetum.com Logo
Inetum
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience in data engineering or analytics projects
  • Good knowledge of Dutch and English (French is an asset)
  • Familiarity with Azure stack (Data Factory, Synapse, Storage, Purview, Functions) and/or Databricks
  • Structural and flexible thinking
  • Interest in AI and its role in modern data products (prompt engineering, GenAI, monitoring, automation)
  • Ability to create business impact and understand outcomes
  • Team-oriented mindset
Job Responsibility
Job Responsibility
  • Design and build modern data platforms (Azure, Databricks, Data Fabric) with focus on reusability and AI-readiness
  • Deliver value today while preparing for tomorrow
  • Help colleagues grow through coaching, feedback, or knowledge sharing
  • Provide consultancy with solution-oriented approach
  • Take initiative beyond projects to help build Inetum
What we offer
What we offer
  • Company car
  • Fuel/charging card
  • Group insurance
  • Hospitalization coverage
  • 32 days of annual leave
  • Hybrid working options
  • Satellite offices
  • Training and certification programs
  • Fulltime
Read More
Arrow Right