CrawlJobs Logo

Data Engineer

· Job Posted February 18, 2026
Apply Position
Job Link Share

Job Description

The project aims to centralize and streamline data across the organization by collecting information from multiple internal repositories, ensuring data integrity, security, and consistency, and delivering high-quality data to providers with minimal delay.

Job Responsibility

  • Develop and optimize ETL processes using Azure Data Factory
  • Write and maintain complex SQL scripts (DDL, DML)
  • Design and execute database queries and perform data analysis
  • Ensure efficient data transformation and integration across systems
  • Monitor data pipelines and troubleshoot issues
  • Participate in CI/CD processes using Azure DevOps
  • Test SQL logic for accuracy and functionality
  • Analyze existing systems and evaluate architecture improvements
  • Create technical documentation and user manuals

Requirements

  • 3+ years of experience in BI development, data engineering, or ETL-focused roles
  • Experience with Microsoft Azure, particularly Azure Data Factory
  • Strong knowledge of SQL Server and writing complex SQL queries
  • Solid understanding of ETL processes and data transformation
  • Experience with .NET Framework / C#
  • Knowledge of Power BI for reporting and visualization
  • Experience with Azure DevOps for CI/CD and project workflows
  • Strong analytical skills and attention to detail
  • Ability to work effectively in a collaborative team environment
  • English level: B1 (Intermediate) or higher

What we offer

  • Technical and non-technical training for professional and personal growth
  • Internal conferences and meetups to learn from industry experts
  • Support and mentorship from an experienced employee to help you professional grow and development
  • Internal startup incubator
  • Health insurance
  • English courses
  • Sports activities to promote a healthy lifestyle
  • Flexible work options, including remote and hybrid opportunities
  • Referral program for bringing in new talent
  • Work anniversary program and additional vacation days

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer

8 matching positions

Data Engineer

We’re seeking a Data Engineer to design and build scalable data pipelines in a m...
Location
Location
United States , Jacksonville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience with Azure Data Factory + Databricks
  • Strong skills in SQL and Python
  • Knowledge of data modeling (star/snowflake schemas)
  • Experience with data lakes, data warehouses, and cloud storage
  • Understanding of ETL/ELT best practices
Job Responsibility
Job Responsibility
  • Build and maintain ETL/ELT pipelines using Azure Data Factory
  • Develop data solutions in Azure Databricks (PySpark / Spark)
  • Optimize data processing performance and cost efficiency
  • Work with structured and unstructured data across cloud platforms
  • Collaborate with analytics and business stakeholders to define data requirements
  • Ensure data quality, governance, and documentation
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Free online training
Read More
Arrow Right

Data Engineer

We are looking for a Data Engineer to join a financial services organization in ...
Location
Location
United States , Greer
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience building and maintaining data pipelines using Snowflake
  • Practical knowledge of Apache Kafka for streaming or event-based data ingestion
  • Experience working in cloud-based data environments with a focus on scalable architecture
  • Familiarity with Azure Databricks and its role within broader data engineering ecosystems
  • Understanding of data quality, monitoring, and observability practices in production environments
  • Ability to troubleshoot pipeline failures and resolve performance or reliability issues efficiently
  • Experience following engineering best practices for version control, testing, and deployment
  • Exposure to AI-assisted development tools such as Claude or similar coding support platforms
Job Responsibility
Job Responsibility
  • Design, build, and deliver end-to-end data pipelines in Snowflake that support business reporting and data consumption needs
  • Create new ingestion and transformation workflows while troubleshooting pipeline issues to improve stability and performance
  • Contribute to a delivery model that balances new development with targeted optimization of existing data assets and workflows
  • Implement streaming and event-driven ingestion patterns using Kafka to support timely and scalable data movement
  • Improve observability across the data ecosystem by strengthening monitoring, alerting, and data quality controls
  • Help simplify legacy data processes by reducing technical debt and modernizing outdated pipeline components
  • Apply sound software engineering standards, including maintainable code, documentation, and repeatable development practices
  • Support the advancement of testing and CI/CD processes by helping establish more consistent engineering workflows
  • Leverage AI-assisted development tools to accelerate coding, validation, and technical documentation where appropriate
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a Data Engineer to join a financial services organization in ...
Location
Location
United States , Greer
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience building and supporting data pipelines in Snowflake
  • Working knowledge of Apache Kafka for event-driven or streaming data ingestion
  • Experience in data engineering within a cloud-first environment
  • Familiarity with Azure Databricks and its role in broader data platforms
  • Ability to follow engineering best practices across development, testing, and deployment workflows
  • Understanding of data quality, monitoring, and observability concepts in production data systems
  • Comfortable working in an environment with a mix of modern and legacy data processes
  • Exposure to AI-assisted development tools such as Claude or similar coding and documentation assistants
Job Responsibility
Job Responsibility
  • Design, build, and deliver end-to-end data pipelines in Snowflake to support business and analytics needs
  • Create new data integration workflows while troubleshooting and resolving issues in existing pipelines
  • Apply sound engineering practices for coding, documentation, testing, and deployment to improve consistency and maintainability
  • Balance hands-on development of new solutions with optimization work that improves performance, stability, and efficiency
  • Develop streaming and ingestion processes using Kafka to enable timely and dependable data movement
  • Strengthen observability and data quality controls so pipeline health and accuracy are easier to monitor and maintain
  • Help reduce technical debt by simplifying legacy data processes and modernizing pipeline design where appropriate
  • Contribute to AI-assisted engineering efforts by using approved tools to accelerate development, testing, and documentation activities
What we offer
What we offer
  • Medical
  • Vision
  • Dental
  • Life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Data Engineer

As a Data Engineer you'll scale the way data powers Veygo. Our engineering teams...
Location
Location
United Kingdom , Cardiff
Salary
Salary:
Not provided
admiralgroup.co.uk Logo
Admiral Group Plc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in a Data Engineering role
  • Strong SQL skills with experience designing efficient and scalable data models
  • Hands-on experience with Snowflake and Matillion
  • Experience working within cloud-based environments, ideally AWS
  • Good understanding of ETL/ELT methodologies and data warehousing best practices
  • Experience using Python or other scripting languages
  • Experience supporting real-time or near real-time data solutions
  • Experience improving data observability and monitoring capabilities
  • Exposure to CI/CD practices within data engineering environments
  • Understanding of data governance, security, and best practices within modern data platforms
Job Responsibility
Job Responsibility
  • Provide technical guidance on data architecture, pipeline design, and optimisation to support scalable and reliable data solutions
  • Build and maintain ETL/ELT pipelines to ensure efficient ingestion and transformation of data
  • Design and optimise data models to support analytics, reporting, and real-time decision-making
  • Collaborate with cross-functional teams to ensure data is embedded into product and business initiatives from the outset
  • Improve data quality and observability through monitoring, logging, and lineage tracking best practices
  • Champion engineering standards including automated testing, CI/CD, and effective data governance
  • Support and troubleshoot production data pipelines, identifying opportunities to improve performance and resilience
  • Deploy and maintain secure, scalable cloud-based data infrastructure within AWS
  • Share knowledge through mentoring, paired working, and collaborative learning sessions
What we offer
What we offer
  • All colleagues eligible for up to £3,600 of free shares each year after one year of service
  • 33 days holiday (including bank holidays) when they join us, increasing the longer you stay with us, up to a maximum of 38 days (including bank holidays)
  • option to buy or sell up to an additional five days of annual leave
  • Financial & Mortgage Advice
  • 24-Hour Ecare
  • Cycle to Work Scheme
  • Flexible Working
  • Simply Health
  • Private Health Cover
  • Critical Illness Cover
  • Fulltime
Read More
Arrow Right

Data Engineer

AI is changing how software gets built. The data underneath it matters more than...
Location
Location
Denmark , København
Salary
Salary:
Not provided
life-science-talent-solutions.dk Logo
Life Science Talent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • dbt, SnowFlake, Databricks, Fabric, BigQuery or similar ecosystems
  • SQL, Python and APIs
  • Data modelling and warehousing
  • GenAI, ML or MLOps workflows
  • Complex systems and problem solving
Job Responsibility
Job Responsibility
  • Building modern data platforms and pipelines
  • Creating semantic foundations for AI systems
  • Developing AI-powered workflows and agentic systems
  • Helping clients move AI into real operational environments
  • Working closely with both technical teams and decision makers
  • Shaping how modern AI infrastructure is built in practice
  • Fulltime
Read More
Arrow Right

Data Engineer

FinXL by Randstad Digital focuses on developing client's Networking, Digital and...
Location
Location
Australia , Brisbane
Salary
Salary:
Not provided
finxl.com.au Logo
FinXL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data Engineer background
  • Azure and Databricks experience
  • Experience in Cloud Infrastructure including Azure Data Lake, Databricks & Synapse
  • Experience in Data Visualisation Integration: presenting data to Power BI via Serverless SQL
  • Experience in reading and translating R, Python, and MATLAB scripts
  • Experience in Version Control - managing technical documentation and code in GitHub
Job Responsibility
Job Responsibility
  • complete an integrated data pipeline that maintains, manages, and updates the databases underpinning a process decision tool
  • Fulltime
Read More
Arrow Right
New

Data Engineer

The Senior Data Engineer is an advanced subject matter expert, accountable for t...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced knowledge of the definition and management of scoping requirements, definition and prioritization activities
  • Advanced understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models
  • Advanced expertise in Microsoft Azure Data Factory, SQL Analysis Server, SAP Data Services, SAP BTP
  • Advanced understanding of data architecture landscape between physical and logical data models
  • Analytical mindset with excellent business acumen skills
  • Problem-solving aptitude with the ability to communicate effectively, both written and verbal
  • Ability to think strategically and build effective relationships at all levels within the organization
  • Advanced expert in programing languages (Perl, bash, Shell Scripting, Python, etc.)
  • Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field
  • Relevant certifications preferred such as SAP, Microsoft Azure etc
Job Responsibility
Job Responsibility
  • Designs data models in a structured data format to enable analysis thereof
  • Designs and develops scalable extract, transformation and loading (ETL) packages from the business source systems and the development of ETL routines to populate data from sources
  • Participates in the transformation of object and data models into appropriate database schemas within design constraints
  • Interprets installation standards to meet project needs and produces database components as required
  • Directs test scenarios and is responsible for participating in thorough testing and validation to support the accuracy of data transformations
  • Accountable for running data migrations across different databases and applications, for example MS Dynamics, Oracle, SAP and other ERP systems
  • Works across multiple IT and business teams to define and implement data table structures and data models based on requirements
  • Accountable for analysis, and development of ETL and migration documentation
  • Works with various stakeholders to evaluate potential data requirements
  • Accountable for the definition and management of scoping, requirements, definition, and prioritization activities for small-scale changes and assist with more complex change initiatives
  • Fulltime
Read More
Arrow Right
New

Data Engineer

At Codvo, we are committed to building scalable, future-ready data platforms tha...
Location
Location
India , Pune
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience with Python, SQL, and GCP services (BigQuery, Dataflow, Vertex AI, Pub/Sub, Cloud Storage)
  • Experience with Airflow, CI/CD, and data pipeline orchestration
  • Familiarity with ML frameworks (scikit-learn, TensorFlow) and feature engineering
  • Expertise in API integration, data ingestion, and automation of ML pipelines
  • Strong understanding of data quality, governance, and lineage best practices
Job Responsibility
Job Responsibility
  • Design, implement, and maintain scalable data pipelines on Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, Cloud Storage)
  • Ingest and process real-time data from connected vehicles and IoT devices
  • Develop and maintain ETL/ELT workflows using Python, SQL, and Apache Beam/Spark
  • Ensure data quality, lineage, and governance in the data lake
  • Act as a bridge between data engineering and analytics teams, performing data wrangling, feature engineering, and ML model prototyping
  • Support pipeline automation and ML model deployment on GCP
  • Collaborate with AI/ML leads to operationalize machine learning pipelines and integrate data solutions with applications
  • Fulltime
Read More
Arrow Right