CrawlJobs Logo

Data Engineer 2

Spain, Madrid · Job Posted April 23, 2026
Apply Position
Job Link Share

Job Description

We are seeking a Data Engineer P2 who is a self-starter to work in a diverse and fast-paced environment as part of our Capital Markets Data Engineering team. This individual contributor role is responsible for designing and developing data solutions that are strategic to the business and built on the latest technologies and patterns. This is a global role that requires partnering with the broader JLLT team at the country, regional, and global levels by utilizing in-depth knowledge of data, infrastructure, technologies, and data engineering experience.

Job Responsibility

  • Design and implement robust, scalable data pipelines using Databricks, Apache Spark, and Delta Lake as well as BigQuery
  • Design and implement efficient data pipeline frameworks, ensuring the smooth flow of data from various sources to data lakes, data warehouses, and analytical platforms
  • Troubleshoot and resolve issues related to data processing, data quality, and data pipeline performance
  • Document data infrastructure, data pipelines, and ETL processes, ensuring knowledge transfer and smooth handovers
  • Create automated tests and integrate them into testing frameworks
  • Configure and optimize Databricks workspaces, clusters, and job scheduling
  • Work in a Multi-cloud environment including Azure, GCP and AWS
  • Implement security best practices including access controls, encryption, and audit logging
  • Build integrations with market data vendors, trading systems, and risk management platforms
  • Establish monitoring and performance tuning for data pipeline health and efficiency
  • Collaborate with cross-functional teams to understand data requirements, identify potential data sources, and define data ingestion
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver data solutions that meet their needs

Requirements

  • Bachelor's degree in Computer Science, Data Engineering, or a related field (Master's degree preferred)
  • Minimum 3-5 years of experience in data engineering or full-stack development, with a focus on cloud-based environments
  • Strong expertise in managing big data technologies (Python, SQL, PySpark, Spark) with a proven track record of working on large-scale data projects
  • Strong Databricks experience
  • Strong database/backend testing with the ability to write complex SQL queries for data validation and integrity
  • Strong experience in designing and implementing data pipelines, ETL processes, and workflow automation
  • Familiarity with data warehousing concepts, dimensional modeling, data governance best practices, and cloud-based data warehousing platforms (e.g., Google BigQuery, Snowflake)
  • Experience with cloud platforms such as Microsoft Azure, or Google Cloud Platform (GCP)
  • Experience working in DevOps model
  • Experience with Unit, Functional, Integration, User Acceptance, System, and Security testing of data pipelines
  • Strong problem-solving skills and ability to analyze complex data processing issues
  • Excellent communication and interpersonal skills to collaborate effectively with cross-functional teams
  • Attention to detail and commitment to delivering high-quality, reliable data solutions
  • Ability to adapt to evolving technologies and work effectively in a fast-paced, dynamic environment

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer 2

8 matching positions

Data Engineer 2

Delivery Data Solutions (DDS) is a horizontal team responsible to transform data...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science or a related technical field, or equivalent practical experience
  • Experience coding using a general-purpose programming language such as Java, Python, Go or similar
  • Experience working with data processing frameworks such as Spark, Hive or similar technologies
  • Understanding of data warehousing concepts and analytical data modeling
  • Experience writing data transformation logic, queries and scripts for data processing workflows
  • Strong problem-solving skills and ability to work collaboratively with cross-functional teams
Job Responsibility
Job Responsibility
  • Build and maintain data pipelines and data products that power analytics, reporting and machine learning use cases across the Delivery organization
  • Develop batch and real-time data processing workflows that transform large datasets into reliable and well-structured data assets
  • Contribute to the development of core business metrics and analytical datasets used by product, data science and engineering teams
  • Work closely with product engineers, data scientists and analysts to understand data requirements and implement scalable solutions
  • Ensure data quality, reliability and timeliness across pipelines by following established data engineering best practices
  • Support performance optimizations and infrastructure improvements to improve pipeline efficiency and maintain SLA commitments
  • Participate in improving data engineering tools, processes and documentation within the team
  • Fulltime
Read More
Arrow Right

Data Engineer 2

The Delivery Data Solutions (DDS) team is a horizontal team responsible to trans...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science or related technical field or equivalent practical experience
  • Experience coding using general purpose programming language (eg. Java, Python, Go, Scala)
  • Understanding of Data tech stack eg: Spark, Hive, Kafka
  • Data warehouse experience
  • Scripting and programming skill
Job Responsibility
Job Responsibility
  • Build Data Products for business use cases - batch & real time
  • Metrics development for the analytical needs
  • Optimizations & improvements focussed on optimal resource utlization, improve SLA and adhere to the data quality standards
  • Consult and advise the product engineering teams on the data engineering practices
  • Fulltime
Read More
Arrow Right

Data Engineer 2

We are seeking a Data Engineer P2 who is a self-starter to work in a diverse and...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
jll.com Logo
JLL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Data Engineering, or a related field (Master's degree preferred)
  • Minimum 3-5 years of experience in data engineering or full-stack development, with a focus on cloud-based environments
  • Strong expertise in managing big data technologies (Python, SQL, PySpark, Spark) with a proven track record of working on large-scale data projects
  • Strong Databricks experience
  • Strong database/backend testing with the ability to write complex SQL queries for data validation and integrity
  • Strong streaming and real-time API/service validation including automation
  • Experience with automated web services (WSDL) and microservices (REST) using custom scripts and assertions for data validation and data-driven testing
  • Experience with cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
  • Proficiency in object-oriented programming and software design patterns
  • Experience working in DevOps model, including installing, configuring, and integrating automation scripts on continuous integration tools (CI/CD) and GitHub for real-time test suite execution and troubleshooting
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable and efficient cloud-based data infrastructure using SQL and PySpark
  • Collaborate with cross-functional teams to understand data requirements, identify potential data sources, and define data ingestion architecture
  • Design and implement efficient data pipeline frameworks, ensuring the smooth flow of data from various sources to data lakes, data warehouses, and analytical platforms
  • Troubleshoot and resolve issues related to data processing, data quality, and data pipeline performance
  • Stay updated with emerging technologies, tools, and best practices in cloud data engineering, SQL, and PySpark
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver data solutions that meet their needs
  • Document data infrastructure, data pipelines, and ETL processes, ensuring knowledge transfer and smooth handovers
  • Create complex automated tests and integrate them into testing frameworks
  • Fulltime
Read More
Arrow Right

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
  • Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
  • Experience building data lake or data engineering products, tools, or pipelines
  • Familiarity with container-based architectures (Docker, Kubernetes)
  • Ability to debug complex distributed systems on Linux and/or Windows platforms
Job Responsibility
Job Responsibility
  • Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
  • Use AI tools and coding best practices across the development lifecycle
  • Design data refresh, scheduling, and query optimisation features with minimal supervision
  • Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
  • Coach junior engineers through code reviews
  • Debug complex issues in distributed systems running on Azure, Linux, and Windows
  • Run live site operations on a rotational, on-call basis
  • Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
  • Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features
  • Fulltime
Read More
Arrow Right

Level 2 Data Engineer

Location
Location
India , Bellandur
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 04, 2026
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field with a focus on data engineering or data analytics
  • Strong proficiency in programming languages such as Python, SQL, Java, or Scala for data processing and analysis
  • Experience with data modeling, ETL processes, data warehousing, data integration, and data pipeline development
  • Proficiency in relational databases (e.g., SQL, PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra)
  • Working knowledge of cloud platforms such as Snowflake, AWS, Azure, or Google Cloud Platform for data storage and processing
  • Experience with data visualization tools (e.g., Power BI) to create meaningful insights from data
  • Understanding of data quality principles, data governance, and data validation processes
  • Ability to analyze complex data sets, identify trends, patterns, and insights to drive data-driven decision-making
  • Proficiency in troubleshooting data-related issues, identifying root causes, and implementing solutions
  • Familiarity with project management methodologies to contribute effectively to project planning and execution
Job Responsibility
Job Responsibility
  • Develop pipelines using the standard patterns for data pipelines and workflows utilizing Kestra, dbt, Git
  • Design and Implement data storage and processing solutions employing Snowflake
  • Utilize AWS services for cloud-based platform tooling infrastructure including but not limited to: Lambda, ECS, MSK, RDS, EC2, Secrets Manager, ALB, Cloud Watch, Event Bridge
  • Utilize Terraform for AWS and Azure deployments
  • Leverage and integrate APIs for data access and manipulation
  • Write Python scripts for data common processing and automation tasks
  • Leverage Platform API's and Web Applications to enforce Platform Security
  • Development experience with SQL, Python, C#, .net, JavaScript, shell scripts & container platforms like Docker
  • Create and execute comprehensive test plans to ensure the pipelines functionality and performance
  • Develop unit tests, integration tests, and end-to-end tests for data pipelines and workflows
What we offer
What we offer
  • Commitment to your ongoing development, including on the job opportunities and formal programs
  • Inclusive parental leave entitlements for both parents
  • Values led culture
  • Flexible work options
  • Generous annual leave, sick leave and casual leave
  • Cultural and religious leave with flexible public holiday opportunities
  • A competitive remuneration package featuring performance based incentives with uncapped Employer Provident Fund
  • Fulltime
Read More
Arrow Right

Software Engineer 2, Azure Data Platform

Microsoft is a company where passionate innovators come to collaborate, envision...
Location
Location
Costa Rica , San José
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Global collaboration is integral to our work at Microsoft, and proficiency in English is essential for effective communication in this role
  • Prior experience building or working with distributed systems or cloud-based services
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role, including Microsoft Cloud Background Check
Job Responsibility
Job Responsibility
  • Design, produce and deliver software to improve the reliability, scalability, performance, security, and efficiency of a cloud service
  • Contribute with fixing, enhancing, and supporting our services in production, including periodic on-call duties
  • Contribute to the development and implementation of automation solutions within production environments
  • Collaborate with colleagues across the world to address all requirements needed to run enterprise-grade services
  • Participate actively in code reviews, bug/issue triage with the feature teams, and support well informed decisions towards business and engineering goals
  • Review and influence ongoing design, architecture, standards and methods for operating services and systems
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Software Engineer 2 - Azure Data

Microsoft’s Azure Data engineering team is leading the transformation of analyti...
Location
Location
Serbia , Belgrade
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science or Engineering or Mathematics or Statistics or Physics OR equivalent experience
  • Some experience in design and development of computing systems
  • Experience working in a fast-paced environment working with several teams to develop production quality software
  • Proven track record in delivering reliable, scalable and highly performant end-to-end solutions
  • Excellent communication and demonstrated ability to drive cross-team improvements
  • Hands-on engineering experience developing and managing scalable cloud services
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Build and maintain highly reliable cluster/distributed environments and enable engineers to rapidly deploy bits and verify their changes end to end
  • Design, develop and maintain highly reliable engineering systems and infrastructure that enable building world class products leveraging new technologies and AI
  • Work with a large set of engineers across orgs and teams to troubleshoot issues, find root causes and bring them to closure
  • Support development teams and internal stakeholders by maintaining and running tight and efficient engineering systems and services
  • Partner with stakeholders (e.g., project manager, technical leads) to define product requirements and create technical designs for future product capabilities
  • Collaborate with members within and across teams at Microsoft
  • Produce extensible and maintainable code with a focus on security, reliability, diagnosability, and performance
  • Lead design discussions with the team and share learnings from investigations, holding ownership for design decisions
  • Contribute to the roadmap, architecture, design and planning
  • Participate in on-call rotation for maintaining service health along with other things
  • Fulltime
Read More
Arrow Right

Software Engineer 2 - Azure Data SQL MI

We are Azure Databases, a Microsoft team that drives the future of databases in ...
Location
Location
Serbia , Belgrade
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Degree in Computer Science or a related engineering discipline OR equivalent experience
  • Experience in system programming
  • Some software development experience
  • Ability to effectively communicate in English
  • Great collaboration and team-player skills
Job Responsibility
Job Responsibility
  • Design, produce and deliver software to improve the reliability, scalability, performance, security, and efficiency of a cloud service
  • Contribute with fixing, enhancing, and supporting our services in production, including periodic on-call duties
  • Collaborate with colleagues across the world to address all requirements needed to run enterprise-grade services
  • Participate actively in code reviews, bug/issue triage with the feature teams, and support well informed decisions towards business and engineering goals
  • Review and influence ongoing design, architecture, standards and methods for operating services and systems
  • Fulltime
Read More
Arrow Right