Data Engineering Tech Lead – Azure Databricks Job at Lingaro

Data Engineering Tech Lead-Azure

Location

India

Salary:

Not provided

Lingaro

Expiration Date

Until further notice

Requirements

A bachelor's or master’s degree in computer science, Information Systems, or a related field is typically required
Minimum of 8-10 years of experience in data engineering or a related field
Strong technical skills in data engineering, including proficiency in programming languages such as Python, SQL, R or Scala
Practical experience with Microsoft Azure cloud and Databricks platform
Expertise in working with various data tools and technologies, such as ETL frameworks, data pipelines, and data warehousing solutions
Proven experience in leading and managing a team of data engineers
In-depth knowledge of data management principles and best practices, including data governance, data quality, and data integration
Strong project management skills
Excellent problem-solving and analytical skills
Knowledge of data security and privacy regulations

Job Responsibility

Efficient and effective project delivery is the primary responsibility of the tech lead
Provide leadership and guidance to the data engineering team, including mentoring, coaching, and fostering a collaborative work environment
Set clear goals, assign tasks, and manage resources to ensure successful project delivery
Work closely with developers to support them and improve data engineering processes
Support team members with troubleshooting and resolving complex technical issues and challenges
Utilize and promote Generative AI tools to accelerate project delivery
Provide technical expertise and direction in data engineering
Collaborate with stakeholders to understand project requirements, define scope, and create project plans
Support project managers to ensure that projects are executed effectively, meeting timelines, budgets, and quality standards
Act as a trusted advisor for the customer

What we offer

Stable employment
100% remote
Flexibility regarding working hours
Comprehensive online onboarding program with a “Buddy” from day 1
Cooperation with top-tier engineers and experts
Unlimited access to the Udemy learning platform from day 1
Certificate training programs
Upskilling support
Grow as we grow as a company
A diverse, inclusive, and values-driven community

Fulltime

Tech Lead - Software Engineering, Data Platform

Location

Egypt , Cairo

Salary:

Not provided

Coca-Cola HBC

Expiration Date

Until further notice

Requirements

5 years of experience in leading and managing engineering teams
Practical experience in object-oriented programming, design patterns, software architecture
Knowledge about algorithms and data structures, with focus on solving complex problems
Ability to write well designed and testable code
Proficiency in Python and Spark
Expert knowledge of Azure data services and frameworks, such as Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage
Familiarity with data warehousing and business intelligence concepts and methodologies
Ability to work independently and in a team
Degree in Computer Science, Information Technology, Engineering, or related field
Strong ability to work independently, manage your own priorities, and deliver under ambiguity

Job Responsibility

Lead and mentor a team of platform engineers in delivering high-quality solutions using Python, Object Oriented Programming and Spark
Design and delivery of software solutions using Azure data services and frameworks, such as Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Microsoft Fabric and more
Work with stakeholders and Product Managers to understand required platform capabilities
Support End to end Platform roadmap planning and delivery together with Product Managers
Own platform lifecycle management, including upgrades, operational stability, reliability, and continuous improvements
Drive solution design, testing, troubleshooting, deployment, and operational excellence across Azure environments
Provide technical leadership, coaching, and knowledge sharing across engineering teams and platform users
Stay updated with the latest Azure data technologies and best practices
Ensure that the platform is scalable, reliable, secure, and compliant with the organization standards and policies
Collaborate closely with data scientists, BI analysts, and business stakeholders to understand requirements and translate them into technical solutions - including data products that feed AI/ML models built on Databricks

What we offer

Coaching and mentoring programs
Development opportunities
Equal opportunity employer
IT Equipment
Work with iconic brands
Supportive team

Fulltime

Data Engineer Tech Lead

We are seeking a Data Engineer Tech Lead to join our capital markets data engine...

Location

Israel , Tel Aviv

Salary:

Not provided

JLL

Expiration Date

Until further notice

Requirements

Engineering experience with strong expertise in Apache Spark and distributed computing
Strong programming skills in Python including data handling libraries (pandas, numpy, etc.), and data modeling
Proficient in Databricks platform and Delta Lake for data lake architecture
Proficient in writing complex SQL queries
Experience with cloud-based databases (Google BigQuery \ Snowflake)
Advanced SQL skills and experience with both relational and NoSQL databases
Bachelor's degree in Computer Science, Engineering or related field
Experience with integration of multiple data sources and working with various databases technologies

Job Responsibility

Design and implement robust, scalable data pipelines using Databricks, Apache Spark, and Delta Lake as well as BigQuery
Use SQL and Python to develop, scale, and optimize advanced data pipelines
Build and optimize ETL/ELT processes for capital markets data
Develop real-time and batch processing solutions to support trading and risk management operations
Implement data quality monitoring, validation, and alerting systems
Configure and optimize Databricks workspaces, clusters, and job scheduling
Work in a Multi-cloud environment including Azure, GCP and AWS
Implement security best practices including access controls, encryption, and audit logging
Build integrations with market data vendors, trading systems, and risk management platforms
Establish monitoring and performance tuning for data pipeline health and efficiency

Fulltime

New

Senior Manager, Data Engineering

Senior Manager, Data Engineering (Enterprise Platforms Technology) Do you love ...

Location

United States , McLean

Salary:

229900.00 - 262400.00 USD / Year

Capital One

Expiration Date

Until further notice

Requirements

Bachelor's Degree
At least 6 years of experience in application development (Internship experience does not apply)
At least 2 years of experience in big data technologies
At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
At least 4 years of people management experience

Job Responsibility

Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using data movement tools and technologies
Work, as a lead developer, with a team of developers with deep experience in data movement, distributed computing, and full stack systems
Utilize programming languages like Python, SQL and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Snowflake, Databricks
Optimize information system for end-user and downstream application consumers by using sound data design practices
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

What we offer

Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
Competitive set of health, financial and other benefits

Fulltime

Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)

Do you love building and pioneering in the technology space? Do you enjoy solvin...

Location

United States , McLean, Virginia; Chicago, Illinois

Salary:

179400.00 - 225100.00 USD / Year

Capital One

Expiration Date

Until further notice

Requirements

Bachelor’s Degree
At least 4 years of experience in application development (Internship experience does not apply)
At least 2 years of experience in big data technologies
At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Job Responsibility

Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using data movement tools and technologies
Work, as a lead developer, with a team of developers with deep experience in data movement, distributed computing, and full stack systems
Utilize programming languages like Python, SQL and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Snowflake, Databricks
Optimize information system for end-user and downstream application consumers by using sound data design practices
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

What we offer

Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
Comprehensive, competitive, and inclusive set of health, financial and other benefits

Fulltime

Tech Lead

EY.ai Data Marketplace is looking for a proactive, dynamic, and adaptable team m...

Location

India , HYDERABAD

Salary:

Not provided

Tech Mahindra

Expiration Date

July 06, 2026

Requirements

Working experience and proficiency in Pyspark, Python and SQL
Knowledge and experience in Generative AI (LLM models, prompting techniques, RAG/GraphRAG solutions)
Experience in Azure stack (ADF, Databricks, SQL Server, ADLS)
Experience in analysing, transforming, manipulating and interpreting data
Collaborative working/development using shared code repositories (Git/GitHub)
Experience analysing, transforming and modelling data structures

Job Responsibility

Develop functionalities around Data Science /Generative AI (chat bot, Agentic AI, RAG / GraphRAG)
Improve existing Pyspark/Python code to make it more performant and in line with the coding standards
Develop and maintain data pipelines with Azure stack (ADF, Databricks, SQL, ADLS)
Conduct robust data analysis
Work with Consumption Team and integrate code with API they develop
Promote coding standards amongst the Team and propose the most optimal and efficient solutions
Collaboratively identify and ideate opportunities to continuously improve Data Science Team solutions and services it provides to consumers

Director, Data Engineering & Analytics

We are seeking a Director, Data Engineering & Analytics to be a hands-on, indivi...

Location

United States

Salary:

220000.00 - 235000.00 USD / Year

Apogee Therapeutics

Expiration Date

Until further notice

Requirements

10+ years of experience in data engineering, data platform, or analytics roles, with meaningful experience owning or leading a modern cloud data platform (Data Lakehouse or cloud data warehouse)
Bachelor’s degree (or equivalent professional experience) in Life Sciences, Information Systems, Engineering, or related field
Proven track record as a hands-on senior level individual contributor
Experience with cloud-based data platforms (e.g., Databricks, Snowflake, BigQuery, or similar) and modern data stack components
Strong expertise in data modeling and ETL/ELT for analytics and reporting
Experience working closely with integration teams (ideally with MuleSoft or similar)
Prior experience in biotech / pharma / life sciences is strongly preferred, especially supporting Clinical Development, Clinical Operations, Biometrics, or Medical Monitoring
Familiarity with data from CROs and clinical systems (e.g., EDC, CTMS, safety, lab, statistical outputs)
Experience working in regulated environments (e.g., GxP, 21 CFR Part 11, HIPAA) and supporting audit/inspection readiness is highly desirable
Exposure to Apogee-relevant systems is a plus (e.g., Veeva Vault applications, Egnyte GxP repositories, SAS server, NetSuite)

Job Responsibility

Serve as the primary owner of Apogee’s Data Lakehouse architecture, roadmap, and implementation
Define the data platform to support Clinical Development and Clinical Operations, with a clear path to extend to Technical Operations, Commercial, Medical Affairs, and Finance
Design and oversee data ingestion, transformation, and storage for structured and semi-structured data from key Apogee sources
Establish and maintain subject area data models and semantic layers tailored to clinical and operational use cases
Ensure the platform is designed and operated in alignment with Apogee’s GxP, 21 CFR Part 11, SOX Controls, and other regulatory/compliance expectations
Design, build, and maintain end-to-end data pipelines (ingestion, transformation, curation) into the Data Lakehouse
Develop and maintain data models that serve Clinical Development, Clinical Operations, and later Tech Ops and Commercial / Med Affairs / Finance
Implement data quality, lineage, and metadata practices
Contribute to defining data governance at Apogee
Design and build dashboards / analytic views that support key functional area use cases

What we offer

Market competitive compensation and benefits package, including base salary, performance bonus, equity grant opportunities, health, welfare & retirement benefits
Competitive time off, including three weeks PTO, two one-week company-wide shutdowns a year and dedicated paid sick leave
Commitment to growing you professionally and providing access to resources to further your development
Apogee offers regular all team, in-person meetings to build relationships and problem solve

Fulltime

AI Tech Lead

Addepto is a leading AI consulting and data engineering company that builds scal...

Location

Poland , Warsaw; Cracow; Wroclaw; Bialystok

Salary:

19320.00 - 28560.00 PLN / Month

Addepto sp. z o.o.

Expiration Date

Until further notice

Requirements

6+ years of commercial experience in designing and implementing scalable AI solutions (Machine Learning, Predictive Modeling, Optimization, NLP, LLM, Computer Vision, GenAI)
Experience in leading end-to-end Machine Learning projects and managing cross-functional teams
Proficiency in developing ML algorithms from scratch to production deployment
Strong programming skills in Python: writing clean code, OOP design, extensive knowledge of ML libraries (Scikit-Learn, PyTorch/Tensorflow)
Proven expertise in deploying solutions in cloud environments (preferably AWS and/or Azure)
Knowledge in applying LLMs (semantic search, prompt engineering, multimodal embeddings, RAG)
High proficiency in English (C1 level)
Excellent communication skills and consulting experience with direct interaction with clients
Working experience in SQL and NoSQL databases (MongoDB, Snowflake, Databricks)
Good knowledge of CI/CD principles (GitHub and GitHub Actions)

Job Responsibility

Lead the development, implementation, and validation of Machine Learning solutions, ensuring alignment with project objectives
Lead the design of AI solution architectures that meet complex business goals and drive innovation
Research, test and select the best tools and technologies as well as AI solutions to meet the business requirements
Lead and mentor cross-functional teams, encouraging collaboration and helping everyone grow their skills
Understand clients’ needs and translate business problems into data science problems
Architect and oversee the implementation of data pipelines and workflows, setting standards for data quality and security
Coordinate with Data Engineering and Software Engineering teams to strategize and oversee the building of AI applications.
Present findings and recommendations clearly and concisely to stakeholders
Prioritize, and control tasks within an Agile/Scrum framework, ensuring timely delivery

What we offer

Work in a supportive team of passionate enthusiasts of AI & Big Data
Engage with top-tier global enterprises and cutting-edge startups on international projects
Enjoy flexible work arrangements, allowing you to work remotely or from modern offices and coworking spaces
Accelerate your professional growth through career paths, knowledge-sharing initiatives, language classes, and sponsored training or conferences, including a partnership with Databricks, which offers industry-leading training materials and certifications
Choose your preferred form of cooperation: B2B or a contract of mandate, and enjoy 20 fully paid days off
Participate in team-building events and utilize the integration budget
Celebrate work anniversaries, birthdays, and milestones
Access medical and sports packages, eye care, and well-being support services, including psychotherapy and coaching
Get full work equipment for optimal productivity, including a laptop and other necessary devices
With our backing, you can boost your personal brand by speaking at conferences, writing for our blog, or participating in meetups

Fulltime

Select Country

Data Engineering Tech Lead – Azure Databricks

Job Responsibility

Requirements

Nice to have

What we offer

Looking for more opportunities?

Data Engineering Tech Lead – Azure Databricks

Data Engineering Tech Lead-Azure

Tech Lead - Software Engineering, Data Platform

Data Engineer Tech Lead

Senior Manager, Data Engineering

Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)

Tech Lead

Director, Data Engineering & Analytics

AI Tech Lead

Our AI answers in your language