CrawlJobs Logo

Team Lead Data Engineer

· Job Posted December 07, 2025

Job offer has expired

Job Link Share

Job Description

Data Management Platform is the core system that receives, processes and provides information to other external DMPs and real time platforms. The purpose of DMP is to store the connection between users/devices and their respective behavioral categories. Further this data is used by the other teams for the analytics and digital ad targeting. Team roadmap includes developing a new system based on the streaming architecture with a relevant tech stack.

Job Responsibility

  • Perform the team lead / people management role for 3 our engineers: 1:1s, ensuring high motivation and retention, working with feedback, mentoring and tech support
  • Perform the tech lead role for a mixed team of +-5 customer and Coherent engineers: coordination, task distribution, technical assistance
  • End-to-end development and ownership, from design to production
  • Implement high scale Big-Data solutions and contribute to our platform infrastructure and architecture
  • Research core technologies and integrations with external APIs and services
  • Work with various stakeholders: Product, Engineering, Data providers, and etc.
  • Participate in off-hours Pager Duty

Requirements

  • Desire and readiness to perform a team lead role and a tech lead role
  • 5+ years of experience in Java
  • Strong knowledge of algorithms and data structures
  • Readiness to deep dive into legacy codebase
  • Experience with SQL DBs
  • Solid experience with Kafka, streaming systems, microservices
  • Experience in dealing with performance and high scale systems
  • Understanding of Hadoop/Spark/big data tools
  • Analytical thinking, ability to deeply investigate tasks and understand how system components works from business side
  • Reliability, confidence and readiness to deal with production issues
  • Passion to offer new solutions and improvements
  • Good people management and communication skills
  • English - at least solid B1+ with the ability to speak and express themselves

Nice to have

  • Experience with Kubernetes
  • Experience with Gitlab, Grafana, InfluxDB, Airflow, Redis, Scala
  • Team leadership experience

What we offer

  • Technical and non-technical training for professional and personal growth
  • Internal conferences and meetups to learn from industry experts
  • Support and mentorship from an experienced employee to help you professional grow and development
  • Internal startup incubator
  • Health insurance
  • English courses
  • Sports activities to promote a healthy lifestyle
  • Flexible work options, including remote and hybrid opportunities
  • Referral program for bringing in new talent
  • Work anniversary program and additional vacation days

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Team Lead Data Engineer

8 matching positions

Team Lead - Data Engineer

Looking for stable projects with modern tech and room to grow? We are Clouds on ...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
cloudsonmars.com Logo
Clouds on Mars Sp. z o. o.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience delivering data engineering solutions in a consulting or multi-client project environment
  • Strong technical expertise with the Microsoft Azure ecosystem (Data Factory, Synapse, Fabric), Databricks, and Power BI
  • Solid background in ETL/ELT design, data integration, data modeling, and performance optimization
  • Proven people management experience, including performance evaluation, coaching, and career development
  • Excellent communication skills and ability to engage with both technical and business stakeholders
  • Fluency in English and Polish
Job Responsibility
Job Responsibility
  • Design and deliver scalable ETL/ELT pipelines, data models, and reporting solutions using technologies such as Azure Data Factory, Synapse, Fabric, Databricks, and Power BI
  • Architect modern data platforms (data warehouse, data lake, or lakehouse) with performance, scalability, and reliability in mind
  • Collaborate with technical stakeholders to translate business requirements into robust, production-ready data solutions
  • Contribute to CI/CD processes, code quality standards, automated testing, and documentation
  • Act as a senior technical contributor across one or more client projects in a consulting setting
  • Act as direct people manager for a team of data engineers, responsible for performance reviews, development planning, and career coaching
  • Conduct regular 1:1s, provide feedback, and support skills growth through mentoring and learning opportunities
  • Balance and allocate team members across multiple projects, ensuring workload clarity and capacity planning
  • Foster a healthy, collaborative team culture by promoting open communication, continuous improvement, and psychological safety
  • Monitor team morale and resolve delivery blockers that affect individual or team performance
What we offer
What we offer
  • Flexible working hours
  • Private health insurance (UNUM up to PLN 350,000, advanced up to PLN 500,000)
  • Co-funding for PZU, Medicover or LuxMed medical packages
  • Multisport card
  • Access to training platforms (MS certificates, SQL BI, internal Delivery Excellence Workshops)
  • Breakfasts, fruit, snacks, and always-chilled drinks in the office
  • Anniversary gifts and quarterly integration budgets
  • Paid referral program (up to PLN 8,000)
  • „It’s good to stay with us” – PLN 2,500 voucher after 3 years with the company
  • Fulltime
Read More
Arrow Right

Principal Engineer, Computer Vision & AI /3D Data (Team Lead)

Cesium is the leading open platform for streaming and visualizing huge 3D geospa...
Location
Location
Salary
Salary:
Not provided
bentley.com Logo
Bentley Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • PhD or equivalent in Computer Vision, AI, or Machine Learning
  • 10+ years' experience as a Software Engineer
  • at least 5+ years leading and mentoring technical teams within a product driven environment
  • 5+ years of experience in AI/3D vision development including industry experience of deploying AI and working with 3D data, including ML ops and practical, user-focused product development
  • Expertise in deep learning, computer vision, 3D geometry, and multimodal AI, including experience with large language models
  • Strong programming skills in Python and/or C++ with ML frameworks (PyTorch, TensorFlow), GPU programming (CUDA)
  • Excellent communication and leadership skills
  • Fluent in English
Job Responsibility
Job Responsibility
  • Lead and mentor a team of 5 engineers, providing technical direction and project coordination in computer vision and AI/3D data modeling projects, providing coaching and guidance
  • Design and deploy advanced AI/ML and 3D vision algorithms generated by our modelling team for large-scale datasets for practical, user focused product development including point clouds, meshes, sensor data and Gaussian splatting
  • Define the AI strategy and contribute to product roadmap decisions
  • Implement ML Ops practices for scalable, automated training and inference pipelines
  • Conduct research on emerging AI techniques for 3D understanding and integrate findings into production
  • Ensure quality through rigorous evaluation, optimization, and code reviews
What we offer
What we offer
  • A great Team and culture
  • An exciting career as an integral part of a world-leading software company providing solutions for architecture, engineering, and construction
  • An attractive salary and benefits package
  • A commitment to inclusion, belonging and colleague wellbeing through global initiatives and resource groups
  • A company committed to making a real difference by advancing the world’s infrastructure for better quality of life, where your contributions help build a more sustainable, connected, and resilient world
Read More
Arrow Right

Lead Data Engineer - Data Pipelines

Economic Intelligence is a Mastercard Services program within Economic & Busines...
Location
Location
Czechia , Prague
Salary
Salary:
Not provided
mastercard.com Logo
Mastercard
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong professional experience with Python building production-grade systems
  • Strong SQL skills, including writing readable and well-tuned queries for large-scale datasets
  • Experience leading design and delivery of data pipelines and/or data platform components, with attention to scalability, reliability, and maintainability
  • Familiarity with Databricks (or similar Spark-based data platforms)
  • Comfortable using LLM‑based coding tools, with the discipline to validate, test, and take full ownership of the generated code
  • Strong foundation in object-oriented software design and engineering best practices
  • Comfortable with Linux command line and production troubleshooting
  • Clear communicator with strong written and verbal English
  • Ownership mindset: motivation, creativity, self-direction, and ability to thrive in small, collaborative teams while influencing across boundaries
  • Passion for analytical/quantitative problem solving, quality, and continuous improvement of both platform and team processes
Job Responsibility
Job Responsibility
  • Lead technical execution to deliver end-to-end capabilities from data processing through publishing and customer consumption
  • Design, build, and evolve scalable, maintainable data pipelines that deliver insights from economic data
  • Drive performance, reliability, observability, and readability in the data platform codebase
  • Own and unify the data layer across multiple products, establishing shared patterns, reusable components, and clear interfaces
  • Translate business needs into durable technical designs
  • Tackle technical debt strategically
  • Set engineering direction and standards for pipeline development and cross-team integration
  • Write, test, and review code
  • Provide technical leadership through mentorship, rigorous code reviews, and support for other engineers’ growth and delivery
  • Continuously innovate, evaluating new approaches, tools, and technologies
  • Fulltime
Read More
Arrow Right

Lead Data Engineer - Data Pipelines

Economic Intelligence is a Mastercard Services program within Economic & Busines...
Location
Location
Czechia , Prague
Salary
Salary:
Not provided
mastercard.com Logo
Mastercard
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong professional experience with Python building production-grade systems
  • Strong SQL skills, including writing readable and well-tuned queries for large-scale datasets
  • Experience leading design and delivery of data pipelines and/or data platform components, with attention to scalability, reliability, and maintainability
  • Familiarity with Databricks (or similar Spark-based data platforms)
  • Comfortable using LLM‑based coding tools
  • Strong foundation in object-oriented software design and engineering best practices
  • Comfortable with Linux command line and production troubleshooting
  • Clear communicator with strong written and verbal English
  • Ownership mindset: motivation, creativity, self-direction, and ability to thrive in small, collaborative teams while influencing across boundaries
  • Passion for analytical/quantitative problem solving, quality, and continuous improvement of both platform and team processes
Job Responsibility
Job Responsibility
  • Lead technical execution to deliver end-to-end capabilities from data processing through publishing and customer consumption
  • Design, build, and evolve scalable, maintainable data pipelines that deliver insights from economic data
  • Drive performance, reliability, observability, and readability in the data platform codebase
  • Own and unify the data layer across multiple products, establishing shared patterns, reusable components, and clear interfaces
  • Translate business needs into durable technical designs
  • Tackle technical debt strategically
  • Set engineering direction and standards for pipeline development and cross-team integration
  • Write, test, and review code
  • Provide technical leadership through mentorship, rigorous code reviews, and support for other engineers’ growth and delivery
  • Continuously innovate, evaluating new approaches, tools, and technologies
  • Fulltime
Read More
Arrow Right

Data Engineer Lead (OT Data)

Data Engineer (OT Data) (Category - Engineer) Sector: Oil and Gas Location: Doha...
Location
Location
Qatar , Doha
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's in engineering, Information Systems, or a related quantitative field
  • 5+ years of proven experience in a data engineering role
  • Experience within oil and gas industry is highly preferred
  • Demonstrable experience building and operationalizing large-scale data pipelines and applications
Job Responsibility
Job Responsibility
  • Architect & Build Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems and ETL/ELT pipelines
  • Integrate Diverse Data Sources: Develop processes to ingest and integrate high-volume, high-velocity data from SCADA systems, historians (like OSIsoft PI, Aspen InfoPlus.21), DCS, PLC, and IoT sensors
  • Cloud Data Platform Development: Implement and manage data solutions on the Microsoft Azure cloud platform, Leveraging services like Azure IoT Hub, Azure Event Hubs, and Azure Stream Analytics for real-time ingestion and processing of operational technology (OT) data
  • Data Modelling & Warehousing: Design and implement data models optimized for time-series data from industrial assets, supporting operational dashboards and real-time analytics
  • Enable Advanced AI: Build the data infrastructure to support AI/ML models for predictive maintenance, operational anomaly detection, and process optimization using real-time OT data
  • Champion Master Data Management (MDM): Design and implement MDM strategies and solutions to create a single, authoritative source of truth for critical data domains such as wells, equipment, and assets, ensuring data consistency across the enterprise
  • Ensure Data Quality & Governance: Implement robust data quality checks, validation rules, and monitoring to ensure the accuracy, consistency, and reliability of our data. Adhere to and help shape our data governance policies
  • Embrace Industry Standards: Champion and implement industry-specific data standards and models, such as the OSDU™ Data Platform, to ensure interoperability and a unified data view across the upstream lifecycle
  • Collaborate & Innovate: Work closely with a cross-functional team of geoscientists, drilling engineers, data scientists, and business analysts to understand their data needs and deliver effective solutions
  • Automate & Optimize: Identify opportunities for process automation and infrastructure optimization to improve data delivery, scalability, and cost-effectiveness
  • Fulltime
Read More
Arrow Right

Lead Data Engineer - Nexus Data Products

Do you love building and pioneering in the technology space? Do you enjoy solvin...
Location
Location
United States , McLean
Salary
Salary:
197300.00 - 225100.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • Performance based incentive compensation which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right
New

Lead Data Engineer (Bank Tech)

Do you love building and pioneering in the technology space? Do you enjoy solvin...
Location
Location
United States , New York, New York; Wilmington, Delaware
Salary
Salary:
179400.00 - 245600.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
  • Fulltime
Read More
Arrow Right
New

Lead Data Engineer

Lead Data Engineer. Do you love building and pioneering in the technology space?...
Location
Location
United States , McLean, Virginia; Richmond, Virginia; Chicago, Illinois
Salary
Salary:
179400.00 - 225100.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Health benefits
  • Financial benefits
  • Other benefits
  • Fulltime
Read More
Arrow Right