CrawlJobs Logo

Technical Lead, Data Engineering

Malaysia, Selangor Darul Ehsan · Job Posted May 04, 2026
Apply Position
Job Link Share

Job Description

The Technical Lead in Data Engineering at NTT DATA is an entry-level management role focused on guiding a small team of data engineers. The position requires foundational technical skills in SQL and Python, along with familiarity with ETL processes and cloud platforms like AWS, Azure, and GCP. The candidate will assist in onboarding, project coordination, and the development of data pipelines. A bachelor’s degree in Computer Science or Information Technology is required, and certifications in cloud fundamentals are preferred. This hybrid role offers an opportunity to transition from technical to leadership responsibilities.

Job Responsibility

  • Guide and support a small team of data engineers in their daily tasks
  • Assist with onboarding and provide basic mentoring under the direction of senior managers
  • Help plan and track progress of data engineering projects
  • Communicate priorities and timelines clearly to the team
  • and escalate risks and issues to senior management when needed
  • Contribute to building and maintaining data pipelines for structured and unstructured data
  • Apply best practices in ETL processes and data quality checks
  • and support troubleshooting and basic performance optimization
  • Work with analysts and business stakeholders to understand data needs
  • Translate simple business requirements into technical tasks with guidance from senior engineers
  • Identify small process improvements and share ideas with the team
  • Assist in monitoring KPIs for data systems and report findings

Requirements

  • Basic proficiency in SQL and Python
  • Familiarity with ETL concepts and cloud platforms (AWS/Azure/GCP)
  • Introductory knowledge of handling unstructured data (JSON, text files, logs)
  • Strong communication and interpersonal skills
  • Ability to coordinate tasks and support team collaboration
  • Problem-solving mindset, adaptability, and willingness to learn
  • Bachelor’s degree in Computer Science, Information Technology, or related field
  • Relevant experience in data engineering or related technical role
  • Exposure to data pipeline development and basic project coordination
  • Some experience in developing and mentoring a team

Nice to have

Certifications in cloud or data fundamentals (AWS Cloud Practitioner, Azure Fundamentals) are a plus

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Technical Lead, Data Engineering

8 matching positions

Technical Lead & Manager, Fixed Income Data Engineering

This role is for a application dev lead within the FI Data team, responsible for...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of demonstrable and relevant experience in software development
  • At least 3-5 years in a leadership role within a high-performing technical team
  • Strong understanding of Python 3.6
  • Solid understanding of REST API development
  • Demonstrable experience in driving the creation of reusable, testable, and efficient code
  • Extensive experience with the design and implementation of cloud-native applications and deployment via Kubernetes / Openshift
  • Expertise in big data computation platforms (Flink, Spark, Apache Beam) or big data distribution platforms (Hadoop, Druid, Pinot, Trino, Ignite)
  • Hands-on experience in handling various data structures
  • Proven leadership in establishing and maturing Continuous Integration and Continuous Delivery environments
  • Extensive experience with the SDLC lifecycle and in leading and coaching within an Agile environment (Scrum/Kanban)
Job Responsibility
Job Responsibility
  • Lead and oversee the design and development of high-performance green-field data analytics products
  • Collaborate strategically with other dev leads in US and Canada
  • Drive innovation within the team
  • Mentor and guide team members in applying an engineering mindset
  • Lead the evaluation and development of Proof-of-Concepts (POCs) for new strategic initiatives
  • Foster a culture of continuous learning and growth within the team
  • Provide leadership and strategic direction for post-release support
  • Manage team performance, including goal setting, performance reviews, career development
  • Participate in hiring processes
  • Facilitate effective communication within the team and across different stakeholders
  • Fulltime
Read More
Arrow Right

Technical Project Manager / Project Lead III - Data Engineering & AI Adoption Program

We are seeking a Senior-level Technical Project Manager / Project Lead III to su...
Location
Location
United States , Austin
Salary
Salary:
Not provided
mmcgrp.com Logo
MMC Group LP
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience leading technical projects or enterprise programs within data, analytics, or cloud environments
  • 10+ years of experience leading data architecture, data modeling, and data warehousing initiatives
  • Proven experience managing enterprise business intelligence, big data, and analytics programs
  • Experience supporting healthcare data initiatives
  • Familiarity with healthcare interoperability standards such as FHIR, CCDA, HL7
  • Strong working knowledge of SQL and database technologies
  • Exceptional communication and stakeholder management skills
  • Proven experience managing cross-functional teams, vendors, and enterprise timelines
  • Experience defining project scope, milestones, objectives, and success metrics
  • Experience with budgeting, forecasting, and resource management
Job Responsibility
Job Responsibility
  • Lead planning, coordination, and execution of complex technical projects and initiatives
  • Support enterprise data engineering and AI adoption programs
  • Manage project scope, timelines, milestones, deliverables, and success metrics
  • Coordinate cross-functional collaboration between business, engineering, analytics, AI, and stakeholder teams
  • Facilitate requirements gathering, business analysis, project planning, and implementation activities
  • Track deliverables, risks, dependencies, and project status reporting
  • Support cloud platform, data pipeline, and enterprise analytics initiatives
  • Partner with technical teams to resolve project issues and remove blockers
  • Maintain project documentation including project plans, schedules, charters, and lessons learned
  • Assist with budgeting, forecasting, resource planning, and financial reporting
What we offer
What we offer
  • Medical, dental, and vision coverage
  • Life and disability insurance
  • Additional voluntary benefits
  • Competitive compensation
  • Fulltime
Read More
Arrow Right

Data Scientist, Technical Lead - Infrastructure Data Center

The Infrastructure Data Center (IDC) organization at Meta is looking for an exce...
Location
Location
United States , Bellevue
Salary
Salary:
253000.00 - 314000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in a Data Science, Applied Science, or Analytical Engineering role, with a proven track record of leading large, complex technical programs
  • Exceptional technical background in Data Science, Machine Learning, and statistical methods, demonstrated through industry experience and/or advanced education
  • Extensive experience working in the Data Center, Infrastructure, Cloud, or other relevant hyperscaler domains, demonstrating deep domain knowledge
  • Demonstrated ability to function as a technical storyteller, articulating highly technical concepts and their business implications effectively to technical, business, and executive audiences
  • Proven experience driving technical strategy and thought leadership in a fast-paced, high-growth, and rapidly evolving technical environment, particularly adapting to new AI paradigms
  • Expertise in programming and querying languages (e.g., Python, R, SQL) and experience working with large-scale data systems
  • B.S. or M.S. in a quantitative field such as Computer Science, Engineering, Mathematics, Statistics, Physics, or equivalent practical experience
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Serve as the foremost technical authority and individual contributor for Data Science within the IDC organization, setting technical direction, standards, and best practices
  • Lead the development and execution of technical solutions for high-priority IDC initiatives, particularly those leveraging advanced AI, Machine Learning, and foundational Data Science techniques
  • Represent IDC Data Science and the broader IDC organization in high-stakes technical and engineering discussions with a wide range of cross functional partners, including Infra leadership and other Meta organizations
  • Act as a technical thought leader, driving innovation in Data Science, Engineering, and analytics specifically tailored to the unique challenges of Data Center and Infrastructure at a hyperscale level
  • Translate complex technical work into clear, compelling narratives for diverse audiences, demonstrating the business impact of Data Science initiatives to both technical and executive stakeholders
  • Proactively adapt the team's technical roadmap and capabilities to incorporate the latest developments in AI, both ensuring IDC remains at the cutting edge of AI enabling infrastructure and how AI is being leveraged to significantly increase productivity and effectiveness of the team’s work product
  • Provide deep technical mentorship and guidance to other Data Scientists and Engineers, raising the overall technical bar of the organization
  • Collaborate with Engineering and Product teams to drive the full lifecycle of data science solutions, from ideation and experimentation to robust deployment and measurement at scale
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Senior Technical Lead - Data & AI (Oil & Gas)

At Codvo, we are committed to building scalable, future-ready data platforms tha...
Location
Location
India , Pune
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience: 12+ years in technical roles, with at least 4+ years in a technical leadership or principal engineer capacity, managing cross-functional engineering teams
  • Cloud Expertise: Expert-level, hands-on knowledge of Microsoft Azure as a primary platform
  • Data & AI Expertise: Proven mastery of Databricks and Apache Spark (PySpark)
  • Extensive experience designing and building large-scale ETL/ELT data pipelines
  • Strong understanding of AI/ML workflows and data requirements for industrial AI use cases
  • DevOps & IaC Expertise: Deep proficiency with Infrastructure as Code (Terraform, ARM templates)
  • Hands-on mastery of Kubernetes and containerization (Docker)
  • Proven experience building and managing complex CI/CD pipelines (Azure DevOps, Jenkins)
  • Cloud Security: Strong, practical knowledge of cloud network security (VNETs, NSGs, Firewalls) and identity management (Azure Key Vault, IAM)
  • Industry Knowledge: Experience in the Oil & Gas sector or a similar heavy-industry/critical infrastructure environment
Job Responsibility
Job Responsibility
  • Technical Leadership & Mentorship: Lead, mentor, and provide technical direction to a multi-disciplinary team of engineers (Data, DevOps, Security). Foster a culture of high technical standards, collaboration, and continuous improvement
  • Detailed Solution Design: Partner with the Solutions Architect and Project Manager to decompose high-level architecture into detailed technical designs, actionable tasks, and implementation plans for the engineering team
  • Hands-on Development: Act as the lead engineer, personally designing and building the most complex components of the solution, including data pipelines, IaC modules, and CI/CD frameworks
  • Cross-Functional Integration: Drive the seamless integration of diverse systems, including OT data from historians (OSIsoft PI), data platforms (Databricks), cloud infrastructure (Azure), and CI/CD pipelines (Azure DevOps)
  • Technical Governance & Quality: Enforce technical best practices across all domains. Conduct rigorous code reviews, design reviews, and security assessments. Ensure all solutions adhere to security-by-design principles, CI/CD automation standards, and data governance policies
  • Stakeholder Collaboration: Translate complex technical concepts and risks to the Project Manager and business stakeholders. Manage technical dependencies and help the PM with accurate effort estimation and milestone tracking
  • Problem Solving: Serve as the primary escalation point for the team's most complex technical challenges, leading root cause analysis and implementing robust, long-term solutions
  • Fulltime
Read More
Arrow Right

Platform Technical Lead – Data, MLOps & Virtualization

Location
Location
Greece , Athens
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or related field (or equivalent experience)
  • 8-10 years of experience in enterprise database operations, administration, and migration programs within complex production environments
  • Strong technical expertise across relational and modern data platforms, including technologies such as DB2, PostgreSQL, MongoDB, and cloud-native database ecosystems
  • Hands-on understanding of MLOps and machine learning platform operations, including Kubernetes-based environments and technologies such as Kubeflow, Pachyderm, Ray, Python, and GPU-enabled platforms
  • Strong experience with enterprise virtualization and infrastructure engineering technologies, including Hyper-V, VMware, SCVMM, Azure Arc, HPE Synergy, OneView, and backup/recovery tooling
  • Proven ability to lead complex technology transitions, modernization initiatives, and operational transformation programs
  • Strong understanding of disaster recovery, backup strategies, operational resilience, recoverability testing, and service continuity practices
  • Experience coordinating vendors, infrastructure teams, cloud/platform engineers, and operational stakeholders in enterprise environments
  • Strong analytical, troubleshooting, stakeholder management, and communication skills
  • Ability to balance operational reliability with modernization and platform evolution objectives
Job Responsibility
Job Responsibility
  • Lead the operational and engineering roadmap across database platforms, MLOps environments, and virtualization infrastructure
  • Drive the transition from legacy database technologies toward modern platforms such as PostgreSQL, MongoDB, and emerging cloud-native data services while ensuring production stability and service continuity
  • Own the operational readiness and reliability of MLOps platforms, including deployment governance, observability, platform resilience, and coordination with Kubernetes and cloud engineering teams
  • Lead virtualization and infrastructure modernization initiatives, including Hyper-V adoption, VMware transition activities, HPE hardware lifecycle management, and backup/disaster recovery governance
  • Act as the escalation point for critical incidents, complex migrations, disaster recovery testing, service restoration, and major engineering activities across the supported technology towers
  • Ensure platform dependencies across infrastructure, databases, and ML operations are managed proactively and aligned with operational and engineering objectives
  • Coordinate with vendors, infrastructure teams, cloud engineers, and operational stakeholders to ensure platform performance, recoverability, and long-term sustainability
  • Drive continuous improvement initiatives focused on automation, resilience, monitoring, scalability, and operational excellence
  • Contribute to technology transition planning, capacity management, modernization roadmaps, and service improvement strategies
  • Maintain and promote engineering standards, operational governance, and production readiness practices across all managed platforms
What we offer
What we offer
  • Health insurance for the employee and one dependent family member (100% paid by NTT DATA)
  • Meal vouchers of 120€ per month (x12)
  • Corporate mobile phone: subscription & device
  • Teleworking equipment allowance
  • Udemy Account
  • Access to Open Up mental health service
  • 28 days of paid annual leave consisting of your legal holidays and compensation days
  • Fulltime
Read More
Arrow Right

Data Engineering Lead

Role: Data Engineering Lead. Location: New York, NY. FTE ONLY. Must Have Technic...
Location
Location
United States , New York
Salary
Salary:
138000.00 USD / Year
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • AWS Data Engineering Services (EMR/Glue, Redshift, Aurora, S3, Lambda)
  • Spark
  • Python
  • Collibra
  • Snowflake/Databricks
  • Tableau
  • 4–15 years of professional data engineering experience
  • Strong Python, SQL, and Spark (PySpark) skills, and/or Kafka
  • Snowflake (Snowpipe, Tasks, Streams) as a complementary warehouse
  • Databricks (Delta formats, workflows, cataloging) or equivalent Spark platforms
Job Responsibility
Job Responsibility
  • Ingest and model data from APIs, files/SFTP, and relational sources
  • implement layered architectures (raw/clean/serving) using PySpark/SQL and dbt, Python
  • Design and operate pipelines with Prefect (or Airflow), including scheduling, retries, parameterization, SLAs, and well documented runbooks
  • Build on cloud data platforms, leveraging S3/ADLS/GCS for storage and a Spark platform (e.g., Databricks or equivalent) for compute
  • manage jobs, secrets, and access
  • Publish governed data services and manage their lifecycle with Azure API Management (APIM) authentication/authorization, policies, versioning, quotas, and monitoring
  • Enforce data quality and governance through data contracts, validations/tests, lineage, observability, and proactive alerting
  • Optimize performance and cost via partitioning, clustering, query tuning, job sizing, and workload management
  • Uphold security and compliance (e.g., PII handling, encryption, masking) in line with firm standards
  • Collaborate with stakeholders (analytics, AI engineering, and business teams) to translate requirements into reliable, production ready datasets
  • Fulltime
Read More
Arrow Right

Data Engineering Lead

We’re looking for a Lead Data Engineer who is ready to both lead and build. This...
Location
Location
Salary
Salary:
Not provided
5CA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Located in Albania, Bosnia and Herzegovina, Bulgaria, Greece, Hungary, Kosovo, North Macedonia, Poland, Romania, Serbia, South Africa, or Tunisia
  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field
  • Minimum 7 years’ experience in data engineering
  • At least 2 years of leadership experience managing or mentoring engineers
  • Proven experience in designing, building, and maintaining scalable ETL/ELT pipelines and data platforms
  • Proficiency in SQL, Python, and data modelling techniques
  • Experience with cloud-based data architectures (e.g., Azure, AWS, or GCP)
  • Strong understanding of data governance, quality frameworks, and security best practices
  • Experience integrating data from multiple sources, including APIs and third-party systems
  • Familiarity with modern data tools and technologies (e.g., Databricks, Snowflake, Apache Spark, Airflow, Microsoft Fabric)
Job Responsibility
Job Responsibility
  • Lead the strategy, design, and implementation of scalable, high-performance data pipelines, platforms, and architectures
  • Manage the Data Engineering team’s backlog, priorities, and capacity to ensure timely delivery of high-quality outputs
  • Collaborate with data scientists, analysts, and product teams to understand data requirements and deliver fit-for-purpose solutions
  • Oversee and contribute to the development of ETL/ELT processes, data models, and data integration frameworks
  • Ensure data quality, consistency, and governance across all systems and datasets
  • Monitor and optimise data infrastructure for performance, scalability, and cost efficiency
  • Define and enforce engineering best practices, coding standards, and security guidelines
  • Evaluate and adopt new technologies, tools, and frameworks that can improve data engineering capabilities
  • Provide technical leadership and mentorship to data engineers, fostering a high-performance culture
  • Troubleshoot complex data issues and drive root cause analysis and remediation
What we offer
What we offer
  • A position at a fast-paced international company with ambitious gaming, e-commerce, and tech clients
  • A diverse and inclusive culture with people from 80+ countries, speaking 25+ languages - where we celebrate everyone's uniqueness
  • Innovative digital tools, and continuous opportunities for learning and development
  • Various learning and career development initiatives throughout the year
  • Fun employee engagement activities and participation in 5CA employee-led communities such as 5CA Connect, Pride, 5CA Gamers, Women of 5CA, to name a few
  • Fulltime
Read More
Arrow Right

Data Engineering Lead

The next step of your career starts here, where you can bring your own unique mi...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
metyis.com Logo
Metyis
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-10 years of professional hands-on experience
  • A broad practice in multiple software engineering fields
  • Experience on managing & leading data engineering / warehousing projects
  • Must have experience on Python, SQL and Distributed programming languages, preferable Spark
  • Experience working on Cloud, Azure is a plus
  • Experience working setting up data lakes using entire Big Data and DWH ecosystem
  • Experience on data workflows and ETL, Apache Airflow is a plus
  • Comfortable with Unix OS type systems, Bash and Linux
  • Basic knowledge of webservices and APIs
  • Basic knowledge of Containers and Docker as platform
Job Responsibility
Job Responsibility
  • Independently lead & manage execution of data engineering projects
  • Engineer complete technical solutions to solve concrete business challenges in the areas of digital marketing, eCommerce, Business Intelligence and self-service analytics
  • Collect functional and non-functional requirements, consider technical environments, business constraints and enterprise organizations
  • Support our clients in executing their Big Data strategies by designing and building operational data platforms: ETL pipelines, data anonymization pipelines, data lakes, near real-time streaming data hubs, web services, training and scoring machine learning models
  • Troubleshoot and quality check work done by team members
  • Collaborate closely with partners, strategy consultants and data scientists in a flat and agile organization where personal initiative is highly valued
  • Share data engineering knowledge by giving technical trainings
  • Communicate and interact with clients at the executive level
  • Guide and mentor team members
What we offer
What we offer
  • Interact with C-level at our clients on regular basis to drive their business towards impactful change
  • Lead your team in creating new business solutions
  • Seize opportunities at the client and at Metyis in our entrepreneurial environment
  • Become part of a fast-growing international and diverse team
Read More
Arrow Right