CrawlJobs Logo

Etl/data Engineer

https://www.randstad.com Logo

Randstad

Location Icon

Location:
China , Shanghai

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

240000.00 - 480000.00 CNY / Year

Job Responsibility:

  • Dedicate on the construction or upgrade of key data platform components, i.e. data pipeline orchestration, adhering to the data platform roadmap
  • Evaluate technical options, define comprehensive solutions with comparative analysis, and implement components using Infrastructure as Code (IaC) principles, including thorough troubleshooting and unit testing
  • Collaborate closely with the Company Global Tech Data team through the Architecture Design Record (ADR) process

Requirements:

  • 7+ yr experience on Big Data solution and Cloud with hands-on and solid technical expertise
  • Master Open-Source solution, including Terraform, Airflow, DBT, Linux/Docker/K8S, GitHub, etc.
  • Experience and familiar with Ali-Cloud Products, including RAM, ECS, OSS, KMS, FunctionCompute, MaxCompute, Hologres, ACK with proven project
  • Experience and familiar with Security technology, including SSO, AD, Authentication, SSL, RAM Policy
  • Strong programming background (Python, Shell, SQL, etc.)
  • Logical thinking, documentation and oral (EN) fluently

Nice to have:

Experience on GCP is a big plus

Additional Information:

Job Posted:
April 11, 2026

Expiration:
June 02, 2026

Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Etl/data Engineer

Senior QA Engineer

We’re hiring a Senior QA Engineer who can own test automation across data/ETL pi...
Location
Location
India , Mohali
Salary
Salary:
Not provided
Harmonydi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s in CS/IT or equivalent experience
  • 6+ years in QA with at least 3 years in data/ETL test automation and 2+ years in performance testing
  • Proven experience integrating tests into CI/CD and scaling suites for speed and reliability
  • Excellent communication
  • comfortable driving quality across engineering, data, and product teams
  • ETL/Data QA: Strong experience validating data pipelines/warehouses (e.g., BigQuery/Snowflake/Redshift/PostgreSQL), reconciliation at scale, partitioning/windowing awareness, and SQL proficiency
  • Automation: Hands-on with Python/TypeScript/Java for test frameworks
  • solid patterns (fixtures, page objects, data builders)
  • API Testing: Postman/Newman, REST Assured, Pact or equivalent for contract testing
  • UI Testing: Playwright or Cypress (preferred) for stable, parallelizable suites
Job Responsibility
Job Responsibility
  • ETL/Data Quality Automation: Design and automate tests for ingestion, transformation, and loading (schema checks, constraints, null/dup checks, reconciliation, row/column-level validation, business rule assertions)
  • Implement data contract and data lineage test coverage
  • ensure CDC/merge logic and dedup rules are verified
  • Add data checks to orchestration (e.g., Airflow/Prefect/Cloud Composer) and block bad data from promotion
  • API & Frontend Test Automation: Build end-to-end, integration, contract, and regression suites for REST/GraphQL services
  • Create UI automation for critical user journeys
  • stabilize flaky tests with good wait/retry design
  • Performance/Load Testing: Establish load, stress, soak, and breakpoint tests for APIs and web apps
  • define SLAs/SLOs and capacity baselines
  • Automate performance tests in CI and publish trend dashboards
Read More
Arrow Right

Azure Data Engineer

Location
Location
United States , Bellevue
Salary
Salary:
76.00 USD / Hour
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience in Data Engineering, Python, Snowflake, SQL, Azure
  • Hands-on expertise with ETL/data pipelines
  • Experience with large-scale data processing frameworks
  • Strong SQL and data modelling knowledge
  • Experience working in Agile/Scrum delivery models
  • Ability to work onsite and collaborate with cross-functional teams
  • Cloud data platforms (AWS/Azure/GCP)
  • Performance optimization and data quality management
  • Production support and troubleshooting experience
Read More
Arrow Right

Sales, Marketing, Risk - Technical Leader

The Sales, Marketing, Risk and Legal Platforms Technical Leader is responsible f...
Location
Location
Lithuania , Vilnius
Salary
Salary:
4100.00 - 6666.00 / Month
alterdomus.com Logo
Alter Domus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of management or technical leadership experience, including direct line management of software engineers or technical leads
  • Proven ability to balance leadership and hands-on technical contribution — comfortable rolling up your sleeves to debug, prototype, or code when needed
  • Strong experience delivering and supporting solutions across CRM (ideally Salesforce or similar) and marketing, risk (ideally Archer or similar), compliance, or legal platforms
  • Expertise in data integration, ETL, and data pipeline engineering, including the use of modern integration tools and frameworks
  • Deep understanding of API design, service orchestration, and secure, scalable architecture
  • Demonstrated success running critical services in production environments, with a focus on performance, reliability, and security
  • Proficiency in CI/CD practices, DevOps principles, and modern cloud or hybrid infrastructure
  • Excellent collaboration and communication skills — adept at influencing across technical and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Provide technical and team leadership across the full software development lifecycle — from requirements gathering and solution design through to implementation, testing, deployment, and operations
  • Act as a hands-on leader, contributing to design discussions, code reviews, and complex problem solving when required
  • Apply Lean and Agile principles to develop secure, scalable, and supportable solutions that adhere to organisational standards and engineering best practice
  • Collaborate with Solution Architects, Product Managers/Technical Domain Leaders, and Business Analysts to translate business needs into robust, integrated technology solutions
  • Shape and execute the CRM, Marketing, Risk, Compliance, and Legal Platforms strategy, ensuring alignment with enterprise data and technology architecture
  • Lead the design and delivery of integrations across platforms — including Salesforce, Marketing Automation, Archer(risk and compliance), and Legal systems — using modern integration tools, APIs, and ETL/data pipeline frameworks
  • Champion best practices for data management, governance, and automation, working closely with data engineering and security teams
  • Apply Site Reliability Engineering (SRE) principles to maintain and improve the availability, performance, and security of all supported platforms
  • Oversee release management, CI/CD pipelines, and deployment processes to ensure smooth delivery into production
  • Manage and mentor a team of 2–5 engineers, architects, and system administrators, fostering a culture of continuous learning, technical excellence, and collaboration
What we offer
What we offer
  • Support for professional accreditations such as ACCA and study leave
  • Flexible arrangements, generous holidays, plus an additional day off for your birthday
  • Continuous mentoring along your career progression
  • Active sports, events and social committees across our offices
  • 24/7 support available from our Employee Assistance Program
  • The opportunity to invest in our growth and success through our Employee Share Plan
  • Plus additional local benefits depending on your location
Read More
Arrow Right

Engineering Manager - Enterprise Platforms

The Engineering Manager - Enterprise Platforms is responsible for providing tech...
Location
Location
Lithuania , Vilnius
Salary
Salary:
4100.00 - 6666.00 / Month
alterdomus.com Logo
Alter Domus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of management or technical leadership experience, including direct line management of software engineers or technical leads
  • Proven ability to balance leadership and hands-on technical contribution — comfortable rolling up your sleeves to debug, prototype, or code when needed
  • Strong experience delivering and supporting solutions across CRM (ideally Salesforce or similar) and marketing, risk (ideally Archer or similar), compliance, or legal platforms
  • Expertise in data integration, ETL, and data pipeline engineering, including the use of modern integration tools and frameworks
  • Deep understanding of API design, service orchestration, and secure, scalable architecture
  • Demonstrated success running critical services in production environments, with a focus on performance, reliability, and security
  • Proficiency in CI/CD practices, DevOps principles, and modern cloud or hybrid infrastructure
  • Excellent collaboration and communication skills — adept at influencing across technical and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Provide technical and team leadership across the full software development lifecycle — from requirements gathering and solution design through to implementation, testing, deployment, and operations
  • Act as a hands-on leader, contributing to design discussions, code reviews, and complex problem solving when required
  • Apply Lean and Agile principles to develop secure, scalable, and supportable solutions that adhere to organisational standards and engineering best practice
  • Collaborate with Solution Architects, Product Managers/Technical Domain Leaders, and Business Analysts to translate business needs into robust, integrated technology solutions
  • Shape and execute the CRM, Marketing, Risk, Compliance, and Legal Platforms strategy, ensuring alignment with enterprise data and technology architecture
  • Lead the design and delivery of integrations across platforms — including Salesforce, Marketing Automation, Archer(risk and compliance), and Legal systems — using modern integration tools, APIs, and ETL/data pipeline frameworks
  • Champion best practices for data management, governance, and automation, working closely with data engineering and security teams
  • Apply Site Reliability Engineering (SRE) principles to maintain and improve the availability, performance, and security of all supported platforms
  • Oversee release management, CI/CD pipelines, and deployment processes to ensure smooth delivery into production
  • Manage and mentor a team of 2–5 engineers, architects, and system administrators, fostering a culture of continuous learning, technical excellence, and collaboration
What we offer
What we offer
  • Support for professional accreditations such as ACCA and study leave
  • Flexible arrangements, generous holidays, plus an additional day off for your birthday
  • Continuous mentoring along your career progression
  • Active sports, events and social committees across our offices
  • 24/7 support available from our Employee Assistance Program
  • The opportunity to invest in our growth and success through our Employee Share Plan
  • Plus additional local benefits depending on your location
Read More
Arrow Right

Engineering Manager - Enterprise Platforms

The Engineering Manager - Enterprise Platforms is responsible for providing tech...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
alterdomus.com Logo
Alter Domus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of management or technical leadership experience, including direct line management of software engineers or technical leads
  • Proven ability to balance leadership and hands-on technical contribution — comfortable rolling up your sleeves to debug, prototype, or code when needed
  • Strong experience delivering and supporting solutions across CRM (ideally Salesforce or similar) and marketing, risk (ideally Archer or similar), compliance, or legal platforms
  • Expertise in data integration, ETL, and data pipeline engineering, including the use of modern integration tools and frameworks
  • Deep understanding of API design, service orchestration, and secure, scalable architecture
  • Demonstrated success running critical services in production environments, with a focus on performance, reliability, and security
  • Proficiency in CI/CD practices, DevOps principles, and modern cloud or hybrid infrastructure
  • Excellent collaboration and communication skills — adept at influencing across technical and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Provide technical and team leadership across the full software development lifecycle — from requirements gathering and solution design through to implementation, testing, deployment, and operations
  • Act as a hands-on leader, contributing to design discussions, code reviews, and complex problem solving when required
  • Apply Lean and Agile principles to develop secure, scalable, and supportable solutions that adhere to organisational standards and engineering best practice
  • Collaborate with Solution Architects, Product Managers/Technical Domain Leaders, and Business Analysts to translate business needs into robust, integrated technology solutions
  • Shape and execute the CRM, Marketing, Risk, Compliance, and Legal Platforms strategy, ensuring alignment with enterprise data and technology architecture
  • Lead the design and delivery of integrations across platforms — including Salesforce, Marketing Automation, Archer(risk and compliance), and Legal systems — using modern integration tools, APIs, and ETL/data pipeline frameworks
  • Champion best practices for data management, governance, and automation, working closely with data engineering and security teams
  • Apply Site Reliability Engineering (SRE) principles to maintain and improve the availability, performance, and security of all supported platforms
  • Oversee release management, CI/CD pipelines, and deployment processes to ensure smooth delivery into production
  • Manage and mentor a team of 2–5 engineers, architects, and system administrators, fostering a culture of continuous learning, technical excellence, and collaboration
What we offer
What we offer
  • Support for professional accreditations such as ACCA and study leave
  • Flexible arrangements, generous holidays, plus an additional day off for your birthday
  • Continuous mentoring along your career progression
  • Active sports, events and social committees across our offices
  • 24/7 support available from our Employee Assistance Program
  • The opportunity to invest in our growth and success through our Employee Share Plan
  • Plus additional local benefits depending on your location
  • Fulltime
Read More
Arrow Right

DataOps Engineer (AWS)

We are looking for a skilled DevOps + Data Engineer (AWS) to design, build, and ...
Location
Location
India
Salary
Salary:
3800000.00 - 4100000.00 INR / Year
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–7 years of experience in DevOps, Data Engineering, or Cloud Engineering
  • Strong hands-on experience with AWS services (EC2, S3, RDS, Lambda, EMR, Glue, Redshift, etc.)
  • Solid experience with Terraform for infrastructure automation
  • Experience building and maintaining ETL/data pipelines
  • Proficiency in Python and/or Shell scripting
  • Experience with CI/CD tools (GitHub Actions, Jenkins, GitLab CI, etc.)
  • Strong understanding of Linux systems and networking fundamentals
  • Experience with monitoring tools (CloudWatch, Prometheus, Grafana, ELK, etc.)
Job Responsibility
Job Responsibility
  • Design, deploy, and manage AWS cloud infrastructure using Infrastructure as Code (Terraform)
  • Build, maintain, and optimize ETL/data pipelines for large-scale data processing
  • Automate infrastructure provisioning, deployment, and monitoring
  • Develop and manage CI/CD pipelines for data and application workloads
  • Ensure high availability, scalability, security, and cost optimization of AWS environments
  • Support data ingestion, transformation, and orchestration workflows
  • Monitor systems, troubleshoot issues, and improve system reliability
  • Implement logging, monitoring, and alerting for infrastructure and data pipelines
  • Collaborate with Data Engineers, Analytics teams, and DevOps teams
  • Enforce security best practices, IAM policies, and compliance standards
  • Fulltime
Read More
Arrow Right

Solutions Architect

We’re looking for a Solutions Architect to join our high-impact Field Solutions ...
Location
Location
Salary
Salary:
Not provided
unstructured.io Logo
Unstructured
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years in Solutions Architecture, Sales Engineering, or a customer-facing technical role
  • Familiarity with at least 1 Cloud Provider (AWS, Azure, or GCP), and general security and networking principles
  • Deep familiarity with Python for scripting, API integration, and building PoCs
  • Hands-on understanding of ETL/data pipeline design, RESTful APIs, and data transformation workflows
  • Strong grasp of unstructured data processing: text, PDFs, images, and retrieval workflows
  • Ability to communicate complex technical concepts clearly to both engineering and executive stakeholders
  • Proven record of technical ownership in technical engagements—POCs, architecture reviews, solution validation, and deployment/implementation
Job Responsibility
Job Responsibility
  • Lead Technical Discovery and Solution Design
  • Partner with account executives during customer engagements to uncover requirements, define success criteria, and architect tailored solutions
  • Design and present technical architectures that integrate Unstructured’s SDKs, APIs, and connectors into customer environments
  • Architect and Validate Complex Deployments
  • Implement Unstructured across diverse infrastructure—cloud-native (AWS, GCP, Azure), hybrid, and on-premises
  • Design scalable solutions leveraging Kubernetes, containerized workloads, and Python-based data pipelines
  • Solve real-world challenges involving file parsing, ETL, vectorization, and retrieval at enterprise scale
  • Demonstrate Technical Credibility in the Field
  • Deliver compelling demos, proof-of-concepts, and reference architectures that show value and technical rigor
  • Act as a trusted advisor to customer architects and data science teams, guiding best practices and integration strategies
What we offer
What we offer
  • Highly Technical Work: You’ll design and deploy real AI/data infrastructure, not just talk about it
  • Elite Customers & Impact: Work directly with leading enterprises and federal teams on GenAI deployments
  • Cross-Functional Collaboration: Influence product direction and customer strategy in equal measure
  • Startup Agility + Enterprise Reach: Move fast, stay hands-on, and solve problems that truly scale
  • Backed by the Best: Our investors include Nvidia, Microsoft, IBM, Databricks, and more
  • Fulltime
Read More
Arrow Right

IT Architect

The IT Architect is responsible for designing, evolving, and governing the softw...
Location
Location
France
Salary
Salary:
Not provided
cencora.com Logo
Cencora
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a Software Architect / Solution Architect or senior engineer with architecture ownership
  • Strong command of software design principles (DDD, SOLID, event-driven patterns, API design, microservices where relevant)
  • Experience with integration and enterprise systems (REST, messaging, ETL/data flows, IAM/security patterns)
  • Ability to communicate with both technical and non-technical stakeholders, facilitating decisions and trade-offs
  • Familiarity with DevOps/DevSecOps practices and tooling (CI/CD, automation, monitoring, quality gates)
  • Analytical mindset and risk anticipation
  • Structured communication and documentation skills
  • Leadership through influence (without direct authority)
  • Pragmatic decision-making, focused on value and maintainability
  • Collaboration in multi-team and group-level environments
Job Responsibility
Job Responsibility
  • Audit and analyze existing architectures and proactively anticipate risks (security, performance, scalability, maintainability, obsolescence)
  • Design software architecture at both functional and technical levels according to expressed needs and constraints
  • Ensure alignment and consistency between actual implementation and the recommended architecture model (architecture governance)
  • Advise and promote best practices, engineering standards, and adherence to methodologies (e.g., design principles, documentation, validation processes)
  • Support Business (MOA) and IT Delivery (MOE) in technology choices and solution trade-offs
  • Conduct technology watch and contribute to a mindset of continuous improvement (tools, frameworks, patterns, cloud practices, DevSecOps)
  • Collaborate with technical teams to ensure project delivery and preventive/corrective maintenance of systems
  • Provide technical guidance to development teams throughout the full development lifecycle (design, build, testing, deployment, operations)
  • Fulltime
Read More
Arrow Right