CrawlJobs Logo

L3-Data Engineer

https://www.randstad.com Logo

Randstad

Location Icon

Location:
India , Bengaluru

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

The purpose of the Data Engineer position is to leverage their technical expertise and domain knowledge to design, build, and maintain efficient and robust data solutions. The Data Engineer shall be responsible for the building, testing, and deployment of Data Pipelines on the EDP. The engineer shall ensure that the pipelines are developed and deployed with a secure-by-design approach, delivering robust, thoroughly tested, and maintainable solutions.

Job Responsibility:

  • Leverage technical expertise and domain knowledge to design, build, and maintain efficient and robust data solutions
  • Build, test, and deploy Data Pipelines on the EDP
  • Develop pipelines using standard patterns for data pipelines and workflows utilizing Streamsets, Kestra, dbt, Git
  • Design and Implement data storage and processing solutions employing Snowflake
  • Utilize AWS services for cloud-based platform tooling infrastructure including but not limited to: Lambda, ECS, MSK, RDS, EC2, Secrets Manager, ALB, Cloud Watch, Event Bridge
  • Utilize Terraform for AWS and Azure deployments
  • Leverage and integrate APIs for data access and manipulation
  • Write Python scripts for data common processing and automation tasks
  • Leverage Platform APIs and Web Applications to enforce Platform Security
  • Create and execute comprehensive test plans to ensure the pipelines functionality and performance
  • Develop unit tests, integration tests, and end-to-end tests for data pipelines and workflows
  • Ensure data accuracy and consistency through rigorous testing processes
  • Leverage automated testing processes to enhance efficiency
  • Strictly adhere to access process and procedures to maintain Data Privacy and Security
  • Identify and report any potential breaches of the Data Information and Systems Processes
  • Monitor and manage the platform to ensure optimal performance and uptime
  • Conduct regular maintenance tasks such as updates, patches, and backups
  • Resolve any issues or incidents related to the platform in a timely manner
  • Continuously improve platform operations through automation and optimization
  • Implement security best practices throughout the pipeline development and deployment process
  • Conduct regular security reviews and vulnerability assessments
  • Ensure data encryption, access control, and other security measures are enforced
  • Use credential management platforms like Thycotic Secret Server, AWS Secrets Manager
  • Assist in troubleshooting and resolving intricate technical issues

Requirements:

  • 10yrs Data Engineering/Data Analyst experience
  • Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field with a focus on data engineering or data analytics
  • Strong proficiency in programming languages such as Python, SQL, Java, or Scala for data processing and analysis
  • Experience with data modeling, ETL processes, data warehousing, data integration, and data pipeline development
  • Proficiency in relational databases (e.g., SQL, PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra)
  • Working knowledge of cloud platforms such as Snowflake, AWS, Azure, or Google Cloud Platform for data storage and processing
  • Experience with data visualization tools (e.g., Power BI) to create meaningful insights from data
  • Understanding of data quality principles, data governance, and data validation processes
  • Ability to analyze complex data sets, identify trends, patterns, and insights to drive data-driven decision-making
  • Proficiency in troubleshooting data-related issues, identifying root causes, and implementing solutions
  • Familiarity with project management methodologies to contribute effectively to project planning and execution
  • Strong verbal and written communication skills to collaborate with cross-functional teams and communicate technical concepts to non-technical stakeholders
  • Willingness to stay updated with the latest data technologies, tools, and industry trends to enhance data engineering skills
  • Prior experience in data engineering, data analytics, or related roles with a track record of successful data project delivery
  • Ability to make informed, strategic decisions that align technology with business objectives, while balancing short-term and long-term trade-offs
  • Deep understanding of customer needs and how to translate them into effective technical solutions that drive business value
  • Encourages collaboration across teams and stakeholders, breaking down silos and ensuring alignment
  • Strong analytical and problem-solving skills, capable of addressing complex technical challenges and delivering innovative solutions
  • Ability to lead innovation in technology while maintaining an eye on product-market fit and user experience
  • Adaptability in a fast-moving environment, with a mindset focused on delivering high-impact solutions quickly and iteratively
What we offer:
  • Commitment to your ongoing development, including on the job opportunities and formal programs
  • Inclusive parental leave entitlements for both parents
  • Values led culture
  • Flexible work options
  • Generous annual leave, sick leave and casual leave
  • Cultural and religious leave with flexible public holiday opportunities
  • A competitive remuneration package featuring performance based incentives with uncapped Employer Provident Fund

Additional Information:

Job Posted:
May 19, 2026

Expiration:
July 10, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Icon
Randstad - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon
PREMIUM
More languages and countries
+ Unlock 31594 hidden job offers
Languages
English Čeština Deutsch Ελληνικά Español Français +15
Countries
United States United Kingdom India Canada Australia +
See plans
Plans from $2.99 / month

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for L3-Data Engineer

New

Software Developer

Whitehall Resources are currently looking for a Software Developer based in Some...
Location
Location
United Kingdom , Somerset
Salary
Salary:
Not provided
whitehallresources.com Logo
Whitehall Resources Ltd
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Must have experience of SPARK or ADA
  • At least 6 years' experience as a Software Engineer in industry
  • Ideally have experience in leadership roles
  • Strong knowledge of the whole safety critical software development life cycle
  • Extended expertise in either requirements, development or test
  • Experience in at least one of the following markets: aerospace, transport, defence, rail, automotive
  • Experience of applying relevant standards such as 61508, 50128, 26262, 00-55, ED-109, DO-178 etc
  • Track record of the technical leadership of high value software development projects
  • Experience in leading people, building careers and capability
  • Excellent interpersonal skills and the ability to quickly build rapport with others
Job Responsibility
Job Responsibility
  • Shaping technical strategy on bids and projects basing your approach on our standard life-cycle model, extensive quality management system and development toolset and techniques
  • Taking lead consultancy roles to shape how our customers approach their software challenges
  • Taking a lead in the generation of software requirements, architecture and design
  • Taking a lead in the development of software and systems
  • Taking a lead in the testing of software and systems
  • Working with the safety team to provide evidence against the relevant standards
  • Line managing and/or mentoring junior staff and support their competency growth
  • Being an advocate for our correctness-by-construction approach both internally within our business and externally with our clients
  • Work with our market sales teams to support bidding for new projects
Read More
Arrow Right
New

Channel Sales Manager EMEA

Responsible for managing and further improving performance of our Li-Cor and HOB...
Location
Location
United Kingdom
Salary
Salary:
Not provided
licor.com Logo
LI-COR
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS in commercial or science fields
  • 5+ years of international channel sales experience with quota responsibility in technology-driven markets, including environmental and agricultural sectors
  • Proven success managing reseller and distributor networks, sales funnels, and forecasting activities
  • Strong ability to understand and communicate technical applications and technologies across environmental and agricultural industries
  • Demonstrated expertise in partner management, including developing and executing joint sales plans to achieve revenue targets and strategic growth objectives
  • Proven leadership skills with experience in strategic planning, business growth initiatives, and translating strategic plans into tactical actions and measurable operational results
  • Collaborative team-oriented approach with a strong ability to work cross-functionally
  • Strong technical aptitude with working knowledge of dataloggers, weather stations, software platforms, and commercial cloud-based solutions
  • Fluent in environmental and technology-related terminology
  • Excellent verbal and written communication skills with experience delivering presentations, seminars, mentoring, and facilitating small group discussions
Job Responsibility
Job Responsibility
  • Develop and execute regional channel sales strategies in collaboration with the Director of EMEA Sales, distribution sales leadership, and international distribution partners to drive revenue growth, strengthen customer relationships, and support long-term brand development across the full portfolio of products and services
  • Lead the execution of EMEA channel sales initiatives by directly managing distributor and channel partner accounts, maintaining a healthy sales funnel, and achieving regional sales objectives
  • Provide market insights and recommendations to support marketing focus areas and lead generation activities
  • Build, develop, and maintain strong relationships with international distribution partners
  • Drive lead generation efforts with direct customers and collaborate with channel partners to achieve company sales and growth objectives
  • Responsibilities include distributor funnel management, pricing recommendations, sales and marketing plan development, performance monitoring, and growth improvement initiatives
  • Support regional financial planning activities by contributing to sales forecasting, defining sales targets by customer and region, monitoring sales trends, and recommending tactical adjustments throughout the fiscal year in collaboration with senior sales leadership
  • Participate in strategic planning initiatives related to business growth, new product opportunities, market development, research initiatives, and service expansion to support long-term organizational success
  • Collaborate closely with global and regional marketing teams, including SDR teams, to align marketing campaigns, conferences, lead generation programs, and web-based promotions with regional business objectives and channel partner activities
  • Travel regionally and internationally to customer sites, distributor meetings, conferences, and industry events to identify new market opportunities, applications, and business development initiatives
Read More
Arrow Right
New

Zscaler Engineer

Whitehall Resources currently require an experienced Zscaler Engineer to work wi...
Location
Location
United Kingdom
Salary
Salary:
Not provided
whitehallresources.com Logo
Whitehall Resources Ltd
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands on experience administering Zscaler ZIA and/or ZPA
  • Strong knowledge of Zero Trust, DNS/HTTPS, SSL inspection, GRE/IPsec tunnels, and SSO integrations (Azure AD/Okta)
  • Experience troubleshooting network, identity, and policy driven issues
  • Ability to work effectively with Network and IDAM teams to resolve cross domain issues
  • Good documentation and communication skills
Job Responsibility
Job Responsibility
  • Review and document the existing Zscaler architecture, traffic flows, authentication methods, and integrations
  • Maintain day to day operations including monitoring logs, managing policies, and supporting user/device onboarding
  • Troubleshoot ZIA/ZPA issues such as connectivity, authentication failures, Zscaler Client Connector behaviour, and policy related blocks
  • Collaborate closely with the Network team on traffic routing, GRE/IPsec tunnels, DNS, SD WAN, and connectivity optimisation
  • Partner with the IDAM team on SSO/SAML integrations, SCIM provisioning, identity policies, and certificate/SSL requirements
  • Produce operational and compliance reports covering user activity, threats, tunnel health, and usage patterns
  • Support integrations with SIEM, security tools, and identity platforms
  • Assist with audits, security reviews, and adherence to enterprise security standards
  • Recommend improvements, maintain configuration hygiene, and track new Zscaler features
Read More
Arrow Right
New

Web Analyst

We are looking for a Web Analyst to join our client based in Romford. You will v...
Location
Location
United Kingdom , Romford
Salary
Salary:
Not provided
whitehallresources.com Logo
Whitehall Resources Ltd
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience using Google Analytics (GA4)
  • Experience with Google Tag Manager, custom event setup, and troubleshooting tracking issues
  • Experience working with paid media platforms (e.g. Google Ads, Meta)
  • Familiarity with marketing tools (HubSpot would be ideal)
  • Excellent communication skills and ability to engage with both technical and non-technical audiences
  • Attention to detail, along with a passion for data quality and accuracy
Job Responsibility
Job Responsibility
  • Analysing website performance, digital marketing activity, and customer journeys across multiple platforms including Google Analytics, Google Ads, Bing Ads and HubSpot
  • Act as the primary steward of GA4 tracking, ensuring all website events, conversions, and custom dimensions remain accurate and up-to-date as the website evolves
  • Fulltime
Read More
Arrow Right
New

Orderpicker morning (English)

Location
Location
Netherlands , Honselersdijk
Salary
Salary:
16.04 - 16.22 EUR / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
August 30, 2026
Flip Icon
Requirements
Requirements
  • You are available at least 3 days a week, especially on Mondays
  • You can start working at 05:45h and the ending time is between 09:30h and 12:00h
  • You have your own place to stay in The Netherlands
  • You are available for at least 2 months
  • You speak Dutch or English
  • You can work in Honselersdijk
  • You meet the 1.65m height requirement
Job Responsibility
Job Responsibility
  • You check if the flowers are fresh and in good condition
  • You verify if the cart matches the order
  • You roll the cart to the right spot for pickup
What we offer
What we offer
  • Opportunity for a permanent contract
  • Travel allowance or public transport subscription
  • Participation in staff association & fun events
  • €0,18 extra allowance
  • Enjoy free flowers up to 5 times a year
  • Parttime
Read More
Arrow Right
New

Oracle Cloud Finance Consultant

Whitehall Resources are looking for an Oracle Cloud Finance Consultant. This rol...
Location
Location
United Kingdom , Scotland
Salary
Salary:
Not provided
whitehallresources.com Logo
Whitehall Resources Ltd
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience of working on at least 2 Oracle Cloud Finance implementations end to end
  • Knowledge of Order to Cash, Expenses, Fixed Assets, Cash Management modules
  • Responsible for design, build, testing and support of these modules
  • Holding relevant Oracle certification(s) desired
Job Responsibility
Job Responsibility
  • Responsible for design, build, testing and support of these modules
Read More
Arrow Right
New

Sap Finance Systems Analyst

A SAP Ariba Analyst is required by Whitehall Resources to join our client based ...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
whitehallresources.com Logo
Whitehall Resources Ltd
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience working with SAP Ariba
  • Experience supporting or enhancing SAP Ariba purchasing platforms, including Guided Buying and Buying
  • Proven experience providing systems administration and support within a large organisation
  • Experience delivering end user training and support across finance or procurement systems
  • Strong stakeholder management and communication skills across all levels
Job Responsibility
Job Responsibility
  • Lead the administration, ongoing development and training agenda for SAP Ariba procurement systems
  • Support stakeholders across all levels of the organisation
  • Provide wider support to the Finance Systems team, ensuring finance systems are operating effectively and appropriately controlled
  • Deputise for the Finance Systems Manager where required
  • Fulltime
Read More
Arrow Right
New

Azure Architect

Whitehall Resources currently require an experienced Azure Architect to work wit...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
whitehallresources.com Logo
Whitehall Resources Ltd
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a Solution Architect delivering Azure based solutions in secure or highly regulated public sector environments
  • Strong background in data migration and system integration architecture, including legacy to target transformations
  • Experience designing solutions across multiple environments (development, test, staging, production) using Azure environment and release management principles
  • Experience applying Azure Well Architected Framework and cloud design patterns (resilience, scalability, cost optimisation)
  • Solid understanding of integration patterns, APIs, data flows, and interface design
  • Demonstrable experience working in multi vendor delivery landscapes
  • Strong documentation skills, with experience producing clear, structured architecture artefacts
  • Familiarity with public sector data, digital, or transformation programmes
  • Experience supporting testing, migration rehearsals, and cutover planning from an architectural perspective
  • Knowledge of architectural frameworks (e.g. TOGAF) and secure by design principles
Job Responsibility
Job Responsibility
  • Own and define the end to end solution architecture for the Griffin data migration and integration scope, covering application, data, integration, environment, and security aspects
  • Produce and maintain solution architecture artefacts, including high level designs, low level designs, integration patterns, data flows, and environment views
  • Ensure architectural decisions align with Azure Well Architected Framework principles, client enterprise architecture principles, security policies, and public sector standards
  • Define architectural guardrails and non functional requirements (performance, resilience, availability, scalability)
  • Architect Azure based data migration approaches, including data sourcing, transformation, validation, reconciliation, and cutover strategies
  • Define integration patterns between legacy systems, target platforms, and downstream consumers (APIs, batch, event based where applicable)
  • Work closely with Data Analysts and migration teams to ensure data quality, lineage, and traceability are built into the solution design
  • Embed security by design principles across all solution components, aligned to SC cleared and public sector requirements
  • Ensure compliance with relevant security, data protection, and governance standards throughout design and delivery
  • Support security assurance activities, including design reviews, risk assessments, and audit engagement
Read More
Arrow Right