CrawlJobs Logo

L2 Data Engineer

https://www.randstad.com Logo

Randstad

Location Icon

Location:
India , Bengaluru

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

The purpose of the Data Engineer position is to leverage their technical expertise and domain knowledge to design, build, and maintain efficient and robust data solutions. The Data Engineer shall be responsible for the building, testing, and deployment of Data Pipelines on the EDP. The engineer shall ensure that the pipelines are developed and deployed with a secure-by-design approach, delivering robust, thoroughly tested, and maintainable solutions.

Job Responsibility:

  • Build: Pipeline Development
  • Develop pipelines using the standard patterns for data pipelines and workflows utilizing Streamsets, Kestra, dbt, Git
  • Design and Implement data storage and processing solutions employing Snowflake
  • Utilize AWS services for cloud-based platform tooling infrastructure including but not limited to: Lambda,ECS,MSK,RDS,EC2, Secrets Manager, ALB, Cloud Watch, Event Bridge
  • Utilize Terraform for AWS and Azure deployments
  • Leverage and integrate APIs for data access and manipulation
  • Write Python scripts for data common processing and automation tasks
  • Leverage Platform API’s and Web Applications to enforce Platform Security
  • Development experience with Go, SQL, C#, .net, JavaScript, shell scripts & container platforms like Docker
  • The engineer shall have experience integrating with timeseries source systems: Honeywell Plant Historian Database, OSI Pi
  • The engineer shall have experience in Authentication mechanisms including but not limited to (OAuth 2.0, OIDC, Microsoft Entra, Key Pair Authentication, Certificate based authentication, SAML based SSO)
  • Test: Quality Assurance
  • Create and execute comprehensive test plans to ensure the pipelines functionality and performance
  • Develop unit tests, integration tests, and end-to-end tests for data pipelines and workflows
  • Ensure data accuracy and consistency through rigorous testing processes
  • Leverage automated testing processes to enhance efficiency
  • Governance: Compliance & Risk
  • This role requires strict adherence to access process and procedures to maintain Data Privacy and Security
  • Identify and report any potential breaches of the Data Information and Systems Processes
  • Operate: Platform Maintenance
  • Monitor and manage the platform to ensure optimal performance and uptime
  • Conduct regular maintenance tasks such as updates, patches, and backups
  • Resolve any issues or incidents related to the platform in a timely manner
  • Continuously improve platform operations through automation and optimization
  • Strong experience with Windows & Unix like operating systems
  • Security: Secure by Design
  • Implement security best practices throughout the pipeline development and deployment process
  • Conduct regular security reviews and vulnerability assessments
  • Ensure data encryption, access control, and other security measures are enforced
  • Use credential management platforms like Thycotic Secret Server, AWS Secrets Manager
  • Support: Technical Guidance
  • Assist in troubleshooting and resolving intricate technical issues
  • Deliverables: Robust and scalable data pipelines with well-documented code and processes
  • Comprehensive test plans and automation scripts ensuring platform reliability
  • Regular security assessments and compliance reports
  • Technical support and guidance documentation for delivery data engineers
  • Deliver secure, robust, and maintainable data pipelines
  • Ensure high-quality and thoroughly tested data solutions
  • Maintain compliance with security standards and best practices
  • Maintain compliance with the Data Lifecycle Management Process
  • Maintain compliance with the Data Privacy standards and best practices

Requirements:

  • Bachelor’s or Master’s degree in Computer Science, Data Science, Information Technology, or a related field with a focus on data engineering or data analytics
  • Strong proficiency in programming languages such as Python, SQL, Java, or Scala for data processing and analysis
  • Experience with data modeling, ETL processes, data warehousing, data integration, and data pipeline development
  • Proficiency in relational databases (e.g., SQL, PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra)
  • Working knowledge of cloud platforms such as Snowflake, AWS, Azure, or Google Cloud Platform for data storage and processing
  • Experience with data visualization tools (e.g., Power BI) to create meaningful insights from data
  • Understanding of data quality principles, data governance, and data validation processes
  • Ability to analyze complex data sets, identify trends, patterns, and insights to drive data-driven decision-making
  • Proficiency in troubleshooting data-related issues, identifying root causes, and implementing solutions
  • Familiarity with project management methodologies to contribute effectively to project planning and execution
  • Strong verbal and written communication skills to collaborate with cross-functional teams and communicate technical concepts to non-technical stakeholders
  • Willingness to stay updated with the latest data technologies, tools, and industry trends to enhance data engineering skills
  • Prior experience in data engineering, data analytics, or related roles with a track record of successful data project delivery
  • Ability to make informed, strategic decisions that align technology with business objectives, while balancing short-term and long-term trade-offs
  • Deep understanding of customer needs and how to translate them into effective technical solutions that drive business value
  • Encourages collaboration across teams and stakeholders, breaking down silos and ensuring alignment
  • Strong analytical and problem-solving skills, capable of addressing complex technical challenges and delivering innovative solutions
  • Ability to lead innovation in technology while maintaining an eye on product-market fit and user experience
  • Adaptability in a fast-moving environment, with a mindset focused on delivering high-impact solutions quickly and iteratively
What we offer:
  • Commitment to your ongoing development, including on the job opportunities and formal programs
  • Inclusive parental leave entitlements for both parents
  • Values led culture
  • Flexible work options
  • Generous annual leave, sick leave and casual leave
  • Cultural and religious leave with flexible public holiday opportunities
  • A competitive remuneration package featuring performance based incentives with uncapped Employer Provident Fund

Additional Information:

Job Posted:
March 26, 2026

Expiration:
May 08, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Icon
Randstad - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for L2 Data Engineer

Technology Services Engineer – Data Protection & Disaster Recovery

Immediate need for a Data Protection & Disaster Recovery Technical Services Engi...
Location
Location
United States , Alpharetta, Georgia
Salary
Salary:
Not provided
tier4group.com Logo
Tier4 Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years in an MSP setting focused on backup/DR and Windows server environments
  • Deep Veeam proficiency
  • Solid grounding in Windows Server/AD, virtualization (preferably Hyper-V, working knowledge of VMware), storage (SMB/NFS, iSCSI), networking basics, and change control
  • PowerShell and basic API/JSON skills to automate deployments, checks, and reports
  • Security & compliance mindset: RBAC/least privilege, MFA, encryption in transit/at rest, audit artifacts for SOC 2/HIPAA
  • Excellent documentation and incident communications
  • willing to support maintenance windows/on-call
Job Responsibility
Job Responsibility
  • Own backup, restore, and resiliency outcomes for all MSP clients
  • act as the primary technical liaison for backup/DR platforms and service delivery
  • Veeam platform ownership: design, configure, and maintain Veeam Backup & Replication (SOBR, backup copy, replication, Instant Recovery, SureBackup labs)
  • manage repositories, retention, encryption, and job health
  • Immutable off-site copies: build and operate (bucket policies, retention/immutability, lifecycle/usage controls) as the off-site tier
  • Monitoring & compliance reporting: implement and tune end-to-end success/failure monitoring, alerting/escalation, daily health checks, and compliance evidence packs
  • 3-2-1 architectures: design and run three-copy / two-media / one off-site strategies using NAS appliances (QNAP/Synology) for local copy and off-site
  • document RPO/RTO per workload
  • Recovery testing & documentation: execute regular restore drills (file/VM/app-item, Instant Recovery, SureBackup verification), record results, and maintain DR runbooks with clear owners and contact trees
  • Incident response & escalation: lead backup/restore and DR events (containment, comms, status cadence, executive updates), perform RCA, and drive corrective and preventive actions
What we offer
What we offer
  • Competitive salary
  • comprehensive benefits (medical, dental, vision, life, disability, 401(k) match)
  • robust PTO
  • Fulltime
Read More
Arrow Right

Sr. Machine Learning Engineer, AdTech

As a member of our Data Science Engineering team, the Sr. Machine Learning Engin...
Location
Location
United Kingdom
Salary
Salary:
Not provided
pulsepoint.com Logo
PulsePoint
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5 years minimum of experience in machine learning/data science
  • Key Skills: Python, Algorithms, Optimisation, NLP, Data Mining, Statistical Analysis, Neural Networks, Generalised Linear Regression, Multiclass Classification, Java, R
  • Advanced knowledge of Python using standard DS packages (numpy/pandas/scikit, etc.)
  • Being able to optimize and speed-up code.
  • 3+ years of RTB Auction or similar online technologies.
  • Algorithms and Data Structures (e.g., sorting, search tree, binary heap, trie
  • time & mem complexities of algorithms)
  • Probability and Statistics (e.g., hypothesis testing
  • Markov process and its stationary distributions, stochastic matrix and its properties
  • Bayesian inference)
Job Responsibility
Job Responsibility
  • Analyzing and optimizing real-time bidding strategies and online auction mechanics
  • Developing new or improving existing models of event predictions
  • New feature engineering for multiple machine learning models: User embeddings and clustering
  • fraud detection, etc.
  • Cross-device user identification, cookieless mechanisms development
  • Mining different data sources
  • Supporting existing codebase for data integration and production support for our core models.
  • Fulltime
Read More
Arrow Right

Software Engineer

The Software Engineer in Test is a highly technical role in Networking Products ...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Min 6 to 8 Yrs Experience in the Networking Technology domain
  • Preparation of test plan and test execution of the feature
  • Automation of test framework and test cases using python and REST APIs, and Robo Framework
  • Work with different software releases to verify the bugs and provide support to the development team to reproduce the problems
  • Attend any critical customer/partner escalation issues
  • Relevant Technolgy understanding and Testing experience in L2 Protocols - xSTP, LACP, LLDP, IGMP Snooping, MacSEC, VPLS, EVPN-VXLAN, COS/QOS, RED/WRED, GLB, DLB, PFC, ECN
  • Experience using Traffic Generator for manual as well automation using - Spirent/IXIA Traffic Generator
  • Automation Skillset with Python and Robo Framework / or any scripting language Perl/TCL/Python
  • Advanced level of expertise in handling Customer escalations, and Trouble shooting the reported issues, and effectively collaborate with larger team accounts, sales and engineering and ensuring the customer issues are resolved
Job Responsibility
Job Responsibility
  • Designs, develops, troubleshoots and debugs software programs for software enhancements and new products
  • Develops software including operating systems, compilers, routers, networks, utilities, databases and Internet-related tools
  • Determines hardware compatibility and/or influences hardware design
  • Contributes to assignments of limited scope by applying technical concepts and theoretical knowledge acquired through specialized training, education, or previous experience
  • Acts as team member by providing information, analysis and recommendations in support of team efforts
  • Exercises independent judgment within defined parameters
  • Drives technology leadership in QFX Series switching products, deployed in some of the world’s largest enterprises and data centers
  • Drives HPE’s growth in revenue and market share in the switching, and Data Center Networking Business, by delivering market-leading products with continuous innovation and relentless execution
  • Networking Products validation and automation of test cases
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

Infrastructure Engineer II

Infrastructure Engineer II position at Arrow Electronics. The role involves bein...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
arrow.com Logo
Arrow Electronics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Typically requires a minimum of 8 years of related experience with a 4 year degree
  • or 6 years and an advanced degree
  • or equivalent experience
  • Experience in Redhat Linux with an Esxi/VMware Virtualization environment
  • Perform Security OS patching on Windows and Linux servers
  • Build and basic troubleshoot the Redhat Linux & Windows servers
  • Linux & AIX & Windows Day-to-day support
  • multipathing, LVM, & disk management in Linux and Windows servers
  • work on Printer issues on Windows & Linux
  • Linux directory permissions
Job Responsibility
Job Responsibility
  • Be a Part of the technical team in cloud engineering platform techniques and processes such as: Infrastructure as Code and continued automation of tasks
  • Develop and grow Kubernetes based microservices clusters in a Cloud Organization
  • Provide direction on engineering platform in Azure
  • Document designs and implementation
  • Provide expertise to development teams on CI/CD
  • Help the team with initial triage of platform issues
  • Fulltime
Read More
Arrow Right

Cisco Data L2 Engineer

We’ve always been an organisation with purpose; to use the power of communicatio...
Location
Location
Hungary , Budapest
Salary
Salary:
Not provided
plus.net Logo
Plusnet
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • In depth understanding of LAN WAN WLAN BGP MPLS OSPF EIGRP DMVPN IPSEC technologies
  • Advanced level of troubleshooting end to end
  • CISCO CCNA CCNP certification or equivalent knowledge
  • Service desk experience
  • Communicating effectively and efficiently while adapting to your audience and getting the message through as intended
  • Ability to comprehend and to oversee various aspects of a problem or a situation
  • Focusing on all aspects and details of a task and delivering your output with a high level of accuracy
  • Ability to find root causes of problems and to focus on their quick and efficient solution
  • English on a fluent level
Job Responsibility
Job Responsibility
  • Supporting and maintaining a global network for our dedicated customer
  • Working closely with design architects (TDA), project managers and other technical resolver groups
  • Supporting the 1st line engineers with technical information
  • Solving underlying problems
  • Supporting other engineering teams to find rootcause
  • Willing to learn new concepts, new technologies, accepting challenges
  • Fulltime
Read More
Arrow Right

Systems Engineer L2

Amentum is a global leader in advanced engineering and innovative technology sol...
Location
Location
Australia , Newcastle or Canberra
Salary
Salary:
Not provided
amentum.com Logo
Amentum
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Eligible to access US Export Controlled (ITAR) information: Yes
  • Required Quals/Memberships/accreditations: Engineering Qual
  • Experience working in complex projects
  • Required Security Clearance Level: NV1 min
Job Responsibility
Job Responsibility
  • Support the maintenance and currency of project engineering plans and processes, including the Engineering Management Plan (EMP) and Test and Evaluation Master Plan (TEMP)
  • Develop and coordinate engineering reports in accordance with project standards and direction
  • Support the engineering team to conduct reviews of technical data, including CDRLs, plans, Technical Instructions, RFIs, CCPs, and ECPs
  • Support the engineering team to undertake reviews of internally generated furnished data and the verification of furnished services
  • Liaise with stakeholders to develop and maintain project architecture documentation
  • Support the project team with document and configuration management activities
  • Review and develop project engineering decision records in support of authorised engineering decision making
  • Support the project at stakeholder meetings and working groups, as directed
  • Provide engineering input on current and emerging project risks to support project risk management activities
  • Support system integration and verification and validation (V&V) activities
What we offer
What we offer
  • Health, dental, and vision insurance
  • Paid time off and holidays
  • Retirement benefits (including 401(k) matching)
  • Educational reimbursement
  • Parental leave
  • Employee stock purchase plan
  • Tax-saving options
  • Disability and life insurance
  • Pet insurance
  • Fulltime
Read More
Arrow Right

Data Centre Service Delivery Field Support Engineer (L2)

The Data Center Service Delivery Field Support Engineer (L2) is a developing eng...
Location
Location
Malaysia , Petaling Jaya
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree or equivalent in Information Technology or Computing or related field
  • Professional level certification in different Data Centre technologies such as Cisco, NetApp, EMC- Ex: CCNP (DC), ONTApp etc.
  • Moderate level of experience in building, deploying and supporting data center networking infrastructure
  • Intermediate knowledge of data center network equipment like Nexus and MDS series switching and integration into server and storage technologies
  • Good communicate skills, both verbal and written
  • Ability to plan activities and projects well in advance and take into account possible changing circumstances
  • Ability to maintain a positive outlook at work
  • Ability to work well in a pressurized environment
  • Ability to work hard and put in longer hours when it is necessary
  • Ability to apply active listening techniques such as paraphrasing the message to confirm understanding, probing for further relevant information and refraining from interrupting
Job Responsibility
Job Responsibility
  • Ensures that the assigned infrastructure at the client site is configured, installed, tested and operational
  • Ensures that any software that is part of the solution is installed and configured according to client requirements
  • Proactively identifies problems and errors as they occur and logs such incidents in a timely manner with the required level of detail
  • Liaises with all stakeholders including client IT environments, carriers and colleagues to expediate diagnosis of errors and problems and to identify a resolution
  • Investigates second line support calls assigned and identifies the root cause of incidents and problems following knowledge articles
  • Responds to and diagnoses all alerts, escalate to L3 Field Engineer when unable to resolve within the stipulated time
  • Ensures incidents are updated with progress and resolution details in a timely manner using the required platform
  • Ensures the efficient and comprehensive resolution of incidents and requests
  • Applies tools, techniques and processes to track, log, report on and correct configuration items, components and changes
  • Investigates problems in systems, processes and services and assists with the implementation of agreed remedies and preventative measures
  • Fulltime
Read More
Arrow Right

Senior Network Engineer

KAYAK's Network Operations team is looking for a motivated network engineer with...
Location
Location
United States , Cambridge
Salary
Salary:
Not provided
https://www.kayak.com/ Logo
KAYAK
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 4 years experience configuring and maintaining web-scale production networks
  • Strong Linux skills (3 or more years preferred)
  • Experience with network automation, specifically using Ansible
  • Dedicated and has a growth-mindset to improve themselves, the team, and the business
  • Excellent collaboration skills and are able to document work and share knowledge with the rest of the team internally and externally
  • Strong oral and written communication skills
  • Experience with designing, troubleshooting, and operating data center networks including L2 switching and L3 routing with OSPF and BGP
  • Linux routing software such as FRR, BIRD, or equivalent
  • Automating network tasks using scripting or configuration management tools such as Ansible and Python
  • Cisco, Juniper, and Dell, switches, and security appliances
Job Responsibility
Job Responsibility
  • Designing and deploying data center network fabric
  • Monitoring and maintaining all network equipment via SNMP, API or other means available
  • Using standard processes, maintain network security policies on Palo Alto firewalls
  • Maintain and scale data center interconnects as needed
  • Research and implement new connectivity methods to AWS infrastructure
  • Collaborate with diverse teams to integrate on premises Kubernetes clusters into our infrastructure
  • Continue to improve and maintain our existing enterprise office network infrastructure
  • Act as an escalation point for any network operations queries
What we offer
What we offer
  • Work from (almost) anywhere for up to 20 days per year
  • Focus on mental health and well-being: Company-paid therapy sessions through SpringHealth
  • Company-paid subscription to HeadSpace
  • Company-wide week off a year - the whole team fully recharges (and returns without a pile-up of work!)
  • No meeting Fridays
  • Paid parental leave
  • Generous paid vacation + time off for your birthday
  • Paid volunteer time
  • Focus on your career growth: Development Dollars
  • Leadership development
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy