CrawlJobs Logo
Inetum Logo Inetum · IT - Administration

Big Data Engineer

Portugal, Lisbon Employment contract · Job Posted September 16, 2025
Apply Position
Job Link Share

Job Description

Inetum is seeking a seasoned Big Data Engineer to join our team and support the operations of our Hadoop-based data lake environments. This is a critical role for ensuring the performance, reliability, and security of our big data infrastructure.

Job Responsibility

  • Operate, monitor, and support Hadoop-based data lake platforms
  • Provide L3 incident response, deep troubleshooting, and performance tuning for big data components
  • Ensure data integrity, replication, and capacity management within HDFS clusters
  • Develop and automate monitoring and alerting for service health and node performance
  • Collaborate with platform and data teams to onboard new workloads with optimal resource allocation
  • Apply patches, upgrades, and configuration changes to maintain platform security and stability
  • Manage Kerberos authentication, Ranger/Sentry policies, and TLS encryption
  • Work with storage, network, and security teams to optimize throughput and access controls
  • Maintain cluster documentation and share knowledge across teams

Requirements

  • Bachelor’s degree in Computer Science or equivalent
  • Minimum 5 years of experience in a similar role
  • Strong expertise in Hadoop Ecosystem & Data Lake Operations, Big Data Services & Query Engines, Security & Access Control in Distributed Environments, Monitoring, Automation & Platform Lifecycle Management
  • Proven ability to diagnose and resolve complex issues in Big Data environments
  • Strong communication skills to collaborate with cross-functional teams
  • English proficiency: B2-C1 level

Nice to have

  • Big Data certifications (e.g., Cloudera)
  • Familiarity with Kafka, NiFi, or Flume for ingestion pipelines
  • Knowledge of ITIL processes for incident and change management

What we offer

  • Opportunity to grow your expertise
  • Certified Top Employer Europe 2025
Inetum - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Big Data Engineer

8 matching positions

Big Data Engineer

We are seeking a talented and experienced Big Data Hadoop Developer to join our ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field
  • 3-4 years of professional experience in Big Data development
  • Proven experience with the Hadoop ecosystem, including HDFS, YARN, Hive, and other related technologies
  • Hands on experience in SQL and shell scripting
  • Strong expertise in Apache Spark for data processing and analysis
  • Proficiency in at least one of the following programming languages: Scala, Python, or PySpark
  • Experience with building and optimizing large-scale data pipelines
  • Familiarity with data warehousing concepts and ETL methodologies
  • Solid understanding of distributed computing principles
  • Excellent problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Design, develop, and maintain robust and scalable ETL processes and data pipelines using Apache Hadoop and Apache Spark
  • Write efficient, clear, and well-documented code primarily in Scala, Python, or PySpark for big data processing
  • Implement data ingestion, transformation, and loading routines from various sources into Hadoop Distributed File System (HDFS) and other big data stores
  • Optimize existing Spark jobs and Hadoop ecosystem components for performance and scalability
  • Collaborate with data architects, data scientists, and other stakeholders to understand data requirements and translate them into technical solutions
  • Ensure data quality, integrity, and security across all big data platforms
  • Participate in code reviews, testing, and deployment of big data applications
  • Troubleshoot and resolve issues in big data environments
  • Stay up-to-date with the latest trends and technologies in the big data ecosystem
  • Fulltime
Read More
Arrow Right

Big Data Engineer

We are seeking a talented Big Data Engineer with strong expertise in Java and Ap...
Location
Location
India , Haveli
Salary
Salary:
Not provided
votredircom.fr Logo
Wissen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2–4 years of hands-on experience in Big Data and Apache Spark
  • Strong experience in Core Java, including: Multithreading
  • Collections Framework
  • Practical expertise in Spark with Java
  • Strong knowledge of Unix commands and Bash scripting
  • Proficiency in PL/SQL for data querying and transformations
  • Experience building or maintaining scalable backend systems
  • Strong analytical and problem‑solving skills with the ability to handle complex technical issues
  • Understanding of configuration management and change control processes
Job Responsibility
Job Responsibility
  • Design and develop backend services and data‑driven applications using Core Java
  • Build, optimize, and maintain Apache Spark–based data processing pipelines
  • Develop and integrate REST APIs for backend and data applications
  • Write efficient and optimized PL/SQL queries for large datasets
  • Work with Unix commands and Bash scripts for automation and job orchestration
  • Ensure proper configuration management, version control, and deployment best practices
  • Troubleshoot and resolve complex technical issues across Java and Spark layers
  • Collaborate with backend, frontend, and data engineering teams to deliver high‑quality solutions
  • Fulltime
Read More
Arrow Right

Big Data Engineer

Bright Vision Technologies is looking for a skilled Big Data Engineer to join th...
Location
Location
United States , Bridgewater
Salary
Salary:
Not provided
bvteck.com Logo
Bright Vision Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 3 to 5 years real time experience
  • Experience with Apache Hadoop, Spark, PySpark, Scala, Kafka, HDFS, Hive, HBase, Airflow, Data Warehousing, ETL pipelines, SQL, NoSQL databases, Cloud Platforms (AWS / Azure / GCP), Big Data services (EMR, Dataproc), Docker, Linux, CI/CD pipelines, Git, Agile methodologies
  • Must be willing to take an AI-proctored online coding test
  • Must have at least 1 year of real-time project experience in the USA
  • Must be willing to relocate nationwide based on project needs
  • Must be looking for H-1B sponsorship for the 2026/2027 quota
  • Must be on OPT/CPT/H4 EAD/TN/E3 or any other Non-immigrant visa
  • Must be willing to work on W2 (not C2C/1099/3rd party)
  • Must commit to paying the USCIS-mandated $215 H-1B registration fee after offer
  • Must proceed exclusively with this company for H-1B sponsorship
Job Responsibility
Job Responsibility
  • Design scalable, reliable, and high-performance data platforms
  • Transform business processes through technology
  • Contribute to the mission of building innovative solutions that help businesses automate and optimize their operations
What we offer
What we offer
  • H-1B sponsorship for the 2026/2027 quota
  • Career growth potential
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • SQL
  • working knowledge of program languages
  • consistently demonstrates clear and concise written and verbal communication
  • bachelor’s degree/University degree or equivalent experience
What we offer
What we offer
  • Programs and services for physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • database management: SQL
  • working knowledge of program languages
  • consistently demonstrates clear and concise written and verbal communication
What we offer
What we offer
  • programs and services for physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • Proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • Database Management: SQL
  • Working knowledge of program languages
  • Consistently demonstrates clear and concise written and verbal communication
  • Bachelor’s degree/University degree or equivalent experience
What we offer
What we offer
  • Programs and services for your physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • Proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • Database Management: SQL
  • Working knowledge of program languages
  • Consistently demonstrates clear and concise written and verbal communication
  • Bachelor’s degree/University degree or equivalent experience
What we offer
What we offer
  • Programs and services for your physical and mental well-being including access to telehealth options, health advocates, confidential counseling
  • Fulltime
Read More
Arrow Right

Big Data Engineer

We are looking for a Big Data Engineer that will work on the collecting, storing...
Location
Location
United States , St. Louis
Salary
Salary:
Not provided
protocolinfotech.com Logo
Protocol Infotech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Applications, Science, Engineering, Technology
  • 2-4 Years experience
  • Proficiency with Hadoop v2, MapReduce, HDFS
  • Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
  • Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
  • Experience with Spark
  • Experience with integration of data from multiple data sources
  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
  • Knowledge of various ETL techniques and frameworks, such as Flume
  • Experience with various messaging systems, such as Kafka or RabbitMQ
Job Responsibility
Job Responsibility
  • Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
  • Implementing ETL process
  • Monitoring performance and advising any necessary infrastructure changes
  • Defining data retention policies
  • Ability to solve any ongoing issues with operating the cluster
  • Guides the development team in overall application technology design activities
What we offer
What we offer
  • Employee referral program
  • Referral fee of $1,000 will be paid if referred candidate is hired
  • Fulltime
Read More
Arrow Right