CrawlJobs Logo
Wissen Logo Wissen · IT - Software Development

Big Data Engineer

India, Haveli · Job Posted March 05, 2026
Apply Position
Job Link Share

Job Description

We are seeking a talented Big Data Engineer with strong expertise in Java and Apache Spark. The ideal candidate should have hands-on experience in Big Data development, solid knowledge of Core Java concepts (including multithreading and collections), and the ability to work across backend systems. You will be responsible for designing scalable data applications, optimizing Spark jobs, and collaborating with cross-functional teams to build robust data-driven solutions.

Job Responsibility

  • Design and develop backend services and data‑driven applications using Core Java
  • Build, optimize, and maintain Apache Spark–based data processing pipelines
  • Develop and integrate REST APIs for backend and data applications
  • Write efficient and optimized PL/SQL queries for large datasets
  • Work with Unix commands and Bash scripts for automation and job orchestration
  • Ensure proper configuration management, version control, and deployment best practices
  • Troubleshoot and resolve complex technical issues across Java and Spark layers
  • Collaborate with backend, frontend, and data engineering teams to deliver high‑quality solutions

Requirements

  • 2–4 years of hands-on experience in Big Data and Apache Spark
  • Strong experience in Core Java, including: Multithreading
  • Collections Framework
  • Practical expertise in Spark with Java
  • Strong knowledge of Unix commands and Bash scripting
  • Proficiency in PL/SQL for data querying and transformations
  • Experience building or maintaining scalable backend systems
  • Strong analytical and problem‑solving skills with the ability to handle complex technical issues
  • Understanding of configuration management and change control processes

Nice to have

  • Experience with Hadoop ecosystem tools (HDFS, Hive, Oozie, Kafka, etc.)
  • Exposure to cloud platforms like AWS, Azure, or GCP
  • Knowledge of containerization (Docker) and CI/CD pipelines
  • Familiarity with frontend technologies (React/Angular) for full-stack exposure
  • Experience with performance tuning of Spark and Java services
  • Knowledge of distributed systems and large‑scale data architecture
Wissen - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Big Data Engineer

8 matching positions

Big Data Engineer

We are seeking a talented and experienced Big Data Hadoop Developer to join our ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field
  • 3-4 years of professional experience in Big Data development
  • Proven experience with the Hadoop ecosystem, including HDFS, YARN, Hive, and other related technologies
  • Hands on experience in SQL and shell scripting
  • Strong expertise in Apache Spark for data processing and analysis
  • Proficiency in at least one of the following programming languages: Scala, Python, or PySpark
  • Experience with building and optimizing large-scale data pipelines
  • Familiarity with data warehousing concepts and ETL methodologies
  • Solid understanding of distributed computing principles
  • Excellent problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Design, develop, and maintain robust and scalable ETL processes and data pipelines using Apache Hadoop and Apache Spark
  • Write efficient, clear, and well-documented code primarily in Scala, Python, or PySpark for big data processing
  • Implement data ingestion, transformation, and loading routines from various sources into Hadoop Distributed File System (HDFS) and other big data stores
  • Optimize existing Spark jobs and Hadoop ecosystem components for performance and scalability
  • Collaborate with data architects, data scientists, and other stakeholders to understand data requirements and translate them into technical solutions
  • Ensure data quality, integrity, and security across all big data platforms
  • Participate in code reviews, testing, and deployment of big data applications
  • Troubleshoot and resolve issues in big data environments
  • Stay up-to-date with the latest trends and technologies in the big data ecosystem
  • Fulltime
Read More
Arrow Right

Big Data Engineer

Bright Vision Technologies is looking for a skilled Big Data Engineer to join th...
Location
Location
United States , Bridgewater
Salary
Salary:
Not provided
bvteck.com Logo
Bright Vision Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 3 to 5 years real time experience
  • Experience with Apache Hadoop, Spark, PySpark, Scala, Kafka, HDFS, Hive, HBase, Airflow, Data Warehousing, ETL pipelines, SQL, NoSQL databases, Cloud Platforms (AWS / Azure / GCP), Big Data services (EMR, Dataproc), Docker, Linux, CI/CD pipelines, Git, Agile methodologies
  • Must be willing to take an AI-proctored online coding test
  • Must have at least 1 year of real-time project experience in the USA
  • Must be willing to relocate nationwide based on project needs
  • Must be looking for H-1B sponsorship for the 2026/2027 quota
  • Must be on OPT/CPT/H4 EAD/TN/E3 or any other Non-immigrant visa
  • Must be willing to work on W2 (not C2C/1099/3rd party)
  • Must commit to paying the USCIS-mandated $215 H-1B registration fee after offer
  • Must proceed exclusively with this company for H-1B sponsorship
Job Responsibility
Job Responsibility
  • Design scalable, reliable, and high-performance data platforms
  • Transform business processes through technology
  • Contribute to the mission of building innovative solutions that help businesses automate and optimize their operations
What we offer
What we offer
  • H-1B sponsorship for the 2026/2027 quota
  • Career growth potential
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • SQL
  • working knowledge of program languages
  • consistently demonstrates clear and concise written and verbal communication
  • bachelor’s degree/University degree or equivalent experience
What we offer
What we offer
  • Programs and services for physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • database management: SQL
  • working knowledge of program languages
  • consistently demonstrates clear and concise written and verbal communication
What we offer
What we offer
  • programs and services for physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more
  • Fulltime
Read More
Arrow Right

Big Data Engineer

Inetum is seeking a seasoned Big Data Engineer to join our team and support the ...
Location
Location
Portugal , Lisbon
Salary
Salary:
Not provided
https://www.inetum.com Logo
Inetum
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or equivalent
  • Minimum 5 years of experience in a similar role
  • Strong expertise in Hadoop Ecosystem & Data Lake Operations, Big Data Services & Query Engines, Security & Access Control in Distributed Environments, Monitoring, Automation & Platform Lifecycle Management
  • Proven ability to diagnose and resolve complex issues in Big Data environments
  • Strong communication skills to collaborate with cross-functional teams
  • English proficiency: B2-C1 level
Job Responsibility
Job Responsibility
  • Operate, monitor, and support Hadoop-based data lake platforms
  • Provide L3 incident response, deep troubleshooting, and performance tuning for big data components
  • Ensure data integrity, replication, and capacity management within HDFS clusters
  • Develop and automate monitoring and alerting for service health and node performance
  • Collaborate with platform and data teams to onboard new workloads with optimal resource allocation
  • Apply patches, upgrades, and configuration changes to maintain platform security and stability
  • Manage Kerberos authentication, Ranger/Sentry policies, and TLS encryption
  • Work with storage, network, and security teams to optimize throughput and access controls
  • Maintain cluster documentation and share knowledge across teams
What we offer
What we offer
  • Opportunity to grow your expertise
  • Certified Top Employer Europe 2025
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • Proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • Database Management: SQL
  • Working knowledge of program languages
  • Consistently demonstrates clear and concise written and verbal communication
  • Bachelor’s degree/University degree or equivalent experience
What we offer
What we offer
  • Programs and services for your physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • Proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • Database Management: SQL
  • Working knowledge of program languages
  • Consistently demonstrates clear and concise written and verbal communication
  • Bachelor’s degree/University degree or equivalent experience
What we offer
What we offer
  • Programs and services for your physical and mental well-being including access to telehealth options, health advocates, confidential counseling
  • Fulltime
Read More
Arrow Right

Big Data Engineer

We are looking for a Big Data Engineer that will work on the collecting, storing...
Location
Location
United States , St. Louis
Salary
Salary:
Not provided
protocolinfotech.com Logo
Protocol Infotech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Applications, Science, Engineering, Technology
  • 2-4 Years experience
  • Proficiency with Hadoop v2, MapReduce, HDFS
  • Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
  • Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
  • Experience with Spark
  • Experience with integration of data from multiple data sources
  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
  • Knowledge of various ETL techniques and frameworks, such as Flume
  • Experience with various messaging systems, such as Kafka or RabbitMQ
Job Responsibility
Job Responsibility
  • Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
  • Implementing ETL process
  • Monitoring performance and advising any necessary infrastructure changes
  • Defining data retention policies
  • Ability to solve any ongoing issues with operating the cluster
  • Guides the development team in overall application technology design activities
What we offer
What we offer
  • Employee referral program
  • Referral fee of $1,000 will be paid if referred candidate is hired
  • Fulltime
Read More
Arrow Right