CrawlJobs Logo

Big Data Engineer

India, Pune · Job Posted January 22, 2026
Apply Position
Job Link Share

Job Description

We are seeking a skilled Big Data Engineer to join our Data and Analytics (DNA) team on a 6-month contract basis. Based in Pune, Bangalore, or Ahmedabad, this role is pivotal in designing and maintaining scalable big data solutions that support efficient data processing and analytics. The ideal candidate will collaborate with cross-functional teams to build robust data pipelines and leverage big data technologies to drive data-driven decision-making across the organisation.

Job Responsibility

  • Design, develop, and maintain scalable data pipelines for processing structured and unstructured data
  • Build and optimise data storage solutions including distributed file systems, NoSQL databases, and data warehouses
  • Utilise big data frameworks such as Apache Hadoop, Spark, Flink, and Kafka to develop data processing workflows
  • Ensure high performance and scalability through parallel processing, distributed computing, and caching strategies
  • Implement monitoring, alerting, and automated scaling mechanisms for big data systems
  • Maintain data quality and governance by applying validation, cleansing, and enrichment processes
  • Collaborate with data scientists, analysts, and engineers to align data solutions with business objectives
  • Document system architecture and processes, and provide training and support to stakeholders

Requirements

  • Graduate or Postgraduate in Computer Science, Engineering, or a related technical field
  • Over 5 years of experience in building cloud-based data engineering solutions
  • Proficient in SQL and programming languages such as Python, Java, or Scala
  • Hands-on experience with big data technologies including Apache Hadoop, Spark, Flink, and Kafka
  • Familiar with cloud platforms such as AWS, GCP, or Azure
  • Experienced in streaming tools like Amazon Kinesis, Apache Kafka, Flink, or Pulsar
  • Strong understanding of distributed systems and database management principles
  • Excellent communication and collaboration skills with a proactive approach to problem-solving
  • Ability to work independently and manage multiple priorities in a fast-paced environment
  • Familiarity with ITIL practices and experience in large global organisations is desirable

Nice to have

Familiarity with ITIL practices and experience in large global organisations is desirable

What we offer

  • Opportunity to work on cutting-edge big data technologies and cloud platforms
  • Exposure to large-scale data engineering projects within a global telecom environment
  • Collaborative work culture with cross-functional teams
  • Flexible work location options including Pune, Bangalore, and Ahmedabad
  • Be part of a dynamic team driving innovation and digital transformation

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Big Data Engineer

8 matching positions

Big Data Engineer

We are seeking a talented and experienced Big Data Hadoop Developer to join our ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field
  • 3-4 years of professional experience in Big Data development
  • Proven experience with the Hadoop ecosystem, including HDFS, YARN, Hive, and other related technologies
  • Hands on experience in SQL and shell scripting
  • Strong expertise in Apache Spark for data processing and analysis
  • Proficiency in at least one of the following programming languages: Scala, Python, or PySpark
  • Experience with building and optimizing large-scale data pipelines
  • Familiarity with data warehousing concepts and ETL methodologies
  • Solid understanding of distributed computing principles
  • Excellent problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Design, develop, and maintain robust and scalable ETL processes and data pipelines using Apache Hadoop and Apache Spark
  • Write efficient, clear, and well-documented code primarily in Scala, Python, or PySpark for big data processing
  • Implement data ingestion, transformation, and loading routines from various sources into Hadoop Distributed File System (HDFS) and other big data stores
  • Optimize existing Spark jobs and Hadoop ecosystem components for performance and scalability
  • Collaborate with data architects, data scientists, and other stakeholders to understand data requirements and translate them into technical solutions
  • Ensure data quality, integrity, and security across all big data platforms
  • Participate in code reviews, testing, and deployment of big data applications
  • Troubleshoot and resolve issues in big data environments
  • Stay up-to-date with the latest trends and technologies in the big data ecosystem
  • Fulltime
Read More
Arrow Right

Big Data Engineer

We are seeking a talented Big Data Engineer with strong expertise in Java and Ap...
Location
Location
India , Haveli
Salary
Salary:
Not provided
votredircom.fr Logo
Wissen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2–4 years of hands-on experience in Big Data and Apache Spark
  • Strong experience in Core Java, including: Multithreading
  • Collections Framework
  • Practical expertise in Spark with Java
  • Strong knowledge of Unix commands and Bash scripting
  • Proficiency in PL/SQL for data querying and transformations
  • Experience building or maintaining scalable backend systems
  • Strong analytical and problem‑solving skills with the ability to handle complex technical issues
  • Understanding of configuration management and change control processes
Job Responsibility
Job Responsibility
  • Design and develop backend services and data‑driven applications using Core Java
  • Build, optimize, and maintain Apache Spark–based data processing pipelines
  • Develop and integrate REST APIs for backend and data applications
  • Write efficient and optimized PL/SQL queries for large datasets
  • Work with Unix commands and Bash scripts for automation and job orchestration
  • Ensure proper configuration management, version control, and deployment best practices
  • Troubleshoot and resolve complex technical issues across Java and Spark layers
  • Collaborate with backend, frontend, and data engineering teams to deliver high‑quality solutions
  • Fulltime
Read More
Arrow Right

Big Data Engineer

Bright Vision Technologies is looking for a skilled Big Data Engineer to join th...
Location
Location
United States , Bridgewater
Salary
Salary:
Not provided
bvteck.com Logo
Bright Vision Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 3 to 5 years real time experience
  • Experience with Apache Hadoop, Spark, PySpark, Scala, Kafka, HDFS, Hive, HBase, Airflow, Data Warehousing, ETL pipelines, SQL, NoSQL databases, Cloud Platforms (AWS / Azure / GCP), Big Data services (EMR, Dataproc), Docker, Linux, CI/CD pipelines, Git, Agile methodologies
  • Must be willing to take an AI-proctored online coding test
  • Must have at least 1 year of real-time project experience in the USA
  • Must be willing to relocate nationwide based on project needs
  • Must be looking for H-1B sponsorship for the 2026/2027 quota
  • Must be on OPT/CPT/H4 EAD/TN/E3 or any other Non-immigrant visa
  • Must be willing to work on W2 (not C2C/1099/3rd party)
  • Must commit to paying the USCIS-mandated $215 H-1B registration fee after offer
  • Must proceed exclusively with this company for H-1B sponsorship
Job Responsibility
Job Responsibility
  • Design scalable, reliable, and high-performance data platforms
  • Transform business processes through technology
  • Contribute to the mission of building innovative solutions that help businesses automate and optimize their operations
What we offer
What we offer
  • H-1B sponsorship for the 2026/2027 quota
  • Career growth potential
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • SQL
  • working knowledge of program languages
  • consistently demonstrates clear and concise written and verbal communication
  • bachelor’s degree/University degree or equivalent experience
What we offer
What we offer
  • Programs and services for physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • database management: SQL
  • working knowledge of program languages
  • consistently demonstrates clear and concise written and verbal communication
What we offer
What we offer
  • programs and services for physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more
  • Fulltime
Read More
Arrow Right

Big Data Engineer

Inetum is seeking a seasoned Big Data Engineer to join our team and support the ...
Location
Location
Portugal , Lisbon
Salary
Salary:
Not provided
https://www.inetum.com Logo
Inetum
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or equivalent
  • Minimum 5 years of experience in a similar role
  • Strong expertise in Hadoop Ecosystem & Data Lake Operations, Big Data Services & Query Engines, Security & Access Control in Distributed Environments, Monitoring, Automation & Platform Lifecycle Management
  • Proven ability to diagnose and resolve complex issues in Big Data environments
  • Strong communication skills to collaborate with cross-functional teams
  • English proficiency: B2-C1 level
Job Responsibility
Job Responsibility
  • Operate, monitor, and support Hadoop-based data lake platforms
  • Provide L3 incident response, deep troubleshooting, and performance tuning for big data components
  • Ensure data integrity, replication, and capacity management within HDFS clusters
  • Develop and automate monitoring and alerting for service health and node performance
  • Collaborate with platform and data teams to onboard new workloads with optimal resource allocation
  • Apply patches, upgrades, and configuration changes to maintain platform security and stability
  • Manage Kerberos authentication, Ranger/Sentry policies, and TLS encryption
  • Work with storage, network, and security teams to optimize throughput and access controls
  • Maintain cluster documentation and share knowledge across teams
What we offer
What we offer
  • Opportunity to grow your expertise
  • Certified Top Employer Europe 2025
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • Proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • Database Management: SQL
  • Working knowledge of program languages
  • Consistently demonstrates clear and concise written and verbal communication
  • Bachelor’s degree/University degree or equivalent experience
What we offer
What we offer
  • Programs and services for your physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • Proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • Database Management: SQL
  • Working knowledge of program languages
  • Consistently demonstrates clear and concise written and verbal communication
  • Bachelor’s degree/University degree or equivalent experience
What we offer
What we offer
  • Programs and services for your physical and mental well-being including access to telehealth options, health advocates, confidential counseling
  • Fulltime
Read More
Arrow Right