CrawlJobs Logo

Senior Hadoop developer

realign-llc.com Logo

Realign

Location Icon

Location:
United States , Newark

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

120000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

We are seeking a highly skilled and experienced Senior Hadoop Developer to join our team. The ideal candidate will have a strong background in Pyspark, Hadoop, and SQL.

Job Responsibility:

  • Design, develop, and maintaining scalable and secure software solutions
  • Collaborate with ML teams on feature engineering, data preprocessing, and optimizing data formats for model training
  • Optimize performance for large-scale distributed data processing and ML workloads
  • Collaborate with data scientists, ML engineers to ensure data is efficiently ingested, processed, and prepared for model training

Requirements:

  • Bachelor’s or Master’s in Computer Science, Data Engineering, or related field
  • 10+ years in Hadoop ecosystem development
  • 2+ years in data engineering for ML projects
  • Technically Strong in Pyspark, Hadoop and SQL
  • Excellent problem-solving and communication skills
  • Mentor junior engineers and enforce best practices in coding, architecture, and data engineering

Nice to have:

  • Work experience in Machine learning project
  • Cloudera/Hortonworks or equivalent (preferred)

Additional Information:

Job Posted:
March 21, 2026

Employment Type:
Fulltime
Icon
Realign - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Hadoop developer

Applications Development Senior Programmer

The Applications Development Senior Programmer is an intermediate level position...
Location
Location
Canada , Mississauga
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8-10 Years Overall IT experience, Big Data Developer with experience in building Java/Scala, Spark based application
  • At least 5 Years of strong Development experience along with troubleshooting kills with technologies like Spark, Java/Scala and Hive
  • Previous experience with Hadoop stack, HDFS, Yarn resourcing, Zookeeper interactions are good to have
  • Good SQL knowledge on Hive/Impala
  • Basic Data warehousing concepts like SCD2 will be an added advantage
  • Experience with Kafka, Elastic will be a big plus
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Acts as SME to senior stakeholders and /or other team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Big Data Application Development Senior Programmer

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8-10 years of Development experience in big data space
  • Core Java
  • Full Stack developer
  • Big Data Frameworks
  • Hadoop
  • Scala
  • Hive
  • Impala
  • Kafka
  • Elastic
Job Responsibility
Job Responsibility
  • Develop real time and batch data transformation processes using wide range of technologies using Hadoop, Spark Stream, Spark SQL, Python, Hive etc
  • Ability to translate architecture and low-level requirements to design and code using Big-data tools and processes
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Critically evaluate the current processing and recommend process efficiencies/enhancements
  • Work closely with Technology partners to ensure the Business requirements are met by the development team
  • Fulltime
Read More
Arrow Right

Applications Development Senior Programmer Analyst

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8-12 years of relevant experience
  • Experience in Java, Spark, Hive, Hadoop and Kafka
  • Experience in Data Pipeline and Data Modeling
  • Experience in Shell scripting
  • Experience in managing CI/CD Pipeline and Release management
  • Experience in systems analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
What we offer
What we offer
  • Equal opportunity and affirmative action employer
  • Reasonable accommodation for persons with disabilities
  • Global benefits
  • Fulltime
Read More
Arrow Right

Senior Java Developer

Citi is seeking a Senior Java Developer to join the Technology team in Belfast, ...
Location
Location
United Kingdom , Belfast
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Authoritative knowledge of Java and Hadoop including HDFS, Hive and Spark
  • Comfortable working with large data volumes and demonstrating understanding of logical data structures and analysis techniques
  • Strong skills in identifying and resolving code vulnerabilities
  • Familiarity with utilizing Citi tools
  • Expertise in identifying and resolving data quality issues in datasets
  • Expert SQL coder
  • Proficiency in writing Linux shell scripts
  • Experience with automated build and test processes like RLM, Jenkins, Lightspeed, and Harness
  • Knowledge of Autosys
  • Strong written and verbal communication skills
Job Responsibility
Job Responsibility
  • Collaborating with the architecture team to define best practices in Java and Hadoop development
  • Challenging and directing the technical roadmap
  • Proposing adoption of new technology or techniques
  • Providing breakdowns of project deliverables and estimates
  • Designing and building data pipelines and Hadoop storage objects
  • Assisting in production issue resolution
  • Mentoring team members
  • Working with data analysts to define logical data structures
  • Encouraging team self-learning
What we offer
What we offer
  • 27 days annual leave plus bank holidays
  • Discretional annual performance-related bonus
  • Private medical care and life insurance
  • Employee Assistance Program
  • Pension plan
  • Paid parental leave
  • Special discounts for employees, family, and friends
  • Access to learning and development resources
  • Fulltime
Read More
Arrow Right

Applications Development Senior Programmer Analyst

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
Canada , Mississauga
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of Application development experience through full lifecycle
  • SME for UI architecture patterns - Micro Frontend, NX
  • Experience with Core Java/J2EE Application with complete command over OOPs and Design Patterns
  • Commendable in Data Structures and Algorithms
  • Worked on Core Application Development of complex size encompassing all areas of Java/J2EE
  • Thorough knowledge and hands on experience in following technologies Hadoop, Map Reduce Framework, Spark, YARN, Sqoop, Pig, Hue, Unix, Java, Sqoop, Impala, Cassandra on Mesos
  • Cloudera certification (CCDH) is an added advantage
  • Implemented or part complex project execution in Big Data Spark eco system
  • Exposure to ETL and BI tools
  • Work in an agile environment following through the best practices of agile Scrum
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Applications Development Senior Group Manager

This role will be part of the Risk Data team and is a senior management level po...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong academic record, ideally with a Bachelor’s or Master’s degree in Computer Science or engineering or related technical discipline
  • Proven experience in enterprise application development with full stack technologies
  • Strong Architect and hands on technical experience in implementing large volume real time complex solutions in Big Data Platforms & Public Cloud platforms
  • Experience in Data architecture, strong Software development fundamentals, data structures, design patterns, object-oriented principles
  • Experience in design and delivery of multi-tiered applications and high performance server side components
  • Skills on system performance tuning, high performance, low latency, multithreading and experience with Java server side programming
  • Preferred experience in Handling high volumes of data and working with In-memory databases and Caching solutions
  • Experience of building and leading teams, ideally with a global resource profile and demonstrated ability to deliver large projects efficiently and on time
  • Significant experience in large Financial Services Technology services companies is expected for this position
  • Hands-on development, architecture and leadership experience in real-time data engineering platforms implementation
Job Responsibility
Job Responsibility
  • Lead the efforts in Institutional Data Platform (ICG) that span multiple businesses, products and functions
  • Delivery of Price Risk related Data initiatives and Capital reporting (GSIB) related deliverables
  • Establish strong relationships with the global business stakeholders and ensure transparency of project deliveries
  • Actively identify and manage risks and issues, working with disparate teams to create mitigation plans and follow-through to resolution
  • Adhere to all key Project Management (PMQC) & Engineering Excellence standards
  • Ensure timely communications to Senior Technology Management and Business Partners in Front Office, Middle Office & other Operations functions
  • Drive the design and development of system architecture, work with end-users of the systems, and enhance the quality of deliverables
  • Ensure staff follows Citi documented policy and procedures as well as maintain desktop procedures and supporting documentation for filings on a current basis and in comprehensive manner
  • Ensure change is managed with appropriate controls, documentation, and approvals including implementation of new and revised regulatory reporting requirements
  • Manage and maintain all disaster recovery plans, oversee appropriate testing, and provide permit-to-operate for new applications
What we offer
What we offer
  • 27 days annual leave (plus bank holidays)
  • A discretional annual performance related bonus
  • Private Medical Care & Life Insurance
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right

Ab-Initio Senior Developer

The position is to fulfill a need within the Commercial Card’s Global Data Repos...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS or MS Degree in Computer Science, Information Technology, or equivalent
  • Minimum 5+ years of proven project experience
  • Strong technical experience in Ab Initio (primarily using GDE components, plans, etc), Unix scripting & data warehousing
  • Strong Database experience (Oracle/SQL)
  • Working experience in Spark, Scala, Hadoop will be an added advantage
Job Responsibility
Job Responsibility
  • Design, code, test, document and implement application release projects as part of development team
  • Work with onsite development partners to participate in design and architecture for key enterprise applications to ensure deliver software on time, to required standards and as per the design documentation
  • Proactively notify Development Project Manager of risks, bottlenecks, problems, issues, and concerns
  • Compliance with Citi's System Development Lifecycle and Information Security requirements
  • Work closely with Quality Control teams to deliver quality software to agreed project schedules
  • Work with BA and understand all functional and technical requirements of the project
  • Fulltime
Read More
Arrow Right

Applications Development Senior Programmer Analyst

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Pune; Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8-13 years of experience on following areas
  • Strong in Python programming
  • Strong in Object oriented programming & Data Structures
  • Good knowledge of design patterns
  • Experience with Python frameworks - flask, Django
  • Strong technical skills for Big data Pyspark & Hadoop ecosystem components (HDFS, Hbase, Hive, Pig)
  • Strong experience in pyspark
  • Strong knowledge of REST web services
  • Spark Performance tuning and optimization techniques
  • Databases knowledge should extend to PL SQL, SQL and Transact-SQL. Oracle is a plus
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications.
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision.
  • Can exercise independence of judgement and autonomy.
  • Acts as SME to senior stakeholders and /or other team members.
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy