CrawlJobs Logo

Hadoop consultant

nttdata.com Logo

NTT DATA

Location Icon

Location:
India , pune

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

The Hadoop Consultant role at NTT DATA requires over 6 years of experience in Hadoop Engineering, with a focus on Python and DevOps methodologies. Candidates should have strong problem-solving skills and the ability to work independently. Familiarity with CDP/HDP clusters and automation tools is essential. Join a leading technology services provider and contribute to innovative solutions.

Requirements:

  • 6+ Years Experience in Hadoop Engineering with working experience on Python, Ansible DevOps methodologies
  • Primary Skills - HDP, CDP, Linux, Python, Ansible and Kubernetes
  • Extensive experience on CDP/HDP Cluster and Server build , including Control nodes / Worker nodes / Edge nodes
  • Data copy from cluster to cluster and Migration Experience on components from one server to other
  • Proficient in Shell scripting, YAML
  • Good Technical Design, Problem Solving and debugging skills
  • Understanding of how to use GitHub, Jenkins, Ansible etc
  • Understanding of CI/CD concept
  • Familiar with Test automation tools JUnit, Selenium, Cucumber
  • Hands on development solutions using industry leading Cloud technologies
  • Working knowledge of Git Ops and DevSecOps
  • Agile proficient and knowledgeable/experience in other agile methodologies
  • Ideally certified
  • Strong communication & networking skills
  • Ability to work autonomously and take accountability to execute and deliver on goals
  • Strong commitment to high quality standards
  • Good communication skills and sense of ownership to work as individual contributor

Nice to have:

  • Linux
  • Kubernetes
  • Ansible
  • Spring Web Services
  • Micro Services

Additional Information:

Job Posted:
March 03, 2026

Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Hadoop consultant

Bigdata Consultant

The Technical Specialist will be responsible for Medicaid Enterprise Data Wareho...
Location
Location
United States , Columbus
Salary
Salary:
Not provided
oceanbluecorp.com Logo
Ocean Blue Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience with Big Data, Hadoop on Data Warehousing or Data Integration projects
  • Analysis, Design, development, support and Enhancements of ETL/ELT in data warehouse environment with Cloudera Bigdata Technologies (with a minimum of 7 or more years’ experience in Hadoop, MapReduce, Sqoop, PySpark, Spark, HDFS, Hive, Impala, StreamSets, Kudu, Oozie, Hue, Kafka, Yarn, Python, Flume, Zookeeper, Sentry, Cloudera Navigator) along with Oracle SQL/PL-SQL, Unix commands and shell scripting
  • Strong development experience (minimum of 7 or more years) in creating Sqoop scripts, PySpark programs, HDFS commands, HDFS file formats (Parquet, Avro, ORC etc.), StreamSets pipeline creation, jobs scheduling, hive/impala queries, Unix commands, scripting and shell scripting etc.
  • Writing Hadoop/Hive/Impala scripts (minimum of 7 or more years’ experience) for gathering stats on table post data loads
  • Strong SQL experience (Oracle and Hadoop (Hive/Impala etc.))
  • Writing complex SQL queries and performed tuning based on the Hadoop/Hive/Impala explain plan results
  • Proven ability to write high quality code
  • Experience building datasets and familiarity with PHI and PII data
  • Expertise implementing complex ETL/ELT logic
  • Develop and enforce strong reconciliation process
Job Responsibility
Job Responsibility
  • Participate in Team activities, Design discussions, Stand up meetings and planning Review with team
  • Perform data analysis, data profiling, data quality and data ingestion in various layers using big data/Hadoop/Hive/Impala queries, PySpark programs and UNIX shell scripts
  • Follow the organization coding standard document, Create mappings, sessions and workflows as per the mapping specification document
  • Perform Gap and impact analysis of ETL and IOP jobs for the new requirement and enhancements
  • Create jobs in Hadoop using SQOOP, PYSPARK and Stream Sets to meet the business user needs
  • Create mockup data, perform Unit testing and capture the result sets against the jobs developed in lower environment
  • Updating the production support Run book, Control M schedule document as per the production release
  • Create and update design documents, provide detail description about workflows after every production release
  • Continuously monitor the production data loads, fix the issues, update the tracker document with the issues, Identify the performance issues
  • Performance tuning long running ETL/ELT jobs by creating partitions, enabling full load and other standard approaches
  • Fulltime
Read More
Arrow Right

Big Data / Data Management Consultant

We are looking for talented individuals to become part of our growing business a...
Location
Location
United States , Scottsdale; Naperville
Salary
Salary:
Not provided
thinkartha.com Logo
Artha Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS/BA in Computer Science or related discipline required
  • Minimum 3 years of experience in IT Industry
  • At least 3 years of technical experience with data management and with hands-on experience in one or more areas of Big data
  • Experience in Talend, Oracle DB, SQL Server, Mysql, No SQL such as Mongo DB with strong skills on SQL and PL/SQL and Java
  • At least 3+ years of hands-on development experience on Cloudera or Horton Works platform
  • Experience using SPARK with SCALA or Java Mandatory
  • Strong Java development experience mandatory
Job Responsibility
Job Responsibility
  • Responsible for design and development of application on Cloudera platform
  • Fulltime
Read More
Arrow Right

Sr. Big Data / Data Management Consultants / Architects

We are looking for talented individuals to become part of our growing business a...
Location
Location
United States
Salary
Salary:
Not provided
thinkartha.com Logo
Artha Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS/BA in Computer Science or related discipline required
  • Minimum 10 years of experience in the IT Industry
  • At least 10 years of technical experience with data management and with hands-on experience in one or more areas of Big data
  • Experience with reporting and analytics tools is an advantage
  • Experience in Oracle DB, SQL Server, Mysql, No SQL such as Mongo DB with strong skills on SQL and PL/SQL and Java
  • Candidates with exposure to Informatica, IBM, Oracle, Enterprise service bus, working experience with multiple big data technology areas will be given a strong preference
  • Well organized and able to manage multiple projects in a fast-paced demanding environment
  • Attention to detail and quality
  • excellent problem solving and communication skills
  • Ability and willingness to learn new tools and applications
Read More
Arrow Right

Big Data Developer

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-6 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience
  • Strong knowledge in Big data, Hadoop or Cloud Era
  • Programming Language in spark or scala
Job Responsibility
Job Responsibility
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Principal Data Scientist

T-Mobile’s Strategy and Corporate Development (S&CD) team is looking for a Princ...
Location
Location
United States , Bellevue; Overland Park
Salary
Salary:
127400.00 - 229800.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Quantitative Discipline (math, statistics, economics, computer science, physics, engineering)
  • Master's/Advanced Degree Quantitative Discipline (math, statistics, economics, computer science, physics, engineering)
  • 7-10 years of industry experience in predictive modeling, data science, and analysis in an ML engineer or data scientist role building and deploying ML models or hands on experience developing deep learning models
  • 7-10 years of Experience articulating and translating business questions and using statistical techniques to arrive at an answer using available data
  • 7-10 years of Experience with data scripting languages (e.g., SQL, Python, R) and Extended experience working with relational database using SQL
  • 4-7 years of Experience writing and speaking about technical concepts to business, technical, and lay audiences and giving data-driven presentations
  • 4-7 years of Experience with statistical methods and advanced modeling techniques. For example- SVM, Random Forest, graph models, Bayesian inference, NLP, Computer Vision, neural networks
  • 4-7 years of Experience with big data architecture and pipeline, Hadoop, Hive, Spark, Kafka, etc
  • 4-7 years of Experience in data visualization
  • 2-4 years Management consulting, investment banking, or corporate strategy
Job Responsibility
Job Responsibility
  • Extract, prepare, and model large, complex data sets using a combination of skills, including machine learning theory, mathematics, statistics, and programming
  • Identify critical and emerging technologies that will support and extend our consumer data, data integration, and quantitative analytic capabilities
  • Lead the implementation, assessment and standardization of advanced analytics and modeling toolkits for our data science team
  • Partner with data engineering teams to shape data management strategies, architecture, governance, pipelines, and infrastructure enabling effective modeling environments for data science teams
  • Provide senior level guidance to the data science and measurement science teams on approach and methodologies
  • Communicate important information and insights to business leaders using verbal, written, and data visualization skills
What we offer
What we offer
  • competitive base salary and compensation package
  • annual stock grant
  • employee stock purchase plan
  • 401(k)
  • access to free, year-round money coaches
  • medical, dental and vision insurance
  • flexible spending account
  • employee stock grants
  • paid time off
  • up to 12 paid holidays
  • Fulltime
Read More
Arrow Right

Sr. Delivery Solutions Architect

At Databricks we are on a mission to empower our customers to solve the world's ...
Location
Location
South Korea , Seoul
Salary
Salary:
Not provided
databricks.com Logo
databricks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years in a customer-facing pre-sales, technical architecture, customer success, or consulting role
  • Experience understanding architecture related distributed data systems, specifically within one of the following: Data Engineering technologies (e.g. Spark, Hadoop, Kafka)
  • Data Warehousing (e.g. SQL, OLTP/OLAP/DSS)
  • Data Science and Machine Learning technologies (e.g. pandas, scikit-learn, HPO)
  • Comfortable managing multiple projects at once, and engaging a virtual team of subject matter experts
  • Influencing and leading teams - especially without having direct reporting line responsibility
  • Executive Stakeholder management - experience in effectively engaging and influencing a variety of audiences at all levels of an organization with particular success in building and maintaing strong CxO level relationship
  • Executive escalation management - experience in resolving complex and critical escalation with senior customer and internal executives
  • Strategic Management Consulting - experience of conducting open-ended discovery workshops, creating strategic roadmaps, conducting business analysis and managing delivery of complex programmes/projects
  • Building and steering to a value case - business value consulting and realization
Job Responsibility
Job Responsibility
  • Engage with the Solutions Architect to understand the full Use Case Demand Plan for prioritized customers
  • Own the Post-Technical Win technical account strategy and investment plan for the majority of Databricks Use Cases within our most strategic accounts
  • Be the accountable technical leader assigned to specific Use Cases and customer(s) across multiple selling teams and internal stakeholders, creating certainty from uncertainty/ambiguity and driving onboarding, enablement, success, go-live and healthy consumption of the workloads where the customer has made the decision to consume Databricks
  • Be the first point of contact for any technical issues or questions related to production/go live status of agreed upon Use Cases within an account
  • Leverage both Shared Services of User Education, Onboarding/Technical Services and Support resources, along with escalating to Level 400/500 technical experts to execute on the right tasks that are beyond your scope of activities or expertise
  • Create, own and execute a PoV as to how key use cases can be accelerated into production, bringing EM/PM in to prepare Professional Services proposals
  • Navigate Databricks Product and Engineering teams for New Product Innovations, Private Previews and Upgrade needs
  • Build and maintain an executive level as well as a detailed programme level success plan that covers all activities of Customer, PS, Partner, SSA, Product Specialist, SA
  • Proactively provide internal and external updates - KPI reporting on the status of consumption and customer health, covering investment status, key risks, product adoption and use case progression - to your Technical GM
  • Development of reusable and scalable assets and mentorship of junior team members to establish the DSA team
Read More
Arrow Right

Business Intelligence Developer

Work with the Data warehousing – Business Intelligence Analytics projects as a D...
Location
Location
United States , San Ramon
Salary
Salary:
158642.00 USD / Year
redhibbert.com Logo
Red Hibbert Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science/Information Technology/IS/Engineering (any)/Science or closely related field
  • Twelve (12) months of experience in the job offered or as an IT Consultant or Analyst or Programmer or Developer or Engineer or closely related field
  • Twelve (12) months working with Power BI or Tableau or Hadoop
  • Travel and/or relocation is required to unanticipated client sites within USA
Job Responsibility
Job Responsibility
  • Work with the Data warehousing – Business Intelligence Analytics projects as a Data Analyst, Data Mapper, development of reports and design of Data visualization & Dashboards
  • Managing all internal and external stake holders for complete life cycle of the project: Business users, Source, PMO
  • Working with the business team and business analyst to understand requirements and translate them into technical requirements
  • Responsible for end-to-end delivery of the Business Intelligence project on solution, design and delivery
  • Perform analysis and effort estimation
  • Providing leadership to the technology team in development of standards, reporting and monitoring system with the aim of providing high quality service and optimization of performance
  • Work under supervision
  • Travel and/or Relocation to various unanticipated client sites throughout USA is required
What we offer
What we offer
  • Employee Referral Program: special bonus of $1000 for referring employee if new hire stays at least 90 days
  • Fulltime
Read More
Arrow Right

Teradata Data Consultant

This Teradata Data Consultant will be part of Teradata platform Data mover team.
Location
Location
United States , Plano
Salary
Salary:
Not provided
enormousenterprise.com Logo
Enormous Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficient with NOS, Python, SQL, RDBMS, Teradata utilities such as TPT, BTEQ, FastLoad, MultiLoad, and TPump
  • Familiar with Object Storage, Hadoop, Cloudera and upcoming Cloud native technologies
  • Seasoned developer with efficiency-based approach in solutioning and expertise in troubleshooting issue
  • Ability to conceptualize solutions, build POC and design approach on automation
  • Experience in mentoring developers to implement coding and compliance standards
  • Experience in performance optimization, role-based access control setup, and managing database upgrades
  • Proficient in utilities like NOS, QueryGrid and Clearscape Analytics
  • Good Communication Skills
  • Banking domain experience
Job Responsibility
Job Responsibility
  • Provide end to end data analysis on business strategy and function
  • Includes trending analysis, views on data treatments and success analytics for determining future strategy focused on improving operational performance
  • Data mining, data aggregation, and business planning, inventory analysis, program analysis, E2E platform and performance/milestone analytics
  • Sets policy and standards for Data Management (DM), Operates routine governance to set enterprise priorities for standards compliance
  • Tracks compliance to implement standards for the prioritized functions
  • Monitor and test controls and data quality measures for validity
  • Escalates risk associated with non-compliance to standards with clear options for resolution
  • Is a source of expertise and is well versed in current industry best practice
  • Building automation solutions to move data within and outside of Teradata platform
Read More
Arrow Right