CrawlJobs Logo

Business Analyst with Hadoop and Big Query

realign-llc.com Logo

Realign

Location Icon

Location:
United States

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

55.00 USD / Hour

Job Description:

The Business Analyst will work closely with business stakeholders, data engineers, and analytics teams to analyze large-scale datasets using Hadoop and Google BigQuery. This role focuses on translating business requirements into data-driven insights, supporting reporting, analytics, and decision-making initiatives.

Requirements:

  • Gather, analyze, and document business and data requirements
  • Work with large datasets stored in Hadoop ecosystems and BigQuery
  • Write and optimize SQL queries in BigQuery for data analysis and reporting
  • Perform data validation, reconciliation, and quality checks
  • Translate business questions into data models, dashboards, and reports
  • Partner with data engineering teams to support ETL / ELT pipelines
  • Support data migration and modernization initiatives (on-prem Hadoop to cloud)
  • Create BRDs, FRDs, user stories, and acceptance criteria
  • Support UAT, defect tracking, and release validation
  • Present insights and recommendations to business and leadership teams

Additional Information:

Job Posted:
March 21, 2026

Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Business Analyst with Hadoop and Big Query

Business System Analyst

As a Business System Analyst for estockgifts, Crypto and Digital Currencies unit...
Location
Location
Salary
Salary:
Not provided
keyutech.com Logo
Keyu Tech LLC.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A computer science graduate or undergraduate degree or 8+ years of industry experience in business systems analysis on big data platforms
  • Technical experience related to BI and/or data warehouse development
  • Strong working knowledge of SQL query language
  • Working knowledge of Hadoop, Map-Reduce, Hive, Pig, AI/ML
  • Ability to draw on technical background to work with both business and development teams
  • Experience with BI / EDW solutions in a large-scale enterprise environment, such as Teradata
  • Good in Analytics throughout product lifecycle – documentation, communication and systems
  • Ability to engage with business users and understand their needs
  • Problem solver and innovative thinker
  • Ability to work with and across teams in an agile environment. Experience in agile project development life cycle a strong plus
Job Responsibility
Job Responsibility
  • Collaborate with business partners to understand the business problem and translate problems into proof-of-concept products
  • Be the domain expert on Crypto and provide insights to senior leadership
  • Capture and document product requirements and partner with our engineering team to develop those products
  • With minimal guidance, develop a product strategy for the specific area and lead project execution
  • Represent the product to peers across estockgifts for feedback on new feature ideas
  • Facilitate technical discussion and provide feedback and input in architectural design
  • Fulltime
Read More
Arrow Right

Applications Support Senior Analyst

The Applications Support Senior Analyst is responsible for providing technical a...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years' experience in an Application Support role L2 & L3
  • Experience installing, configuring or supporting business applications
  • Experience with some programming languages and willingness/ability to learn
  • Advanced execution capabilities and ability to adjust quickly to changes and re-prioritization
  • Effective written and verbal communications including ability to explain technical issues in simple terms that non-IT staff can understand
  • Demonstrated analytical skills
  • Issue tracking and reporting using tools
  • Knowledge/ experience of problem Management Tools
  • Good all-round technical skills
  • Effectively share information with other support team members and with other technology teams
Job Responsibility
Job Responsibility
  • Provide Level 2/3 support for business applications, troubleshooting technical and functional issues
  • Monitor daily Autosys job executions, system performance, ensuring uptime and reliability
  • Investigate and diagnose production issues in a timely manner to provide root cause analysis and solutions to prevent future issues
  • Collaborate with cross-functional teams to identify and resolve production issues
  • Create and maintain documentation related to production issues and resolutions
  • Coordinate with development and release management teams to ensure smooth deployment of sprint releases with minimal business interruptions
  • Coordinate with development, release management and business teams to during the UAT Testing phase of the sprint
  • Coordinate with SA and EAP teams on the System updates, green zones and COB activities
  • Monitor and Manage Inbound and Outbound feed SLA breaches
  • Provide timely updates on system performance and issue status to senior management
What we offer
What we offer
  • Global Benefits
  • We bring the best to our people
  • We put our employees first and provide the best-in-class benefits they need to be well, live well and save well
  • Fulltime
Read More
Arrow Right

Senior Data Analyst, Finance

Our analysts transform data into meaningful insights that drive strategic decisi...
Location
Location
United States , Wayne; Southfield; Philadelphia; Englewood
Salary
Salary:
81917.17 - 128726.98 USD / Year
comcastadvertising.com Logo
Comcast Advertising
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Works with business leaders and stakeholders to understand data and analysis needs and develop technical requirements
  • Determines relevancy of data and identifies alternative data sources as needed
  • Analyzes large, complex data to determine actionable business insights using self-service analytics and reporting tools
  • Queries disparate big data platforms such as Teradata, SQL Server, Hadoop, and AWS
  • Combines data as needed from disparate data sources to complete analysis
  • Identifies key business drivers and insights by conducting exploratory data analysis and hypothesis testing
  • Develops forecasting models to predict sales, demand and other key business metrics
  • Analyzes the results of campaigns, offers or initiatives to measure their effectiveness and identifies opportunities for improvement
  • Communicates findings clearly and concisely through narrative-driven presentations and effective data visualizations to Company executives and decisionmakers
  • Promotes and evangelizes a culture of excellence, data driven discussions, healthy skepticism, intellectual curiosity, knowledge sharing, and teamwork
Job Responsibility
Job Responsibility
  • Works with business leaders and stakeholders to understand data and analysis needs and develop technical requirements
  • Determines relevancy of data and identifies alternative data sources as needed
  • Analyzes large, complex data to determine actionable business insights using self-service analytics and reporting tools
  • Queries disparate big data platforms such as Teradata, SQL Server, Hadoop, and AWS
  • Combines data as needed from disparate data sources to complete analysis
  • Identifies key business drivers and insights by conducting exploratory data analysis and hypothesis testing
  • Develops forecasting models to predict sales, demand and other key business metrics
  • Analyzes the results of campaigns, offers or initiatives to measure their effectiveness and identifies opportunities for improvement
  • Communicates findings clearly and concisely through narrative-driven presentations and effective data visualizations to Company executives and decisionmakers
  • Promotes and evangelizes a culture of excellence, data driven discussions, healthy skepticism, intellectual curiosity, knowledge sharing, and teamwork
What we offer
What we offer
  • Paid Time off
  • Physical Wellbeing benefits
  • Financial Wellbeing benefits
  • Emotional Wellbeing benefits
  • Life Events + Family Support benefits
  • Fulltime
Read More
Arrow Right

Big Data / PySpark Engineering Lead - Vice President

The Applications Development Technology Lead Analyst is a senior level position ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Highly experienced and skilled technical lead with 12+years of experience with software building and platform engineering
  • Experience in Data Engineering, focused on Big Data ecosystems
  • Knowledge in Hadoop, YARN, Hive, Impala, Spark, and Spark SQL with extensive high volume of data processing pipeline development
  • Programming Expert level and hand on experience in Python
  • Familiarity with data formats like Avro, Parquet, CSV, JSON
  • Hands-on experience in writing SQL queries
  • Highly experienced with Unix based operating systems and shell scripting
  • Experience with source code management tools such as Bitbucket, Git etc
  • Big Data Tech Proficiency and hands-on in Hadoop, Spark, Hive, Kafka, and NoSQL databases (MongoDB, HBase)
  • Experience working with query engines like Trino, Presto, Starburst
Job Responsibility
Job Responsibility
  • Design and implement scalable, fault-tolerant batch and real-time data processing pipelines
  • Develop robust data models and schema designs optimized for both performance and storage efficiency
  • Evaluate and integrate emerging tools and frameworks (e.g., Spark, Flink, Kafka) into the existing stack
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Legacy Systems Decommissioning: Lead the strategic migration of data and logic from legacy platforms (e.g. on-premises SQL Servers) to a modern Data Lakehouse environment
  • ETL/ELT Transformation: Re-engineer existing stored procedures and complex legacy ETL jobs into scalable, distributed processing frameworks using Spark (Python) and Starburst/Trino
  • Validation & Parity Testing: Design and implement automated frameworks for Data Parity Testing to ensure 100% accuracy and consistency between legacy outputs and new big data results
  • Schema Evolution: Map and transform rigid, legacy relational schemas into flexible, high-performance formats optimized for the cloud (e.g., Parquet, Avro, or Iceberg)
  • Phased Cutover Management: Orchestrate a phased migration strategy (Parallel Run, Shadow Execution) to ensure zero downtime for downstream business applications and reporting tools
  • Fulltime
Read More
Arrow Right

REFM Analyst

The hired candidate will partner with multiple departments, including Global Rea...
Location
Location
India , Gurugram
Salary
Salary:
Not provided
https://www.circlek.com Logo
Circle K
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree required, preferably with a quantitative focus (Statistics, Business Analytics, Math, Economics, etc.)
  • Master’s degree preferred (MBA/MS Computer Science/M.Tech Computer Science, etc.)
  • 3 plus years for Senior REFM Analyst
  • Relevant working experience in a data advanced analytics, Power BI dashboard development role
  • Delivery Excellence
  • Business disposition
  • Social intelligence
  • Innovation and agility
  • Functional Analytics (Real Estate, Property Management, Facilities, Maintenance, etc.)
  • Statistical modelling using Analytical tools (R, Python, KNIME, etc.)
Job Responsibility
Job Responsibility
  • Design & develop reports and dashboards to meet the needs of the Real Estate and Facilities Management team
  • Create comprehensive reporting on periodic, quarterly basis to create actionable insights
  • Apply multiple algorithms or architectures and recommend the best model with in-depth description to evangelize data-driven business decisions
  • Utilize cloud setup to extract processed data for statistical modelling and big data analysis, and visualization tools to represent large sets of time series/cross-sectional data
  • Follow industry standards in coding solutions and follow programming life cycle to ensure standard practices across the project
  • Partner with Data Engineering to build, design and maintain core data infrastructure, pipelines and data workflows to automate dashboards and analyses
  • Working collaboratively across multiple sets of stakeholders – Business functions, Data Engineers, Data Visualization experts to deliver on project deliverables
  • Articulate complex data to business teams and present the insights in easily understandable and innovative formats
  • Fulltime
Read More
Arrow Right

Contract Data Engineer

Robert Half is seeking a Contract Data Engineer to support our client’s data and...
Location
Location
United States , Nashville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a Data Engineer or in a similar role
  • Strong proficiency in SQL and Python (or similar languages)
  • Experience with cloud platforms (AWS, Azure, GCP)
  • Hands-on experience with ETL / ELT tools (Airflow, dbt, Fivetran, Matillion, Glue, ADF, etc.)
  • Experience with data warehousing platforms such as Snowflake, Redshift, BigQuery, or Azure Synapse
  • Familiarity with streaming and big data tools (Kafka, Spark, Databricks, Hadoop) is a plus
  • Strong understanding of data modeling, performance tuning, and pipeline optimization
  • Experience with version control systems (Git) and agile development practices
  • Excellent problem-solving, analytical, and communication skills
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL / ELT pipelines to ingest, transform, and deliver data from multiple sources
  • Develop and optimize data models, schemas, and warehouse structures to support analytics, reporting, and business intelligence needs
  • Work within cloud environments such as AWS, Azure, or GCP to deploy and manage data solutions
  • Design and support enterprise data warehouses using platforms such as Snowflake, Redshift, BigQuery, or Azure Synapse
  • Develop solutions using big data technologies such as Spark, Databricks, Kafka, and Hadoop when required
  • Tune queries, pipelines, and storage solutions for performance, scalability, and cost efficiency
  • Implement monitoring, validation, and alerting processes to ensure data accuracy, integrity, and availability
  • Work closely with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver data solutions
  • Maintain detailed documentation for pipelines, data flows, and system architecture
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • eligible to enroll in our company 401(k) plan
Read More
Arrow Right

Data Engineer

Location
Location
Vietnam , Hà Nội
Salary
Salary:
Not provided
cmcglobal.com.vn Logo
CMC Global Company Limited.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data Engineer with strong Hadoop / Spark / Talend experience
  • Experience building and operating large-scale data lakes and data warehouses
  • Experience with Hadoop ecosystem and big data tools, including Spark and Kafka
  • Experience with Master Data Management (MDM) tools and platforms such as Informatica MDM, Talend Data Catalog, Semarchy xDM, IBM PIM & IKC, or Profisee
  • Familiarity with MDM processes such as golden record creation, survivorship, reconciliation, enrichment, and quality
  • Experience in data governance, including data quality management, data profiling, data remediation, and automated data lineage
  • Experience with stream-processing systems including Spark-Streaming
  • Experience working with Cloud services using one or more Cloud providers such as Azure, GCP, or AWS
  • Experience with Delta Lake and Databricks
  • Advanced working experience with relational SQL and NoSQL databases, including Hive, HBase, and Postgres
Job Responsibility
Job Responsibility
  • Create and manage a single master record for each business entity, ensuring data consistency, accuracy, and reliability
  • Implement data governance processes, including data quality management, data profiling, data remediation, and automated data lineage
  • Create and maintain multiple robust and high-performance data processing pipelines within Cloud, Private Data Centre, and Hybrid data ecosystems
  • Assemble large, complex data sets from a wide variety of data sources
  • Collaborate with Data Scientists, Machine Learning Engineers, Business Analysts, and Business users to derive actionable insights and reliable foresights into customer acquisition, operational efficiency, and other key business performance metrics
  • Develop, deploy, and maintain multiple microservices, REST APIs, and reporting services
  • Design and implement internal processes to automate manual workflows, optimize data delivery, and re-design infrastructure for greater scalability
  • Establish expertise in designing, analyzing, and troubleshooting large-scale distributed systems
  • Support and work with cross-functional teams in a dynamic environment
What we offer
What we offer
  • Attractive compensation package: 14-month salary scheme plus annual bonus and additional allowances
  • Annual bonus package tailored based on performance and contribution
  • Young, open, and dynamic working environment that promotes innovation and creativity
  • Ongoing learning and development with regular professional training and opportunities to enhance both technical and soft skills
  • Exposure to cutting-edge technologies and diverse real-world enterprise projects
  • Vibrant company culture with regular team-building activities, sports tournaments, arts events, Family Day, and more
  • Full compliance with Vietnamese labor laws, plus additional internal perks such as annual company trips, special holidays, and other corporate benefits
  • Fulltime
Read More
Arrow Right

Analyst-Data Science

At American Express, our culture is built on a 175-year history of innovation, s...
Location
Location
India , Bengaluru Urban
Salary
Salary:
Not provided
americanexpress.com Logo
Amex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong quantitative, analytical, and structured problem-solving skills
  • Strong technical background in AI / ML with background on python, SQL, data analytics and data visualization
  • Familiarity with ML model development lifecycle (MDLC): feature selection and engineering, different ML model algorithm families - Decision Trees, Boosting algorithms, optimizations considerations for ML models, deployment and serving challenges
  • Knowledge of Google Cloud Platform (GCP), Big Query, GCP AI / ML capabilities such as Vertex AI
  • Knowledge of Big Data Platforms such as Hadoop and PySpark
  • Knowledge of designing and building big data tools and frameworks
  • Demonstrate creativity and self-sufficiency along with strong interpersonal/ collaborative skills and experience working in global teams
  • Understanding of the various ML Model deployment systems and processes with a basic knowledge of various model regulatory and governance policies
  • Ability to prioritize well, communicate clearly and compellingly and understand how to drive a high level of focus and excellence with a strong, talented, opinionated engineering, UX and QA teams
  • Knowledge of Notebook based IDE for performing AI / ML tasks such as Jupyter and Airflow
Job Responsibility
Job Responsibility
  • Contribute to defining and articulation of long-term AI product strategy and roadmap with clearly defined business metrics and outcomes
  • Solve complicated business problems by prioritization & ownership of products and solutions to meet business objectives
  • Prioritize and manage product backlogs, by balancing the requirements of partners and stakeholders. Evaluate prospective features in AI Products pipeline against changing requirements in the direction of AI adoptions
  • Contribute to all product lifecycle processes including market (external) research, competitive analysis, planning, positioning, roadmap development, requirements finalization and product development
  • Translate product roadmap into well-defined requirements and acceptance test criteria
  • Drive end-to-end ML / AI product developments with a team of engineers and designers. Transform MVPs to production grade capabilities in collaboration with engineering teams
  • Contribute to ideation and launch of innovative ML/AI products and capabilities. Innovate ways to evangelize products to drive Amex wide user adoption
  • (For Learn): Curate and Deliver technical trainings in AI, Cloud, Hive and Spark for beginners to advance level users
  • Create POCs for best-in-class AI-ML innovative products with the potential to scale
What we offer
What we offer
  • Competitive base salaries
  • Bonus incentives
  • Support for financial-well-being and retirement
  • Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location)
  • Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
  • Generous paid parental leave policies (depending on your location)
  • Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
  • Free and confidential counseling support through our Healthy Minds program
  • Career development and training opportunities
Read More
Arrow Right