CrawlJobs Logo

Big Data Engineer

United States, Chicago 60.00 - 68.26 USD / Hour · Job Posted January 09, 2026
Apply Position
Job Link Share

Job Description

Job Title: Big Data Engineer. Location: Chicago IL. Duration: 10 months.

Requirements

  • Strong SQL Skills – one or more of MySQL, HIVE, Impala, SPARK SQL
  • Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like Json, csv, xml
  • Experience working with SPARK Structured streaming
  • Experience working with Hadoop/Big Data and Distributed Systems
  • Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.
  • Hands on programming experience in at least one of Scala, Python, PHP, or Shell Scripting, to name a few
  • Performance tuning experience with spark /MapReduce or SQL jobs
  • Experience and proficiency with Linux operating system is a must
  • Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines
  • Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle
  • Experience using Source Code and Version Control systems like SVN, Git, Bit Bucket etc.
  • Experience working with Jenkins and Jar management
  • Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets
  • Ability to comprehend customer requests and provide the correct solution
  • Strong analytical mind to help take on complicated problems
  • Desire to resolve issues and dive into potential issues
  • Ability to adapt and continue to learn new technologies is important

What we offer

  • medical
  • dental
  • vision
  • life
  • disability
  • other insurance plans
  • ESPP (employee stock purchase program)
  • 401K program with company match after 12 months
  • HSA (Health Savings Account on the HDHP plan)
  • SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions
  • corporate discount savings program
  • other discounts
  • on-demand training program
  • access to certification prep and a library of technical and leadership courses/books/seminars after 6+ months tenure
  • certification discounts and other perks to associations that include CompTIA and IIBA
  • dedicated customer service team
  • certified Career Coach

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Big Data Engineer

8 matching positions

Big Data Engineer

We are seeking a talented and experienced Big Data Hadoop Developer to join our ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field
  • 3-4 years of professional experience in Big Data development
  • Proven experience with the Hadoop ecosystem, including HDFS, YARN, Hive, and other related technologies
  • Hands on experience in SQL and shell scripting
  • Strong expertise in Apache Spark for data processing and analysis
  • Proficiency in at least one of the following programming languages: Scala, Python, or PySpark
  • Experience with building and optimizing large-scale data pipelines
  • Familiarity with data warehousing concepts and ETL methodologies
  • Solid understanding of distributed computing principles
  • Excellent problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Design, develop, and maintain robust and scalable ETL processes and data pipelines using Apache Hadoop and Apache Spark
  • Write efficient, clear, and well-documented code primarily in Scala, Python, or PySpark for big data processing
  • Implement data ingestion, transformation, and loading routines from various sources into Hadoop Distributed File System (HDFS) and other big data stores
  • Optimize existing Spark jobs and Hadoop ecosystem components for performance and scalability
  • Collaborate with data architects, data scientists, and other stakeholders to understand data requirements and translate them into technical solutions
  • Ensure data quality, integrity, and security across all big data platforms
  • Participate in code reviews, testing, and deployment of big data applications
  • Troubleshoot and resolve issues in big data environments
  • Stay up-to-date with the latest trends and technologies in the big data ecosystem
  • Fulltime
Read More
Arrow Right

Big Data Engineer

We are seeking a talented Big Data Engineer with strong expertise in Java and Ap...
Location
Location
India , Haveli
Salary
Salary:
Not provided
votredircom.fr Logo
Wissen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2–4 years of hands-on experience in Big Data and Apache Spark
  • Strong experience in Core Java, including: Multithreading
  • Collections Framework
  • Practical expertise in Spark with Java
  • Strong knowledge of Unix commands and Bash scripting
  • Proficiency in PL/SQL for data querying and transformations
  • Experience building or maintaining scalable backend systems
  • Strong analytical and problem‑solving skills with the ability to handle complex technical issues
  • Understanding of configuration management and change control processes
Job Responsibility
Job Responsibility
  • Design and develop backend services and data‑driven applications using Core Java
  • Build, optimize, and maintain Apache Spark–based data processing pipelines
  • Develop and integrate REST APIs for backend and data applications
  • Write efficient and optimized PL/SQL queries for large datasets
  • Work with Unix commands and Bash scripts for automation and job orchestration
  • Ensure proper configuration management, version control, and deployment best practices
  • Troubleshoot and resolve complex technical issues across Java and Spark layers
  • Collaborate with backend, frontend, and data engineering teams to deliver high‑quality solutions
  • Fulltime
Read More
Arrow Right

Big Data Engineer

Bright Vision Technologies is looking for a skilled Big Data Engineer to join th...
Location
Location
United States , Bridgewater
Salary
Salary:
Not provided
bvteck.com Logo
Bright Vision Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 3 to 5 years real time experience
  • Experience with Apache Hadoop, Spark, PySpark, Scala, Kafka, HDFS, Hive, HBase, Airflow, Data Warehousing, ETL pipelines, SQL, NoSQL databases, Cloud Platforms (AWS / Azure / GCP), Big Data services (EMR, Dataproc), Docker, Linux, CI/CD pipelines, Git, Agile methodologies
  • Must be willing to take an AI-proctored online coding test
  • Must have at least 1 year of real-time project experience in the USA
  • Must be willing to relocate nationwide based on project needs
  • Must be looking for H-1B sponsorship for the 2026/2027 quota
  • Must be on OPT/CPT/H4 EAD/TN/E3 or any other Non-immigrant visa
  • Must be willing to work on W2 (not C2C/1099/3rd party)
  • Must commit to paying the USCIS-mandated $215 H-1B registration fee after offer
  • Must proceed exclusively with this company for H-1B sponsorship
Job Responsibility
Job Responsibility
  • Design scalable, reliable, and high-performance data platforms
  • Transform business processes through technology
  • Contribute to the mission of building innovative solutions that help businesses automate and optimize their operations
What we offer
What we offer
  • H-1B sponsorship for the 2026/2027 quota
  • Career growth potential
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • SQL
  • working knowledge of program languages
  • consistently demonstrates clear and concise written and verbal communication
  • bachelor’s degree/University degree or equivalent experience
What we offer
What we offer
  • Programs and services for physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • database management: SQL
  • working knowledge of program languages
  • consistently demonstrates clear and concise written and verbal communication
What we offer
What we offer
  • programs and services for physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more
  • Fulltime
Read More
Arrow Right

Big Data Engineer

Inetum is seeking a seasoned Big Data Engineer to join our team and support the ...
Location
Location
Portugal , Lisbon
Salary
Salary:
Not provided
https://www.inetum.com Logo
Inetum
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or equivalent
  • Minimum 5 years of experience in a similar role
  • Strong expertise in Hadoop Ecosystem & Data Lake Operations, Big Data Services & Query Engines, Security & Access Control in Distributed Environments, Monitoring, Automation & Platform Lifecycle Management
  • Proven ability to diagnose and resolve complex issues in Big Data environments
  • Strong communication skills to collaborate with cross-functional teams
  • English proficiency: B2-C1 level
Job Responsibility
Job Responsibility
  • Operate, monitor, and support Hadoop-based data lake platforms
  • Provide L3 incident response, deep troubleshooting, and performance tuning for big data components
  • Ensure data integrity, replication, and capacity management within HDFS clusters
  • Develop and automate monitoring and alerting for service health and node performance
  • Collaborate with platform and data teams to onboard new workloads with optimal resource allocation
  • Apply patches, upgrades, and configuration changes to maintain platform security and stability
  • Manage Kerberos authentication, Ranger/Sentry policies, and TLS encryption
  • Work with storage, network, and security teams to optimize throughput and access controls
  • Maintain cluster documentation and share knowledge across teams
What we offer
What we offer
  • Opportunity to grow your expertise
  • Certified Top Employer Europe 2025
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • Proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • Database Management: SQL
  • Working knowledge of program languages
  • Consistently demonstrates clear and concise written and verbal communication
  • Bachelor’s degree/University degree or equivalent experience
What we offer
What we offer
  • Programs and services for your physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more
  • Fulltime
Read More
Arrow Right

Big Data Engineer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 - 5 years of relevant experience in Big data platforms such as Hadoop, Hive
  • Proficient in one or more programming languages commonly used in data engineering such as Python, PySpark
  • Database Management: SQL
  • Working knowledge of program languages
  • Consistently demonstrates clear and concise written and verbal communication
  • Bachelor’s degree/University degree or equivalent experience
What we offer
What we offer
  • Programs and services for your physical and mental well-being including access to telehealth options, health advocates, confidential counseling
  • Fulltime
Read More
Arrow Right