CrawlJobs Logo

Senior Software Engineer- Big Data & Java

United States · Job Posted February 18, 2026
Apply Position
Job Link Share

Requirements

  • Do you have experience with data pipelines processing large amounts of data in Real Time or Near Real Time?
  • Do you have experience with Lakehouse architecture, Azure ADLS Gen2, Apache Hudi?
  • How many years of experience developing Java/Spring Boot microservices?
  • Do you have experience with Agentic AI components?
  • Are you legally authorized to work in the US for our company?

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Software Engineer- Big Data & Java

8 matching positions

Senior Software Engineer- Big Data & Java

Location
Location
Canada , Mississauga
Salary
Salary:
Not provided
pointclickcare.com Logo
PointClickCare
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience with data pipelines processing large amounts of data in Real Time or Near Real Time
  • Experience with Lakehouse architecture, Azure ADLS Gen2, Apache Hudi
  • Experience developing Java/Spring Boot microservices
  • Experience with Agentic AI components
  • Legally authorized to work in Canada
  • Fulltime
Read More
Arrow Right

Senior Software Engineer- Big Data & Java

At PointClickCare our mission is simple: to help providers deliver exceptional c...
Location
Location
United States
Salary
Salary:
158000.00 - 176000.00 CAD / Year
pointclickcare.com Logo
PointClickCare
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience with distributed computing tools like Apache Hudi, Spark, Kafka, Flink, Beam, Trino, DataBricks and other big data technologies
  • Experience with distributed storage systems like ADLS, HDFS, S3, DLT etc.
  • Familiarity with Hadoop, Spark, Databricks or other distributed computing systems
  • Understanding of data partitioning and sharding techniques
  • Knowledge of distributed computing principles and how they apply to large-scale data processing
  • Experience in writing clean code that performs well at scale using languages such as Python, Java etc.
  • Knowledge of relational databases (e.g. Microsoft SQL Server, MySQL)
  • Solid experience writing RESTful API endpoints
  • Absolutely love TDD and have working knowledge of it
  • Proficient in GIT
Job Responsibility
Job Responsibility
  • Identify, prioritize and execute tasks in the software development life cycle
  • Work with business to iterate over software requirements
  • Develop tools and applications by producing clean, efficient code
  • Automate tasks through appropriate tools and scripting
  • Analyze and debug systems
  • Perform validation and verification testing in a test-driven manner
  • Review the work of others, and invite others to review your work
  • Collaborate with internal teams and vendors to fix and improve products
  • Ensure software is up-to-date with latest technologies
  • Work with distributed computing systems like Apache Hudi and Trino for big data processing
What we offer
What we offer
  • Benefits starting from Day 1!
  • Retirement Plan Matching
  • Flexible Paid Time Off
  • Wellness Support Programs and Resources
  • Parental & Caregiver Leaves
  • Fertility & Adoption Support
  • Continuous Development Support Program
  • Employee Assistance Program
  • Allyship and Inclusion Communities
  • Employee Recognition … and more!
  • Fulltime
Read More
Arrow Right

Senior Software Engineer- Big Data & Java

At PointClickCare our mission is simple: to help providers deliver exceptional c...
Location
Location
Canada , Mississauga
Salary
Salary:
142000.00 - 158000.00 CAD / Year
pointclickcare.com Logo
PointClickCare
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience with distributed computing tools like Apache Hudi, Spark, Kafka, Flink, Beam, Trino, DataBricks and other big data technologies
  • Experience with distributed storage systems like ADLS, HDFS, S3, DLT etc.
  • Familiarity with Hadoop, Spark, Databricks or other distributed computing systems
  • Understanding of data partitioning and sharding techniques
  • Knowledge of distributed computing principles and how they apply to large-scale data processing
  • Experience in writing clean code that performs well at scale using languages such as Python, Java etc.
  • Knowledge of relational databases (e.g. Microsoft SQL Server, MySQL)
  • Solid experience writing RESTful API endpoints
  • Absolutely love TDD and have working knowledge of it
  • Proficient in GIT
Job Responsibility
Job Responsibility
  • Identify, prioritize and execute tasks in the software development life cycle
  • Work with business to iterate over software requirements
  • Develop tools and applications by producing clean, efficient code
  • Automate tasks through appropriate tools and scripting
  • Analyze and debug systems
  • Perform validation and verification testing in a test-driven manner
  • Review the work of others, and invite others to review your work
  • Collaborate with internal teams and vendors to fix and improve products
  • Ensure software is up-to-date with latest technologies
  • Work with distributed computing systems like Apache Hudi and Trino for big data processing
What we offer
What we offer
  • Benefits starting from Day 1
  • Retirement Plan Matching
  • Flexible Paid Time Off
  • Wellness Support Programs and Resources
  • Parental & Caregiver Leaves
  • Fertility & Adoption Support
  • Continuous Development Support Program
  • Employee Assistance Program
  • Allyship and Inclusion Communities
  • Employee Recognition … and more
  • Fulltime
Read More
Arrow Right

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
  • Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
  • Experience building data lake or data engineering products, tools, or pipelines
  • Familiarity with container-based architectures (Docker, Kubernetes)
  • Ability to debug complex distributed systems on Linux and/or Windows platforms
Job Responsibility
Job Responsibility
  • Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
  • Use AI tools and coding best practices across the development lifecycle
  • Design data refresh, scheduling, and query optimisation features with minimal supervision
  • Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
  • Coach junior engineers through code reviews
  • Debug complex issues in distributed systems running on Azure, Linux, and Windows
  • Run live site operations on a rotational, on-call basis
  • Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
  • Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features
  • Fulltime
Read More
Arrow Right

Senior Java Big Data Technical Engineer

The Applications Development Technology Lead Analyst is a senior level position ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of relevant experience in Apps Development or systems analysis role
  • Extensive experience system analysis and in programming of software applications
  • Experience in managing and implementing successful projects
  • Subject Matter Expert (SME) in at least one area of Applications Development
  • Ability to adjust priorities quickly as circumstances dictate
  • Demonstrated leadership and project management skills
  • Consistently demonstrates clear and concise written and verbal communication
  • Highly experienced and skilled Java & Big Data Engineer technical lead with 10+years of experience with software building and platform engineering
  • Extensive knowledge of HDFS, Hive(Relevant experience of 8+ years)
  • Hands-on development expertise in Java with Spark
Job Responsibility
Job Responsibility
  • Contribute significantly to both engineering and research initiatives within the EAP domain
  • Adopt a product-focused approach, ensuring the development of robust, scalable, and user-friendly solutions
  • Thrive in a fast-paced environment by continuously testing, learning, and tackling cutting-edge problems
  • Develop, Lead and inspire a team of developers working on cutting-edge applications
  • Manage one or more Applications Development teams in an effort to accomplish established goals as well as conduct personnel duties for team (e.g. performance evaluations, hiring and disciplinary actions)
  • Utilize in-depth knowledge and skills across multiple Applications Development areas to provide technical oversight across systems and applications
  • Review and analyze proposed technical solutions for projects
  • Contribute to formulation of strategies for applications development and other functional areas
  • Develop comprehensive knowledge of how areas of business integrate to accomplish business goals
  • Provide evaluative judgment based on analysis of factual data in complicated and unique situations
  • Fulltime
Read More
Arrow Right

Senior Software Development Engineer - Big Data

Zillow’s Comprehensive Customer Data team is part of the Data Engineering organi...
Location
Location
Mexico , Mexico City
Salary
Salary:
Not provided
Zillow
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A degree (BS+) in Computer Science or a related discipline
  • 5+ years of experience with building and maintaining data-intensive applications
  • Experience developing complex software systems scaling to millions of users with production quality deployment, monitoring and reliability
  • Experience with modern data technologies (Spark, Flink, Kafka, Airflow)
  • Strong background in Java or Python
  • Excellent interpersonal skills and passionate about collaborating across organizational boundaries
Job Responsibility
Job Responsibility
  • Design, implement, and take ownership of mission-critical data pipelines and data products
  • Collaborate with various internal teams (platform, product, other stakeholders) to scope and deliver tools ensuring ease of system use
  • Carefully review specifications, designs, pull requests and provide constructive/helpful feedback
  • Write high-quality code, refactor and optimize code for better scalability, performance, and readability
  • Integrate new frameworks, libraries, technologies, and components into codebase
  • Proactively log/collect and review metrics, monitor, alert and address issues quickly
  • Ensure the consistency and maintainability of existing applications adhering to standards/procedures for implementing technical solutions
  • Execute production/support tasks according to a documented schedule that meets or exceeds customer expectations
  • Support and mentor teams through design, implementation and deployment of solutions using relevant technologies
  • Mentor junior engineers
What we offer
What we offer
  • competitive base salary and benefits
  • equity awards based on factors such as experience, performance and location
  • Fulltime
Read More
Arrow Right

Senior Software Development Engineer, Big Data

This role will be responsible for developing and supporting data platform infras...
Location
Location
Mexico , Mexico City
Salary
Salary:
Not provided
Zillow
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in software development with one or more programming languages such as Python, Java, C++, etc.
  • Proficiency in developing and supporting services with cloud infrastructure such as AWS
  • Experience with and ability to debug/troubleshoot container orchestration platforms like Kubernetes
  • Experience with data infrastructure systems like Databricks, Spark, Hive, Airflow, Trino, Kafka, and Flink
  • Experience in setting up and optimizing data pipelines
  • Experience in developing scalable processes for supporting multiple user groups and teams
  • Familiarity and Experience with running on-call operational responsibilities for data platform systems
Job Responsibility
Job Responsibility
  • Developing and supporting data platform infrastructure
  • Collaborating to provide Data Platform Environments that empower internal Zillow Group customers to deliver high-quality data solutions
What we offer
What we offer
  • Competitive base salary and benefits
  • Equity awards based on factors such as experience, performance and location
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Data Products

We are seeking a highly skilled Senior Software Engineer with deep expertise in ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, Engineering, or a related field (or equivalent experience).
  • 8+ years of experience in software and/or data engineering with expertise in big data technologies such as Apache Spark, Apache Airflow.
  • Expertise with at least one of the following Apache Druid, StarRocks, and Trino.
  • Strong understanding of SOLID principles and distributed systems architecture.
  • Proven experience in distributed data processing, data warehousing, and real-time data pipelines.
  • Advanced SQL skills, with expertise in query optimization for large datasets.
  • Exceptional problem-solving abilities and the capacity to work independently or collaboratively.
  • Excellent verbal and written communication skills.
  • Experience with cloud platforms such as AWS, GCP, or Azure, and containerization tools like Docker and Kubernetes. (preferred)
  • Familiarity with additional big data technologies, including Hadoop and Kafka.
Job Responsibility
Job Responsibility
  • Design and build APIs and backend services using Spring Boot to support data products and analytics workflows.
  • Write clean, maintainable, and efficient code, ensuring adherence to best practices through code reviews.
  • Design, develop, and maintain data pipelines and ETL workflows using Apache Spark and Apache Airflow.
  • Optimize data storage, retrieval, and processing systems to ensure reliability, scalability, and performance.
  • Develop and fine-tune complex queries and analytics solutions using Druid, Trino, and StarRocks for large-scale datasets.
  • Monitor, troubleshoot, and improve data systems to minimize downtime and maximize efficiency.
  • Partner with data scientists, software engineers, and other teams to deliver integrated, high-quality solutions.
  • Provide technical guidance and mentorship to junior engineers, promoting best practices in software and data engineering.
What we offer
What we offer
  • Global access to mental health and financial wellness support and resources.
  • Local benefits including statutory and voluntary benefits which may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension).
  • Time off in accordance with local leave policies.
  • Fulltime
Read More
Arrow Right