CrawlJobs Logo
Z
Zillow · IT - Software Development

Senior Software Development Engineer, Big Data

Mexico, Mexico City · Job Posted May 26, 2026
Apply Position
Job Link Share

Job Description

This role will be responsible for developing and supporting data platform infrastructure. They utilize data technologies such as Spark, Hive, Airflow, Databricks, Kafka, Flink, and other industry and internal tools. Will collaborate to provide Data Platform Environments that empower internal Zillow Group customers to deliver high-quality data solutions that create trust and delight our customers.

Job Responsibility

  • Developing and supporting data platform infrastructure
  • Collaborating to provide Data Platform Environments that empower internal Zillow Group customers to deliver high-quality data solutions

Requirements

  • Experience in software development with one or more programming languages such as Python, Java, C++, etc.
  • Proficiency in developing and supporting services with cloud infrastructure such as AWS
  • Experience with and ability to debug/troubleshoot container orchestration platforms like Kubernetes
  • Experience with data infrastructure systems like Databricks, Spark, Hive, Airflow, Trino, Kafka, and Flink
  • Experience in setting up and optimizing data pipelines
  • Experience in developing scalable processes for supporting multiple user groups and teams
  • Familiarity and Experience with running on-call operational responsibilities for data platform systems

Nice to have

  • Databricks experience is a plus
  • Experience with Data Governance & Compliance (CCPA/CPRA, GDPR, SOX, etc) is a plus

What we offer

  • Competitive base salary and benefits
  • Equity awards based on factors such as experience, performance and location
Zillow - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Software Development Engineer, Big Data

8 matching positions

Senior Software Development Engineer, Big Data

The Zillow Group’s Housing Trends Data Engineering team brings innovative analys...
Location
Location
United States
Salary
Salary:
152900.00 - 257100.00 USD / Year
Zillow
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong proficiency in Python programming
  • Hands-on experience with big data ecosystems, architectures and modern data platforms, including AWS cloud data services and Lakehouse/Lakebase platforms
  • Hands-on experience with Databricks is a significant advantage
  • Proven ability to design, build, and orchestrate batch and real-time data pipelines, processing large-scale datasets from diverse sources
  • Practical experience with cutting-edge data engineering technologies such as SparkSQL and Spark Streaming, PostgreSQL, EKS, and Kubernetes
  • Familiarity with Agile/DevOps software development processes and tools such as GitLab and CI/CD
  • A good understanding of data science concepts, fundamental machine learning algorithms/libraries, and development lifecycle is a must-to-have
  • Familiarity with LLM and Agentic AI technologies and engineering patterns is a big advantage
  • Strong ability in performing root cause analysis to address operational issues and identify opportunities for improvement
  • Exceptional communication skills to drive effective customer engagement, collaborate with cross-functional teams, and clearly articulate technical concepts to technical and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Build data systems to link raw data and concrete Housing Trends insights
  • Build and extend our internal forecasting model development framework
  • Develop and maintain scalable data products and deliver pipelines built for speed, accuracy, and consistency that will scale as our stakeholders’ need
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability and performance, etc
  • Collaborate with data scientists to understand their data requirements and build systems/tools that enable efficient model training and experimentation
  • Implement feature stores and ETL pipelines to streamline feature engineering and model development
  • Build and maintain infrastructure for deploying machine learning models into production environments
  • Be a trusted partner for our stakeholders, such as Forecasting, Zestimates, and the ML teams within the AI organization to assist them for data investigation/publication, ML model development and infrastructure support
What we offer
What we offer
  • Eligible for equity awards based on factors such as experience, performance and location
  • Fulltime
Read More
Arrow Right

Senior Software Development Engineer - Big Data

Zillow’s Comprehensive Customer Data team is part of the Data Engineering organi...
Location
Location
Mexico , Mexico City
Salary
Salary:
Not provided
Zillow
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A degree (BS+) in Computer Science or a related discipline
  • 5+ years of experience with building and maintaining data-intensive applications
  • Experience developing complex software systems scaling to millions of users with production quality deployment, monitoring and reliability
  • Experience with modern data technologies (Spark, Flink, Kafka, Airflow)
  • Strong background in Java or Python
  • Excellent interpersonal skills and passionate about collaborating across organizational boundaries
Job Responsibility
Job Responsibility
  • Design, implement, and take ownership of mission-critical data pipelines and data products
  • Collaborate with various internal teams (platform, product, other stakeholders) to scope and deliver tools ensuring ease of system use
  • Carefully review specifications, designs, pull requests and provide constructive/helpful feedback
  • Write high-quality code, refactor and optimize code for better scalability, performance, and readability
  • Integrate new frameworks, libraries, technologies, and components into codebase
  • Proactively log/collect and review metrics, monitor, alert and address issues quickly
  • Ensure the consistency and maintainability of existing applications adhering to standards/procedures for implementing technical solutions
  • Execute production/support tasks according to a documented schedule that meets or exceeds customer expectations
  • Support and mentor teams through design, implementation and deployment of solutions using relevant technologies
  • Mentor junior engineers
What we offer
What we offer
  • competitive base salary and benefits
  • equity awards based on factors such as experience, performance and location
  • Fulltime
Read More
Arrow Right

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
  • Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
  • Experience building data lake or data engineering products, tools, or pipelines
  • Familiarity with container-based architectures (Docker, Kubernetes)
  • Ability to debug complex distributed systems on Linux and/or Windows platforms
Job Responsibility
Job Responsibility
  • Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
  • Use AI tools and coding best practices across the development lifecycle
  • Design data refresh, scheduling, and query optimisation features with minimal supervision
  • Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
  • Coach junior engineers through code reviews
  • Debug complex issues in distributed systems running on Azure, Linux, and Windows
  • Run live site operations on a rotational, on-call basis
  • Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
  • Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features
  • Fulltime
Read More
Arrow Right

Senior Software Engineer- Big Data & Java

Location
Location
Canada , Mississauga
Salary
Salary:
Not provided
pointclickcare.com Logo
PointClickCare
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience with data pipelines processing large amounts of data in Real Time or Near Real Time
  • Experience with Lakehouse architecture, Azure ADLS Gen2, Apache Hudi
  • Experience developing Java/Spring Boot microservices
  • Experience with Agentic AI components
  • Legally authorized to work in Canada
  • Fulltime
Read More
Arrow Right

Senior Software Engineer- Big Data & Java

Location
Location
United States
Salary
Salary:
Not provided
pointclickcare.com Logo
PointClickCare
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Do you have experience with data pipelines processing large amounts of data in Real Time or Near Real Time?
  • Do you have experience with Lakehouse architecture, Azure ADLS Gen2, Apache Hudi?
  • How many years of experience developing Java/Spring Boot microservices?
  • Do you have experience with Agentic AI components?
  • Are you legally authorized to work in the US for our company?
  • Fulltime
Read More
Arrow Right

Senior Software Engineer- Big Data & Java

At PointClickCare our mission is simple: to help providers deliver exceptional c...
Location
Location
United States
Salary
Salary:
158000.00 - 176000.00 CAD / Year
pointclickcare.com Logo
PointClickCare
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience with distributed computing tools like Apache Hudi, Spark, Kafka, Flink, Beam, Trino, DataBricks and other big data technologies
  • Experience with distributed storage systems like ADLS, HDFS, S3, DLT etc.
  • Familiarity with Hadoop, Spark, Databricks or other distributed computing systems
  • Understanding of data partitioning and sharding techniques
  • Knowledge of distributed computing principles and how they apply to large-scale data processing
  • Experience in writing clean code that performs well at scale using languages such as Python, Java etc.
  • Knowledge of relational databases (e.g. Microsoft SQL Server, MySQL)
  • Solid experience writing RESTful API endpoints
  • Absolutely love TDD and have working knowledge of it
  • Proficient in GIT
Job Responsibility
Job Responsibility
  • Identify, prioritize and execute tasks in the software development life cycle
  • Work with business to iterate over software requirements
  • Develop tools and applications by producing clean, efficient code
  • Automate tasks through appropriate tools and scripting
  • Analyze and debug systems
  • Perform validation and verification testing in a test-driven manner
  • Review the work of others, and invite others to review your work
  • Collaborate with internal teams and vendors to fix and improve products
  • Ensure software is up-to-date with latest technologies
  • Work with distributed computing systems like Apache Hudi and Trino for big data processing
What we offer
What we offer
  • Benefits starting from Day 1!
  • Retirement Plan Matching
  • Flexible Paid Time Off
  • Wellness Support Programs and Resources
  • Parental & Caregiver Leaves
  • Fertility & Adoption Support
  • Continuous Development Support Program
  • Employee Assistance Program
  • Allyship and Inclusion Communities
  • Employee Recognition … and more!
  • Fulltime
Read More
Arrow Right

Senior Software Engineer- Big Data & Java

At PointClickCare our mission is simple: to help providers deliver exceptional c...
Location
Location
Canada , Mississauga
Salary
Salary:
142000.00 - 158000.00 CAD / Year
pointclickcare.com Logo
PointClickCare
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience with distributed computing tools like Apache Hudi, Spark, Kafka, Flink, Beam, Trino, DataBricks and other big data technologies
  • Experience with distributed storage systems like ADLS, HDFS, S3, DLT etc.
  • Familiarity with Hadoop, Spark, Databricks or other distributed computing systems
  • Understanding of data partitioning and sharding techniques
  • Knowledge of distributed computing principles and how they apply to large-scale data processing
  • Experience in writing clean code that performs well at scale using languages such as Python, Java etc.
  • Knowledge of relational databases (e.g. Microsoft SQL Server, MySQL)
  • Solid experience writing RESTful API endpoints
  • Absolutely love TDD and have working knowledge of it
  • Proficient in GIT
Job Responsibility
Job Responsibility
  • Identify, prioritize and execute tasks in the software development life cycle
  • Work with business to iterate over software requirements
  • Develop tools and applications by producing clean, efficient code
  • Automate tasks through appropriate tools and scripting
  • Analyze and debug systems
  • Perform validation and verification testing in a test-driven manner
  • Review the work of others, and invite others to review your work
  • Collaborate with internal teams and vendors to fix and improve products
  • Ensure software is up-to-date with latest technologies
  • Work with distributed computing systems like Apache Hudi and Trino for big data processing
What we offer
What we offer
  • Benefits starting from Day 1
  • Retirement Plan Matching
  • Flexible Paid Time Off
  • Wellness Support Programs and Resources
  • Parental & Caregiver Leaves
  • Fertility & Adoption Support
  • Continuous Development Support Program
  • Employee Assistance Program
  • Allyship and Inclusion Communities
  • Employee Recognition … and more
  • Fulltime
Read More
Arrow Right

Senior Lead Software Engineer – Regulatory Reporting & Big Data

Job Overview: The Applications Development Technology Lead Analyst is a senior l...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8–10 years of hands-on software development experience, with a strong focus on backend engineering and enterprise-scale systems
  • Deep expertise in Java and Spring Boot, with advanced knowledge of SQL and real-time messaging technologies
  • Demonstrated ability to design software architecture and conduct meaningful trade-off analysis across complex technical landscapes
  • Practical experience building and delivering microservices-based architectures in production environments
  • Proficiency with a modern JavaScript framework such as Angular, with the ability to contribute across the full stack where needed
  • Proven leadership and people management skills, with experience guiding engineering teams and allocating work effectively
  • Clear and confident communicator, able to translate complex technical concepts for both engineering and non-technical audiences
  • Bachelor’s degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Architect and lead the development of scalable, high-performance applications within Citi's Insight regulatory reporting framework, ensuring alignment with enterprise architecture standards
  • Design and implement solutions across a modern stack including Java, Spring Boot, SQL, and real-time messaging systems to support large-scale data processing needs
  • Build and optimize data pipelines and analytical workflows using Big Data technologies, contributing to robust and reliable regulatory reporting outcomes
  • Define and enforce engineering standards for coding, testing, debugging, and deployment across the team, raising the bar for software quality and delivery consistency
  • Collaborate with cross-functional teams — including architecture, infrastructure, and business stakeholders — to identify system enhancements and deliver new product capabilities
  • Evaluate complex business and system processes to resolve high-impact technical challenges, developing innovative and pragmatic engineering solutions
  • Mentor and coach mid-level engineers and analysts, providing technical direction and supporting their professional growth
  • Embed risk awareness into engineering decisions, ensuring solutions meet compliance requirements and uphold Citi's standards for data integrity and regulatory adherence
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
What we offer
What we offer
  • Hybrid working model — 3 days in the office and 2 days working remotely
  • Hands-on exposure to Big Data technologies including Spark, Hive, Impala, and HDFS within a large-scale production environment
  • Access to Citi's AI tools and emerging technologies
  • Senior-level ownership and influence over architectural decisions
  • Opportunities to mentor and develop engineering talent
  • A collaborative, global engineering community with access to learning and development resources
  • Competitive compensation and a comprehensive benefits package, including financial wellbeing and family support programs
  • Fulltime
Read More
Arrow Right