CrawlJobs Logo

Staff Software Engineer, Data

astronomer.io Logo

Astronomer

Location Icon

Location:
United States , New York City

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

215000.00 - 250000.00 USD / Year

Job Description:

At Astronomer, we’re redefining how companies run Apache Airflow at scale. Our R&D organization is home to some of the most innovative minds in cloud infrastructure and open-source software. You can’t spell “Data Orchestration” without “Data”, and we’re looking to add a world-class Staff+ level engineer to our team, to set out our Data and Database story as we level up our platform’s Reliability, cost profile and growth trajectory. You get to go in at the ground level of how our production infrastructure is designed, built, tested and deployed. Your work will directly influence how we build Astro, Observe and our IDE product, as well as how global organizations orchestrate data pipelines at scale—making them faster, more reliable, and easier to manage.

Job Responsibility:

  • Be a subject-matter expert in how we treat Data at scale
  • Recommend, design and later lead building the data systems that will help us continue to scale
  • Own and develop our Database and overall data strategy and practice
  • Be directly involved in decision-making on what we work on, as well as how we work on it
  • Make build vs. buy assessments, and advocate for the right tools for the right job when it comes to data
  • Create and maintain comprehensive internal documentation and decision records for systems and processes, ensuring clarity and accessibility
  • Participate in Architectural forums and discussion and make principled, open decisions

Requirements:

  • Hands-on experience designing, developing, and scaling production infrastructure
  • Extensive knowledge of Postgres and Postgres-like cloud offerings (AWS, GCP, Azure)
  • Extensive and recent experience with building low-level data systems and/or managed data platforms
  • In-depth knowledge and practical experience of the product and technology space in Database and related fields (Blob, NoSQL, Timeseries, Graph, Vector)
  • Experience defining requirements and making and justifying technology choices around the data space
  • Strong experience in Non-Abstract Systems design and implementation
  • Strong proficiency in Golang and in-depth experience with Kubernetes
  • Strong communication skills, both written and verbal, with experience in working with a globally distributed team in delivery

Nice to have:

  • Experience working with Spanner, AlloyDB and/or other cloud-native databases, including hands-on experience with provisioning, development practices and migration of data
  • Experience working on a SaaS/PaaS product across multiple cloud providers
  • Experience building internal data platforms from cloud-native component parts
  • Experience with Apache Airflow
What we offer:
  • equity component
  • comprehensive benefits package

Additional Information:

Job Posted:
February 14, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Staff Software Engineer, Data

Staff Data Engineer

As a Staff Data Engineer, you will be leading the architecture, design and devel...
Location
Location
United States; Canada , Remote
Salary
Salary:
Not provided
https://www.1password.com Logo
1Password
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 8+ years of professional software engineering experience
  • Minimum of 7 years technical engineering experience building data processing applications (batch and streaming) with coding in languages
  • In-depth, hands-on experience on extensible data modeling, query optimizations and work in Java, Scala, Python, and related technologies
  • Experience in data modeling across external facing product insights and business processes, such as revenue/sales operations, finance, and marketing
  • Experience with Big Data query engines such as Hive, Presto, Trino, Spark
  • Experience with data stores such as Redshift, MySQL, Postgres, Snowflake, etc.
  • Experience using Realtime technologies like Apache Kafka, Kinesis, Flink, etc.
  • Experience building scalable services on top of public cloud infrastructure like Azure, AWS, or GCP with extensive use of datastores like RDBMS, key-value stores, etc.
  • Experience leveraging distributed systems at scale and systems knowledge on infrastructure hardware, resources bare-metal hosts to containers to networking.
Job Responsibility
Job Responsibility
  • Design, develop, and automate large-scale, high-performance batch and streaming data processing systems to drive business growth and enhance product experience
  • Build data engineering strategy that supports a rapidly growing tech company and aligns with the priorities across our product strategy and internal business organizations’ desire to leverage data for more competitive advantages
  • Build scalable data pipelines using best-in-class software engineering practices
  • Develop optimal data models for storage and retrieval, meeting critical product and business requirements
  • Establish and execute short and long-term architectural roadmaps in collaboration with Analytics, Data Platform, Business Systems, Engineering, Privacy and Security
  • Lead efforts on continuous improvement to the efficiency and flexibility of the data, platform, and services
  • Mentor Analytics & Data Engineers on best practices, standards and forward-looking approaches on building robust, extensible and reusable data solutions
  • Influence and evangelize high standard of code quality, system reliability, and performance.
What we offer
What we offer
  • Maternity and parental leave top-up programs
  • Generous PTO policy
  • Four company-wide wellness days
  • Company equity for all full-time employees
  • Retirement matching program
  • Free 1Password account
  • Paid volunteer days
  • Employee-led inclusion and belonging programs and ERGs
  • Peer-to-peer recognition through Bonusly
  • Fulltime
Read More
Arrow Right

Software Engineer Staff - Data Scientist

Designs, develops, troubleshoots and debugs software programs for software enhan...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Masters or PhD in Computer Science, Electrical Engineering, Statistics, Applied Math or equivalent fields with strong mathematical background
  • Proficiency in Python, R, SQL, or other programming languages for data analysis
  • Experience with data wrangling, manipulation, and visualization tools and libraries such as pandas, numpy, scikit-learn, matplotlib, seaborn, etc.
  • Knowledge of machine learning concepts and techniques such as supervised and unsupervised learning, regression, classification, clustering, dimensionality reduction, etc.
  • Familiarity with cloud computing platforms and services such as AWS, Azure, or Google Cloud
  • Strong analytical and problem-solving skills
Job Responsibility
Job Responsibility
  • Collect, clean, and transform data from various sources and formats for model training
  • Perform exploratory data analysis and visualization to understand patterns and trends
  • Build, test, and deploy predictive models and algorithms using appropriate tools and frameworks to a production cloud environment
  • Communicate findings and recommendations to stakeholders and clients using clear and compelling reports and presentations
  • Collaborate with other data scientists, engineers, and domain experts on cross-functional projects
What we offer
What we offer
  • Comprehensive suite of benefits that supports physical, financial and emotional wellbeing
  • Programs for personal and professional development
  • Inclusive environment that celebrates individual uniqueness
  • Fulltime
Read More
Arrow Right

Software Engineer Staff

This role has been designed as ‘Hybrid’ with an expectation that you will work o...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BTech / MTech in CS/CE or related field with 12+ years of proven experience
  • In-depth knowledge of data networking, e.g., TCP/IP, Ethernet, Packet forwarding, Routing etc.
  • Proficiency with device drivers, system bring-up, FreeBSD/Linux internals
  • Understanding of Ethernet, OTN, SONET etc. technologies desired
  • Strong technical, analytical, and problem-solving skills
  • Strong in C, C++ programming, OO analysis & design, data structures and system debugging skills
  • Good understanding of firmware, hardware level details for Optics, PCIe, SPI, I2C, Retimers, FPGA, CPLD, MDIO, Flash Driver
  • Prior software development experience on networking products would be a plus
Job Responsibility
Job Responsibility
  • Designs, develops, troubleshoots and debugs software programs for software enhancements and new products
  • Develops software including operating systems, compilers, routers, networks, utilities, databases and Internet-related tools
  • Determines hardware compatibility and/or influences hardware design
  • Board-bring up related experience
  • 10G, 40G, 100G and 400G interface related platform software
  • Platform infrastructure related software like Chassis/line card, fabric, Optics, HA etc.
  • Networking knowledge of L2, L3, Packet forwarding etc.
  • Responsible for these product developments in the platform area in either JunOS or Junos Evoled based software architecture
  • Work closely with system and solution test teams to ensure products/solutions delivered are with highest quality
  • Work closely with HPE Technical Assistance Team for providing engineering assistance in supporting critical customer escalations for customer deployments
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

Software Engineer Staff

This Software Engineer Staff will be engaged in data science-related research an...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Utilize analytical and programming skills and open-source systems, such as Apache Storm, Apache Spark, Elasticsearch, Cassandra, Graph DB etc. develop data processing pipeline required efficacy and latency
  • Require good knowledge and experience of the big data tool sets and techniques of distributed storage and computation engine
  • Require the experience to develop the reusable and highly scalable data processing component
  • Require good knowledge and experience to work with cloud based CICD tools and cloud devops teams to collect stats and create monitors for our data processing pipelines
  • Develop good quality python APIs to support micro services
  • Require the knowledge of APIs to various No SQL storage systems, Elasticsearch, Cassandra, and Redis, etc.
  • Good understanding Python Flask web service and be able to develop good quality code
  • Troubleshoot production environment and customer reported issues
  • Require the knowledge of the multi-cloud production environment
  • Require the agility to troubleshoot open-source data processing engine, such as Apache Spark, Apache Storm and Apache Flink
Job Responsibility
Job Responsibility
  • Designs, develops, troubleshoots and debugs software programs for software enhancements and new products
  • Develops software including operating systems, compilers, routers, networks, utilities, databases and Internet-related tools
  • Determines hardware compatibility and/or influences hardware design
  • Engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology and autonomous platform to provide an unprecedented visibility into the user experience
  • Collaborate with other engineers and product managers to build the next generation of autonomous Wi-Fi networks leveraging big data and predictive models
  • Use knowledge of wireless communication networks, machine learning and software engineering to develop and implement scalable algorithms to process a large amount of streaming data to detect anomalies, predict problems, and classify them in real-time
  • Leverage the data collected from the Wi-Fi network to empower the inference engine of our Mist platform and systems, including the Mist virtual assistant chat bot
  • Determine the likelihood of failures across the Wi-Fi network and performing failure scope analysis
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

Staff Software Engineer - Integrated Test

Archer is an aerospace company based in San Jose, California building an all-ele...
Location
Location
United States , San Jose
Salary
Salary:
168000.00 - 200000.00 USD / Year
archer.com Logo
Archer Aviation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in simulation software development and systems integration
  • Bachelor's or higher degree in Aerospace, Software, Electrical Engineering, Computer Science, or a related field
  • Seasoned technical lead for an engineering team
  • providing guidance in planning and execution
  • Advanced proficiency in C/C++ and Python
  • Very experienced in MATLAB/Simulink
  • Extensive experience developing real-time HIL test infrastructures
  • Proven ability to develop simulation tools with a focus on usability, modularity, and performance
  • Expert of communication standards and protocols (RS-422/485, CAN/CAN-FD, ARINC-429, Ethernet, TCP/IP, USB etc…)
  • Experience prototyping Graphical User Interfaces based on user feedback
Job Responsibility
Job Responsibility
  • Architect and lead the team managing Archer’s lab integration environments supporting validation and verification activities, handling quality evaluations, human factor evaluations and test pilot training
  • Collaborate cross-functionally with internal groups and suppliers to integrate, instrument and maintain configuration of simulation models in a real-time, integrated hardware-in-the-loop environments
  • Own end-to-end configuration of simulation environments (e.g., SIL, HIL, CeRT, Iron Bird), including data analysis and simulation correlation with flight test data
  • Develop and optimize simulation pipelines including CI/CD integration for automated deployment, execution, and monitoring
  • Integrate third-party software/hardware systems into cohesive simulation architectures
  • Set technical standards, provide mentorship, and foster a collaborative and high-performance engineering culture
  • Guide the design and build of graphical user interfaces to control the real-time simulation environment
  • Lead task decomposition, technical planning, and debugging of complex issues across real-time and distributed systems
  • Influence tool architecture in support of lab configuration and automation
  • Fulltime
Read More
Arrow Right

Staff Software Engineer, Backend

The Staff Engineer will work closely with AI/ML engineers, product managers, app...
Location
Location
United States , NYC
Salary
Salary:
160000.00 - 190000.00 USD / Year
conductor.com Logo
Conductor
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Completed studies in Computer Science, Mathematics, engineering or a related field or equivalent professional experience
  • 8+ years of experience in software development, with experience in product-driven companies
  • Strong expertise in system design, distributed computing, and scalable architecture patterns for handling large datasets and high-throughput applications
  • Proficiency in multiple programming languages with strong Python coding skills. Experience with Java is highly valued
  • Strong database experience including both SQL and NoSQL systems, with knowledge of data modeling and optimization techniques
  • Experience with AI/ML technologies including LLMs, vector databases (e.g., Milvus), embeddings, and ML frameworks
  • Knowledge of MLOps practices, model deployment, and AI system integration in production environments
  • Experience working across the full software development lifecycle including CI/CD, monitoring, testing, and production deployment
  • Proven track record of technical leadership, mentoring engineers, and driving engineering excellence within teams
  • Up-to-date with rapidly-evolving technologies and demonstrated ability to evaluate and adopt new tools and frameworks
Job Responsibility
Job Responsibility
  • Lead the technical architecture, design, and implementation of large-scale distributed systems and data platforms to support customer needs and business growth
  • Oversee the planning, execution, and successful delivery of complex engineering projects, ensuring adherence to engineering best practices and quality standards
  • Design and build scalable, high-performance backend systems and APIs that handle millions of requests and large datasets efficiently
  • Architect robust data processing pipelines and ETL workflows using modern cloud technologies and distributed computing frameworks
  • Drive technical decision-making across the engineering organization, evaluating trade-offs and establishing engineering standards and practices
  • Lead cross-functional collaboration with product, AI/ML engineering, data engineering, and infrastructure teams to deliver comprehensive solutions
  • Build and maintain CI/CD pipelines, monitoring systems, and deployment automation to ensure reliable software delivery
  • Implement AI/ML capabilities including LLM integration, vector databases, and intelligent content processing workflows
  • Mentor senior and junior engineers, fostering technical excellence and knowledge sharing within the engineering organization
What we offer
What we offer
  • 100% covered employee medical plan
  • a dental & vision plans
  • 401(k) with employer contribution
  • an unlimited vacation policy
  • 10 sick days
  • short-term disability
  • long-term disability
  • generous paid parental leave
  • employee assistance program
  • flexible savings accounts
  • Fulltime
Read More
Arrow Right

Staff Software Engineer

EarnIn is looking for experienced, collaborative, and resourceful staff-level en...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
earnin.com Logo
EarnIn
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of delivering value through software in a collaborative environment
  • Architected and implemented complex features focusing on data-driven decision making and performance optimization
  • Technical leadership: hands-on experience leading project teams, setting technical direction and strategy, system design, and mentoring engineers
  • Passionate about efficiency, availability, technical quality, and system quality
  • Experience leveling up those around you with curiosity and fostering a collaborative, inclusive team environment
  • Proven experience in defining product/technical strategy and deriving alignment with xfn leaders/stakeholders
  • Strong communication and initiative that spans across teams
  • Experience leading design, implementation, and deployment of high-scale cross-functional payments systems
  • Bring a strong product mindset and a deep understanding of product needs and long-term flexibility in design
Job Responsibility
Job Responsibility
  • Design & implement features robust enough for our high scale
  • Drive the implementation of new features—break complex problems down to their bare essentials, translate that complexity into elegant design, and create high-quality, maintainable code
  • Create and maintain test automation to enable continuous integration and development velocity
  • Design & deliver thoughtfully crafted REST APIs to drive the interactions between our client applications and backend services
  • Collaborate and mentor other engineers while providing thoughtful guidance using code, design, and architecture reviews
  • Work cross-functionally with other teams (data science, design, product, marketing, analytics)
  • Leverage a broad skill set and help us implement and learn new technologies quickly
  • Provide and receive design and implementation evaluations and improve with each iteration
  • Debug production issues across our services infrastructure and multiple levels of our stack
  • Think about distributed systems & services and care passionately about producing high-quality code
What we offer
What we offer
  • healthcare
  • internet/cell phone reimbursement
  • a learning and development stipend
  • potential opportunities to travel to our Mountain View HQ
Read More
Arrow Right

Staff Software Engineer

EarnIn is looking for experienced, collaborative, and resourceful staff-level en...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
earnin.com Logo
EarnIn
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of delivering value through software in a collaborative environment including experience in a tech lead type of role
  • Architected and implemented complex features focusing on data-driven decision making and performance optimization
  • Demonstrated a high level of ownership to get changes shipped in the highly regulated domain of payments
  • Technical leadership: hands-on experience leading project teams, setting technical direction and strategy, and mentoring engineers
  • Passionate about efficiency, availability, technical quality, and system quality
  • Passion to level up those around you with curiosity and foster a collaborative and inclusive team environment
  • Proven experience in defining product/technical strategy and deriving alignment with cross-functional leaders/stakeholders
  • Strong communication and initiative that spans across teams
Job Responsibility
Job Responsibility
  • Work cross-functionally with various teams
  • Contribute to the design and development of our backend services
What we offer
What we offer
  • Healthcare
  • Internet/cell phone reimbursement
  • Learning and development stipend
  • Potential opportunities to travel to our Palo Alto HQ
Read More
Arrow Right