CrawlJobs Logo

Senior Software Engineer - Cloud Data Storage

temporal.io Logo

Temporal

Location Icon

Location:
United States

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

180000.00 - 225000.00 USD / Year

Job Description:

Cloud Data Store (CDS) owns the storage, retrieval, and lifecycle of all workflow data at planet scale. We design the persistence APIs, build storage abstractions that run across cloud vendors, and deliver the observability that lets customers trust their state machines for years. As a Senior Software Engineer, you will get the chance to design, build, and maintain significant portions of our backend functionality for highly scalable, multi-tenant services. You’ll own the custom persistence stack for Temporal Cloud which includes a Write Ahead Log, various metadata stores (Cassandra, etcd), multi-level caches, tiered storage etc.

Job Responsibility:

  • Design & build distributed data systems – craft APIs, schemas, and replication paths that keep petabytes of workflow history durable and query-able
  • Drive reliability & performance – own SLOs, create chaos-test plans, profile hot paths, and lead incident reviews
  • Technical leadership – break down roadmap epics, mentor mid-level engineers, steward design docs through RFC
  • Cross-team collaboration – partner with the Server, Cloud, and DX teams to land features end-to-end

Requirements:

  • 5 or more years of experience as an 'Arranger' and/or 'Builder/Enhancer' of highly scalable distributed systems
  • Solid computer science fundamentals in distributed systems concepts including multi-threading and concurrency
  • Experience writing concurrent code in production with languages like Go or Java or other applicable languages with skill level as 'high end of Intermediate' and/or 'Advanced' or 'Expert' levels
  • Experience building and running services on AWS

Nice to have:

  • Prior contributions to Temporal, Cadence, or other workflow engines
  • Deep expertise in a storage domain (LSM trees, columnar stores, transactional logs, etc.)
  • Operated multi-region, ≥99.99 % uptime services
  • Experience working with Open Source Systems
  • Experience in building K8s controllers and/or CRDs is a plus
What we offer:
  • Unlimited PTO, 12 Holidays + 2 Floating Holidays
  • 100% Premiums Coverage for Medical, Dental, and Vision
  • AD&D, LT & ST Disability, and Life Insurance (Standard & Supplemental Available)
  • Empower 401K Plan
  • Additional Perks for Learning & Development, Lifestyle Spending, In-Home Office Setup, Professional Memberships, WFH Meals, Internet Stipend and more
  • $3,600 / Year Work from Home Meals
  • $1,500 / Year Career Development & Learning
  • $1,200 / Year Lifestyle Spending Account
  • $1,000 / Year In-Home Office Setup
  • $500 / Year Professional Memberships
  • $74 / Month Reimbursement for Internet
  • Calm App Subscription for Mental Health & Wellness

Additional Information:

Job Posted:
January 04, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Software Engineer - Cloud Data Storage

Senior Principal Data Platform Software Engineer

We’re looking for a Sr Principal Data Platform Software Engineer (P70) to be a k...
Location
Location
Salary
Salary:
239400.00 - 312550.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years in Data Engineering, Software Engineering, or related roles, with substantial exposure to big data ecosystems
  • Demonstrated experience building and operating data platforms or large‑scale data services in production
  • Proven track record of building services from the ground up (requirements → design → implementation → deployment → ongoing ownership)
  • Hands‑on experience with AWS, GCP (e.g., compute, storage, data, and streaming services) and cloud‑native architectures
  • Practical experience with big data technologies, such as Databricks, Apache Spark, AWS EMR, Apache Flink, or StarRocks
  • Strong programming skills in one or more of: Kotlin, Scala, Java, Python
  • Experience leading cross‑team technical initiatives and influencing senior stakeholders
  • Experience mentoring Staff/Principal engineers and lifting the technical bar for a team or org
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Design, develop and own delivery of high quality big data and analytical platform solutions aiming to solve Atlassian’s needs to support millions of users with optimal cost, minimal latency and maximum reliability
  • Improve and operate large‑scale distributed data systems in the cloud (primarily AWS, with increasing integration with GCP and Kubernetes‑based microservices)
  • Drive the evolution of our high-performance analytical databases and its integrations with products, cloud infrastructures (AWS and GCP) and isolated cloud environments
  • Help define and uplift engineering and operational standards for petabyte scale data platforms, with sub‑second analytic queries and multi‑region availability (coding guidelines, code review practices, observability, incident response, SLIs/SLOs)
  • Partner across multiple product and platform teams (including Analytics, Marketplace/Ecosystem, Core Data Platform, ML Platform, Search, and Oasis/FedRAMP) to deliver company‑wide initiatives that depend on reliable, high‑quality data
  • Act as a technical mentor and multiplier, raising the bar on design quality, code quality, and operational excellence across the broader team
  • Design and implement self‑healing, resilient data platforms with strong observability, fault tolerance, and recovery characteristics
  • Own the long‑term architecture and technical direction of Atlassian’s product data platform with projects that are directly tied to Atlassian’s company-level OKRs
  • Be accountable for the reliability, cost efficiency, and strategic direction of Atlassian’s product analytical data platform
  • Partner with executives and influence senior leaders to align engineering efforts with Atlassian’s long-term business objectives
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

As a Senior Data Engineer on our Core Engineering Data Team, you will design and...
Location
Location
United States , Boston
Salary
Salary:
111800.00 - 164000.00 USD / Year
simplisafe.com Logo
SimpliSafe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field or equivalent practical experience
  • 4+ years of experience in software engineering, data engineering, or a related field, with at least 2 years focused on data operations or data infrastructure
  • Strong knowledge of AWS or other public cloud platforms (e.g., Azure, GCP)
  • Strong SQL knowledge and experience optimizing for data warehousing technologies like AWS Athena
  • Strong knowledge of Python for use in data transformation
  • Hands-on experience with ETL/ELT, schema design, and datalake technologies
  • Hands-on experience with data orchestration tools like Dagster, Airflow, or Prefect
  • Experience with CI/CD pipelines, Docker, Kubernetes, and infrastructure-as-code tools (e.g., Terraform, CloudFormation)
  • Familiarity with various data and table formats (JSON, Avro, Parquet, Iceberg)
  • Love of data and a passion for building reliable data products
Job Responsibility
Job Responsibility
  • Collaborate with analysts, engineers, product managers, and stakeholders to design and implement solutions for Product and Engineering data workflows
  • Identify areas for improvement and contribute to centralized data platform
  • Manage data pipeline, orchestration, storage, and analytics infrastructure for Product and Engineering
  • Monitor performance and reliability of data pipelines, implementing solutions for scalability and efficiency
  • Optimize table structures to support query and usage patterns
  • Partner with producers of data across SimpliSafe to develop an understanding of data creation and meaning
  • Support data discovery, catalog, and analytics tooling
  • Implement and maintain data security measures and ensure compliance with data governance policies
  • Design and implement testing strategies and data quality validation to ensure the accuracy, reliability, and integrity of data pipelines
  • Contribute to the formation of our new team, assisting with the development of team norms, practices, and charter
What we offer
What we offer
  • A mission- and values-driven culture and a safe, inclusive environment where you can build, grow and thrive
  • A comprehensive total rewards package that supports your wellness and provides security for SimpliSafers and their families
  • Free SimpliSafe system and professional monitoring for your home
  • Employee Resource Groups (ERGs) that bring people together, give opportunities to network, mentor and develop, and advocate for change
  • Participation in our annual bonus program, equity, and other forms of compensation, in addition to a full range of medical, retirement, and lifestyle benefits
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

We are looking for a Data Engineer to join our team and support with designing, ...
Location
Location
Salary
Salary:
Not provided
foundever.com Logo
Foundever
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 7 years plus experience in data engineering
  • Track record of deploying and maintaining complex data systems at an enterprise level within regulated environments
  • Expertise in implementing robust data security measures, access controls, and monitoring systems
  • Proficiency in data modeling and database management
  • Strong programming skills in Python and SQL
  • Knowledge of big data technologies like Hadoop, Spark, and NoSQL databases
  • Deep experience with ETL processes and data pipeline development
  • Strong understanding of data warehousing concepts and best practices
  • Experience with cloud platforms such as AWS and Azure
  • Excellent problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Design and optimize complex data storage solutions, including data warehouses and data lakes
  • Develop, automate, and maintain data pipelines for efficient and scalable ETL processes
  • Ensure data quality and integrity through data validation, cleansing, and error handling
  • Collaborate with data analysts, machine learning engineers, and software engineers to deliver relevant datasets or data APIs for downstream applications
  • Implement data security measures and access controls to protect sensitive information
  • Monitor data infrastructure for performance and reliability, addressing issues promptly
  • Stay abreast of industry trends and emerging technologies in data engineering
  • Document data pipelines, processes, and best practices for knowledge sharing
  • Lead data governance and compliance efforts to meet regulatory requirements
  • Collaborate with cross-functional teams to drive data-driven decision-making within the organization
What we offer
What we offer
  • Impactful work
  • Professional growth
  • Competitive compensation
  • Collaborative environment
  • Attractive salary and benefits package
  • Continuous learning and development opportunities
  • A supportive team culture with opportunities for occasional travel for training and industry events
Read More
Arrow Right

Senior Manager, Software Engineering (Orchestration Services)

The Data and Storage Services team is responsible for handling all of Affirm’s D...
Location
Location
United States
Salary
Salary:
232000.00 - 310000.00 USD / Year
affirm.com Logo
Affirm
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid leadership and interpersonal skills
  • 10+ years of experience in managing multiple diverse and inclusive teams and delivering large cross-functional technical programs
  • Proven track record in stakeholder management, ownership, and successful delivery
  • Expertise in managing large-scale, geographically distributed compute and data processing systems, including data lake solutions and Workflow Orchestration frameworks
  • Expertise in scaling frameworks like Spark, Flink and, Kafka on Kubernetes and cloud providers like AWS, leveraging storage systems such as AWS S3 and Apache Iceberg
  • Capable of mentorship, cross-functional project execution, and individual contribution
  • Strong interpersonal, written, and verbal communication skills with a growth mindset
  • Experience in the data infrastructure domain and a passion for leading technical teams and contributing to Open Source solutions
  • Bachelor’s degree in Computer Science, related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Lead a team of engineers and managers with empathy while fostering a high-performance, ownership-driven & inclusive culture to develop frameworks, systems, and tools for new Affirm products
  • Oversee teams managing storage services including relational, key-value, and analytics storage infrastructure and tools at scale
  • Understand and drive business and engineering metrics, promoting a culture of reliability, security, and productivity
  • Collaborate with tech leads, program managers, and other engineering managers on security, tools, architecture, planning, and delivery of multiple concurrent projects
  • Work across the engineering organization and with internal and external partners
  • Provide leadership and growth opportunities to team members, mentor engineers, recruit, and represent Affirm hiring brands
  • Lead technical decisions, projects, and roadmaps within the Batch and Streaming teams, shaping Affirm’s strategy for managing and serving orchestration workloads
  • Collaborate with peers, leadership, and stakeholders across platform engineering and product engineering organizations
  • In collaboration with tech leads, develop a multi year roadmap to design and implement frameworks, services, and tools for new Affirm products and business needs
  • Guide, tutor, and aid in the professional growth of junior and senior engineers within the team
What we offer
What we offer
  • Health care coverage - Affirm covers all premiums for all levels of coverage for you and your dependents
  • Flexible Spending Wallets - generous stipends for spending on Technology, Food, various Lifestyle needs, and family forming expenses
  • Time off - competitive vacation and holiday schedules allowing you to take time off to rest and recharge
  • ESPP - An employee stock purchase plan enabling you to buy shares of Affirm at a discount
  • Fulltime
Read More
Arrow Right

Senior Manager, Software Engineering (Orchestration Services)

The Data and Storage Services team is responsible for handling all of Affirm’s D...
Location
Location
Canada
Salary
Salary:
206000.00 - 256000.00 CAD / Year
affirm.com Logo
Affirm
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid leadership and interpersonal skills
  • 10+ years of experience in managing multiple diverse and inclusive teams and delivering large cross-functional technical programs
  • Proven track record in stakeholder management, ownership, and successful delivery
  • Expertise in managing large-scale, geographically distributed compute and data processing systems, including data lake solutions and Workflow Orchestration frameworks
  • Expertise in scaling frameworks like Spark, Flink and, Kafka on Kubernetes and cloud providers like AWS, leveraging storage systems such as AWS S3 and Apache Iceberg
  • Capable of mentorship, cross-functional project execution, and individual contribution
  • Strong interpersonal, written, and verbal communication skills with a growth mindset
  • Experience in the data infrastructure domain and a passion for leading technical teams and contributing to Open Source solutions
  • Bachelor’s degree in Computer Science, related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Lead a team of engineers and managers with empathy while fostering a high-performance, ownership-driven & inclusive culture to develop frameworks, systems, and tools for new Affirm products
  • Oversee teams managing storage services including relational, key-value, and analytics storage infrastructure and tools at scale
  • Understand and drive business and engineering metrics, promoting a culture of reliability, security, and productivity
  • Collaborate with tech leads, program managers, and other engineering managers on security, tools, architecture, planning, and delivery of multiple concurrent projects
  • Work across the engineering organization and with internal and external partners
  • Provide leadership and growth opportunities to team members, mentor engineers, recruit, and represent Affirm hiring brands
  • Lead technical decisions, projects, and roadmaps within the Batch and Streaming teams, shaping Affirm’s strategy for managing and serving orchestration workloads
  • Collaborate with peers, leadership, and stakeholders across platform engineering and product engineering organizations
  • In collaboration with tech leads, develop a multi year roadmap to design and implement frameworks, services, and tools for new Affirm products and business needs
  • Guide, tutor, and aid in the professional growth of junior and senior engineers within the team
What we offer
What we offer
  • Health care coverage - Affirm covers all premiums for all levels of coverage for you and your dependents
  • Flexible Spending Wallets - generous stipends for spending on Technology, Food, various Lifestyle needs, and family forming expenses
  • Time off - competitive vacation and holiday schedules allowing you to take time off to rest and recharge
  • ESPP - An employee stock purchase plan enabling you to buy shares of Affirm at a discount
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Search

Truveta is the world’s first health provider led data platform with a vision of ...
Location
Location
United States , Seattle
Salary
Salary:
155000.00 - 190000.00 USD / Year
truveta.com Logo
Truveta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Software Engineering, Computer Engineering, Information Systems, or a related field (advanced degree a plus)
  • 5+ years of professional software engineering experience
  • Designing, building, and operating distributed systems at scale
  • Writing production-quality, efficient, multi-threaded code that runs reliably in cloud environments
  • Architecting and implementing search system features (indexing, querying, optimization), including building robust test frameworks
  • Reviewing data specifications and handling large-scale data storage and distribution using specialized protocols
  • Debugging and resolving complex production issues in distributed systems
  • Proven experience with cloud-native architectures and DevOps practices (preferably Azure, though AWS/GCP experience is relevant)
Job Responsibility
Job Responsibility
  • Design, build, and maintain index, query, and search system features utilized to aggregate and analyze health data
  • Architecting, implementing, and testing new index and query features
  • Optimizing end-to-end index performance
  • Planning, architecting, and deploying highly scalable and highly reliable search systems
  • Implement relevant compliance controls and conduct thorough security reviews
  • Drive observability, reliability, and automation across the infrastructure and platform
  • Monitor emerging technology in the search and infrastructure domains, evaluate applicability, and champion adoption where appropriate
  • Contribute to knowledge sharing and best practices within the team
What we offer
What we offer
  • Comprehensive benefits with strong medical, dental and vision insurance plans
  • 401K plan
  • Professional development & training opportunities for continuous learning
  • Work/life autonomy via flexible work hours and flexible paid time off
  • Generous parental leave
  • Regular team activities (virtual and in-person)
  • Additional compensation such as incentive pay and stock options
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

We are seeking a highly skilled senior software engineer to join our team. This ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
rearc.io Logo
Rearc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep expertise in Java: Proven proficiency in designing, developing, and optimizing high-performance, multithreaded Java applications
  • Comprehensive SDLC Experience: Extensive experience with the entire software development lifecycle, including requirements gathering, architectural design, coding, testing (unit, integration, performance), deployment, and maintenance
  • Data Engineering & Financial Data Processing: Proven experience in data engineering, including building, maintaining, and optimizing complex data pipelines for real-time and historical financial stock market data
  • Financial Market Acumen: A strong background in the financial industry, with a working knowledge of financial instruments, market data (e.g., tick data, OHLC), and common financial models
  • Problem-Solving & Adaptability: Excellent problem-solving skills and the ability to work with complex and evolving requirements
  • Collaboration & Communication: Superior communication skills, capable of collaborating effectively with quantitative analysts, data scientists, and business stakeholders
  • Testing & CI/CD: A strong ability to work on development and all forms of testing, with working knowledge of CI/CD pipelines and deployments
  • Database Proficiency: Experience with various database technologies (SQL and NoSQL) and the ability to design database schemas for efficient storage and retrieval of financial data
Job Responsibility
Job Responsibility
  • Design and Development: Architect, build, and maintain robust, scalable, and low-latency Java applications for processing real-time and historical financial stock market data
  • Data Pipeline Engineering: Engineer and manage sophisticated data pipelines using modern data technologies to ensure timely and accurate data availability for analytics and trading systems
  • Performance Optimization: Profile and optimize applications for maximum speed, scalability, and efficiency
  • System Integration: Integrate data from various financial market sources and ensure seamless data flow into downstream systems
  • Mentorship and Best Practices: Provide guidance and mentorship to other engineers, contribute to code reviews, and advocate for best practices
  • Operational Excellence: Participate in the full software development lifecycle, from initial design to production support, ensuring system reliability and performance
Read More
Arrow Right

Senior Data Engineer

Radix is building the most trusted data and analytics platform in multifamily. J...
Location
Location
United States , Scottsdale
Salary
Salary:
Not provided
radix.com Logo
Radix (AZ)
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering or backend systems, with 2+ years collaborating closely with analytical or scientific practitioners
  • Experience designing at least one end-to-end data application (visualization, model pipeline, etc.) for production use
  • Strong understanding of data modeling, batch processing, and streaming systems
  • Hands-on experience with SQL/NoSQL databases, cloud storage, file-based datasets, and Infrastructure-as-code
  • Experience building or operating data pipelines on AWS cloud services (Lambda, S3, RDS, ECS)
  • Understanding of AI/LLM integration and prompt engineering fundamentals
  • Proficiency with Git/GitHub, and familiarity with Spark and Kubernetes
  • Strong problem-solving skills, ownership, and ability to identify root causes of technical debt and recurring problems
  • Demonstrated ability to translate Product/Science requirements into technical plans and hold teams accountable to delivery timelines
  • Undergraduate degree in computer science, computer engineering, software engineering, or equivalent
Job Responsibility
Job Responsibility
  • Build scalable ETL/ELT pipelines for ingesting structured and unstructured data (Excel, JSON, PDFs, APIs)
  • Design and maintain data pipelines using SQL, Python, Node.js, or TypeScript
  • Work with distributed compute systems (Spark, Kubernetes), message queues, and streaming data
  • Manage and optimize data storage in MongoDB, PostgreSQL, Redis, Snowflake, and S3
  • Develop clean, standardized data schemas and event-driven transformations
  • Integrate AI-assisted parsers, mappers, and LLM-supported transformations
  • Collaborate with backend, analytics, product, and AI teams to break down requirements into well-defined engineering problems
  • Implement monitoring, data validation, and reliability checks (DQ rules, freshness, duplication)
  • Own production readiness, including on-call responsibilities and incident follow-ups
  • Mentor engineers, conduct thorough code reviews, and introduce patterns that raise the team's technical bar
What we offer
What we offer
  • Medical, dental and vision coverage designed to support your wellbeing
  • Pre-IPO Equity
  • Performance Bonus
  • Learn From the Best
  • Build Category-Defining Products
Read More
Arrow Right