CrawlJobs Logo

Senior/Staff Data Engineer

· Job Posted December 23, 2025
Apply Position
Job Link Share

Job Description

As a senior data engineer you will work on complex data pipelines dealing with petabytes of data. Balbix platform is used as one of the critical security tools by the CIOs, CISOs, and the sec-ops teams of small, medium and large sized enterprises including Fortune 10 companies around the world. You will solve problems related to massive cybersecurity and IT data sets. You will collaborate closely with our data scientists, threat researchers and network experts to solve real-world problems plaguing cybersecurity. This role requires excellent algorithm, programming and testing skills as well as experience in large-scale data engineering projects.

Job Responsibility

  • Design and implement the features and own the modules for ingesting, storing and manipulating large data sets for a variety of cybersecurity use-cases
  • Write code to provide backend support for data-driven UI widgets, web dashboards, workflows, search and API connectors
  • Design and implement web services, rest APIs, and microservices
  • Build production quality solutions that balance complexity and meet acceptance criteria of functional requirements
  • Work with multiple-interfacing teams, including ML, UI, backend and data engineering

Requirements

  • MS/BS +3 years in Computer Science or a related field
  • Expert programming experience with Python, Java, or Scala
  • Good working knowledge of SQL databases such as Postgres and NoSQL databases such as MongoDB, Cassandra, Redis
  • Experience with search engine database such as ElasticSearch is preferred
  • Time-series databases such as InfluxDB, Druid, Prometheus
  • Strong computer science fundamentals: data structures, algorithms, and distributed systems

Nice to have

Experience with search engine database such as ElasticSearch is preferred

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior/Staff Data Engineer

8 matching positions

Senior/Staff Software Engineer - Data Platform

Perplexity is looking for experienced Data Platform Engineers to design, build, ...
Location
Location
United States , San Francisco, Seattle, New York City
Salary
Salary:
250000.00 - 385000.00 USD / Year
perplexity.ai Logo
Perplexity
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years (Senior) or 8+ years (Staff) of software engineering experience
  • Strong experience building production data infrastructure systems
  • Hands-on experience with batch and/or streaming data processing at scale
  • Deep familiarity with data orchestration systems (Airflow, Dagster, or similar)
  • Proficiency in Python and at least one additional backend language (Go, TypeScript, etc.)
  • Strong systems thinking: you understand tradeoffs across reliability, latency, cost, and complexity
  • Experience supporting ML/AI workflows, training pipelines, or evaluation systems
  • Familiarity with data quality, lineage, observability, and governance tooling
  • Prior ownership of internal platforms used by many teams
Job Responsibility
Job Responsibility
  • Design and operate large-scale batch and streaming data pipelines supporting product features, AI training/evaluation, analytics, and experimentation
  • Build and evolve event-driven and streaming systems (e.g., Kafka/Kinesis/PubSub-style architectures) for real-time ingestion, transformation, and delivery
  • Own batch processing frameworks for backfills, aggregations, and offline computation
  • Lead the design and operation of data orchestration systems (e.g., Airflow, Dagster, or equivalent), including scheduling, dependency management, retries, SLAs, and observability
  • Establish strong guarantees around data correctness, freshness, lineage, and recoverability
  • Design systems that handle scale, partial failure, and evolving schemas
  • Build self-serve data platforms that empower engineers, data scientists, and analysts to safely create and operate pipelines
  • Improve developer experience for data work through better abstractions, tooling, documentation, and paved paths
  • Set standards for data modeling, testing, validation, and deployment
  • Drive architectural decisions across data infrastructure for storage, compute, orchestration, and APIs
What we offer
What we offer
  • Equity
  • Health
  • Dental
  • Vision
  • Retirement
  • Fitness
  • Commuter and dependent care accounts
  • Fulltime
Read More
Arrow Right

Senior/Staff Engineer, Backend (Identity Platform)

You will own and evolve the core authentication infrastructure that secures ever...
Location
Location
Salary
Salary:
Not provided
phantom.app Logo
Phantom
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ Years of Backend Experience: Demonstrated success in building large-scale, high-availability systems in Node.js, TypeScript, Rust, NestJS (or similar frameworks)
  • Deep expertise in authentication protocols (OAuth2/OIDC, WebAuthn/Passkeys, OTP)
  • Strong background in key management services (e.g. AWS KMS, Vault) and cryptography
  • Web3/Crypto Knowledge: Familiarity with on-chain data, wallet integrations, or decentralized application patterns is strongly preferred
  • Strong System Design & Architecture Skills: Ability to translate product requirements into scalable, maintainable solutions, with a keen eye for performance trade-offs and fault tolerance
  • Leadership & Communication: Experience mentoring engineers, leading technical initiatives, and collaborating effectively with cross-functional teams
Job Responsibility
Job Responsibility
  • Authentication systems: Architect and ship production-grade improvements to Phantom’s Auth stack (e.g. secure enclaves, hardened token flows, threat modeling)
  • Passkey (WebAuthn) & MFA
  • Secrets management: Design and build systems using modern secrets management technologies to push security and functionality to the next level
  • APIs & Integration: Define and maintain stable, versioned auth APIs for downstream teams
  • Partner with cross-functional stakeholders to ensure seamless rollouts
What we offer
What we offer
  • Competitive salary and equity
  • Comprehensive insurance (medical/dental/vision) — 100% covered
  • Stipend for your ideal remote set-up
  • Flexible hours and a supportive remote environment
  • Unlimited vacation: Take time when you need it (and we really mean it!)
  • 401(k) retirement plan
  • Monthly wellness benefit
  • Weekly meal benefit
  • Global off-sites
  • Fulltime
Read More
Arrow Right

Senior/Staff Data Scientist, Infrastructure

Glean is building a world-class data organization spanning data science, applied...
Location
Location
United States , San Francisco Bay Area
Salary
Salary:
175000.00 - 250000.00 USD / Year
glean.com Logo
Glean
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in a highly quantitative data science role
  • Degree in Statistics, Mathematics, Computer Science, or a related field
  • Strong proficiency in SQL and Python
  • Experience working with modern data stacks (e.g., dbt, analytics engineering pipelines)
  • Experience analyzing nascent, complex datasets and translating them into clear, actionable insights
  • A strong product and business mindset, with experience defining KPIs, guardrail metrics, and dashboards that influence decisions
  • Solid grounding in statistics, including experimentation and non-experimental methods
  • Ability to independently own projects end-to-end, from problem framing to delivery
  • Clear, concise communication skills, with the ability to explain complex analyses to both technical and non-technical audience
Job Responsibility
Job Responsibility
  • Become a deep expert in Glean’s product telemetry, billing data, and platform systems, partnering closely with Product, Finance, and Infrastructure to self-serve insights
  • Develop and evolve metrics that capture enterprise readiness, deployment health, and time-to-value, from initial rollout to sustained adoption
  • Drive deployment and infrastructure cost optimization by analyzing usage patterns, workload drivers, and scaling behavior across customers
  • Partner with platform and infrastructure teams to model and optimize the economics of core systems such as connectors, indexing, and knowledge graph infrastructure, ensuring margins scale sustainably with usage growth
  • Support pricing, packaging, and monetization decisions through thoughtful analysis of usage, consumption, and cost drivers
  • Improve observability and data quality for billing and enterprise-critical workflows, identifying gaps and driving alignment across systems
  • Build analytics and models to support security and trust initiatives, including threat detection, abuse patterns, and monitoring for enterprise-critical products
  • Analyze and improve the cost efficiency of compute-intensive workflows (eg: mining and indexing), identifying trade-offs between product value, performance, and unit economics
  • Lead cross-functional data science projects end-to-end, translating ambiguous problems into clear, actionable insights
What we offer
What we offer
  • Medical, Vision, and Dental coverage
  • Generous time-off policy
  • Opportunity to contribute to your 401k plan
  • Home office improvement stipend
  • Annual education and wellness stipends
  • Vibrant company culture through regular events
  • Healthy lunches daily
  • Fulltime
Read More
Arrow Right

Senior/Staff Data Scientist

As a founding Data Scientist at Zip, you'll collaborate extensively with cross-f...
Location
Location
United States , San Francisco
Salary
Salary:
160000.00 - 220000.00 USD / Year
ziphq.com Logo
Zip
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-8 years of professional experience in roles such as Data Science, Data Engineering, Data Analysis, with a track record of building simple data pipelines and analyzing complex datasets to address business challenges
  • Bachelor’s degree in Mathematics, Statistics, Economics, Engineering, or a related technical field
  • Strong command of SQL and Python programming languages
  • Solid foundation in statistical methods and applications
  • Demonstrated skill in data visualization and translating insights into actionable recommendations that drive goal achievement
  • Exceptional project management capabilities with the ability to prioritize and deliver multiple initiatives while maintaining meticulous attention to detail
  • Excellent communication skills to effectively present findings and influence decisions
  • Adept at cross-functional collaboration to identify analytical challenges and implement solutions that combine technical excellence with data-driven insights
Job Responsibility
Job Responsibility
  • Collaborate extensively with cross-functional teams to provide the models, data products, and insights necessary for informed decision-making and sustainable growth
  • Leverage our comprehensive data resources to extract valuable insights, while working alongside leadership to transform business challenges into data-driven solutions
  • Developing metrics, building simple data pipelines, creating intuitive dashboards, and generating reports that drive business operations
  • Through thoughtful analysis and compelling data storytelling, deliver actionable recommendations that directly impact business outcomes
What we offer
What we offer
  • Start-up equity
  • Full health, vision & dental coverage
  • Catered lunches & dinners for SF employees
  • Commuter benefit
  • Team building events & happy hours
  • Flexible PTO
  • Apple equipment plus home office budget
  • 401k plan
  • Fulltime
Read More
Arrow Right

Senior/Staff Software Engineer, Search & Retrieval Infrastructure

We are hiring a senior/staff software engineer to help design and build core com...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
pinecone.io Logo
Pinecone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Systems Expertise: Architectural Depth: You have a proven track record (typically 6+ years) of shipping production-grade backends for large-scale systems
  • Systems Expertise: Data Engineering Savvy: You’re comfortable building high-throughput indexing pipelines that handle both the messy world of unstructured data and the rigid world of structured schemas
  • AI & Retrieval: Retrieval Intuition: You understand that search is more than just a keyword match. You have direct experience (or deep theoretical knowledge) in semantic search, vector databases, hybrid retrieval strategies, or with traditional search engines like Elastic or OpenSearch
  • AI & Retrieval: RAG & Orchestration: You understand the nuances of Retrieval-Augmented Generation (RAG) patterns, from embedding pipelines and hybrid search techniques to how query planning and metadata filtering can make or break an LLM's performance
  • Technical: Language Fluency: You are an expert in at least one major language like Go, Rust, C++, Java, or Python
  • Technical: Infrastructure: Familiarity and experience with modern infrastructure tools, such as Kubernetes, cloud-native architectures, and observability frameworks, as well as infrastructure-as-code tools like Terraform or Pulumi
  • Ownership & Impact: Product Thinking: You don't just build to spec
  • you build for the user. You can design clean, intuitive APIs that both human developers and autonomous agents will love
  • Ownership & Impact: Ambiguity Navigator: You’re comfortable in a high-growth environment. You prefer owning a problem over executing a ticket
Job Responsibility
Job Responsibility
  • Design and build scalable platform components leveraging advanced retrieval via query planning, semantic and hybrid search, metadata-aware search, and LLM generation
  • Design and build optimized indexing pipelines for structured and unstructured data
  • Build backend services for semantic and hybrid retrieval, knowledge graph construction, and retrieval orchestration
  • Improve retrieval quality through evaluation and observability frameworks
  • Design APIs for internal and external user and agentic consumers
  • Optimize latency, throughput and cost across large-scale inference and retrieval workloads
  • Drive technical direction for reliability and security
  • Fulltime
Read More
Arrow Right

Senior/Staff Backend Engineer

BlueCargo is a fast-growing, VC-backed technology company transforming the logis...
Location
Location
United States , New York, NY; Culver City, CA
Salary
Salary:
160000.00 - 220000.00 USD / Year
helpcare.ai Logo
Helpcare AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in a software development environment
  • 5+ years of Python engineering experience, developing and deploying software using Agile methodologies
  • Proven ability to work independently with minimal supervision and oversee complex tasks while prioritizing multiple projects based on strategic goals
  • Interest or experience in logistics and/or supply chain management
  • Startup experience
  • Experience with large-scale systems
  • Experience working on cloud infrastructure, especially AWS
Job Responsibility
Job Responsibility
  • Collaborating with various internal stakeholders including product managers, designers, data scientists, and other software engineers
  • Translating product requirements and technical designs into well-engineered, low-defect, robust code
  • Researching new technologies and methodologies to improve the architecture, software components, user experience, and development processes
  • Performing extensive unit testing, system testing, and regression testing to ensure reliability and efficiency
What we offer
What we offer
  • flexible and international environment
  • Support/Community: Enjoy being a member of a Y Combinator company!
  • Fulltime
Read More
Arrow Right

Senior/Staff Software Engineer

As a Senior/Staff Software Engineer, you are expected to act as a tech lead in y...
Location
Location
Türkiye , İstanbul
Salary
Salary:
Not provided
invent.ai Logo
invent.ai
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years overall professional web application development experience (preferably with Node.js)
  • Demonstrated strong hands-on technical skills
  • actively involved in coding and capable of solving complex architectural challenges directly
  • Experience in designing scalable, high-performance, data-intensive system architectures
  • Good knowledge of OOP, design patterns, asynchronous programming, microservices, concurrency, and transactions
  • At least 2-year production experience in working with various Javascript libraries - Express (preferred), Hapi, Sails, Nest etc.
  • Excellent knowledge of contemporary Javascript (ES6+)
  • Familiarity with relational and non-relational databases, key-value stores and search engines (PostgreSQL, Microsoft SQL Server, MongoDB, Redis, Elasticsearch etc)
  • Strong communication skills
Job Responsibility
Job Responsibility
  • Architect, lead, design, develop, and evolve high-performance APIs and microservices that handle complex data at scale
  • Be an active participant in our technical strategy and roadmap decisions, implement new designs and improve the architecture in our current and new products
  • Working with the front-end developers to ensure that the required data flow is well designed
  • Helping the current engineering processes by code reviews, mentorship, applying best practices etc.
  • Analyze the impact of features, hypothesize and implement new solutions
What we offer
What we offer
  • We provide monthly fixed contribution to internet bill and fun packets (Netflix, Amazon Prime etc.)
  • We care about your health and support it with comprehensive private health insurance
  • We support your career growth with Udemy, Medium, HBR and other learning tools
  • At Invent.ai, you have extra off days for different occasions (birthday, moving day, maternity & paternity leaves etc.)
  • Great people make the perfect match: We have a powerful referral bonus for the friend you refer, bring to buddy!
  • Work hard, play harder, unlimited fun at work: All-day snacks at the office, team activities, social club meetings, annual retreats, monthly happy Friday drinks and other celebrations. Also, we love gaming and so have a Game Master at Invent! (We really mean it when we say we love it!)
  • At Invent.ai we celebrate and reward our successful teammates who have won awards in arts and sports!
  • We care about social responsibility and that's why we have a community! Invent.ai gives you the opportunity to make a real difference in people's lives. Our Invent Social Responsibility Club works for educational scholarships and donations, supports young talents by sponsoring them, raises money by running on behalf of non-governmental organizations in marathons etc.
  • We believe that we will be more productive when we achieve our work-life balance. We support the Invent social clubs for their hobbies
  • painting, tennis, football and more!
  • Fulltime
Read More
Arrow Right

Senior/Staff Software Engineer (Backend), Growth

Our Growth Team sits at the heart of Airwallex’s mission, focusing on user acqui...
Location
Location
United States , San Francisco
Salary
Salary:
140000.00 - 230000.00 USD / Year
airwallex.com Logo
Airwallex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor degree or above in computer science or engineering related majors
  • 5+ years of experience in modern engineering practices focused on continuous integration and quality engineering
  • Strong computer science fundamentals, solid understanding of OOP concepts
  • Experience domain driven design and event driven architectures
  • Deep working experience with high throughput / low latency / high available distributed systems
  • Cloud experience with GCP (preferred) or AWS (EC2, RDS, ELB, CloudFront, etc.) with Docker and Kubernetes
  • Familiarity with observability tooling such as Splunk, Grafana, and Prometheus
Job Responsibility
Job Responsibility
  • Design and Build Scalable Systems
  • Enable Data-Driven Decisions
  • Collaborate and Innovate
  • Experiment and Iterate
  • Promote Security & Compliance
What we offer
What we offer
  • medical, dental, and vision insurance
  • a 401(k) plan
  • short-term and long-term disability
  • basic life insurance
  • well-being benefits
  • 20 paid days of vacation
  • 12 paid days of company holidays
  • Fulltime
Read More
Arrow Right