CrawlJobs Logo

Senior Software Engineer, Data Ingestion

United States, Atlanta Employment contract 160000.00 - 180000.00 USD / Year · Job Posted May 30, 2026
Apply Position
Job Link Share

Job Description

Fullstory’s mission is to help teams create amazing online experiences for their users. We do this by applying deep expertise in distributed systems and computer science to build an ambitiously high-scale and high-value platform. The scale at which Fullstory ingests, processes, and persists data makes our systems uniquely challenging to design and operate. Our Data Ingestion services are responsible for processing hundreds of thousands of browser and mobile application event bundles every second and quickly transforming this data into easily consumable activity for machines and humans alike. As a Senior Software Engineer focused on our ingestion pipeline, you will be working on evolving our highly reliable, secure, performant, and cost efficient foundation for the capture and processing of session data. This data feeds both the product analytics features in our own application as well as data analytics and machine learning systems, where streaming accurate data as it is being captured can power further insights and interactivity for our customers.

Job Responsibility

  • Engineer distributed systems that operate at tens to hundreds of thousands of requests per second using Go, Kubernetes, and GCP
  • Explore ideas about how to unlock new features through thoughtful architecture and framework designs
  • Ensure the quality and reliability of Fullstory's capture and extraction systems across many services and downstream applications both internally and externally
  • Collaborate with technical leaders and product experts to evolve the technical roadmap for Ingestion services, and to participate in collaborative development efforts across the Engineering organization

Requirements

  • You possess a strong understanding the nuances of distributed architectures and tackling capacity and performance challenges when dealing with data at scale
  • You have experience writing Golang code in production
  • You have experience with Kubernetes and supporting highly available and reliable cloud based microservices in production
  • You have worked on asynchronous or streaming ingestion and processing systems and frameworks
  • You leverage AI tools to enhance work quality by implementing AI solutions that optimize efficiency

What we offer

  • Flexibility and Connection
  • flexible PTO policy
  • annual company-wide closure
  • federal holidays
  • sponsored benefit packages for US-based Fullstorians
  • supplemental coverage options for international Fullstorians
  • professional development opportunities through training programs
  • annual learning subsidy for US and EMEA-based employees
  • monthly productivity stipend
  • team off-sites
  • annual full-company meet-up
  • paid parental leave
  • bereavement leave, including miscarriage/pregnancy loss

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Software Engineer, Data Ingestion

8 matching positions

Senior Data Engineer

Senior Data Engineer to design, develop, and optimize data platforms, pipelines,...
Location
Location
United States , Chicago
Salary
Salary:
160555.00 - 176610.00 USD / Year
adtalem.com Logo
Adtalem Global Education
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's degree in Engineering Management, Software Engineering, Computer Science, or a related technical field
  • 3 years of experience in data engineering
  • Experience building data platforms and pipelines
  • Experience with AWS, GCP or Azure
  • Experience with SQL and Python for data manipulation, transformation, and automation
  • Experience with Apache Airflow for workflow orchestration
  • Experience with data governance, data quality, data lineage and metadata management
  • Experience with real-time data ingestion tools including Pub/Sub, Kafka, or Spark
  • Experience with CI/CD pipelines for continuous deployment and delivery of data products
  • Experience maintaining technical records and system designs
Job Responsibility
Job Responsibility
  • Design, develop, and optimize data platforms, pipelines, and governance frameworks
  • Enhance business intelligence, analytics, and AI capabilities
  • Ensure accurate data flows and push data-driven decision-making across teams
  • Write product-grade performant code for data extraction, transformations, and loading (ETL) using SQL/Python
  • Manage workflows and scheduling using Apache Airflow and build custom operators for data ETL
  • Build, deploy and maintain both inbound and outbound data pipelines to integrate diverse data sources
  • Develop and manage CI/CD pipelines to support continuous deployment of data products
  • Utilize Google Cloud Platform (GCP) tools, including BigQuery, Composer, GCS, DataStream, and Dataflow, for building scalable data systems
  • Implement real-time data ingestion solutions using GCP Pub/Sub, Kafka, or Spark
  • Develop and expose REST APIs for sharing data across teams
What we offer
What we offer
  • Health, dental, vision, life and disability insurance
  • 401k Retirement Program + 6% employer match
  • Participation in Adtalem’s Flexible Time Off (FTO) Policy
  • 12 Paid Holidays
  • Annual incentive program
  • Fulltime
Read More
Arrow Right

Senior Backend Engineer - Data Ingestion

The ClickPipes Platform plays a critical role in driving the growth of our compa...
Location
Location
Canada
Salary
Salary:
Not provided
clickhouse.com Logo
ClickHouse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant software development industry experience building data-intensive software solutions
  • Strong knowledge of Golang and experience with its ecosystem
  • Experience with distributed systems and microservices architecture
  • The ability to design and build robust ETL data pipelines that can handle large volumes of data reliably and efficiently
  • Understanding data replication methodologies like CDC
  • Good knowledge of cloud-native architecture and practical experience with at least one major CSP
  • You have excellent communication skills and the ability to work well within a team and across engineering teams
  • You are a strong problem solver and have solid production debugging skills
Job Responsibility
Job Responsibility
  • Develop and enhance integrations with various data sources including streaming platforms, databases, data lakes, and object stores
  • Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements
  • Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience
  • Participate in on-call rotations to ensure system reliability and respond to production incidents
What we offer
What we offer
  • Flexible work environment
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company - Every new team member who joins our company receives stock options
  • Time off - Flexible time off in the US, generous entitlement in other countries
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings – We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites
Read More
Arrow Right

Senior Backend Engineer - Data Ingestion

The ClickPipes Platform plays a critical role in driving the growth of our compa...
Location
Location
Spain
Salary
Salary:
Not provided
clickhouse.com Logo
ClickHouse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant software development industry experience building data-intensive software solutions
  • Strong knowledge of Golang and experience with its ecosystem
  • Experience with distributed systems and microservices architecture
  • The ability to design and build robust ETL data pipelines that can handle large volumes of data reliably and efficiently
  • Understanding data replication methodologies like CDC
  • Good knowledge of cloud-native architecture and practical experience with at least one major CSP
  • Excellent communication skills and the ability to work well within a team and across engineering teams
  • Strong problem solver and have solid production debugging skills
Job Responsibility
Job Responsibility
  • Develop and enhance integrations with various data sources including streaming platforms, databases, data lakes, and object stores
  • Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements
  • Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience
  • Participate in on-call rotations to ensure system reliability and respond to production incidents
What we offer
What we offer
  • Flexible work environment
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company - Every new team member who joins our company receives stock options
  • Time off - Flexible time off in the US, generous entitlement in other countries
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings – opportunities to engage with colleagues at company-wide offsites
Read More
Arrow Right

Senior Backend Engineer- Data Ingestion - (ClickPipes Platform)

The ClickPipes Platform plays a critical role in driving the growth of our compa...
Location
Location
United States
Salary
Salary:
133450.00 - 197200.00 USD / Year
clickhouse.com Logo
ClickHouse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant software development industry experience building data-intensive software solutions
  • Strong knowledge of Golang and experience with its ecosystem
  • Experience with distributed systems and microservices architecture
  • The ability to design and build robust ETL data pipelines that can handle large volumes of data reliably and efficiently
  • Understanding data replication methodologies like CDC
  • Good knowledge of cloud-native architecture and practical experience with at least one major CSP
  • You have excellent communication skills and the ability to work well within a team and across engineering teams
  • You are a strong problem solver and have solid production debugging skills
Job Responsibility
Job Responsibility
  • Develop and enhance integrations with various data sources including streaming platforms, databases, data lakes, and object stores
  • Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements
  • Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience
  • Participate in on-call rotations to ensure system reliability and respond to production incidents
What we offer
What we offer
  • Flexible work environment - ClickHouse is a globally distributed company and remote-friendly
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company - Every new team member who joins our company receives stock options
  • Time off - Flexible time off in the US, generous entitlement in other countries
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings – We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

Flanks is shaking up the wealth management industry by making it simpler and way...
Location
Location
Spain , Barcelona
Salary
Salary:
50000.00 - 80000.00 EUR / Year
flanks.io Logo
Flanks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 7 years on an Engineer Software role
  • Autonomous coder
  • You know your way around collaborating with others using standard tooling (git, github PR's, etc)
  • You are a good communicator who knows how to express problems, solutions and trade-offs
  • You know how to read and understand job offers
  • Focused: You know how to read between the lines and prioritize what matters most
  • You can work with both legacy and greenfield code
  • You take ownership of problems
  • You live in Spain and are close enough to Barcelona to commute to the office once a month by your own means
  • You’re fluent in English and Spanish
Job Responsibility
Job Responsibility
  • Build seamless user interfaces for secure credential storage
  • Handle sensitive financial data with performance, compliance, and traceability in mind
  • Scale our ingestion system to fetch more data, faster
  • Mentor and grow the team, ensuring alignment and consistency as we expand
  • Coding, collaborating, and delivering impactful solutions—not just merging code but owning it beyond deployment
What we offer
What we offer
  • A cool office between Sants Estació and Plaça Espanya with stunning views of Barcelona
  • Flexible working hours and hybrid work options
  • Paid day off on your birthday
  • Weekly fresh fruit, coffee, and tea on tap
  • Friday happy hours after our all-hands meetings
  • Team-building events to bond and have fun
  • Health insurance and flexible compensation with Alan
  • A digital canteen, thanks to Nora Real Food, subsidised at 50%
  • A yearly training budget to keep growing
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Controls

As a Senior Software Engineer on our controls team, you will deliver mission-cri...
Location
Location
United States , Santa Clara
Salary
Salary:
150000.00 - 200000.00 USD / Year
plus.ai Logo
PlusAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's or PhD degree in Mechanical Engineering, Robotics, Aerospace Engineering, Computer Science, or related field
  • 2+ years of MLE experience or industry experience designing and developing for robotics applications
  • Strong foundation in motion control and modern neural network architectures, with expertise in at least one application area, such as IL/RL, time-series analysis, or dynamic system modeling
  • Skilled in debugging robotic systems within Linux environments, with strong programming expertise in Python and C++
  • Experience in model development & training with modern frameworks (e.g. PyTorch)
  • Hands-on familiarity with data ingestion and processing pipelines
Job Responsibility
Job Responsibility
  • Design, implement, and enhance control algorithms by developing frameworks that integrate MPC with learning based approaches (DL/RL/IL)
  • Responsible for the conceptual design and implementation of data driven controller by working cross-functionally with domain experts and other stakeholders by specifying meaningful insights for solving trajectory tracking problems
  • Develop tools and infrastructure for dataset generation, training, and evaluation to drive advancements in online control optimization
  • Ensure all model development keeps a real-time focus and operates efficiently in compute-constrained environments
  • Take a lead role in the planning and execution of vehicle testing in the offline simulation environment and on public roads to systematically improve performance, as well as performing root cause analysis and debugging to address any issues
  • Track and incorporate the latest multidisciplinary research advancements in a fast-moving field
  • Ensure that your work is performed in accordance with the company’s Quality Management System (QMS) requirements and contribute to continuous improvement efforts
  • Ensure team compliance with QMS, monitor quality, and drive process improvements
What we offer
What we offer
  • Work, learn and grow in a highly future-oriented, innovative and dynamic field
  • Wide range of opportunities for personal and professional development
  • Catered free lunch, unlimited snacks and beverages
  • Highly competitive salary and benefits package, including 401(k) plan
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Core Data

As a Senior Software Engineer on our Core Data team, you will take a leading rol...
Location
Location
United States
Salary
Salary:
190000.00 - 220000.00 USD / Year
pomelocare.com Logo
Pomelo Care
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience building high-quality, scalable data systems and pipelines
  • Expert-level proficiency in SQL and Python, with a deep understanding of data modeling and transformation best practices
  • Hands-on experience with dbt for data transformation and Dagster, Beam, Dataflow or similar tools for pipeline orchestration
  • Experience with modern data stack tools and cloud platforms, with a strong understanding of data warehouse design principles
  • A track record of delivering elegant and maintainable solutions to complex data problems that drive real business impact
Job Responsibility
Job Responsibility
  • Build and maintain elegant data pipelines that orchestrate ingestion from diverse sources and normalize data for company-wide consumption
  • Lead the design and development of robust, scalable data infrastructure that enables our clinical and product teams to make data-driven decisions, using dbt, Dagster, Beam and Dataflow
  • Write clean, performant SQL and Python to transform raw data into actionable insights that power our platform
  • Architect data models and transformations that support both operational analytics and new data-driven product features
  • Mentor other engineers, providing technical guidance on data engineering best practices and thoughtful code reviews, fostering a culture of data excellence
  • Collaborate with product, clinical and analytics teams to understand data needs and ensure we are building infrastructure that unlocks the most impactful insights
  • Optimize data processing workflows for performance, reliability and cost-effectiveness
What we offer
What we offer
  • Competitive healthcare benefits
  • Generous equity compensation
  • Unlimited vacation
  • Membership in the First Round Network (a curated and confidential community with events, guides, thousands of Q&A questions, and opportunities for 1-1 mentorship)
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Radix is building the most trusted data and analytics platform in multifamily. J...
Location
Location
United States , Scottsdale
Salary
Salary:
Not provided
radix.com Logo
Radix (AZ)
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering or backend systems, with 2+ years collaborating closely with analytical or scientific practitioners
  • Experience designing at least one end-to-end data application (visualization, model pipeline, etc.) for production use
  • Strong understanding of data modeling, batch processing, and streaming systems
  • Hands-on experience with SQL/NoSQL databases, cloud storage, file-based datasets, and Infrastructure-as-code
  • Experience building or operating data pipelines on AWS cloud services (Lambda, S3, RDS, ECS)
  • Understanding of AI/LLM integration and prompt engineering fundamentals
  • Proficiency with Git/GitHub, and familiarity with Spark and Kubernetes
  • Strong problem-solving skills, ownership, and ability to identify root causes of technical debt and recurring problems
  • Demonstrated ability to translate Product/Science requirements into technical plans and hold teams accountable to delivery timelines
  • Undergraduate degree in computer science, computer engineering, software engineering, or equivalent
Job Responsibility
Job Responsibility
  • Build scalable ETL/ELT pipelines for ingesting structured and unstructured data (Excel, JSON, PDFs, APIs)
  • Design and maintain data pipelines using SQL, Python, Node.js, or TypeScript
  • Work with distributed compute systems (Spark, Kubernetes), message queues, and streaming data
  • Manage and optimize data storage in MongoDB, PostgreSQL, Redis, Snowflake, and S3
  • Develop clean, standardized data schemas and event-driven transformations
  • Integrate AI-assisted parsers, mappers, and LLM-supported transformations
  • Collaborate with backend, analytics, product, and AI teams to break down requirements into well-defined engineering problems
  • Implement monitoring, data validation, and reliability checks (DQ rules, freshness, duplication)
  • Own production readiness, including on-call responsibilities and incident follow-ups
  • Mentor engineers, conduct thorough code reviews, and introduce patterns that raise the team's technical bar
What we offer
What we offer
  • Medical, dental and vision coverage designed to support your wellbeing
  • Pre-IPO Equity
  • Performance Bonus
  • Learn From the Best
  • Build Category-Defining Products
Read More
Arrow Right