CrawlJobs Logo
Clear Street Logo Clear Street · IT - Software Development

Software Engineer - Market Data

United States, New York 200000.00 - 250000.00 USD / Year · Job Posted December 07, 2025
Apply Position
Job Link Share

Job Description

We are looking for a skilled and experienced Software Engineer to join our team, building high-performance real-time data pipelines to process financial market data, including security prices for various asset classes such as equities, options, futures, and more. You will play a key role in designing, developing, and optimizing data pipelines that handle large volumes of data with low latency and high throughput, ensuring that our systems can process and deliver market data in real time.

Job Responsibility

  • Design, develop, and maintain real-time data pipelines to handle financial market data with low latency and high throughput in a resilient manner
  • Work with various asset classes such as equities, options, futures, and other financial instruments to ensure timely and accurate data processing
  • Collaborate with product, trading, and risk teams to understand requirements and deliver high-quality solutions that meet business needs
  • Develop efficient mechanisms for integrating market data feeds from exchanges and other sources into our systems
  • Troubleshoot and resolve performance issues, data discrepancies, and ensure data integrity across the pipeline
  • Continuously monitor the performance and health of data pipelines, identifying and mitigating potential issues before they impact system performance

Requirements

  • At least 8+ years of professional experience implementing low-latency, high-throughput data pipelines
  • Solid understanding of distributed systems and the challenges involved in real-time data pipelines (e.g., data consistency, fault tolerance, scalability)
  • Familiarity with financial market data, including security prices, and asset classes like equities, options, futures, etc...
  • Strong familiarity with Linux/BSD
  • Familiarity with TCP/IP and UDP (Unicast/Multicast) networking
  • You communicate technical ideas with ease and always look to collaborate to deliver high quality products
  • You are a team player, with experience working effectively with other engineers toward common goals

Nice to have

  • Experience with system profiling with eBPF
  • Experience with columnar storage and database systems
  • Kernel bypass networking (DPDK or XDP)
  • Provisioning and configuration of routing in the cloud or on-premise, including BGP, VPCs, network peering
  • Experience with Aeron

What we offer

  • Competitive compensation packages
  • Company equity
  • 401k matching
  • Gender neutral parental leave
  • Full medical, dental and vision insurance
  • Lunch stipends
  • Fully stocked kitchens
  • Happy hours
  • A great location
  • Amazing views
Clear Street - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Software Engineer - Market Data

8 matching positions

C++ Senior Engineer - Market Data

As a Senior Engineer on the Market Data team, you will play a pivotal role in en...
Location
Location
United States , Chicago; New York
Salary
Salary:
225000.00 - 250000.00 USD / Year
chicagotrading.com Logo
Chicago Trading Company
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A minimum of 5 years of experience working in a production environment using modern C++
  • Experience with low-latency feed handler development, market data protocols (e.g. MDP3, ITCH)
  • Deep knowledge of low level systems programming, optimization, and hardware/software co-design
  • Strong fundamentals in computer architecture and networking protocols
  • Experience writing multithreaded and distributed systems with an affinity for delivering clean, performant code
  • Ability to quickly triage issues and drive the resolution effort through completion
Job Responsibility
Job Responsibility
  • Design and build high-performance, low-latency libraries and services that power our global trading platform
  • Work closely with traders, quants and technologists to drive ideas from inception to production in a timely and robust manner
  • Partner closely with other teams such as execution, low-latency and hardware to design and deliver solutions for our next-generation market data platform
  • Ensure operational safety and uphold the highest standards of software engineering by thoroughly testing code, following a coherent and maintainable design and architecture, and adhering to best practices—prioritizing carefully planned, well-structured solutions over ad hoc implementations
What we offer
What we offer
  • Generous time off
  • Insurance coverage
  • Paid parental leave
  • Free breakfast and lunch
  • Healthy snacks
  • Wellness reimbursement
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data

Patreon is looking for a Senior Software Engineer, Data to support our mission. ...
Location
Location
United States , San Francisco; New York
Salary
Salary:
200000.00 - 300000.00 USD / Year
patreon.com Logo
Patreon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in software development
  • At least 2+ years of experience in building scalable, production-grade data pipelines
  • Familiarity with SQL and distributed data processing tools like Spark, Flink, Kafka Streams, or similar
  • Strong programming foundations in Python or similar language, with good software engineering design patterns and principles (testing, CI/CD, monitoring)
  • Familiar with modern data lakes (eg: Delta Lake, Iceberg)
  • Familiar with data warehouses (eg: Snowflake, Redshift, BigQuery) and production data stores such as relational (eg: MySQL, PostgreSQL), object (eg: S3), key-value (eg: DynamoDB) and message queues (eg: Kinesis, Kafka)
  • Excellent collaboration and communication skills
  • comfortable partnering with non-technical stakeholders, writing crisp design docs, giving actionable feedback, and can influence without authority across teams
  • Understanding of data modeling and metric design principles
  • Passionate about data quality, system reliability, and empowering others through well-crafted data assets
Job Responsibility
Job Responsibility
  • Design, build, and maintain the pipelines that power all data use cases. This includes ingestion of raw data from production databases, object storage, and message queues, and vendors into our Data Lake, and building core datasets and metrics
  • Develop intuitive, performant, and scalable data models (facts, dimensions, aggregations) that support product features, internal analytics, experimentation, and machine learning workloads
  • Implement robust batch and streaming pipelines using Spark, Python, and Airflow
  • Build pipelines adhering to standards for accuracy, completeness, lineage, and dependency management. Build monitoring and observability so teams can trust what they’re using
  • Work with Product, Data Science, Infrastructure, Finance, Marketing, and Sales to turn ambiguous questions into well-scoped, high-impact data solutions
  • Pay down technical debt, improve automation, and follow best practices in data modeling, testing, and reliability. Mentor peers earlier in their career within the team
What we offer
What we offer
  • Equity plans
  • Healthcare
  • Flexible time off
  • Company holidays and recharge days
  • Commuter benefits
  • Lifestyle stipends
  • Learning and development stipends
  • Patronage
  • Parental leave
  • 401k plan with matching
  • Fulltime
Read More
Arrow Right

Staff Software Engineer, Data

Patreon is looking for a Staff Software Engineer to support our mission. The Dat...
Location
Location
United States , San Francisco; New York
Salary
Salary:
246400.00 - 369600.00 USD / Year
patreon.com Logo
Patreon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of experience in software development
  • At least 2+ years of experience in building scalable, production-grade data pipelines
  • Expert-level proficiency in SQL and distributed data processing tools like Spark, Flink, Kafka Streams, or similar
  • Strong programming foundations in Python or similar language, with good software engineering design patterns and principles (testing, CI/CD, monitoring)
  • Expert in modern data lakes (eg: Delta Lake, Iceberg)
  • Familiar with data warehouses (eg: Snowflake, Redshift, BigQuery) and production data stores such as relational (eg: MySQL, PostgreSQL), object (eg: S3), key-value (eg: DynamoDB) and message queues (eg: Kinesis, Kafka)
  • Excellent collaboration and communication skills
  • Understanding of data modeling and metric design principles
  • Passionate about data quality, system reliability, and empowering others through well-crafted data assets
  • Highly motivated self-starter who thrives in a collaborative, fast-paced environment and takes pride in high-craft, high-impact work
Job Responsibility
Job Responsibility
  • Design, build, and maintain the pipelines that power all data use cases
  • Develop intuitive, performant, and scalable data models (facts, dimensions, aggregations) that support product features, internal analytics, experimentation, and machine learning workloads
  • Implement robust batch and streaming pipelines using Spark, Python, and Airflow
  • Define and enforce standards for accuracy, completeness, lineage, and dependency management
  • Work with Product, Data Science, Infrastructure, Finance, Marketing, and Sales to turn ambiguous questions into well-scoped, high-impact data solutions
  • Pay down technical debt, improve automation, and drive best practices in data modeling, testing, and reliability
  • Mentor peers and help shape the future of Patreon’s data
What we offer
What we offer
  • Equity plans
  • Healthcare
  • Flexible time off
  • Company holidays and recharge days
  • Commuter benefits
  • Lifestyle stipends
  • Learning and development stipends
  • Patronage
  • Parental leave
  • 401k plan with matching
  • Fulltime
Read More
Arrow Right

Staff Software Engineer, Data Infrastructure

At Docker, we make app development easier so developers can focus on what matter...
Location
Location
United States , Seattle
Salary
Salary:
195400.00 - 275550.00 USD / Year
docker.com Logo
Docker
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of software engineering experience with 3+ years focused on data engineering and analytics systems
  • Expert-level experience with Snowflake including advanced SQL, performance optimization, and cost management
  • Deep proficiency in DBT for data modeling, transformation, and testing with experience in large-scale implementations
  • Strong expertise with Apache Airflow for complex workflow orchestration and pipeline management
  • Hands-on experience with Sigma or similar modern BI platforms for self-service analytics
  • Extensive AWS experience including data services (S3, Redshift, EMR, Glue, Lambda, Kinesis) and infrastructure management
  • Proficiency in Python, SQL, and other programming languages commonly used in data engineering
  • Experience with infrastructure-as-code, CI/CD practices, and modern DevOps tools
  • Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience
  • Proven track record designing and implementing large-scale distributed data systems
Job Responsibility
Job Responsibility
  • Define and drive the technical strategy for Docker's data platform architecture, establishing long-term vision for scalable data systems
  • Lead design and implementation of highly scalable data infrastructure leveraging Snowflake, AWS, Airflow, DBT, and Sigma
  • Architect end-to-end data pipelines supporting real-time and batch analytics across Docker's product ecosystem
  • Drive technical decision-making around data platform technologies, architectural patterns, and engineering best practices
  • Establish technical standards for data quality, testing, monitoring, and operational excellence
  • Design and build robust, scalable data systems that process petabytes of data and support millions of user interactions
  • Implement complex data transformations and modeling using DBT for analytics and business intelligence use cases
  • Develop and maintain sophisticated data orchestration workflows using Apache Airflow
  • Optimize Snowflake performance and cost efficiency while ensuring reliability and scalability
  • Build data APIs and services that enable self-service analytics and integration with downstream systems
What we offer
What we offer
  • Freedom & flexibility
  • fit your work around your life
  • Designated quarterly Whaleness Days plus end of year Whaleness break
  • Home office setup
  • we want you comfortable while you work
  • 16 weeks of paid Parental leave
  • Technology stipend equivalent to $100 net/month
  • PTO plan that encourages you to take time to do the things you enjoy
  • Training stipend for conferences, courses and classes
  • Equity
  • Fulltime
Read More
Arrow Right

Software Engineer, Data Platform

Profound is on a mission to help companies understand and control their AI prese...
Location
Location
United States , New York City
Salary
Salary:
140000.00 - 260000.00 USD / Year
tryprofound.com Logo
Profound
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience building platforms for engineers and data scientists in areas such as product analytics and experimentation, data discovery and catalog, data quality and observability, or governance and access control
  • Experience designing and operating large-scale distributed data systems
  • Expertise with analytics and lakehouse technologies including ClickHouse, Tinybird, Snowflake, or Iceberg
  • Strong cloud experience with AWS, GCP, or Azure
  • Experience with data governance, reliability, and secure data operations
  • Excellent communication skills with the ability to influence across engineering and product teams
  • Experience with or interest in MLOps and supporting machine learning workflows in production
  • Strong problem-solving skills and comfort operating in a fast-paced, impact-driven environment
  • Motivated by access to rare and interesting AI data based on real human interactions with large language models
  • Excited by the opportunity to own and shape Profound’s data platform at an early stage
Job Responsibility
Job Responsibility
  • Design and build platform infrastructure that supports machine learning, analytics, and software engineers, as well as data scientists across the company
  • Develop tools and frameworks for data ingestion, transformation, quality, and observability
  • Architect scalable, reliable systems using Snowflake, Clickhouse, AWS, dbt, and Dagster
  • Build governance, access control, and data quality systems that scale with the organization
  • Enable MLOps by creating infrastructure that supports model development and productionization
  • Drive technical decisions around platform architecture, tool selection, and data patterns
  • Collaborate with product, engineering, and data teams to understand needs and deliver impactful solutions
What we offer
What we offer
  • equity
  • a full range of benefits and perks
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data Engineering

Senior Software Engineer (Contract) – Market Data. A leading global investment m...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
rmgdigital.io Logo
rmg digital
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong commercial experience in Java (essential)
  • Solid Python development experience
  • Background in market data, trading systems, or low-latency / high-performance platforms (highly desirable)
  • Experience working with large-scale, real-time data systems
  • Comfortable operating in fast-paced, high-stakes environments
Job Responsibility
Job Responsibility
  • Design, build and optimise components of a high-throughput market data platform
  • Work across Java (primary) and Python in a performance-critical environment
  • Improve and modernise older parts of the stack with a focus on scalability and latency
  • Partner closely with Data Management teams and Quant Traders within the systematic trading business
  • Contribute to the ongoing expansion of a specialist market data engineering function
  • Fulltime
Read More
Arrow Right

Software Engineer - Data Engineering

Akuna Capital is a leading proprietary trading firm specializing in options mark...
Location
Location
United States , Chicago
Salary
Salary:
130000.00 USD / Year
akunacapital.com Logo
AKUNA CAPITAL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS/MS/PhD in Computer Science, Engineering, Physics, Math, or equivalent technical field
  • 5+ years of professional experience developing software applications
  • Java/Scala experience required
  • Highly motivated and willing to take ownership of high-impact projects upon arrival
  • Prior hands-on experience with data platforms and technologies such as Delta Lake, Spark, Kubernetes, Kafka, ClickHouse, and/or Presto/Trino
  • Experience building large-scale batch and streaming pipelines with strict SLA and data quality requirements
  • Must possess excellent communication, analytical, and problem-solving skills
  • Recent hands-on experience with AWS Cloud development, deployment and monitoring necessary
  • Demonstrated experience working on an Agile team employing software engineering best practices, such as GitOps and CI/CD, to deliver complex software projects
  • The ability to react quickly and accurately to rapidly changing market conditions, including the ability to quickly and accurately respond and/or solve math and coding problems are essential functions of the role
Job Responsibility
Job Responsibility
  • Work within a growing Data Engineering division supporting the strategic role of data at Akuna
  • Drive the ongoing design and expansion of our data platform across a wide variety of data sources, supporting an array of streaming, operational and research workflows
  • Work closely with Trading, Quant, Technology & Business Operations teams throughout the firm to identify how data is produced and consumed, helping to define and deliver high impact projects
  • Build and deploy batch and streaming pipelines to collect and transform our rapidly growing Big Data set within our hybrid cloud architecture utilizing Kubernetes/EKS, Kafka/MSK and Databricks/Spark
  • Mentor junior engineers in software and data engineering best practices
  • Produce clean, well-tested, and documented code with a clear design to support mission critical applications
  • Build automated data validation test suites that ensure that data is processed and published in accordance with well-defined Service Level Agreements (SLA’s) pertaining to data quality, data availability and data correctness
  • Challenge the status quo and help push our organization forward, as we grow beyond the limits of our current tech stack
What we offer
What we offer
  • Discretionary performance bonus
  • Comprehensive benefits package that may encompass employer-paid medical, dental, vision, retirement contributions, paid time off, and other benefits
  • Fulltime
Read More
Arrow Right

Software Engineer, Market Making

As a Software Engineer on our Cryptocurrency Trading Platform, you will take on ...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
blockchain.com Logo
Blockchain
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience in Rust and/or C++, building high-performance, low-latency systems in complex environments such as cryptocurrency trading or financial services
  • Strong background in trading (ideally cryptocurrency trading), with experience in market-making, arbitrage strategies, and order execution in fast-moving markets
  • Proven experience iterating quickly on algorithmic strategies, adapting to market dynamics and optimizing performance in real-time
  • Proficiency in Python for backtesting, scripting, and analysis, along with SQL for managing large-scale data systems
  • Strong focus on performance optimization, identifying bottlenecks, and improving throughput in high-frequency, low-latency real-time systems
  • Excellent problem-solving skills with the ability to think critically about complex challenges and drive technical solutions forward
  • Experience with containerization (Docker) and deploying scalable, high-performance trading systems in cloud environments (AWS)
Job Responsibility
Job Responsibility
  • Design and optimize low-latency trading systems in Rust that power algorithmic trading strategies and support real-time execution in the volatile crypto market
  • Design and implementation of trading algorithms, optimizing liquidity management, price discovery, and slippage reduction in dynamic market conditions
  • Promote best practices in software engineering, advocating for clean, scalable, and maintainable code
  • Collaborate with cross-functional teams, to quickly adapt the trading platform to new data, market conditions, and business needs
  • Communicate effectively with both technical and non-technical stakeholders
  • Ensure high availability, reliability, and scalability of trading systems while maintaining a sharp focus on performance and testing
  • Drive technical decision-making and contribute to high-level architecture discussions
  • Be a technical advocate for excellence, leading efforts to improve development processes, code quality, and overall system performance
  • Prioritize rapid iteration of trading algorithms to ensure maximum profitability, minimal risk, and fast execution
What we offer
What we offer
  • Full-time salary based on experience and meaningful equity in an industry-leading company
  • Hybrid model working from home & our office in Central London (SoHo)
  • Work from Anywhere Policy: You can work remotely from anywhere in the world for up to 20 days per year
  • ClassPass
  • Budgets for learning & professional development
  • Unlimited vacation policy
  • Apple equipment
  • The opportunity to be a key player and build your career at a rapidly expanding, global technology company in an emerging field
  • Flexible work culture
  • Fulltime
Read More
Arrow Right