CrawlJobs Logo

Senior Back End Engineer for Streaming Data Platform

· Job Posted December 09, 2025
Apply Position
Job Link Share

Job Description

Do you want to build a high-quality data platform that will innovate financial markets? Do you want to work for a company that uses modern techniques to achieve the best results for its clients while empowering and supporting you to realize your full potential? We are an experienced team of Spring committers, Kafka contributors, ex-Pivotal, Google, Apple engineers. We are a VC-backed fintech with a live product in the regulatory trade reporting space and a growing list of institutional clients (B2B). Our product journey has started in the US with a roadmap into Canada, UK, EU, Australia, and Singapore over the next twelve months. We are a start-up on a fast paced journey to scale-up. KOR is built on leading edge cloud technology by industry domain experts and world class in-house engineering. We're on a mission to innovate B2B trade servicing starting with regulatory reporting in time for a global wave of mandated changes hitting all segments of market participants across OTC derivatives transactions. We’re solving the most challenging problems around by bringing fresh designs and solutions to data utility, quality, and processing inefficiencies. . . while unlocking insane value for clients. Teamwork and laser focus are central to everything we do at KOR. With the right support, we believe small independent teams with deep expertises achieve better results and encourage skilled people to take responsibility and grow their careers. We live by the mantra of work humble, work smart, and work together.

Job Responsibility

  • Designing and implementing the streaming data platform engine and SDK
  • Implementing new features for our range of web and streaming applications and data reporting capabilities
  • Be an active voice in the platform's build-out in regards to the technical choices and implementations
  • Working closely with the broader team to embrace new challenges and adapt requirements as we continue to grow and adjust priorities
  • Paired programming with a growing team of Back-end, Data, and Front-end Engineers

Requirements

  • A minimum of 8+ years of experience as a Back End Engineer
  • Experience with Java and Spring Boot Framework
  • Experience with building and running applications on public cloud vendors like AWS
  • Working experience Kafka, DataBricks and Streaming data solutions
  • Experience profiling, debugging, and performance tuning complex distributed systems
  • A firm reliance on unit testing and mocking frameworks with a TDD (Test Driven Development) mindset
  • Knowledge of OOP principles and modern development practices

Nice to have

  • Experience with event data modeling in event store/sourcing systems
  • Experience with horizontally scalable and highly available system design and implementation, focusing on performance and resiliency
  • Bachelor's Degree or higher in Engineering, Computer Science, or Information Technology

What we offer

  • Culture of trust, empowerment, and constructive feedback
  • Competitive salary, great IT equipment, and expense allowance
  • Flexible working times
  • A span of control that matches your ambitions and skills
  • Commitment to a genuine, balanced relationship

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Back End Engineer for Streaming Data Platform

8 matching positions

Senior Solutions Engineer – Big Data & Data Infrastructure

This is a great opportunity to be part of one of the fastest-growing infrastruct...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
vastdata.com Logo
VAST Data
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2–4 years in software / solution or infrastructure engineering
  • 2–4 years focused on building / maintaining large-scale data pipelines / storage & database solutions
  • Proficiency in Trino, Spark (Structured Streaming & batch) and solid working knowledge of Apache Kafka
  • Coding background in Python (must-have)
  • Deep understanding of data storage architectures including SQL, NoSQL, and HDFS
  • Solid grasp of DevOps practices, including containerization (Docker), orchestration (Kubernetes), and infrastructure provisioning (Terraform)
  • Experience with distributed systems, stream processing, and event-driven architecture
  • Hands-on familiarity with benchmarking and performance profiling for storage systems, databases, and analytics engines
  • Excellent communication skills
Job Responsibility
Job Responsibility
  • Build distributed data pipelines using technologies like Kafka, Spark (batch & streaming), Python, Trino, Airflow, and S3-compatible data lakes
  • Design, deploy, and troubleshoot hybrid cloud/on-prem environments using Terraform, Docker, Kubernetes, and CI/CD automation tools
  • Implement event-driven and serverless workflows
  • Create technical guides, architecture docs, and demo pipelines
  • Integrate data validation, observability tools, and governance directly into the pipeline lifecycle
  • Own end-to-end platform lifecycle: ingestion → transformation → storage (Parquet/ORC on S3) → compute layer (Trino/Spark)
  • Benchmark and tune storage backends (S3/NFS/SMB) and compute layers for throughput, latency, and scalability using production datasets
  • Work cross-functionally with R&D to push performance limits across interactive, streaming, and ML-ready analytics workloads
  • Operate and debug object store–backed data lake infrastructure
Read More
Arrow Right

Senior Data Engineer

If you love the pursuit of excellence and are inspired by the challenges that co...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 8+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience
  • 2+ years experience with data governance, data compliance and/or data security
  • 4+ years of hands-on software development experience in one or more general purpose programming languages (e.g., C#, Java, C++, Python, JavaScript/TypeScript)
  • Hands-on experience designing and operating production data pipelines and platforms at scale
  • Working understanding of how GenAI systems consume data — training datasets, features and labels, embeddings, retrieval and grounding data, evaluation harnesses, and the data-side failure modes that drive model and agent regressions
  • Hands-on experience using AI-assisted development tools (e.g., GitHub Copilot, agentic coding workflows, GenAI-based code review and test generation) in a disciplined, production-grade way
  • Experience integrating AI capabilities (LLMs, agents, model-backed features) into production systems, including familiarity with Responsible AI principles and applying AI safety controls in production
  • Experience owning a feature area end-to-end, from design through deployment, monitoring, and on-call ownership
  • Experience designing and operating large-scale distributed data systems in a cloud environment (e.g., Azure), including data model and pipeline design, performance tuning, and cost optimization
Job Responsibility
Job Responsibility
  • Own the end-to-end engineering lifecycle for key components and services—designing, coding, testing, deploying, and operating solutions that are secure, reliable, and maintainable
  • Use AI tools across the full SDLC in a disciplined way. Own the quality of AI-generated requirements, designs, and code — yours and your teammates' — and apply Responsible AI practices
  • Build the training, feature, retrieval, grounding, and evaluation datasets that LLMs, and agents depend on. Partner with PM and engineering to make data contracts, freshness, drift signals, and offline/online consistency first-class concerns
  • Lead design discussions for your project area, evaluate tradeoffs across batch vs. streaming, warehouse vs. lakehouse, ELT vs. ETL, and storage choices for analytical, feature, and vector workloads. Own architectural decisions with minimal oversight
  • Partner with PM and engineering to define data requirements
  • ensure feedback loops on data quality, usage, model performance, and downstream product impact are in place
  • Write extensible, secure, performant code for pipelines, transformations, and supporting services. Apply modern patterns including GenAI-assisted development. Drive code reviews and best practices at the product level
  • Own the test strategy for your area, including data contract tests, schema validation, freshness checks, distribution and drift monitoring, and offline/online parity. Improve the test suite and use AI tools for test automation
  • Identify cross-team data dependencies, manage upstream producer and downstream consumer impact, and resolve conflicts when semantics or schemas change in ways that affect models or downstream products
  • Drive your workgroup's project and release plans. Break work into a roadmap including backfills, migrations, and model-impacting changes, and coach others on estimation
  • Fulltime
Read More
Arrow Right

Digital Software Engineer Senior Manager - Vice President

The Digital S/W Engineer Sr Mgr accomplishes results through the management of p...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 11-17 years of relevant experience in an Apps Development role or senior level experience in an Enterprise Architecture role with subject matter expertise in one or more areas with at least 3+ years of deep specialization in AI/ML, NLP, or Generative AI development
  • Proven experience in successfully building, leading, and delivering complex technology projects from conception through to deployment and ongoing support
  • Proven experience in leading high performance teams spread across multiple locations
  • Effectively coach and give feedback to direct reports to help develop talent and support career development
  • 2+ years of experience building and operating production-grade AI systems such as digital assistants, recommendation engines, or similar intelligent platforms
  • 2+ years of deep, applied experience with LLM technologies (GPT-4, Claude, Gemini, or equivalent), including prompt engineering, fine-tuning, and cost optimization in production environments
  • Hands-on expertise in implementing Retrieval-Augmented Generation (RAG) pipelines and working with vector databases for knowledge-grounded AI applications
  • Demonstrable experience in designing and deploying agentic AI workflows and multi-agent systems using modern frameworks
  • Proficiency in NLP model development using industry-standard libraries and ML frameworks
  • Expert-level Python development skills with strong command of RESTful APIs, microservices architecture, and cloud platforms
Job Responsibility
Job Responsibility
  • Accountable for executing and driving enterprise grade application design and development efforts to completion, serving as a development lead
  • Proficient at operating with considerable autonomy and significantly influence the way an application is designed and developed by providing subject specific expertise and an advanced level of understanding of application programming principles
  • Participate in design discussions as a Development Lead and play the part of a key decision maker in driving design decisions
  • Partner with industry vendors that provide technology or user experience design components that support our Digital architecture and work with vendors on our implementation plans and roadmaps identifying partnership opportunities to increase our development velocity and our learnings
  • Directly impact the business by influencing strategic functional decisions through advice, counsel or provided services
  • This will require persuading and influencing others through strong and comprehensive communication and diplomacy skills
  • Communicate progress, anticipate bottlenecks, provide escalation management, identify, assess, track and mitigate issues/risks at multiple levels
  • Regularly review metrics and proactively seek out new and improved mechanisms for visibility ensuring your program stays aligned with organization objectives
  • Share knowledge with the team in various forums (brown bags, engineering forums etc.) and demonstrate a higher level of knowledge through industry certifications
  • Integrate LLMs for conversational understanding and response generation
  • Fulltime
Read More
Arrow Right

Lead Data Engineer

As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in...
Location
Location
United Kingdom , Any UK Office Hub (Bristol / London / Manchester / Swansea)
Salary
Salary:
80000.00 - 96000.00 GBP / Year
madetech.com Logo
Made Tech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies
  • Strong experience in IaC and able to guide how one could deploy infrastructure into different environments
  • Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop
  • Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes)
  • Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines
  • You understand how to create reusable libraries to encourage uniformity or approach across multiple data pipelines
  • Able to document and present end-to-end diagrams to explain a data processing system on a cloud environment
  • Some knowledge of how you would present diagrams (C4, UML, etc.)
  • Enthusiasm for learning and self-development
  • You have experience of working on agile delivery-lead projects and can apply agile practices such as Scrum, XP, Kanban
Job Responsibility
Job Responsibility
  • Define, shape and perfect data strategies in central and local government
  • Help public sector teams understand the value of their data, and make the most of it
  • Establish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCP
  • Contribute to our recruitment efforts and take on line management responsibilities
  • Help implement efficient data pipelines & storage
What we offer
What we offer
  • 30 days of paid annual leave
  • Flexible parental leave options
  • Part time remote working for all our staff
  • Paid counselling as well as financial and legal advice
  • 7% employer matched pension
  • Flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan
  • Optional social and wellbeing calendar of events
  • Fulltime
Read More
Arrow Right

Senior Big Data Pyspark Developer

We are looking for a skilled and motivated Full Stack Developer to join our engi...
Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-6 years of professional software development experience
  • Proficiency in Java (including modern Java features)
  • Strong experience with Node.js
  • Strong experience with Angular (versions 2+)
  • Strong experience with Spring Boot and Spring MVC for building web applications and microservices
  • Proven experience with Microservices architecture design and implementation
  • Strong experience with Hibernate
  • Solid command of Oracle Database, including SQL and PL/SQL
  • Experience with MongoDB for NoSQL data management
  • Experience with caching mechanisms and technologies like Hazelcast
Job Responsibility
Job Responsibility
  • Contribute to the design, development, and implementation of robust software solutions, ensuring performance, scalability, and security
  • Collaborate with product managers, architects, and senior developers to translate business requirements into technical specifications and develop innovative solutions
  • Develop and maintain back-end services using Java, Spring Boot, Spring MVC, Node.js, and Microservices architecture
  • Build responsive and intuitive user interfaces using Angular
  • Design and manage databases, working with both relational (Oracle) and NoSQL (MongoDB) data stores, leveraging Hibernate for ORM
  • Implement caching strategies using technologies like Hazelcast to improve application performance
  • Implement event-driven architectures and data streaming solutions using Kafka
  • Develop and consume GraphQL APIs, ensuring efficient data exchange between front-end and back-end systems
  • Adhere to best practices in software development, including participating in code reviews, testing, continuous integration, and continuous deployment (CI/CD)
  • Actively learn from and contribute to the team, sharing knowledge and helping to maintain high technical standards
  • Fulltime
Read More
Arrow Right

Senior Android Developer

The Digital S/W Engineer Sr Analyst is a seasoned professional role. Applies in-...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of professional experience in native mobile application development
  • 5+ years of hands-on experience with Kotlin (strong preference for Kotlin-first development
  • Java familiarity a plus)
  • 5+ years of experience building and shipping enterprise-grade native Android applications at scale
  • Deep understanding of the Android SDK, platform lifecycle, and Google ecosystem (Jetpack, Android Runtime, etc.)
  • Strong understanding of Android internals — memory management, process lifecycle, activity/fragment back stack, and app lifecycle at a low level
  • Experience with networking layers, Retrofit, OkHttp, and custom network stack implementations
  • Proficiency with data persistence strategies (Room, SQLite, DataStore, SharedPreferences, EncryptedSharedPreferences)
  • Solid understanding of security best practices at the OS level (certificate pinning, Android Keystore, data encryption, ProGuard/R8 obfuscation)
  • Familiarity with performance profiling and optimization using Android Studio Profiler (memory leaks, CPU usage, rendering bottlenecks, battery impact)
Job Responsibility
Job Responsibility
  • Accountable for executing and driving mid-size feature application design and development efforts to completion, serving as a development lead on medium-scale projects and supporting the execution of larger efforts
  • Proficient at operating with considerable autonomy and discretion as you will significantly influence the way an application is designed and developed by providing subject specific expertise and an advanced level of understanding of application programming principles
  • Sought after due to ability to analyze and troubleshoot coding, application performance and design challenges
  • Capable of research in root cause of development and performance concerns as well as the resolution of defects
  • Have a deep understanding of the technical requirements for the solutions being built
  • Understand engineering needs including those required to build, maintain, and operate the system through all phases of its life
  • Proficient in information modeling, data structures and algorithms
  • Understand maintenance characteristics, runtime properties and dependencies that exist in support of your system’s software. These dependencies will include but not limited to: hardware, platform, operating system, performance and load requirements, as well as contingencies with upstream and downstream systems
  • Demonstrate an advanced understanding of supported main system flows and possess a comprehensive understanding of how the system and others (i.e. architecture or infrastructure) collectively integrate to contribute towards achieving business objectives. Using this expertise, assist with the development of standards for coding, testing, debugging and implementation. This will ensure application design adheres to the overall architecture blueprint
  • Participate in design discussions as a Development Lead and as such will play the part of a key decision maker in driving design decisions. This is evidenced by your knowledge of the application code details and your experience with the technology and teams engaged
  • Fulltime
Read More
Arrow Right

Senior Android Developer

Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional experience in native mobile application development
  • 5+ years of hands-on experience with Kotlin (strong preference for Kotlin-first development
  • Java familiarity a plus)
  • 5+ years of experience building and shipping enterprise-grade native Android applications at scale
  • Deep understanding of the Android SDK, platform lifecycle, and Google ecosystem (Jetpack, Android Runtime, etc.)
  • Strong understanding of Android internals — memory management, process lifecycle, activity/fragment back stack, and app lifecycle at a low level
  • Experience with networking layers, Retrofit, OkHttp, and custom network stack implementations
  • Proficiency with data persistence strategies (Room, SQLite, DataStore, SharedPreferences, EncryptedSharedPreferences)
  • Solid understanding of security best practices at the OS level (certificate pinning, Android Keystore, data encryption, ProGuard/R8 obfuscation)
  • Familiarity with performance profiling and optimization using Android Studio Profiler (memory leaks, CPU usage, rendering bottlenecks, battery impact)
Job Responsibility
Job Responsibility
  • Accountable for executing and driving mid-size feature application design and development efforts to completion, serving as a development lead on medium-scale projects and supporting the execution of larger efforts
  • Proficient at operating with considerable autonomy and discretion as you will significantly influence the way an application is designed and developed by providing subject specific expertise and an advanced level of understanding of application programming principles
  • Sought after due to ability to analyze and troubleshoot coding, application performance and design challenges
  • Capable of research in root cause of development and performance concerns as well as the resolution of defects
  • Have a deep understanding of the technical requirements for the solutions being built
  • Understand engineering needs including those required to build, maintain, and operate the system through all phases of its life
  • Proficient in information modeling, data structures and algorithms
  • Understand maintenance characteristics, runtime properties and dependencies that exist in support of your system’s software. These dependencies will include but not limited to: hardware, platform, operating system, performance and load requirements, as well as contingencies with upstream and downstream systems
  • Demonstrate an advanced understanding of supported main system flows and possess a comprehensive understanding of how the system and others (i.e. architecture or infrastructure) collectively integrate to contribute towards achieving business objectives. Using this expertise, assist with the development of standards for coding, testing, debugging and implementation. This will ensure application design adheres to the overall architecture blueprint
  • Participate in design discussions as a Development Lead and as such will play the part of a key decision maker in driving design decisions. This is evidenced by your knowledge of the application code details and your experience with the technology and teams engaged
  • Fulltime
Read More
Arrow Right

Senior Product Manager, Recommendations

We are looking for a Senior Product Manager to own and drive critical product ar...
Location
Location
United States , San Jose
Salary
Salary:
195000.00 - 303000.00 USD / Year
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of product management experience, ideally in recommendations, personalization, search/discovery, or ML/AI-driven product areas
  • Strong analytical rigor: comfort with experiment design, A/B testing, statistical significance, and metric frameworks. Ability to define, defend, and prevent drift on KPIs
  • Proven ownership and bias to action: track record of driving complex, ambiguous initiatives end-to-end — from problem framing through strategy to shipped outcomes. You escalate early, propose alternatives, and don't let work stall
  • Technical depth: experience working closely with ML engineers and data scientists on ranking, optimization, and signal-based systems. Ability to engage meaningfully in technical discussions about model performance, feature engineering, and system architecture
  • Excellent cross-functional leadership: demonstrated ability to influence and drive alignment across engineering, data science, design, business, and content teams without direct authority
  • Outcome-oriented experimentation mindset: experience designing and running experiments that drive real product and business decisions
  • Clear, concise communicator: strong written and verbal skills
  • ability to present strategy, trade-offs, and recommendations to executive leadership
  • Experience in streaming, media, entertainment, or large-scale content platforms
  • Familiarity with recommendation systems, content ranking, collaborative filtering, or personalization at scale (100M+ users)
Job Responsibility
Job Responsibility
  • Define and own the product strategy and roadmap for your area within Platform Recommendations, with a focus on maximizing user engagement and business value across all monetization models
  • Identify unique problem spaces across surfaces and develop strategic recommendations backed by data and analysis
  • Drive material outcomes from strategic themes: Drive material outcomes from strategic themes through deep, independent analysis, quantified impact, coherent recommendations, and leadership-ready proposals
  • Articulate customer and business problems clearly: Articulate customer and business problems clearly, evaluate options and trade-offs, and develop sequenced roadmaps that move the ball forward strategically
  • Lead KPI definition and defense: propose clear primary decision metrics and supporting metrics for every initiative, especially in ambiguous domains where north-star KPIs are not easily defined
  • Own experiment design end-to-end: define test contracts and hold the line on experimental rigor
  • Drive experiments to decisions: ensure every test is tied to a concrete decision or roadmap change, and prevent KPI drift by proactively aligning stakeholders
  • Move fast and demonstrate extreme ownership of outcomes: actively track, unblock, and push for value, and propose concrete options when faced with trade-offs
  • Maintain 100% lockstep with partners: Maintain 100% lockstep with partners in ML Research and Engineering, Merchandising, and Analytics with detail orientation and ensure alignment on strategy, outcomes and requirements/timelines
  • Communicate with clarity and conciseness: Communicate with clarity and conciseness, with high signal-to-noise in written documents, messaging, presentations and verbal discussions
What we offer
What we offer
  • Health insurance
  • Equity awards
  • Life insurance
  • Disability benefits
  • Parental leave
  • Wellness benefits
  • Paid time off
  • Global access to mental health and financial wellness support and resources
  • Healthcare (medical, dental, and vision)
  • Life, accident, disability, commuter, and retirement options (401(k)/pension)
  • Fulltime
Read More
Arrow Right