CrawlJobs Logo

Senior Software Engineer - Real-Time Workflows & ML Serving

India, Bangalore · Job Posted February 14, 2026
Apply Position
Job Link Share

Job Description

Modern ads platforms run on always-on, real-time data: streaming events, feature computation, near-real-time aggregations, and low-latency serving to power ML models that operate at massive scale under strict freshness, cost, and reliability requirements. Microsoft Ads builds and operates large-scale, latency-sensitive systems that serve billions of requests. We are looking for a Sr Software Engineer who is hands-on with production coding and system design to build the real-time data pipelines and feature/embedding materialization systems that feed online stores/caches and integrate tightly with ML inference serving. This role is ideal for engineers who enjoy: building robust streaming + ETL systems (correctness, idempotency, backfills, late data), owning SLOs with strong observability and operational maturity, and optimizing end-to-end performance and cost across compute, storage, and serving integrations. Primary success metrics are freshness, correctness, latency, reliability, and cost in production.

Job Responsibility

  • Design and implement real-time streaming ETL / feature pipelines (e.g., Flink or Spark Structured Streaming) that meet strict freshness and correctness constraints
  • Build and operate reliable messaging and ingestion with Kafka/Pulsar (partitioning strategy, retries, ordering guarantees, DLQs, backpressure handling)
  • Own data contracts between producers, pipelines, and consumers: schema evolution, versioning, compatibility, validation, and safe rollout
  • Implement production-grade backfill/replay workflows
  • Define and meet SLOs using OpenTelemetry/Prometheus/Grafana for metrics, tracing, dashboards, alerting, and incident response readiness
  • Integrate pipelines with online stores/caches and ML consumers (feature stores, embedding pipelines, LLM API calls, online/offline consistency patterns)
  • Partner with applied scientists on feature/embedding definitions, validation, and end-to-end quality measurement
  • Optimize end-to-end performance and efficiency: CPU/memory/I/O, serialization, caching, network overhead, concurrency, and pipeline compute cost
  • Contribute to serving/inference integrations where needed (e.g., Triton/ONNX Runtime/TensorRT) including batching and latency/cost tradeoffs
  • Ship safely with CI/CD, automated testing (unit/integration/data quality), and operational playbooks/runbooks

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Electrical/Computer Engineering, or a related field, with 6+ years of related experience
  • Strong programming skills in language C++,C# or Python (at least one required)
  • Hands-on experience in one or more: Building and operating streaming data pipelines in production (Flink or Spark Structured Streaming), Distributed systems engineering with strong reliability and operational rigor, Messaging systems such as Kafka/Pulsar
  • Experience operating services with Kubernetes/containers and production readiness practices (deployments, scaling, rollbacks)
  • Experience with observability stacks such as OpenTelemetry, Prometheus, Grafana

Nice to have

  • Experience with feature stores, embedding pipelines, and online/offline consistency (freshness guarantees, correctness validation)
  • Experience with data lakehouse/table formats and optimizations eg partitioning, compaction, and incremental processing
  • Experience with GPU inference serving (Triton, ONNX Runtime/TensorRT) and performance techniques (batching, request shaping, tail-latency reduction)
  • Background in cost/performance modeling, capacity planning, and reliability improvements for high-scale data platforms
  • Experience in Ads/search/recommendations or other high-scale systems where freshness, latency, and cost are important

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Software Engineer - Real-Time Workflows & ML Serving

8 matching positions

Senior Software Engineer, ML Platform

We’re looking for a software engineer to join Parafin’s Infrastructure team and ...
Location
Location
United States , San Francisco
Salary
Salary:
230000.00 - 265000.00 USD / Year
parafin.com Logo
Parafin
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of software engineering experience, including experience on ML platform/MLOps systems (training, deployment, and/or feature pipelines)
  • Strong Python
  • solid software design and testing fundamentals
  • Proficiency with SQL
  • hands-on Spark/PySpark experience
  • Knowledge of ML fundamentals—probability & statistics, supervised vs. unsupervised learning, bias/variance & regularization, feature engineering, model evaluation metrics, validation strategies, and production concerns like drift, stability, and monitoring
  • Expertise with modern data/ML stacks—AWS, Databricks (workflows, lakehouse, MLflow/registry, Model Serving), and Airflow (or equivalent orchestration)
  • Experience building real-time systems (service design, caching, rate limiting, backpressure) and batch pipelines at scale
  • Practical knowledge of feature-store concepts (offline/online stores, backfills, point-in-time correctness), model registries, experiment tracking, and evaluation frameworks
  • Strong problem-solving skills and a proactive attitude toward ownership and platform health
Job Responsibility
Job Responsibility
  • Turn notebooks into software
  • Decompose data scientist training/inference notebooks into reusable, tested components (libraries, pipelines, templates) with clear interfaces and documentation
  • Create developer-friendly ML abstractions
  • Build SDKs, CLIs, and templates that make it simple to define features, train/evaluate models, and deploy to batch or real-time targets with minimal boilerplate
  • Build our real-time ML inference platform
  • Stand up and scale low-latency model serving
  • Expand batch ML inference
  • Improve scheduling, parallelism, cost controls, observability, and failure/rollback for large-scale batch scoring and post-processing
  • Own and expand the feature store
  • Design offline/online feature definitions, high read/write throughput, and consistent offline/online semantics
What we offer
What we offer
  • Equity grant
  • Medical, dental & vision insurance
  • Work from home flexibility
  • Unlimited PTO
  • Commuter benefits
  • Free lunches
  • Paid parental leave
  • 401(k)
  • Employee assistance program
  • Fulltime
Read More
Arrow Right

FX STIRT Technology - Senior Software Engineer (SVP)

The STIRT Engineering Lead is a London-based Senior Vice President responsible f...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience in software engineering within capital markets or financial services, with significant hands-on development experience in high-performance, distributed systems
  • Proven hands-on expertise in building low-latency, high-throughput trading systems — capable of writing, reviewing, and debugging production code alongside the team
  • Deep domain knowledge of markets businesses — including Short-Term Interest Rates, FX, or broader FX and Rates/Credit markets — with a strong understanding of curve construction, RFQ/pricing workflows, and electronic trading
  • Proven track record of defining and delivering strategic architecture for large-scale, mission-critical financial platforms, including system modernisation and legacy decommissioning programmes
  • Experience managing and mentoring global engineering teams across multiple time zones
  • Strong background in stakeholder management and trader engagement, with the ability to translate complex technical concepts into business-relevant language
  • Demonstrable experience evaluating, adopting, or delivering AI/ML capabilities within a financial services or trading technology context, including familiarity with model governance and responsible AI practices
  • Strong proficiency in Java — including core Java (JVM internals, concurrency, memory management), modern frameworks (Spring Boot), and experience building low-latency, high-throughput applications
  • Proven system design and architecture skills — including large-scale distributed systems, microservices, event-driven architectures, and real-time data pipelines (e.g., Solace, KDB, in-memory data grids such as Couchbase)
  • Market data and pricing systems — experience with real-time market data feeds, curve construction engines, and pricing libraries
Job Responsibility
Job Responsibility
  • Serve as the primary technology partner for STIRT traders, building trusted relationships and acting as the first point of contact for all technology needs across FX and Rates desks
  • Conduct regular structured engagement sessions with traders to capture workflow pain points, prioritise enhancements, and translate business requirements into actionable engineering deliverables
  • Partner with Desk Heads, Quants, Sales, Operations, and Risk to ensure technology solutions are aligned with front-to-back business objectives
  • Communicate technical strategy, delivery progress, and risk in clear, business-relevant terms to senior stakeholders including Trading Management and Technology leadership
  • Represent STIRT Technology in cross-functional forums, governance committees, and strategic planning sessions
  • Develop and maintain a comprehensive understanding of the full STIRT front-to-back workflow
  • Define and own the target-state technical architecture for the STIRT platform, covering all components from market data ingestion through to trade booking and risk reporting
  • Lead architectural decisions on system decomposition, data flow design, API contracts, event-driven patterns, and integration with upstream/downstream systems
  • Drive the modernisation and consolidation of legacy STIRT systems, establishing a clear migration roadmap that minimises disruption to live trading
  • Evaluate and govern technical trade-offs across build vs. buy, latency vs. throughput, consistency vs. availability, and monolith vs. microservices dimensions
What we offer
What we offer
  • 27 days annual leave (plus bank holidays)
  • A discretional annual performance related bonus
  • Private Medical Care & Life Insurance
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right

Digital Software Engineer Senior Manager - Vice President

The Digital S/W Engineer Sr Mgr accomplishes results through the management of p...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 11-17 years of relevant experience in an Apps Development role or senior level experience in an Enterprise Architecture role with subject matter expertise in one or more areas with at least 3+ years of deep specialization in AI/ML, NLP, or Generative AI development
  • Proven experience in successfully building, leading, and delivering complex technology projects from conception through to deployment and ongoing support
  • Proven experience in leading high performance teams spread across multiple locations
  • Effectively coach and give feedback to direct reports to help develop talent and support career development
  • 2+ years of experience building and operating production-grade AI systems such as digital assistants, recommendation engines, or similar intelligent platforms
  • 2+ years of deep, applied experience with LLM technologies (GPT-4, Claude, Gemini, or equivalent), including prompt engineering, fine-tuning, and cost optimization in production environments
  • Hands-on expertise in implementing Retrieval-Augmented Generation (RAG) pipelines and working with vector databases for knowledge-grounded AI applications
  • Demonstrable experience in designing and deploying agentic AI workflows and multi-agent systems using modern frameworks
  • Proficiency in NLP model development using industry-standard libraries and ML frameworks
  • Expert-level Python development skills with strong command of RESTful APIs, microservices architecture, and cloud platforms
Job Responsibility
Job Responsibility
  • Accountable for executing and driving enterprise grade application design and development efforts to completion, serving as a development lead
  • Proficient at operating with considerable autonomy and significantly influence the way an application is designed and developed by providing subject specific expertise and an advanced level of understanding of application programming principles
  • Participate in design discussions as a Development Lead and play the part of a key decision maker in driving design decisions
  • Partner with industry vendors that provide technology or user experience design components that support our Digital architecture and work with vendors on our implementation plans and roadmaps identifying partnership opportunities to increase our development velocity and our learnings
  • Directly impact the business by influencing strategic functional decisions through advice, counsel or provided services
  • This will require persuading and influencing others through strong and comprehensive communication and diplomacy skills
  • Communicate progress, anticipate bottlenecks, provide escalation management, identify, assess, track and mitigate issues/risks at multiple levels
  • Regularly review metrics and proactively seek out new and improved mechanisms for visibility ensuring your program stays aligned with organization objectives
  • Share knowledge with the team in various forums (brown bags, engineering forums etc.) and demonstrate a higher level of knowledge through industry certifications
  • Integrate LLMs for conversational understanding and response generation
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, AI

Credit Genie is a mobile-first financial wellness platform designed to help indi...
Location
Location
United States , Pittsburgh
Salary
Salary:
150000.00 - 250000.00 USD / Year
creditgenie.com Logo
Credit Genie
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A Software Engineer with 5+ years of industry experience
  • Strong foundations in multiple programming languages (Python, Java, TypeScript, etc.)
  • Hands-on experience with cloud platforms (AWS, GCP, or Azure)
  • Experienced at designing and implementing distributed, production-grade systems
  • Comfortable with system design, APIs, version control, Infrastructure as Code, and testing
  • Collaborative and excited by fast-moving, problem-solving environments
  • Prior exposure with Machine Learning and AI concepts, tools, or frameworks (e.g., LLMs, vector databases, specialized model serving)
Job Responsibility
Job Responsibility
  • Lead the design and implementation of highly available, scalable backend services and APIs that serve and integrate our AI models and applications into production systems
  • Architect and optimize the services and data pipelines essential for deploying, monitoring, and maintaining real-time AI inferencing and retrieval at scale
  • Collaborate with AI and ML Engineers to improve model deployment, monitoring, and experimentation workflows (AIOps)
  • Drive technical excellence, setting high standards for code quality, system reliability, and performance
  • Mentor and guide other engineers on best practices for building robust backend systems in an AI-focused environment
  • Have fun working on hard and highly impactful problems
What we offer
What we offer
  • Offers Equity
  • Offers Bonus
  • Comprehensive medical, vision, and dental coverage
  • 401(k) retirement plan with company match
  • Short & long term disability insurance
  • Life insurance
  • Flexible PTO
  • 100% company-paid medical, dental, and vision coverage for you and your dependents on your first day of employment
  • Receive up to $100 per month in fitness reimbursement or enjoy a complimentary full membership to LifeTime Fitness or Equinox
  • 401(k) with a 3.5% match and immediate vesting
  • Fulltime
Read More
Arrow Right

Senior Software Platform Engineer

Solvd Inc. is a rapidly growing AI-native consulting and technology services fir...
Location
Location
Brazil
Salary
Salary:
Not provided
solvd.com Logo
Solvd Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of professional experience in software engineering and infrastructure engineering
  • Extensive experience building and maintaining AI/ML infrastructure in production, including model, deployment, and lifecycle management
  • Strong knowledge of AWS and infrastructure-as-code frameworks, ideally with CDK
  • Expert-level coding skills in TypeScript and Python building robust APIs and backend services
  • Production-level experience with Databricks MLFlow, including model registration, versioning, asset bundles, and model serving workflows
  • Expert level understanding of containerization (Docker)
  • Proven ability to design reliable, secure, and scalable infrastructure for both real-time and batch ML workloads
  • Ability to articulate ideas clearly, present findings persuasively, and build rapport with clients and team members
  • Strong collaboration skills and the ability to partner effectively with cross-functional teams
Job Responsibility
Job Responsibility
  • Design, implement, and maintain cloud-native platform to support AI and data workloads, with a focus on AI and data platforms such as Databricks and AWS Bedrock
  • Build and manage scalable data pipelines to ingest, transform, and serve data for ML and analytics
  • Develop infrastructure-as-code using tools like Cloudformation, AWS CDK to ensure repeatable and secure deployments
  • Collaborate with AI engineers, data engineers, and platform teams to improve the performance, reliability, and cost-efficiency of AI models in production
  • Drive best practices for observability, including monitoring, alerting, and logging for AI platforms
  • Contribute to the design and evolution of our AI platform to support new ML frameworks, workflows, and data types
  • Stay current with new tools and technologies to recommend improvements to architecture and operations
  • Integrate AI models and large language models (LLMs) into production systems to enable use cases using architectures like retrieval-augmented generation (RAG)
What we offer
What we offer
  • Shape real-world AI-driven projects across key industries, working with clients from startup innovation to enterprise transformation
  • Be part of a global team with equal opportunities for collaboration across continents and cultures
  • Thrive in an inclusive environment that prioritizes continuous learning, innovation, and ethical AI standards
  • Fulltime
Read More
Arrow Right

Senior AI Software Engineer

DefineX is a next-generation consulting house and venture builder, helping finan...
Location
Location
Turkey , Istanbul
Salary
Salary:
Not provided
definex.com Logo
DefineX
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS, MS, or PhD in Computer Science/Engineering, Mathematics, or a related field
  • 5+ years of hands-on experience in Java-based software development, ideally within enterprise or banking environments
  • Solid understanding of machine learning concepts and model lifecycles, with hands-on experience integrating ML models into production systems
  • Experience bridging Python-based ML workflows and Java services (e.g. consuming serialized models, model-serving APIs, or hybrid architectures)
  • Practical experience with LLMs, NLP technologies, and predictive modeling techniques
  • Strong proficiency in Java, with working knowledge of Python for AI/ML integration scenarios
  • Familiarity with NoSQL databases (HBase, Elasticsearch, Couchbase, etc.)
  • Experience designing and operating microservices architecture using Kubernetes and/or OpenShift
  • Strong understanding of software architecture, data structures, data modeling, and RESTful web services
  • Experience with containerization, CI/CD, and version control (Docker, Kubernetes, Git)
Job Responsibility
Job Responsibility
  • Design and develop Java-based AI services that integrate machine learning and deep learning models into enterprise systems, including the consumption of Python-trained models (e.g. serialized models such as pickle) within Java-driven architectures
  • Build end-to-end ML model lifecycles covering model integration, versioning, deployment, monitoring, and retraining triggers in production environments
  • Develop prototypes across AI use cases, focusing on production readiness rather than experimentation only
  • Collaborate with data scientists and ML engineers to operationalize models by exposing them via APIs or embedding them into Java-based microservices
  • Build scalable systems and pipelines for high-throughput data processing and real-time or near real-time inference
  • Work closely with business and technical stakeholders to translate business problems into robust AI-enabled software solutions
  • Contribute to long-term AI platform evolution while delivering incremental, high-impact milestones
What we offer
What we offer
  • Growth and Development: Be part of a growing global team of professionals with training and support to help you grow
  • Every DefineXer has a Growth Coach to accelerate their growth through feedback
  • Independence and Ownership: Blur in creative and challenging business and technology transformation projects
  • Time Off: 20 vacation days per annum
  • We love to Give Back: You will get certain hours a year to volunteer and organize office volunteer programs with local NGOs
  • Health and Wellness: Competitive private health and life insurance coverage
  • Fulltime
Read More
Arrow Right

Senior Software Developer

We’re looking for a Senior Software Developer to be part of our success story. W...
Location
Location
United Kingdom
Salary
Salary:
Not provided
activate-group.com Logo
Activate Group Limited
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expert level Python with 5+ years of production experience
  • 3+ years experience with PyTorch and/or TensorFlow
  • Strong proficiency with scikit-learn, XGBoost, LightGBM
  • Expert level data processing with pandas, NumPy, Spark
  • Practical experience with CNNs, RNNs, Transformers
  • Git proficiency with focus on ML workflows
  • Experience with LLMs (GPT, Claude, Llama) and prompt engineering
  • Experience with vector databases (Pinecone, Weaviate, Chroma, or similar)
  • RAG (Retrieval Augmented Generation) implementation experience
  • Experience with Computer Vision libraries (OpenCV, PIL, torchvision)
Job Responsibility
Job Responsibility
  • Design, develop, and deploy machine learning models and pipelines using Python
  • Build and maintain end-to-end ML systems from data ingestion to model serving
  • Implement deep learning solutions using PyTorch and TensorFlow
  • Develop and optimize NLP solutions and computer vision applications
  • Create scalable feature engineering and data preprocessing pipelines
  • Build model training, evaluation, and monitoring frameworks
  • Implement MLOps practices for continuous model improvement
  • Design and maintain vector databases for similarity search and RAG applications
  • Integrate LLMs and foundation models into production applications
  • Optimize model inference for latency and throughput requirements
What we offer
What we offer
  • 33 days holiday (including bank holidays)
  • Personal health cash plan – claim back the cost of things like dentist and optical check ups
  • Enhanced maternity / paternity / adoption / shared parental pay
  • Life assurance: three times basic salary
  • Free breakfasts and fruit
  • Birthday surprise for everybody
  • Fulltime
Read More
Arrow Right

Senior Machine Learning Engineer

We're looking for a Senior Machine Learning Engineer who can build large-scale s...
Location
Location
Finland , Helsinki
Salary
Salary:
Not provided
supercell.com Logo
Supercell
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep expertise in Machine Learning with a strong track record of taking ML systems into production
  • Hands-on experience deploying ML models at large scale, operating in high-traffic, low-latency production environments
  • Strong software, data, and ML engineering skills, with the ability to design, build, and maintain robust end-to-end ML pipelines
  • Experience leveraging modern AI-assisted development tools to improve productivity and accelerate iteration speed
  • Proven ability to collaborate with other developers and AI agents, as well as independently drive ML projects from idea to production
  • Excellent problem-solving ability, with strong analytical thinking and attention to detail
  • Clear and effective communication skills, able to translate complex technical concepts for both technical and non-technical audiences
  • Positive, proactive, and 'can-do' mindset, with a willingness to dive deep and take ownership
  • Passion for games. Previous industry experience is a strong plus
Job Responsibility
Job Responsibility
  • Understand our games, players, and business goals to identify where ML can deliver meaningful impact, and build strong relationships across teams
  • Design and build end-to-end, real-time and event-driven ML systems from data to low-latency serving, enabling context-aware player experiences
  • Develop and deploy ML models and decision systems that shape personalized player experiences across the full player journey
  • Build scalable ML systems and reusable platform capabilities, enabling game teams to adopt ML through tools, pipelines, and APIs
  • Balance speed, robustness, experimentation, and standardization while continuously reducing time from idea to experiment to production
  • Operate, monitor, and optimize production ML systems to ensure world-class performance, reliability, and scalability
  • Champion modern MLOps practices through mentorship, code and design reviews, documentation, and by guiding game teams in adopting ML workflows
  • Shape ML strategy and ensure it drives real player and business impact
  • Continue to level up Supercell AI maturity through knowledge sharing and adoption of new tools
What we offer
What we offer
  • Relocation support for you and your family
  • Comprehensive compensation and benefits
  • Fulltime
Read More
Arrow Right