CrawlJobs Logo

Senior Software Engineer, ML Data Platform

United States, Detroit 216418.50 USD / Year · Job Posted May 17, 2026
Apply Position
Job Link Share

Job Description

DUTIES: Develop fast, robust, and spike-resistant data consumption, data mining, and processing tools for the entire company. Develop orchestration for large-scale post-processing, and computational pipelines. Participate in the development, optimization and productionization of the next generation data processing platform using Beam and Spark in the cloud. Build self-serve capabilities to help customers to adopt the next generation data processing platform. Use the latest cloud technologies to own, design, implement, and test scalable distributed data systems in the cloud. Champion engineering excellence by continuously improving systems and processes. Own technical projects from start to finish, contribute to the team’s product roadmap, and be responsible for major technical decisions and tradeoffs. Effectively participate in team’s planning, code reviews and design discussions. Consider the effects of projects across multiple teams and proactively manage conflicts. Work with partner teams and orgs to achieve cross-organizational goals and satisfy broad requirements. Conduct technical interviews with well-calibrated standards and play an essential role in recruiting activities. 100% telecommuting available.

Job Responsibility

  • Develop fast, robust, and spike-resistant data consumption, data mining, and processing tools for the entire company
  • Develop orchestration for large-scale post-processing, and computational pipelines
  • Participate in the development, optimization and productionization of the next generation data processing platform using Beam and Spark in the cloud
  • Build self-serve capabilities to help customers to adopt the next generation data processing platform
  • Use the latest cloud technologies to own, design, implement, and test scalable distributed data systems in the cloud
  • Champion engineering excellence by continuously improving systems and processes
  • Own technical projects from start to finish, contribute to the team’s product roadmap, and be responsible for major technical decisions and tradeoffs
  • Effectively participate in team’s planning, code reviews and design discussions
  • Consider the effects of projects across multiple teams and proactively manage conflicts
  • Work with partner teams and orgs to achieve cross-organizational goals and satisfy broad requirements
  • Conduct technical interviews with well-calibrated standards and play an essential role in recruiting activities

Requirements

  • Bachelor's degree in Computer Science, Electronic Engineering, Management Information Systems, or related field of study and Five (5) years of experience as a Software Engineer, Programmer Analyst, or related occupation
  • Five (5) years of experience with: Building Peta Byte (PB) scale data management systems
  • Optimizing those data processing clusters for cost efficiency and performance
  • Building serving systems capable of delivering data at high-throughput, low-latency and high QPS (Queries Per Second) in a cost-efficient and spike-resilient manner
  • Building scalable infrastructure on the cloud with Python, Java, or Scala
  • Writing SQL queries for analytic purposes.

What we offer

An incentive pay program offers payouts based on company performance, job level, and individual performance

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Software Engineer, ML Data Platform

8 matching positions

Senior Software Engineer, Data Platform

We’re looking for a seasoned software engineer to join Parafin’s Infrastructure ...
Location
Location
United States , San Francisco
Salary
Salary:
230000.00 - 265000.00 USD / Year
parafin.com Logo
Parafin
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in software engineering with a strong background in data infrastructure, pipelines, and distributed systems
  • Advanced proficiency in Python and SQL
  • Hands-on Spark development experience
  • Expertise with modern cloud data stacks—AWS (S3, RDS), Databricks, and Airflow—and lakehouse architectures
  • Hands‑on experience with foundational data‑infrastructure technologies such as Hadoop, Hive, Kafka (or similar streaming platforms), Delta Lake/Iceberg, and distributed query engines like Trino/Presto
  • Familiarity with ingestion frameworks, developer‑experience tooling, and best practices for data versioning, lineage, partitioning, and clustering
  • Strong problem-solving skills and a proactive attitude toward ownership and platform health
  • Excellent communication and collaboration skills, especially in cross-functional settings
Job Responsibility
Job Responsibility
  • Design and build robust, highly scalable data pipelines and lakehouse infrastructure with PySpark, Databricks, and Airflow on AWS
  • Improve the data platform development experience for Engineering, Data Science, and Product by creating intuitive abstractions, self‑service tooling, and clear documentation
  • Own and maintain core data pipelines and models that power internal dashboards, ML models, and customer-facing products
  • Own the Data & ML platform infrastructure using Terraform, including end‑to‑end administration of Databricks workspaces: manage user access, monitor performance, optimize configurations (e.g., clusters, lakehouse settings), and ensure high availability of data pipelines
  • Lead projects to improve data quality, testing, observability, and cost efficiency across existing pipelines and backend systems (e.g., migrating Databricks SQL pipelines to dbt, scaling data ingestion, improving data-lineage tracking, and enhancing monitoring)
  • Act as the primary engineering partner for the Data Science team—embedded closely to gather requirements, design scalable solutions, and provide end-to-end support on all engineering aspects of their work
  • Work closely with backend engineers and data scientists to design performant data models and support new product development initiatives
  • Share best practices and mentor other engineers working on data-centric systems
What we offer
What we offer
  • Equity grant
  • Medical, dental & vision insurance
  • Work from home flexibility
  • Unlimited PTO
  • Commuter benefits
  • Free lunches
  • Paid parental leave
  • 401(k)
  • Employee assistance program
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, ML Platform

We’re looking for a software engineer to join Parafin’s Infrastructure team and ...
Location
Location
United States , San Francisco
Salary
Salary:
230000.00 - 265000.00 USD / Year
parafin.com Logo
Parafin
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of software engineering experience, including experience on ML platform/MLOps systems (training, deployment, and/or feature pipelines)
  • Strong Python
  • solid software design and testing fundamentals
  • Proficiency with SQL
  • hands-on Spark/PySpark experience
  • Knowledge of ML fundamentals—probability & statistics, supervised vs. unsupervised learning, bias/variance & regularization, feature engineering, model evaluation metrics, validation strategies, and production concerns like drift, stability, and monitoring
  • Expertise with modern data/ML stacks—AWS, Databricks (workflows, lakehouse, MLflow/registry, Model Serving), and Airflow (or equivalent orchestration)
  • Experience building real-time systems (service design, caching, rate limiting, backpressure) and batch pipelines at scale
  • Practical knowledge of feature-store concepts (offline/online stores, backfills, point-in-time correctness), model registries, experiment tracking, and evaluation frameworks
  • Strong problem-solving skills and a proactive attitude toward ownership and platform health
Job Responsibility
Job Responsibility
  • Turn notebooks into software
  • Decompose data scientist training/inference notebooks into reusable, tested components (libraries, pipelines, templates) with clear interfaces and documentation
  • Create developer-friendly ML abstractions
  • Build SDKs, CLIs, and templates that make it simple to define features, train/evaluate models, and deploy to batch or real-time targets with minimal boilerplate
  • Build our real-time ML inference platform
  • Stand up and scale low-latency model serving
  • Expand batch ML inference
  • Improve scheduling, parallelism, cost controls, observability, and failure/rollback for large-scale batch scoring and post-processing
  • Own and expand the feature store
  • Design offline/online feature definitions, high read/write throughput, and consistent offline/online semantics
What we offer
What we offer
  • Equity grant
  • Medical, dental & vision insurance
  • Work from home flexibility
  • Unlimited PTO
  • Commuter benefits
  • Free lunches
  • Paid parental leave
  • 401(k)
  • Employee assistance program
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data Platform

We are looking for an experienced software engineer to own, maintain, and evolve...
Location
Location
United States
Salary
Salary:
107000.00 - 120000.00 USD / Year
missionwired.com Logo
MissionWired
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive hands-on software engineering experience, with a strong track record of delivering production data pipelines or platforms in a mission critical environment
  • Strong experience with Python in production systems
  • Experience building and operating Databricks (or Spark) based pipelines
  • Experience with SQL
  • Experience with at least one major cloud infrastructure provider (GCP, AWS, Azure)
  • Experience with supporting business-critical systems with on-call ownership
  • Passion, energy, and excitement for progressive and philanthropic causes and all things digital
Job Responsibility
Job Responsibility
  • Joining each and every one of your colleagues in creating an inclusive workspace
  • Owning, maintaining, and supporting the reliability, architecture, and evolution of our production machine learning and delivery platform
  • Designing, operating, and improving large scale Databricks/Spark pipelines and workflows
  • Partner with our data scientists to productionize new data and ML-powered products
  • Leading improvements on the software integration layers between data pipelines and product workflows
  • Growing the team via mentorship and leadership, reviewing technical documents, improving code quality, and improving team performance and processes
  • Acting as a senior technical owner in debugging complex production issues and improving system observability
  • Collaborating with cross-functional teams to support their data infrastructure needs
What we offer
What we offer
  • 100% employer-paid premiums for platinum-level medical plan on a national health care network
  • 100% employer-paid life insurance and short term disability
  • 50% employer-paid vision and dental insurance
  • 401(k) with 3% employer contribution
  • 17 vacation days in addition to 12 paid holidays, sick days, bereavement leave, and a volunteer day off
  • Paid parental leave at 100% of your salary
  • Financial support for reproductive and transgender care
  • Flexible telecommute and remote work policies
  • Company issued Mac products for home offices
  • Cell phone service reimbursement, meal and ride-share reimbursement, and other perks available
  • Fulltime
Read More
Arrow Right

Senior Software Engineer II, ML Platform

Dandy is building the operating system for dental offices around the world. As a...
Location
Location
Brazil
Salary
Salary:
Not provided
meetdandy.com Logo
Dandy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience as a Machine Learning Engineer or Software Engineer, ideally within a high-growth startup environment
  • Deep proficiency in building and operating ML platform components, including feature stores, model registries, distributed training infrastructure, and experiment tracking
  • Experience designing and running ML systems on cloud infrastructure, including containerization and orchestration technologies such as Docker and Kubernetes, and public cloud platforms (AWS or GCP or Azure)
  • Expertise in large-scale data processing, with proven experience building reliable ML data pipelines to support complex model training and evaluation
  • Experience creating and maintaining automated build, test, and deployment workflows across multiple environments (e.g., Buildkite, CI/CD pipelines)
  • Strong background in observability, including implementing metrics, logging, and tracing for complex, distributed production systems
  • Ability to communicate clearly and concisely about complex architectural problems and propose iterative, pragmatic solutions
Job Responsibility
Job Responsibility
  • Collaborate with Machine Learning Engineers to build the ML training pipelines that process massive 3D datasets, orchestrate model training, and enable continuous model improvements
  • Streamline the ML lifecycle, from data labeling and experimentation to deployment, by optimizing internal ML components and reducing technical debt
  • Develop and maintain cloud-native systems and tooling (GCP/Kubernetes) that support Dandy’s 3D dental products in a secure, well-tested, and high-performing manner
  • Write clean, maintainable code and tests that set the standard for our internal best practices
  • Partner with stakeholders across the Engineering organization to influence long-term architectural goals and maintain a high-quality bar
What we offer
What we offer
  • Healthcare
  • dental
  • mental health support
  • parental planning resources
  • retirement savings options
  • generous paid time off
  • Fulltime
Read More
Arrow Right

Senior Software Engineer I - ML Platform

Dandy is transforming the massive and antiquated dental industry. We’re on an am...
Location
Location
United States , New York NY
Salary
Salary:
181000.00 - 213000.00 USD / Year
meetdandy.com Logo
Dandy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience as a Machine Learning Engineer or Software Engineer, ideally within a high-growth startup environment
  • Deep proficiency in building and operating ML platform components, including feature stores, model registries, distributed training infrastructure, and experiment tracking
  • Experience designing and running ML systems on cloud infrastructure, including containerization and orchestration technologies such as Docker and Kubernetes, and public cloud platforms (AWS or GCP or Azure)
  • Expertise in large-scale data processing, with proven experience building reliable ML data pipelines to support complex model training and evaluation
  • Experience creating and maintaining automated build, test, and deployment workflows across multiple environments (e.g., Buildkite, CI/CD pipelines)
  • Strong background in observability, including implementing metrics, logging, and tracing for complex, distributed production systems
  • Ability to communicate clearly and concisely about complex architectural problems and propose iterative, pragmatic solutions
Job Responsibility
Job Responsibility
  • Collaborate with Machine Learning Engineers to build the ML training pipelines that process massive 3D datasets, orchestrate model training, and enable continuous model improvements
  • Streamline the ML lifecycle, from data labeling and experimentation to deployment, by optimizing internal ML components and reducing technical debt
  • Develop and maintain cloud-native systems and tooling (GCP/Kubernetes) that support Dandy’s 3D dental products in a secure, well-tested, and high-performing manner
  • Write clean, maintainable code and tests that set the standard for our internal best practices
  • Partner with stakeholders across the Engineering organization to influence long-term architectural goals and maintain a high-quality bar
What we offer
What we offer
  • Offers Equity
  • healthcare
  • dental
  • mental health support
  • parental planning resources
  • retirement savings options
  • generous paid time off
  • Fulltime
Read More
Arrow Right

Senior ML Platform Engineer, AI Platform

We are seeking a skilled and passionate ML Platform Engineer to join our team an...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
airwallex.com Logo
Airwallex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years in backend software development
  • at least 2+ years focus on AI/ML Platform or MLOps infrastructure
  • deep expertise in MLOps practices, including automated deployment pipelines, model optimization, and production lifecycle management
  • proven experience designing and implementing low-latency model serving solutions
  • proficiency in Python
  • skill in writing high-quality, maintainable code
  • experience in design and development of large-scale distributed, high concurrency, low-latency inference, high availability systems
  • excellent communication and mentoring abilities
  • a relevant degree in Computer Science, Mathematics or related fields
Job Responsibility
Job Responsibility
  • Platform Development: Design, build, and maintain the end-to-end MLOps platform using Kubernetes and Cloud Services
  • Infrastructure as Code (IaC): Use Terraform or similar tools to manage, provision, and scale all ML-related infrastructure securely and efficiently
  • Pipeline Automation: Implement and optimize CI/CD/CT (Continuous Integration, Delivery, Training) pipelines to automate model training, testing, packaging, and deployment using tools like Argo and Kubeflow Pipelines
  • Serving Infrastructure: Build highly available, low-latency, and high-throughput model serving infrastructure
  • Observability: Implement robust monitoring, alerting, and logging solutions to track infrastructure health, model performance, and data/model drift
  • Tooling & Support: Evaluate, integrate, and support ML tools such as Feature Stores and distributed model training pipelines
  • Security & Compliance: Ensure platform security, implement RBAC (Role-Based Access Control), and manage secrets for sensitive data and production environments
  • Collaboration: Work closely with Data Scientists and ML Engineers to understand their needs and provide technical guidance on best practices for scaling their models
  • Fulltime
Read More
Arrow Right

Senior Data Engineer - Platform Team

Our team of dedicated Data Engineers delivers comprehensive data engineering sol...
Location
Location
Israel , Multiple Locations
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree or master’s degree in computer science, Math, Software Engineering, Computer Engineering, or related field
  • At least 6+ years’ experience in business analytics, data science, data modelling OR/AND Data Engineering work
  • Architecting, building, and maintaining end-to-end, high-throughput data systems and their supporting services
  • Designing efficient data structures and database schemas and working with distributed systems architecture
  • Experience working with large data sets using SQL/Azure Data Lake/Spark/Data bricks, etc., to derive actionable insights is highly desirable
  • Experience in Building AI \ ML-OPS tools for data platforms
  • Developing for continuous integration and automated deployments
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data pipelines, ETL workflows, and back-end services for real-time decisioning, reporting, optimization, data collection, and related functions
  • Develop AI \ ML workflows to support queries and automate data driven processes
  • Experiment with and recommend new technologies that simplify or improve the tech stack
  • Participate in an on-call rotation and work occasional off-hours
  • Mentor data engineers, guide complex design decisions, and foster a culture of engineering excellence, and continuous learning across the organization
  • Fulltime
Read More
Arrow Right

Senior Data Platform Engineer

We are looking for a Senior Data Platform Engineer to help build and scale the n...
Location
Location
United States , San Diego
Salary
Salary:
143000.00 - 215000.00 USD / Year
resmed.com Logo
ResMed
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in a STEM field or equivalent practical experience
  • Significant hands-on experience as a data engineer or senior software engineer working on data-intensive systems (typically 5–8+ years)
  • Strong SQL expertise and experience with data modeling on large-scale analytical platforms (Snowflake preferred)
  • Proven experience building and operating production data pipelines using Python and cloud services
  • Proficiency with dbt or similar transformation and analytics engineering tools
  • Solid software engineering fundamentals, including system design, debugging, performance optimization, and maintainable code practices
  • Experience with Git/GitHub workflows, including pull requests, code reviews, and collaborative development
  • Hands-on experience building or working with CI/CD pipelines (GitHub Actions preferred), including automated testing and deployments
  • Ability to work effectively across both data engineering and analytics engineering responsibilities
  • Strong hands-on experience building and operating data systems on AWS, including designing cloud-native architectures and working with services such as S3, IAM, EC2/ECS/EKS, Lambda, Glue, EMR, or related AWS data and compute services
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines for ingestion, transformation, and delivery using Python, SQL, Spark, APIs, and modern cloud-native tools
  • Develop high-quality analytics and data models in Snowflake using dbt or similar frameworks, with a focus on performance, correctness, and maintainability
  • Apply strong software engineering practices to data systems, including modular design, testing, code reviews, and version control
  • Implement automation, monitoring, and observability to ensure reliable and resilient data pipelines in production
  • Collaborate closely with product managers, analytics engineers, data scientists, and application engineers to deliver data products that drive business and clinical outcomes
  • Support advanced analytics and ML use cases by building feature pipelines and data foundations for classical ML models and emerging AI-driven workloads
  • Contribute to shared standards, patterns, and best practices across the data engineering organization through hands-on contributions and technical collaboration
What we offer
What we offer
  • comprehensive medical, vision, dental, and life, AD&D, short-term and long-term disability insurance, sleep care management, Health Savings Account (HSA), Flexible Spending Account (FSA), commuter benefits, 401(k), Employee Stock Purchase Plan (ESPP), Employee Assistance Program (EAP), and tuition assistance
  • Employees accrue fifteen days Paid Time Off (PTO) in their first year of employment, receive 11 paid holidays plus 3 floating days and are eligible for 14 weeks of primary caregiver or two weeks of secondary caregiver leave when welcoming new family members
  • Fulltime
Read More
Arrow Right