CrawlJobs Logo

Platform Engineer - Data Science Platform

https://www.roberthalf.com Logo

Robert Half

Location Icon

Location:
United States , Columbus, OH or Dallas, TX or Minneapolis, MN

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Responsibility:

  • Support and maintain ongoing Data Science infrastructure operations
  • Design, build, and deploy AWS environments using automated CI/CD pipelines
  • Manage and scale large, secure cloud environments to support current and future Data Science initiatives
  • Implement, own, and improve the image management lifecycle process
  • Assist with the setup and ongoing management of AWS accounts dedicated to the Data Science platform
  • Develop and maintain infrastructure pipelines using CI/CD tools (e.g., Azure DevOps)
  • Build and manage environments using Infrastructure as Code (IaC) tools such as Terraform
  • Develop scripts and applications using programming languages such as Python
  • Manage and support database technologies including Athena, Oracle, MySQL, and PostgreSQL
  • Leverage AWS services to enable Data Lake, Data Science, and AI/ML workloads
  • Respond to requests from development and business users, removing technical roadblocks
  • Manage secured infrastructure environments, applying security controls and guardrails
  • Identify, remediate, and track infrastructure vulnerabilities within defined SLAs
  • Maintain audit logs and support compliance-related needs
  • Perform system upgrades, patching, and provide on-call support as required
  • Conduct root cause analysis and knowledge transfer sessions with internal teams
  • Collaborate closely with Network, Database, Infrastructure, and Architecture teams to align on platform strategy and delivery

Requirements:

  • Bachelor's degree in Computer Science or a related field, or equivalent practical experience
  • 5+ years of experience supporting Data Science infrastructure
  • 5+ years of hands-on experience with AWS-hosted Data Lake, Data Science, or AI/ML platforms
  • 5+ years of working knowledge with Kubernetes
  • AWS services such as SageMaker, Glue, Lambda, Athena
  • CI/CD tools such as Azure DevOps
  • Infrastructure as Code tools such as Terraform
  • Container technologies including Docker and Amazon ECR
  • Security tools such as AQUA and Kenna
  • Experience producing technical documentation and written solutions

Nice to have:

  • AWS, Terraform, or Kubernetes certifications (e.g., CKA)
  • Familiarity with technical service management and product lifecycle maintenance
  • Experience with scripting and programming languages such as Python and shell scripting
  • Strong working knowledge of database technologies including Athena, Oracle, and MySQL
  • Advanced experience with CI/CD and IaC tools, particularly Azure DevOps and Terraform
What we offer:
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan

Additional Information:

Job Posted:
May 03, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Platform Engineer - Data Science Platform

Big Data Platform Senior Engineer

Lead Java Data Engineer to guide and mentor a talented team of engineers in buil...
Location
Location
Bahrain , Seef, Manama
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Significant hands-on experience developing high-performance Java applications (Java 11+ preferred) with strong foundation in core Java concepts, OOP, and OOAD
  • Proven experience building and maintaining data pipelines using technologies like Kafka, Apache Spark, or Apache Flink
  • Familiarity with event-driven architectures and experience in developing real-time, low-latency applications
  • Deep understanding of distributed systems concepts and experience with MPP platforms such as Trino (Presto) or Snowflake
  • Experience deploying and managing applications on container orchestration platforms like Kubernetes, OpenShift, or ECS
  • Demonstrated ability to lead and mentor engineering teams, communicate complex technical concepts effectively, and collaborate across diverse teams
  • Excellent problem-solving skills and data-driven approach to decision-making
Job Responsibility
Job Responsibility
  • Provide technical leadership and mentorship to a team of data engineers
  • Lead the design and development of highly scalable, low-latency, fault-tolerant data pipelines and platform components
  • Stay abreast of emerging open-source data technologies and evaluate their suitability for integration
  • Continuously identify and implement performance optimizations across the data platform
  • Partner closely with stakeholders across engineering, data science, and business teams to understand requirements
  • Drive the timely and high-quality delivery of data platform projects
  • Fulltime
Read More
Arrow Right

Senior Principal Data Platform Software Engineer

We’re looking for a Sr Principal Data Platform Software Engineer (P70) to be a k...
Location
Location
Salary
Salary:
239400.00 - 312550.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years in Data Engineering, Software Engineering, or related roles, with substantial exposure to big data ecosystems
  • Demonstrated experience building and operating data platforms or large‑scale data services in production
  • Proven track record of building services from the ground up (requirements → design → implementation → deployment → ongoing ownership)
  • Hands‑on experience with AWS, GCP (e.g., compute, storage, data, and streaming services) and cloud‑native architectures
  • Practical experience with big data technologies, such as Databricks, Apache Spark, AWS EMR, Apache Flink, or StarRocks
  • Strong programming skills in one or more of: Kotlin, Scala, Java, Python
  • Experience leading cross‑team technical initiatives and influencing senior stakeholders
  • Experience mentoring Staff/Principal engineers and lifting the technical bar for a team or org
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Design, develop and own delivery of high quality big data and analytical platform solutions aiming to solve Atlassian’s needs to support millions of users with optimal cost, minimal latency and maximum reliability
  • Improve and operate large‑scale distributed data systems in the cloud (primarily AWS, with increasing integration with GCP and Kubernetes‑based microservices)
  • Drive the evolution of our high-performance analytical databases and its integrations with products, cloud infrastructures (AWS and GCP) and isolated cloud environments
  • Help define and uplift engineering and operational standards for petabyte scale data platforms, with sub‑second analytic queries and multi‑region availability (coding guidelines, code review practices, observability, incident response, SLIs/SLOs)
  • Partner across multiple product and platform teams (including Analytics, Marketplace/Ecosystem, Core Data Platform, ML Platform, Search, and Oasis/FedRAMP) to deliver company‑wide initiatives that depend on reliable, high‑quality data
  • Act as a technical mentor and multiplier, raising the bar on design quality, code quality, and operational excellence across the broader team
  • Design and implement self‑healing, resilient data platforms with strong observability, fault tolerance, and recovery characteristics
  • Own the long‑term architecture and technical direction of Atlassian’s product data platform with projects that are directly tied to Atlassian’s company-level OKRs
  • Be accountable for the reliability, cost efficiency, and strategic direction of Atlassian’s product analytical data platform
  • Partner with executives and influence senior leaders to align engineering efforts with Atlassian’s long-term business objectives
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
  • Fulltime
Read More
Arrow Right

Principal Data Platform Engineer

Are you passionate about data platforms and tools? Are you an open-minded, struc...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep understanding of big data challenges
  • Built solutions using public cloud offerings such as Amazon Web Services
  • Experience with Big Data processing and storage technologies such as Spark, S3, DBT
  • SQL knowledge
  • Solid understanding and experience in building RESTful APIs and micro services, e.g. with Flask
  • Experience with test automation and ensuring data quality across multiple datasets used for analytical purposes
  • Experience with continuous delivery, continuous integration, and source control system such as Git
  • Expert level programming skills in OO Programming language like Java, Kotlin or Python
  • Degree in Computer Science, EE, or related STEM discipline
Job Responsibility
Job Responsibility
  • You will partner with analytical teams, data engineers and data scientists across various initiatives working with them to understand the gaps, and bring your findings back to the team to work on building these capabilities
  • In this role, you will be part of the Analytics Management Platform team under the Data Platform
  • The team focuses on building the foundation for Atlassian analytical platforms
  • We are creating frictionless data experiences for data products builders by offering different services and frameworks that help engineers to move fast and enable their users to generate valuable insights from data
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Fixed Income Data Python Platform Engineer

Fixed Income Data Python Platform Engineer position at Citi, building and mainta...
Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5 years+ of hands-on experience in building an enterprise scale highly componentized application using Python incl. web frameworks like Django or Flask and data science tools - Pandas, Polars, Streamlit, Airflow
  • Experience with Docker and Kubernetes/Openshift
  • Experience with DevOps technologies - Ansible, Chef
  • Experience working in a Continuous Integration and Continuous Delivery environment and familiar with Jenkins, TeamCity, Code Quality Tools - SonarQube, etc.
  • Proficient in industry standard best practices such as Design Patters, Coding Standards, Coding modularity, Prototypes etc.
  • Unit testing frameworks - PyTest
  • Understanding of the SDLC lifecycle for Agile & Waterfall methodologies
  • Excellent written and oral communication skills
  • Bachelor's degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Analyzes system requirements, including identifying program interactions and appropriate interfaces between impacted components and sub systems
  • Participate in Sprint Planning, Tasking and Estimation of the assigned work for Python platform
  • Participate in component and service design for Python analytical services
  • Work on bug resolution and application improvements, such as performance and maintainability
  • May occasionally work a non-standard shift including nights and/or weekends and/or have on-call responsibilities
  • Stay abreast with new trends in open source tooling and champion tools that could help improve efficiency of the Fixed Income quant and data science community
  • Work closely with quants and data scientists to help them use platform capabilities and develop efficient analytical tools
  • Continuously look to automate manual touchpoints in the technology delivery pipeline
  • Fulltime
Read More
Arrow Right

Senior Platform Engineer, ML Data Systems

We’re looking for an ML Data Engineer to evolve our eval dataset tools to meet t...
Location
Location
United States , Mountain View
Salary
Salary:
137871.00 - 172339.00 USD / Year
khanacademy.org Logo
Khan Academy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field
  • 5 years of Software Engineering experience with 3+ of those years working with large ML datasets, especially those in open-source repositories such as Hugging Face
  • Strong programming skills in Go, Python, SQL, and at least one data pipeline framework (e.g., Airflow, Dagster, Prefect)
  • Experience with data versioning tools (e.g., DVC, LakeFS) and cloud storage systems
  • Familiarity with machine learning workflows — from training data preparation to evaluation
  • Familiarity with the architecture and operation of large language models, and a nuanced understanding of their capabilities and limitations
  • Attention to detail and an obsession with data quality and reproducibility
  • Motivated by the Khan Academy mission “to provide a free world-class education for anyone, anywhere.”
  • Proven cross-cultural competency skills demonstrating self-awareness, awareness of other, and the ability to adopt inclusive perspectives, attitudes, and behaviors to drive inclusion and belonging throughout the organization.
Job Responsibility
Job Responsibility
  • Evolve and maintain pipelines for transforming raw trace data into ML-ready datasets
  • Clean, normalize, and enrich data while preserving semantic meaning and consistency
  • Prepare and format datasets for human labeling, and integrate results into ML datasets
  • Develop and maintain scalable ETL pipelines using Airflow, DBT, Go, and Python running on GCP
  • Implement automated tests and validation to detect data drift or labeling inconsistencies
  • Collaborate with AI engineers, platform developers, and product teams to define data strategies in support of continuously improving the quality of Khan’s AI-based tutoring
  • Contribute to shared tools and documentation for dataset management and AI evaluation
  • Inform our data governance strategies for proper data retention, PII controls/scrubbing, and isolation of particularly sensitive data such as offensive test imagery.
What we offer
What we offer
  • Competitive salaries
  • Ample paid time off as needed
  • 8 pre-scheduled Wellness Days in 2026 occurring on a Monday or a Friday for a 3-day weekend boost
  • Remote-first culture - that caters to your time zone, with open flexibility as needed, at times
  • Generous parental leave
  • An exceptional team that trusts you and gives you the freedom to do your best
  • The chance to put your talents towards a deeply meaningful mission and the opportunity to work on high-impact products that are already defining the future of education
  • Opportunities to connect through affinity, ally, and social groups
  • 401(k) + 4% matching & comprehensive insurance, including medical, dental, vision, and life.
  • Fulltime
Read More
Arrow Right

Senior Data Platform Engineer

Working at Atlassian. Atlassians can choose where they work – whether in an offi...
Location
Location
India
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid understanding and experience in building RESTful APIs and micro services, e.g. with Flask, Spring boot
  • Experience with Big Data processing and storage technologies such as Spark, DBT
  • Built solutions using public cloud offerings such as Amazon Web Services
  • SQL knowledge
  • Experience with test automation and ensuring data quality across multiple datasets used for analytical purposes
  • Experience with continuous delivery, continuous integration, and source control system such as Git
  • Expert level programming skills in OO Programming language like Java, Kotlin, Scala or Python
  • Deep understanding of big data challenges
  • Degree in Computer Science, EE, or related STEM discipline
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Data Engineering & Analytics Lead

Premium Health is seeking a highly skilled, hands-on Data Engineering & Analytic...
Location
Location
United States , Brooklyn
Salary
Salary:
Not provided
premiumhealth.org Logo
Premium Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred
  • Proven track record and progressively responsible experience in data engineering, data architecture, or related technical roles
  • healthcare experience preferred
  • Strong knowledge of data engineering principles, data integration, ETL processes, and semantic mapping techniques and best practices
  • Experience implementing data quality management processes, data governance frameworks, cataloging, and master data management concepts
  • Familiarity with healthcare data standards (e.g., HL7, FHIR, etc), health information management principles, and regulatory requirements (e.g., HIPAA)
  • Understanding of healthcare data, including clinical, operational, and financial data models, preferred
  • Advanced proficiency in SQL, data modeling, database design, optimization, and performance tuning
  • Experience designing and integrating data from disparate systems into harmonized data models or semantic layers
  • Hands-on experience with modern cloud-based data platforms (e.g Azure, AWS, GCP)
Job Responsibility
Job Responsibility
  • Collaborate with the CDIO and Director of Technology to define a clear data vision aligned with the organization's goals and execute the enterprise data roadmap
  • Serve as a thought leader for data engineering and analytics, guiding the evolution of our data ecosystem and championing data-driven decision-making across the organization
  • Build and mentor a small data team, providing technical direction and performance feedback, fostering best practices and continuous learning, while remaining a hands-on implementor
  • Define and implement best practices, standards, and processes for data engineering, analytics, and data management across the organization
  • Design, implement, and maintain a scalable, reliable, and high-performing modern data infrastructure, aligned with the organizational needs and industry best practices
  • Architect and maintain data lake/lakehouse, warehouse, and related platform components to support analytics, reporting, and operational use cases
  • Establish and enforce data architecture standards, governance models, naming conventions ,and documentation
  • Develop, optimize, and maintain scalable ETL/ELT pipelines and data workflows to collect, transform, normalize, and integrate data from diverse systems
  • Implement robust data quality processes, validation, monitoring, and error-handling frameworks
  • Ensure data is accurate, timely, secure, and ready for self-service analytics and downstream applications
What we offer
What we offer
  • Paid Time Off, Medical, Dental and Vision plans, Retirement plans
  • Public Service Loan Forgiveness (PSLF)
  • Fulltime
Read More
Arrow Right

Senior Software Engineer (Data Platform)

Atlassians can choose where they work – whether in an office, from home, or a co...
Location
Location
India , Remote
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid understanding and experience in building RESTful APIs and micro services, e.g. with Flask, Spring boot etc
  • Experience with Big Data processing and storage technologies such as Spark, DBT
  • Built solutions using public cloud offerings such as Amazon Web Services
  • SQL knowledge
  • Experience with test automation and ensuring data quality across multiple datasets used for analytical purposes
  • Experience with continuous delivery, continuous integration, and source control system such as Git
  • Expert level programming skills in OO Programming language like Java, Kotlin, Scala or Python
  • Deep understanding of big data challenges
  • Degree in Computer Science, EE, or related STEM discipline
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right