CrawlJobs Logo

Platform Engineer - Data Systems & Orchestration

invent.ai

Location Icon

Location:

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

We're seeking a Senior Data Platform Engineer to design, build, and evolve our end-to-end data ecosystem. Serving as the vital bridge between raw infrastructure and practical data engineering, your mission is to provide a seamless, scalable platform for our data teams. You will be responsible for ensuring the robustness of our underlying cloud infrastructure (Kubernetes on Azure/AWS), orchestrating complex pipelines via Airflow, and optimizing the PySpark/Python execution environments that power our data products.

Job Responsibility:

  • Develop “best-in-class” architecture, design and production artifacts by ensuring that the services and the components are: well-defined and modularized, secure, scalable, reliable, reusable, diagnosable, and actively monitored
  • Contribute to all phases of new developments including architecting, prototyping, productizing, testing and support
  • Adhere to and drive modern software engineering practices through code and design reviews, exercise DevOps principles to deploy, maintain and monitor production workflows and services to provide continuous delivery with high quality and actionable telemetry data
  • Stay educated on existing and state of the art technologies, and do proof of concept studies to evaluate technology fits relevant to our product requirements
  • Understanding business objectives and developing models that help to achieve them, along with metrics to track their progress
  • Mentor junior developers with coaching and participating code/design reviews

Requirements:

  • Bachelor’s degree or higher in a related field
  • 4-6+ years working with distributed production systems at scale
  • Hands-on experience designing data platforms, including managing workflow orchestration (e.g., Apache Airflow, Dagster etc.) and utilizing Python/PySpark for data processing
  • Understanding of modern data lakehouse architectures (Delta Lake, Snowflake, Iceberg etc.), metadata management concepts, and experience integrating data catalogs (OpenMetadata, DataHub, etc.)
  • Experience in observing & tracing data quality, data lineage etc.
  • Hands-on experience manipulating data across varied storage systems, including traditional relational databases and NoSQL document/key-value stores
  • Strong grasp of Python software design, including Object-Oriented Programming (OOP) patterns and effective use of data structures for building robust, maintainable automation and tooling
  • Proficiency in designing and building internal REST APIs using modern Python frameworks (FastAPI, Flask, AWS Serverless etc.)
  • Hands-on experience building and maintaining scalable solutions within cloud environments
  • Proficiency in navigating modern cloud ecosystems and platforms (such as Azure, AWS, GCP, Databricks etc.) with the ability to adapt to multi-cloud architectures
  • Detailed familiarity with essential cloud service offerings (Compute, Storage, Networking, IAM)
  • Expertise in the complete container lifecycle, from packaging applications with Docker to managing production-grade orchestration via Kubernetes
  • Proven ability to design and implement robust CI/CD pipelines using a mix of established tools like Jenkins, GitHub Actions etc. and modern GitOps workflows (e.g., Flux, ArgoCD) for reliable, reproducible infrastructure and application deployments
What we offer:
  • We work flexibly and remotely
  • We provide monthly fixed contribution to internet bill and fun packets (Netflix, Amazon Prime etc.)
  • We care about your health and support it with comprehensive private health insurance
  • We support your career growth with Udemy, Medium, HBR and other learning tools
  • At Invent.ai, you have extra off days for different occasions (birthday, moving day, maternity & paternity leaves etc.)
  • Great people make the perfect match: We have a powerful referral bonus for the friend you refer
  • All-day snacks at the office, team activities, social club meetings, annual retreats, monthly happy Friday drinks and other celebrations
  • We have a Game Master at Invent
  • At Invent.ai we celebrate and reward our successful teammates who have won awards in arts and sports
  • Invent.ai gives you the opportunity to make a real difference in people's lives
  • We support the Invent social clubs for their hobbies
  • painting, tennis, football and more

Additional Information:

Job Posted:
February 24, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Icon
invent.ai - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Platform Engineer - Data Systems & Orchestration

Big Data Platform Senior Engineer

Lead Java Data Engineer to guide and mentor a talented team of engineers in buil...
Location
Location
Bahrain , Seef, Manama
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Significant hands-on experience developing high-performance Java applications (Java 11+ preferred) with strong foundation in core Java concepts, OOP, and OOAD
  • Proven experience building and maintaining data pipelines using technologies like Kafka, Apache Spark, or Apache Flink
  • Familiarity with event-driven architectures and experience in developing real-time, low-latency applications
  • Deep understanding of distributed systems concepts and experience with MPP platforms such as Trino (Presto) or Snowflake
  • Experience deploying and managing applications on container orchestration platforms like Kubernetes, OpenShift, or ECS
  • Demonstrated ability to lead and mentor engineering teams, communicate complex technical concepts effectively, and collaborate across diverse teams
  • Excellent problem-solving skills and data-driven approach to decision-making
Job Responsibility
Job Responsibility
  • Provide technical leadership and mentorship to a team of data engineers
  • Lead the design and development of highly scalable, low-latency, fault-tolerant data pipelines and platform components
  • Stay abreast of emerging open-source data technologies and evaluate their suitability for integration
  • Continuously identify and implement performance optimizations across the data platform
  • Partner closely with stakeholders across engineering, data science, and business teams to understand requirements
  • Drive the timely and high-quality delivery of data platform projects
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data Platform

We are looking for a foundational member of the Data Team to enable Skydio to ma...
Location
Location
United States , San Mateo
Salary
Salary:
180000.00 - 240000.00 USD / Year
skydio.com Logo
Skydio
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional experience
  • 2+ years in software engineering
  • 2+ years in data engineering with a bias towards getting your hands dirty
  • Deep experience with Databricks building pipelines, managing datasets, and developing dashboards or analytical applications
  • Proven track record of operating scalable data platforms, defining company-wide patterns that ensure reliability, performance, and cost effectiveness
  • Proficiency in SQL and at least one modern programming language (we use Python)
  • Comfort working across the full data stack — from ingestion and transformation to orchestration and visualization
  • Strong communication skills, with the ability to collaborate effectively across all levels and functions
  • Demonstrated ability to lead technical direction, mentor teammates, and promote engineering excellence and best practices across the organization
  • Familiarity with AI-assisted data workflows, including tools that accelerate data transformations or enable natural-language interfaces for analytics
Job Responsibility
Job Responsibility
  • Design and scale the data infrastructure that ingests live telemetry from tens of thousands of autonomous drones
  • Build and evolve our Databricks and Palantir Foundry environments to empower every Skydian to query data, define jobs, and build dashboards
  • Develop data systems that make our products truly data-driven — from predictive analytics that anticipate hardware failures, to 3D connectivity mapping, to in-depth flight telemetry analysis
  • Create and integrate AI-powered tools for data analysis, transformation, and pipeline generation
  • Champion a data-driven culture by defining and enforcing best practices for data quality, lineage, and governance
  • Collaborate with autonomy, manufacturing, and operations teams to unify how data flows across the company
  • Lead and mentor data engineers, analysts, and stakeholders across Skydio
  • Ensure platform reliability by implementing robust monitoring, observability, and contributing to the on-call rotation for critical data systems
What we offer
What we offer
  • Equity in the form of stock options
  • Comprehensive benefits packages
  • Relocation assistance may also be provided for eligible roles
  • Paid vacation time
  • Sick leave
  • Holiday pay
  • 401K savings plan
  • Fulltime
Read More
Arrow Right

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in data engineering and data platform development
  • Strong hands-on experience with: AWS Glue
  • Amazon EMR (Spark)
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
Job Responsibility
Job Responsibility
  • Design, develop, and optimize scalable data pipelines using AWS native services
  • Lead the implementation of batch and near-real-time data processing solutions
  • Architect and manage data ingestion, transformation, and storage layers
  • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
  • Orchestrate complex data workflows using Apache Airflow (MWAA)
  • Develop and manage serverless data processing using AWS Lambda
  • Design and optimize data warehouses using Amazon Redshift
  • Implement and manage NoSQL data models using Amazon DynamoDB
  • Utilize AWS DataZone for data governance, cataloging, and access management
  • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
  • Fulltime
Read More
Arrow Right

Data Platform Engineer

Finaloop revolutionizes financial operations for eCommerce businesses! Our cutti...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
finaloop.com Logo
Finaloop
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years experience in data engineering or platform engineering roles
  • Strong programming skills in Python and SQL
  • Experience with orchestration platforms like Airflow/Dagster/Temporal
  • Experience with MPPs like Snowflake/Redshift/Databricks
  • Hands-on experience with cloud platforms (AWS) and their data services
  • Understanding of data modeling, data warehousing, and data lake concepts
  • Ability to optimize data infrastructure for performance and reliability
  • Experience working with containerization (Docker) in Kubernetes environments
  • Familiarity with CI/CD concepts
  • Fluent in English, both written and verbal
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines and ETL processes for our financial data platform
  • Develop and optimize data infrastructure to support real-time analytics and reporting
  • Implement data governance, security, and privacy controls to ensure data quality and compliance
  • Create and maintain documentation for data platforms and processes
  • Collaborate with data scientists and analysts to deliver actionable insights to our customers
  • Troubleshoot and resolve data infrastructure issues efficiently
  • Monitor system performance and implement optimizations
  • Stay current with emerging technologies and implement innovative solutions
Read More
Arrow Right

Platform Engineer, Agent Collaboration Platform

Platform engineering at Hebbia is about excellent, scalable enablement. You are ...
Location
Location
United States , New York City; San Francisco
Salary
Salary:
160000.00 - 300000.00 USD / Year
hebbia.ai Logo
Hebbia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field
  • 5+ years software development experience at a venture-backed startup or top technology firm, with a focus on distributed systems and platform engineering
  • Proficiency in building backend and distributed systems using technologies such as Python, Java, or Go
  • Deep understanding of scalable system design, performance optimization, and resilience engineering
  • Extensive experience with cloud platforms (e.g., AWS)
  • Working experience with one or more of the following: Kafka, ElasticSearch, PostgreSQL, and/or Redis
  • Knowledge of workflow orchestration and execution platforms like Airflow, Temporal or Prefect
  • Proven experience enabling observability patterns
  • Ability to analyze complex problems, propose innovative solutions, and effectively communicate technical concepts
  • Proven experience in leading software development projects and collaborating with cross-functional teams
Job Responsibility
Job Responsibility
  • Own critical system components: Take complex requirements and turn them into robust, scaled solutions that solve real customer needs
  • Unlock O(1) universal indexing: Build and iterate on our high-scale document build system that enables constant time latency for indexing any content in the world, regardless of data volume
  • Drive performance optimization: Architect and implement performance-tuning solutions to ensure our systems operate efficiently at scale, minimizing latency and maximizing throughput across millions of documents
  • Mentor and guide: Provide technical leadership, mentorship, and guidance to junior engineers, fostering a culture of learning and growth
What we offer
What we offer
  • PTO: Unlimited
  • Insurance: Medical + Dental + Vision + 401K
  • Eats: Catered lunch daily + doordash dinner credit if you ever need to stay late
  • Parental leave policy: 3 months non-birthing parent, 4 months for birthing parent
  • Fertility benefits: $15k lifetime benefit
  • New hire equity grant: competitive equity package with unmatched upside potential
  • Fulltime
Read More
Arrow Right

Senior Data Platform Engineer

At Fever, our engineering team powers the technology behind our apps and website...
Location
Location
Spain , Madrid
Salary
Salary:
Not provided
https://feverup.com/fe Logo
Fever
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expert in Python and frameworks like FastAPI or Django
  • Experience with Snowflake, PostgreSQL, and data management best practices
  • Familiar with IaC (Terraform), orchestration tools (Airflow, Metaflow), and CI/CD (Jenkins)
  • Experience with Kubernetes, Kafka, and GitOps tools like ArgoCD
  • Skilled in observability tools like Datadog, Grafana, and Prometheus
  • Strong communicator and team player in international, cross-functional environments
  • Proactive, adaptable, and solution-oriented
  • Fluent in English for effective communication
Job Responsibility
Job Responsibility
  • Build and maintain a scalable, reliable data platform
  • Implement data governance policies to ensure data quality, consistency, and security
  • Develop observability systems for platform monitoring and reliability
  • Build and automate infrastructure: data warehouses, lakes, pipelines, and real-time systems
  • Apply Infrastructure as Code (IaC) practices using tools like Terraform
  • Promote best practices for data engineering and platform operations
  • Build internal tools that simplify data-driven application development
  • Work with teams across the company to understand and meet data needs
What we offer
What we offer
  • Attractive compensation package consisting of base salary and the potential to earn a significant bonus for top performance
  • Stock options
  • Opportunity to have a real impact in a high-growth global category leader
  • 40% discount on all Fever events and experiences
  • Home office friendly
  • Responsibility from day one and professional and personal growth
  • Great work environment with a young, international team of talented people to work with
  • Health insurance and other benefits such as Flexible remuneration with a 100% tax exemption through Cobee
  • English Lessons
  • Gympass Membership
  • Fulltime
Read More
Arrow Right

Data Engineer, Enterprise Data, Analytics and Innovation

Are you passionate about building robust data infrastructure and enabling innova...
Location
Location
United States
Salary
Salary:
110000.00 - 125000.00 USD / Year
vaniamgroup.com Logo
Vaniam Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional experience in data engineering, ETL, or related roles
  • Strong proficiency in Python and SQL for data engineering
  • Hands-on experience building and maintaining pipelines in a lakehouse or modern data platform
  • Practical understanding of Medallion architectures and layered data design
  • Familiarity with modern data stack tools, including: Spark or PySpark
  • Workflow orchestration (Airflow, dbt, or similar)
  • Testing and observability frameworks
  • Containers (Docker) and Git-based version control
  • Excellent communication skills, problem-solving mindset, and a collaborative approach
Job Responsibility
Job Responsibility
  • Design, build, and operate reliable ETL and ELT pipelines in Python and SQL
  • Manage ingestion into Bronze, standardization and quality in Silver, and curated serving in Gold layers of our Medallion architecture
  • Maintain ingestion from transactional MySQL systems into Vaniam Core to keep production data flows seamless
  • Implement observability, data quality checks, and lineage tracking to ensure trust in all downstream datasets
  • Develop schemas, tables, and views optimized for analytics, APIs, and product use cases
  • Apply and enforce best practices for security, privacy, compliance, and access control, ensuring data integrity across sensitive healthcare domains
  • Maintain clear and consistent documentation for datasets, pipelines, and operating procedures
  • Lead the integration of third-party datasets, client-provided sources, and new product-generated data into Vaniam Core
  • Partner with product and innovation teams to build repeatable processes for onboarding new data streams
  • Ensure harmonization, normalization, and governance across varied data types (scientific, engagement, operational)
What we offer
What we offer
  • 100% remote environment with opportunities for local meet-ups
  • Positive, diverse, and supportive culture
  • Passionate about serving clients focused on Cancer and Blood diseases
  • Investment in you with opportunities for professional growth and personal development through Vaniam Group University
  • Health benefits – medical, dental, vision
  • Generous parental leave benefit
  • Focused on your financial future with a 401(k) Plan and company match
  • Work-Life Balance and Flexibility
  • Flexible Time Off policy for rest and relaxation
  • Volunteer Time Off for community involvement
  • Fulltime
Read More
Arrow Right

Staff Data Engineer

We’re looking for a Staff Data Engineer to own the design, scalability, and reli...
Location
Location
United States , San Jose
Salary
Salary:
150000.00 - 250000.00 USD / Year
figure.ai Logo
Figure
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience owning or architecting large-scale data platforms — ideally in EV, autonomous driving, or robotics fleet environments, where telemetry, sensor data, and system metrics are core to product decisions
  • Deep expertise in data engineering and architecture (data modeling, ETL orchestration, schema design, transformation frameworks)
  • Strong foundation in Python, SQL, and modern data stacks (dbt, Airflow, Kafka, Spark, BigQuery, ClickHouse, or Snowflake)
  • Experience building data quality, validation, and observability systems to detect regressions, schema drift, and missing data
  • Excellent communication skills — able to understand technical needs from domain experts (controls, perception, operations) and translate complex data patterns into clear, actionable insights for engineers and leadership
  • First-principles understanding of electrical and mechanical systems, including motors, actuators, encoders, and control loops
Job Responsibility
Job Responsibility
  • Architect and evolve Figure’s end-to-end platform data pipeline — from robot telemetry ingestion to warehouse transformation and visualization
  • Improve and maintain existing ETL/ELT pipelines for scalability, reliability, and observability
  • Detect and mitigate data regressions, schema drift, and missing data via validation and anomaly-detection frameworks
  • Identify and close gaps in data coverage, ensuring high-fidelity metrics coverage across releases and subsystems
  • Define the tech stack and architecture for the next generation of our data warehouse, transformation framework, and monitoring layer
  • Collaborate with robotics domain experts (controls, perception, Guardian, fall-prevention) to turn raw telemetry into structured metrics that drive engineering/business decisions
  • Partner with fleet management, operators, and leadership to design and communicate fleet-level KPIs, trends, and regressions in clear, actionable ways
  • Enable self-service access to clean, documented datasets for engineers
  • Develop tools and interfaces that make fleet data accessible and explorable for engineers without deep data backgrounds
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy