CrawlJobs Logo
invent.ai Logo invent.ai · IT - Software Development

Platform Engineer - Data Systems & Orchestration

· Job Posted February 24, 2026
Apply Position
Job Link Share

Job Description

We're seeking a Senior Data Platform Engineer to design, build, and evolve our end-to-end data ecosystem. Serving as the vital bridge between raw infrastructure and practical data engineering, your mission is to provide a seamless, scalable platform for our data teams. You will be responsible for ensuring the robustness of our underlying cloud infrastructure (Kubernetes on Azure/AWS), orchestrating complex pipelines via Airflow, and optimizing the PySpark/Python execution environments that power our data products.

Job Responsibility

  • Develop “best-in-class” architecture, design and production artifacts by ensuring that the services and the components are: well-defined and modularized, secure, scalable, reliable, reusable, diagnosable, and actively monitored
  • Contribute to all phases of new developments including architecting, prototyping, productizing, testing and support
  • Adhere to and drive modern software engineering practices through code and design reviews, exercise DevOps principles to deploy, maintain and monitor production workflows and services to provide continuous delivery with high quality and actionable telemetry data
  • Stay educated on existing and state of the art technologies, and do proof of concept studies to evaluate technology fits relevant to our product requirements
  • Understanding business objectives and developing models that help to achieve them, along with metrics to track their progress
  • Mentor junior developers with coaching and participating code/design reviews

Requirements

  • Bachelor’s degree or higher in a related field
  • 4-6+ years working with distributed production systems at scale
  • Hands-on experience designing data platforms, including managing workflow orchestration (e.g., Apache Airflow, Dagster etc.) and utilizing Python/PySpark for data processing
  • Understanding of modern data lakehouse architectures (Delta Lake, Snowflake, Iceberg etc.), metadata management concepts, and experience integrating data catalogs (OpenMetadata, DataHub, etc.)
  • Experience in observing & tracing data quality, data lineage etc.
  • Hands-on experience manipulating data across varied storage systems, including traditional relational databases and NoSQL document/key-value stores
  • Strong grasp of Python software design, including Object-Oriented Programming (OOP) patterns and effective use of data structures for building robust, maintainable automation and tooling
  • Proficiency in designing and building internal REST APIs using modern Python frameworks (FastAPI, Flask, AWS Serverless etc.)
  • Hands-on experience building and maintaining scalable solutions within cloud environments
  • Proficiency in navigating modern cloud ecosystems and platforms (such as Azure, AWS, GCP, Databricks etc.) with the ability to adapt to multi-cloud architectures
  • Detailed familiarity with essential cloud service offerings (Compute, Storage, Networking, IAM)
  • Expertise in the complete container lifecycle, from packaging applications with Docker to managing production-grade orchestration via Kubernetes
  • Proven ability to design and implement robust CI/CD pipelines using a mix of established tools like Jenkins, GitHub Actions etc. and modern GitOps workflows (e.g., Flux, ArgoCD) for reliable, reproducible infrastructure and application deployments

What we offer

  • We work flexibly and remotely
  • We provide monthly fixed contribution to internet bill and fun packets (Netflix, Amazon Prime etc.)
  • We care about your health and support it with comprehensive private health insurance
  • We support your career growth with Udemy, Medium, HBR and other learning tools
  • At Invent.ai, you have extra off days for different occasions (birthday, moving day, maternity & paternity leaves etc.)
  • Great people make the perfect match: We have a powerful referral bonus for the friend you refer
  • All-day snacks at the office, team activities, social club meetings, annual retreats, monthly happy Friday drinks and other celebrations
  • We have a Game Master at Invent
  • At Invent.ai we celebrate and reward our successful teammates who have won awards in arts and sports
  • Invent.ai gives you the opportunity to make a real difference in people's lives
  • We support the Invent social clubs for their hobbies
  • painting, tennis, football and more
invent.ai - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Platform Engineer - Data Systems & Orchestration

8 matching positions

Aws Data Engineer (Cloud Data Platform & Pipeline Specialist)

Design, develop, and maintain scalable cloud-based data pipelines using AWS serv...
Location
Location
United States , Atlanta
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering, with strong hands-on expertise in AWS data services (Glue, EMR, S3, RDS, DataSync, DMS)
  • 5+ years of Proven experience building and managing data pipelines (batch and streaming) in cloud environments
  • 5+ years of Strong experience in data migration, transformation frameworks, and large-scale data replication
  • 5+ years of Deep understanding of data modeling, data transformation, and reconciliation techniques
  • 5+ years of Experience designing and implementing secure data access and governance (least privilege principles)
  • 5+ years of Hands-on experience with data validation, auditing, and reconciliation processes
  • Familiarity with regulatory or finance data environments and reporting workloads
  • 5+ years of Strong problem-solving skills and ability to work in a collaborative, fast-paced environment
  • AWS data services
  • data pipelines
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable cloud-based data pipelines using AWS services such as Glue, EMR, S3, RDS, DataSync, and DMS
  • Build and optimize batch and streaming data orchestration workflows to support enterprise data platforms
  • Lead large-scale data migration efforts, including legacy-to-cloud transformations and replication strategies
  • Perform data modeling, transformation, and reconciliation to ensure high-quality, consistent datasets across systems
  • Implement secure data access patterns following least-privilege principles for pipelines and datasets
  • Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver solutions
  • Establish robust data validation, reconciliation, and audit mechanisms to meet regulatory and reporting requirements
  • Troubleshoot and optimize performance of ETL/ELT pipelines and data workflows in AWS environments
  • Support governance, compliance, and audit readiness for data platforms in regulated environments (finance/reporting)
  • Fulltime
Read More
Arrow Right

Senior Product Designer, Data Platform - Online Data Stores and Movement Platform

We're seeking a Senior Product Designer to shape the next generation of data mov...
Location
Location
United States
Salary
Salary:
350000.00 - 520000.00 USD / Year
designx.community Logo
DesignX Community
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years as a Product Designer (or equivalent experience)
  • Experience designing orchestration and/or data movement tools, databases, developer/data platform tools, or analogous complex technical products
  • Strong portfolio showing system‑level product work and the impact of your design leadership, including initiatives that span multiple teams
  • Proven track record of leading design initiatives from concept to launch
  • Proficient in design tools (Figma, etc.) and prototyping technologies
  • Strong systems thinking and ability to design scalable solutions for complex data/analytics challenges
  • Successfully led design strategy for complex technical products
  • Proven track record of influencing and aligning cross-functional partners without direct authority
  • Ability to navigate ambiguity, create clarity, and move complex initiatives forward with partners
  • Excellence in communicating design decisions to technical audiences
Job Responsibility
Job Responsibility
  • Shape and own design for ODS and movement platform
  • creating intuitive workflows that enhance data practitioner and software engineer productivity and delight
  • Contribute to and help drive adoption of patterns and components for operational, data‑dense UIs (runs, pipelines, lineage, diffs) that scale across the platform
  • Identify opportunities for innovation through research, incident analysis, and technical insight
  • sequence delivery for measurable impact
  • Create cohesive, end‑to‑end experiences with guardrails over gates (paved paths, templates, defaults) to reduce errors
  • Partner with product and engineering to define and improve how we measure experiences
  • Anticipate emerging needs and help frame design problems early
  • Drive end‑to‑end design for interdependent workflows
  • Craft and validate prototypes that effectively communicate solutions
What we offer
What we offer
  • Health Plans
  • Mental Health support
  • 401(k) Retirement Plan with employer match
  • Stock Option Program
  • Disability Programs
  • Health Savings and Flexible Spending Accounts
  • Family-forming benefits
  • Life and Serious Injury Benefits
  • Paid leave of absence programs
  • Flexible time off
  • Fulltime
Read More
Arrow Right

Senior Data Platform Engineer

Pinecone is looking for a Senior Data Engineer to own and grow the systems that ...
Location
Location
United States , New York City
Salary
Salary:
Not provided
pinecone.io Logo
Pinecone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years building and operating data pipelines in production
  • Strong SQL, with comfort in BigQuery (or Snowflake/Redshift) writing non-trivial analytical queries, optimizing performance, and reasoning about correctness
  • Strong coding skills, with comfort writing ETL/rETL, consuming services and integrations against REST/GraphQL APIs, and producing clean code that others can reuse and maintain
  • Experience with a modern orchestrator (Airflow, Dagster, Prefect, or similar) running containerized workloads
  • Comfort with Docker, Kubernetes, and modern cloud infrastructure best practices
  • Experience integrating systems, pulling data between APIs, databases, and warehouses
  • handling auth, pagination, schema drift, and incremental loads
  • Hands-on experience using AI coding tools (Claude Code, Cursor, or similar) as part of your workflow
  • Ability to design, build, and own systems end-to-end in a highly autonomous environment
Job Responsibility
Job Responsibility
  • Own and build the ingestion layer. Design, deploy, and scale pipelines that pull from third-party APIs, internal services, and SaaS tools into BigQuery. Add new sources as the business demands
  • Own and build the transform layer. Develop and maintain our DBT project, including staging, intermediate, and marts. Maintain core business datasets: users, organizations, indexes, accounts, usage, revenue. Write tests, snapshots, and documentation. Drive data quality and trust
  • Own and build the orchestration platform. Operate the Airflow-on-Kubernetes environment that runs our ingest and DBT workloads. Improve reliability, scalability, observability, and CI/CD
  • Establish and maintain the business-context and metrics layer. Curate metric definitions and documentation that feed both human analysts and agents
  • Manage infrastructure cost and performance. Manage BigQuery, GKE, Cloud Run, and Kafka costs, right-size compute, and make sure the platform stays efficient
  • Lead and own mission-critical company-level analyses. Partner with finance, GTM, product, and exec stakeholders to answer business questions, design metrics, run experiments and evaluations, build views in BI tools, and ship dashboards that support key business decisions as well as regular reporting to the Board of Directors
  • Enable other teams to self-serve. Onboard analysts and non-DE stakeholders onto the warehouse, help them with best practices, and create reusable models and tooling
  • Set the standard for AI-assisted data workflow. Establish best AI practices and patterns that enable a small data team to operate with outsized leverage
What we offer
What we offer
  • Comprehensive health coverage including medical, dental, vision, and mental health resources
  • 401(k) Plan
  • Equity award
  • Flexible time off
  • Paid parental leave
  • Annual Company Event
  • WFH Equipment Stipend
  • Fulltime
Read More
Arrow Right

Data Platform Engineer

At APS Group, Data Platform Engineers build and maintain the foundation of our d...
Location
Location
United Kingdom , Cheadle
Salary
Salary:
Not provided
theapsgroup.com Logo
APS Group
Expiration Date
August 26, 2026
Flip Icon
Requirements
Requirements
  • Experience designing and operating data platforms or shared data infrastructure in production environments
  • Strong proficiency in Python and SQL
  • Experience with cloud platforms, preferably AWS (e.g. S3, Glue, Redshift, Lambda)
  • Solid understanding of data warehousing concepts such as data lakes, dimensional modelling, and event-driven architectures
  • Experience with ELT/ETL tooling and orchestration frameworks
  • Familiarity with data quality, monitoring, and observability practices
  • Experience with infrastructure-as-code, automation, and CI/CD practices
  • Experience with version control (Git) and collaborative workflows
  • Working knowledge of database systems (PostgreSQL, MS SQL, or similar)
  • A few years of experience in platform engineering, data engineering or a similar role
Job Responsibility
Job Responsibility
  • Design, build, and evolve the Data Platform used by multiple teams and domains
  • Create reusable patterns, tooling, and standards for building data pipelines and data products
  • Own and improve the reliability, scalability, and observability of the data platform
  • Improve self-service capabilities so teams can onboard, ingest, transform, and publish data independently
  • Automate platform workflows including provisioning, testing, deployment, and monitoring
  • Collaborate with domain and analytics teams to remove friction and improve the developer experience
  • Design and evolve data models that support analytics and operational use cases
  • Collaborate with stakeholders to ensure data is usable, reliable, and well understood
What we offer
What we offer
  • Standard
  • Fulltime
Read More
Arrow Right

Data Platform Engineer

Our client is looking for an experienced Data Platform Engineer to design, build...
Location
Location
United States , Beaverton
Salary
Salary:
110000.00 - 120000.00 USD / Year
profocustechnology.com Logo
ProFocus Technology
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced proficiency with SQL and relational databases (SQL Server) — ability to query, manage, and support business data environments
  • 5+ years of progressively responsible experience in data engineering, application development, systems integration, or analytics
  • Experience with Microsoft Fabric, Power BI, and DAX
  • Experience building and supporting ETL/ELT pipelines and orchestration tools (e.g., Airflow)
  • Proficiency using Python for automation, data processing, reporting, or application support
  • Demonstrated experience building and supporting business applications, automated workflows, integrations, and process automation
  • Bachelor's degree or an equivalent combination of education, certifications, and relevant experience
Job Responsibility
Job Responsibility
  • Design, develop, and support business applications, automation solutions, and system integrations that improve operational efficiency
  • Build, maintain, and optimize data pipelines, ETL/ELT processes, and data models to ensure accurate, reliable, and accessible information across multiple business systems
  • Create and enhance reporting, dashboards, and analytics that deliver actionable insights for operational and strategic decision-making
  • Develop and support Power Platform solutions — apps, workflows, and data models — to automate processes and boost productivity
  • Troubleshoot and resolve complex application, data, integration, and reporting issues using root cause analysis
  • Support platform infrastructure, deployment processes, automation frameworks, and monitoring/observability tooling
  • Maintain technical documentation and promote data governance, security, and process standardization
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Data Platform, AI Infrastructure

We are building a large-scale, productized data platform that powers critical in...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
  • Strong programming experience in Python
  • Experience building and operating large-scale distributed systems
  • Hands-on experience with: Backend services or APIs (e.g., FastAPI, Flask, or similar)
  • Cloud-based infrastructure (Azure, AWS, or GCP)
  • Monitoring and observability systems (metrics, logging, alerting)
  • Experience designing systems with reliability, scalability, and operational clarity in mind
  • Proven ability to own and deliver production systems end-to-end
  • Ability to break down ambiguous problems, ask the right questions, and execute effectively
Job Responsibility
Job Responsibility
  • Design, build, and operate core components of a distributed data platform, including: Orchestration systems (e.g., Airflow or equivalent)
  • Backend services and APIs (Python/FastAPI or similar)
  • Monitoring, alerting, and reliability systems
  • Own the end-to-end lifecycle of platform components - from design through deployment, scaling, and maintenance
  • Ensure systems meet requirements for availability, performance, and data reliability at large scale
  • Define and enforce standardized patterns for infrastructure, deployment, and observability across the platform
  • Partner with data engineering teams to enable efficient, reliable data processing workflows
  • Diagnose and resolve complex issues in distributed systems, including performance bottlenecks and failure modes
  • Contribute to infrastructure-as-code and deployment systems to support reproducibility and operational excellence
  • Drive continuous improvements in system robustness, cost efficiency, and operational clarity
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
  • Fulltime
Read More
Arrow Right

Data Platform Engineer

Location
Location
Canada
Salary
Salary:
Not provided
myticas.com Logo
Myticas Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Geospatial Data Engineering: Experience designing and maintaining scalable data pipelines for spatial datasets and geospatial analytics workloads
  • Python Data Engineering Stack: Strong Python experience using libraries such as Pandas, NumPy, SQLAlchemy, pytest, and other data engineering tools
  • Geospatial Libraries & Tooling: Hands-on experience with GeoPandas, Rasterio, Xarray, rioxarray, QGIS, or similar spatial processing tools
  • Spatial Databases: Expertise working with PostgreSQL/PostGIS or other spatially enabled databases for large geospatial datasets
  • Workflow Orchestration: Experience with pipeline orchestration tools such as Airflow, DBT, or similar data workflow frameworks
  • Cloud Data Platforms: Experience deploying and managing data pipelines within AWS or comparable cloud infrastructure environments
  • Containerized Data Workflows: Familiarity with Docker and version control systems (Git) for managing reproducible data engineering environments
  • Geospatial Data Integration: Experience ingesting and harmonizing multi-source geospatial data (public datasets, sensor data, satellite or environmental datasets)
  • Data Quality & Validation: Experience implementing data validation, testing, and quality assurance processes within data pipelines
  • Geospatial Analytics & Visualization: Ability to support spatial analysis, mapping workflows, and geospatial insight generation for technical and non-technical stakeholders
Read More
Arrow Right

Senior Platform Engineer - Data Reliability

The Feedzai Platform Data Reliability play a pivotal role in managing core data ...
Location
Location
Portugal
Salary
Salary:
Not provided
feedzai.com Logo
Feedzai
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A bachelor's degree in Computer Science, Information Systems, or the equivalent combination of education, experience, and training
  • 4+ years of experience in data reliability, platform engineering, or operating data services at scale
  • Proficiency in programming languages such as Go, Java, or similar
  • Hands-on experience with Container Technologies and Orchestration (e.g., Docker, Kubernetes)
  • Valuable experience with data streaming and messaging platforms, like Kafka, Elasticsearch, RabbitMQ
  • Familiarity with CI/CD pipelines and tools such as Jenkins, Gitlab, or similar
  • Demonstrated commitment to staying updated with industry trends and emerging technologies, showcasing a proactive approach to continuous learning
  • Demonstrated knowledge of best practices in security, ensuring the implementation of secure coding standards
  • Experience working with Cloud Providers, with a preference for AWS Cloud
  • Expertise in utilizing monitoring and observability stacks like Grafana and Prometheus
Job Responsibility
Job Responsibility
  • Build and maintain Kubernetes Operators, including deployment, monitoring, operations, and analytics tools developed by the team
  • Engage in development tasks using Go, Java, or similar languages
  • Operate services such as Kafka, Elasticsearch, RabbitMQ, Redis, Relational databases and Couchbase at an enterprise scale
  • Contribute to the self-healing capabilities of applications in our enterprise environments
  • Develop playbooks associated with actionable alerts to streamline response procedures
  • Work with AI-assisted development tools (e.g. Cursor) as part of your daily workflow to ship faster and iterate effectively
  • Maintain and enhance our Infrastructure as Code (IaC) to efficiently manage end-to-end lifecycle operations (monitoring, alerting, security, cost optimization, configuration, backup, etc.) in production environments
  • Utilize your experience and problem solving skills to help prevent and investigate production issues
Read More
Arrow Right