CrawlJobs Logo

Data Platform Engineer (Python / Golang)

Poland; Ukraine · Job Posted June 14, 2026
Apply Position
Job Link Share

Job Description

You will work on a live, high-load fleet management platform that connects tens of thousands of vehicles across enterprise fleets worldwide — processing real-time telemetry, powering mobile apps used by drivers and technicians on the ground, and integrating with hardware, firmware, and 20+ data partners. The system runs 24/7, handles genuine scale, and the work is a mix of complex new features, infrastructure modernisation, and keeping production rock-solid. If you want a project where the data is real, the stakes are real, and the engineering problems are interesting — this is it.

Job Responsibility

  • Own data platform architecture across platform — streaming pipelines, partner integrations, and core backend services
  • Define and enforce backend and data engineering standards: service contracts, error handling, logging, secrets management
  • Own code quality and architectural consistency
  • Own event-driven integrations with 20+ external data partners — data contracts, ingestion, transformation, failure handling
  • Design and govern data models across PostgreSQL, DynamoDB, S3, and analytical systems
  • Define and maintain IaC architecture for owned services using Terraform
  • Collaborate with DevOps on deployment patterns, observability, and incident runbooks
  • Monitor production systems, drive alerting standards, and lead resolution of critical data incidents
  • Represent backend and data constraints in planning and API contract discussions — raises risks before implementation starts
  • Produce and maintain architecture documentation, ADRs, and onboarding materials
  • Participate in planning, estimation, and technical risk discussions at program level
  • Use AI-assisted development tools responsibly — review output critically, ensure quality and security compliance

Requirements

  • 5+ years Python backend in production
  • 2+ years as a lead or principal on a data-heavy platform
  • Typed Python at depth: Pydantic, mypy/pyright, clean code and OOP principles
  • sets standards the team follows
  • AWS data services in production (must-have): Lambda, Kinesis, DynamoDB, S3, Athena/Presto or Redshift, SQS/SNS — owned and operated end-to-end, not just used
  • Event-driven architecture ownership — designs streaming pipelines, DLQ strategies, retry/idempotency patterns
  • makes the calls others follow
  • Data engineering at principal depth: ETL/ELT, schema validation, data contracts, data lake/warehouse architecture
  • defines patterns the team reuses
  • SQL at depth — PostgreSQL and analytical engines (Athena, Redshift)
  • query optimisation, partitioning, large-scale zero-downtime migrations
  • Go (Golang) — 2+ years in production
  • defines Go service patterns, reviews and approves Go code across the team
  • Terraform — owns IaC architecture for owned services
  • defines module structure, not just extends existing ones
  • Testing discipline — pytest, pytest-mock, moto
  • drives testing culture and standards across the team
  • Apache Kafka at scale — topic and partition design, consumer group management, schema registry, dead-letter handling
  • Produces ADRs, integration design docs, data model documentation

Nice to have

  • AWS Powertools, Glue, Step Functions, EventBridge
  • OpenTelemetry, Grafana, Prometheus / Elastic APM
  • dbt or Airflow
  • Telematics, IoT, or fleet domain background

What we offer

  • Comfortable atmosphere
  • support for well-being
  • charge professional growth
  • equity, diversity, and inclusion

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Platform Engineer (Python / Golang)

8 matching positions

Data Platform Engineer

We’re searching for a software engineer to join Aurora’s Data Platform. The Data...
Location
Location
United States , Pittsburgh
Salary
Salary:
105000.00 - 157000.00 USD / Year
aurora.tech Logo
Aurora Innovation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS/MS or PhD in Computer Science or a related field
  • Minimum 1 year related experience
  • Required programming skills: GoLang/Python
  • General knowledge of backend software systems networking, load balancing, API gateways, system security, gRPC services
  • AWS infrastructure experience, including S3 and DynamoDB in a production commercial system
  • Knowledge of database design, database management and database scalability
Job Responsibility
Job Responsibility
  • Contribute to the development of internal products and following best practices to simplify data retention
  • Work on tasks to improve the log data availability, discoverability and end to end lifecycle
  • Design efficient AV Log storage patterns that balance performance and affordability
  • Help drive the system efficiency by improving data hygiene across Aurora to deliver cost efficiency
  • Support software engineers across different teams and proactively working together with stakeholders on tasks to satisfy company OKR
What we offer
What we offer
  • annual bonus
  • equity compensation
  • Fulltime
Read More
Arrow Right

Principal Software Engineer--Web data platform

We are looking for a talented and experienced Principal Software Engineer to joi...
Location
Location
China , Beijing
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 7+ years of professional software development experience
  • Proficiency in at least one high-level programming language including but not limited to: C++, C#, Java, Golang or Rust
  • Good communication, collaboration and problem-solving skills
  • Fluent English speaking and writing
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design the architecture of Crawler system, ensuring scalability, efficiency, performance and quality
  • Implement features in a distributed and scalable environment using data to guide and measure success
  • Develop and execute unit, integration, and performance tests to ensure the system is reliable, robust, and meets quality standards
  • Debug and mitigate incidents in live production environments
  • Stay up to date with the latest industry trends and technologies and proactively suggest improvements to the existing system
  • Collaborate closely with cross-functional teams, including product managers and other engineers, to align development goals with business objectives
  • Fulltime
Read More
Arrow Right

T-Shaped Data Engineer

We are hiring a T-shaped Senior Data Engineer to join our team supporting a high...
Location
Location
Salary
Salary:
Not provided
infinitelambda.com Logo
Infinite Lambda
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience
  • Programming languages: Python, Java, Scala or Golang
  • Cloud providers: AWS, GCP, Azure (Azure is preferred)
  • Data warehousing: Snowflake, Databricks, Redshift, Greenplum, Oracle, DB2 or similar (must have experience with Snowflake or Databricks)
  • Data pipelining tools: Snowplow, Fivetran, dbt, Talend
  • Relational databases: Oracle, PostgreSQL, MySQL, Microsoft or similar
  • NoSQL Databases: MongoDB (Atlas), Cassandra, DynamoDB or similar
  • Streaming Technologies: Kinesis, Kafka or Google PubSub or similar
  • Containers & container orchestration: Docker & Kubernetes
  • Workflow Orchestration: Airflow, Cadence Workflow
Job Responsibility
Job Responsibility
  • Lead the design, development, and optimisation of data pipelines using Databricks (including Delta Live Tables / Lakeflow) on Azure
  • Migrate and refactor legacy stored procedures and sprawling MSSQL processes into modern, governed Databricks solutions
  • Contribute to data platform modernisation initiatives, including medallion architecture, data quality, and governance practices
  • Collaborate with the client’s team and our Analytics Engineers to deliver high-quality, production-ready data assets
  • Work in a client-facing consulting environment: gather requirements, provide recommendations, and professionally push back when needed to ensure the best technical outcomes
  • Apply broad data engineering skills (pipelining, orchestration, cloud infrastructure) while deepening your expertise in the modern data stack
What we offer
What we offer
  • Private health insurance
  • Work-from-home budget
  • Unlimited paid holiday
  • Wellness benefits
  • Fulltime
Read More
Arrow Right

Staff Platform Engineer

We are looking for a Staff Platform Engineer to lead the technical direction of ...
Location
Location
United Kingdom , London
Salary
Salary:
110000.00 - 120000.00 GBP / Year
automata.tech Logo
Automata
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in platform engineering, infrastructure, or distributed systems
  • Deep expertise in Kubernetes, including bare-metal and large-scale production systems
  • Strong experience designing cloud + on-prem hybrid architectures
  • Advanced knowledge of Postgres and data infrastructure
  • Proven experience defining and scaling platform standards and developer workflows
  • Strong background in IaC and GitOps at scale
  • Experience designing systems for compliance-heavy environments
  • Deep understanding of observability, reliability engineering, and incident management
  • Strong programming skills in at least one of (Go, Python, Rust, .NET)
  • Excellent communication and leadership skills across technical and non-technical teams
Job Responsibility
Job Responsibility
  • Define and drive the platform architecture across cloud, edge, and bare-metal deployments
  • Establish and evolve golden paths that standardise how engineers build, deploy, and operate services
  • Lead the design of multi-cluster Kubernetes platforms, including bare-metal and hybrid setups
  • Own strategy and best practices for data infrastructure (Postgres and beyond)
  • Drive adoption of GitOps (ArgoCD) and scalable IaC frameworks
  • Architect systems for highly regulated environments (ISO27001, SOC2, GxP)
  • Lead observability strategy using OpenTelemetry and modern tooling
  • Guide network architecture, including physical networking and vendor integrations (Juniper/Mist)
  • Drive platform-level automation and AI adoption (e.g., developer tooling, Claude Code workflows)
  • Influence and improve orchestration patterns (Temporal and similar systems)
What we offer
What we offer
  • Vitality Health Insurance
  • Eye Care
  • Salary Sacrifice - EV
  • Salary Sacrifice - Bike & Tech
  • Wellbeing & Support
  • Wellbeing & Development Allowance
  • Spill & Employee Assistance Programme
  • Additional Leave
  • Pension Scheme
  • Group Life & Critical Illness cover
  • Fulltime
Read More
Arrow Right

Senior Platform Engineer - FinOps

The Open Banking platform engineering team is looking for a senior platform engi...
Location
Location
Ireland , Dublin 18
Salary
Salary:
Not provided
mastercard.com Logo
Mastercard
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong programming skills in Golang and Python, with hands-on experience building and maintaining complex microservices applications
  • 5+ years of experience in cloud architecture and infrastructure management, with a deep focus on cloud cost optimization
  • Expertise in cloud platforms (AWS, Azure, GCP), with advanced knowledge in cloud cost management and FinOps practices
  • Strong ability to analyze large datasets, identify cost inefficiencies, and present data through dashboards and visualizations
  • Proven experience in cloud cost management, FinOps practices, and scalable architecture design
  • Proficiency in traversing and analyzing large datasets, with expertise in tools like SQL, Python, or other data processing, query languages
  • Expertise in developing dashboards and visualizations using tools like AWS Quicksight, Tableau, Power BI, or cloud-native solutions (e.g Kubecost/Opencost)
  • Strong knowledge of cloud platforms (AWS, Azure, GCP), infrastructure-as-code (Terraform, Kubernetes), and automation frameworks
  • Experience in system and application design with a focus on efficiency and reliability
  • A broad technical background with experience across development and infrastructure tools
Job Responsibility
Job Responsibility
  • Design, implement, and maintain cost-efficient cloud infrastructure across multiple clouds
  • Architect and optimize scalable systems and applications with a focus on performance and reliability
  • Traverse and analyze large datasets to identify trends, inefficiencies, and opportunities for optimization
  • Develop and maintain intuitive dashboards and visualizations to present insights on cloud costs, resource utilization, and performance metrics
  • Collaborate with stakeholders to ensure financial and technical goals align, providing actionable insights to support decision-making
  • Automate infrastructure provisioning, monitoring, and reporting using tools like Terraform, Kubernetes, and cloud-native solutions
  • Build tools and processes for efficient cost forecasting, monitoring, and accountability
  • Advocate for FinOps best practices across the organization, educating teams on cost implications of design and operational decisions
  • Fulltime
Read More
Arrow Right

Platform Engineer

We are looking for an enthusiastic Platform Engineer to join our dynamic team at...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
ema.co Logo
Ema
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or a related field
  • 2-8 years of experience in Platform or Infrastructure Engineering or a related technical role
  • Strong understanding of computer science fundamentals, including data structures, algorithms, and operating systems
  • Proficiency in Golang and Python programming languages
  • Familiarity with containerization technologies, particularly Docker
  • Knowledge of Kubernetes and microservices architecture
  • Experience with at least one major cloud provider, with familiarity in multiple cloud providers being a plus
  • Knowledge of database performance optimization techniques, including query optimization, with practical experience in NoSQL and graph data stores
  • Understanding of CAP theorem and working knowledge of database internals is highly desired
  • Knowledge of distributed systems and message queue solutions
Job Responsibility
Job Responsibility
  • Assist in designing, implementing, and maintaining scalable, microservices-based architectures using Docker and Kubernetes across GCP, Azure, and AWS
  • Build and optimize cloud-based infrastructure and platform components using Golang and Python, focusing on scalability, cost-efficiency, and low latency
  • Design, enhance, and test platform components for data ingestion, knowledge base indexing and search, application connectivity, workflow automation, and ML operations
  • Design and implement monitoring and observability solutions to ensure real-time visibility and system health
  • Collaborate with senior engineers to improve system reliability, scalability, and performance, with an emphasis on cost, infrastructure, and latency optimization
  • Support troubleshooting and resolution of platform and infrastructure-related issues, including monitoring system health through real-time alerting systems
  • Assist in implementing DevOps practices, tools, and CI/CD pipelines
  • Participate in on-call rotations and incident response
  • Fulltime
Read More
Arrow Right

Cloud Engineer, Data Processing

As a Cloud Engineer on the Data Processing team, you will contribute to developm...
Location
Location
Mexico , Monterrey
Salary
Salary:
Not provided
aptiv.com Logo
Aptiv plc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree – Computer Science, Computer Engineering, or similar
  • 5+ years Python and/or Golang (preferred) software development experience
  • Proven ability to analyze and navigate legacy codebases, including independently investigating, debugging, and resolving issues without detailed documentation
  • Demonstrated skill at navigating ambiguity and resolving issues without detailed instructions or oversight
  • Experience interfacing applications with relational and non-relational databases (e.g., MySQL, MongoDB), including CRUD operations and schema design
  • Proficient in Linux environments and shell scripting
  • Deep experience with Kubernetes, AWS, RabbitMQ, MongoDB, and MySQL in production settings
  • Familiarity with debugging tools, performance profiling, and system optimization techniques
  • Strong written and oral communication skills, with the ability to clearly document and explain technical concepts
Job Responsibility
Job Responsibility
  • Design, develop, test, and deploy software solutions for Aptiv’s cloud-based data processing systems for automotive datalogger data, including ingest pipelines, ETL workflows, and analytics infrastructure
  • Investigate, root-cause, and resolve production issues across distributed systems
  • Collaborate with systems analysts, engineers, and developers to design systems and to obtain information on project limitations and capabilities, performance requirements, and interfaces
  • Modify existing software to correct errors, allow it to adapt to new platform, or improve its performance
  • Partner with internal stakeholders to develop and execute validation plans that confirm fixes and enhancements meet operational and customer expectations
  • Stay current with evolving cloud technologies, data processing frameworks, and tooling to continuously improve support capabilities and system efficiency
What we offer
What we offer
  • Savings Fund
  • Pension Plan
  • Christmas Bonus
  • Attendance Bonus
  • Vacation Premium
  • Medical Expenses
  • Life Insurance
  • Social security (IMSS, INFONAVIT, Retirement)
  • Recognition for innovation and excellence
  • Opportunities to give back to the community
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Together AI is looking for a Senior Data Engineer to help define, build, and ope...
Location
Location
United States , San Francisco
Salary
Salary:
160000.00 - 240000.00 USD / Year
together.ai Logo
Together AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of demonstrated experience in building large scale, fault tolerant, distributed data platforms, stream processing pipelines, ETLs, etc
  • Expert-level skills in designing, building, and operating stream processing pipelines with services like AWS Kinesis, Apache Kafka, or Redpanda
  • Expert-level knowledge of building real-time customer facing analytics systems using services like AWS TimeStream or Clickhouse
  • Proficiency in writing and maintaining Infrastructure as Code (IaC) using tools like Terraform, AWS CDK, or Pulumi
  • Proficiency in version control practices and integrating IaC with CI/CD pipelines.
  • Proficiency in implementing and managing GitOps workflows with tools such as ArgoCD, Github Actions, TeamCity, or similar
  • Proficiency in one or more of Golang, Rust, Python, Java, or TypeScript
  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Identify, design, and develop foundational data infrastructure components capable of handling millions or billions of events daily
  • Analyze and improve the robustness and scalability of existing data processing infrastructure
  • Partner with product teams to understand functional requirements and deliver solutions that meet business needs
  • Write clear, well-tested, and maintainable infra-as-code and software for both new and existing systems
  • Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
  • Participate in an on-call rotation to address critical incidents when necessary
What we offer
What we offer
  • competitive compensation
  • startup equity
  • health insurance
  • other competitive benefits
  • Fulltime
Read More
Arrow Right