This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We are seeking a Software Engineer with a strong background in infrastructure and a passion for building robust backend systems. In this role, you will play a pivotal part in managing and evolving our core infrastructure, which is responsible for handling massive, high-load web scraping operations and integrating complex scraping systems.
Job Responsibility
High-Load Infrastructure Management: Maintain, scale, and optimize the underlying core infrastructure that powers our high-volume scraping operations to effortlessly sustain the data demands of thousands of clients.
GPU Migration & Optimization: Cooperate on transitioning machine learning models (such as logo detection) from expensive CPU setups to cost-effective GPU deployments using Kubernetes. Validate GPU outputs rigorously against CPU baselines to ensure scaling efficiency.
System Decommissioning: Help identify, deprecate, and decommission legacy, inefficient scraping infrastructure to continually reduce operational overhead and streamline our high-load data pipelines.
Requirements
Golang or C/C++ Proficiency: Strong, practical experience writing backend services in either Go or C/C++ is a strict requirement for this role. If your primary expertise is in C++, you must be fully willing and motivated to learn, adapt, and develop primarily in Go moving forward.
Containerization & Orchestration: Proven experience deploying, scaling, and managing heavy workloads using Kubernetes.
Cloud Infrastructure: Solid foundational experience working within AWS (Amazon Web Services) environments where our operations live.