This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
A Data Engineer designs, builds and maintains a company's data infrastructure, ensuring data is accessible, timely and accurate for data scientists, applications and other users. They focus on creating data pipelines, systems for data collection, storage and access and optimizing data processing for scale. This role requires a strong understanding of data management, programming and cloud computing, along with the ability to collaborate with other teams. They possess strong Python and SQL skills as well as familiarity with building and deploying these in a cloud environment.
Job Responsibility:
Develop and maintain data processing pipelines (ETLs)
Develop and maintain API endpoints
Work with engineering teams across the company to improve dataflows and tracking
Ensuring data security and compliance with relevant regulations
Assist with operational items in data warehouses (e.g. reloading data, optimizing reporting queries etc.)
Troubleshooting issues and identifying areas for improvement in data systems and pipelines
Requirements:
At least 3-5 years of relevant work experience
Understanding of ETL fundamentals and experience building data pipelines
Experience with creating services and projects in Python
Advanced knowledge of SQL and experience with relational databases (Postgres, MySQL)
Experience with analytical storage engines and NoSQL databases (Redshift, DynamoDB, Clickhouse or similar)
Experience building and deploying services in AWS
Experience with Agile methodologies
Nice to have:
Bachelor’s degree in statistics, computer science or related area of study preferred
Experience with modern business intelligence and product reporting tools (preferably Looker)
QA/Testing experience
Kubernetes/Docker experience
Machine Learning experience
Terraform or similar experience
What we offer:
Medical, dental, vision insurance
Wellness and mental health benefits
Tax-advantaged health care accounts
Financial and income protection benefits (Life insurance, 401(k), short-term disability)
Paid time off (PTO), holidays and sick time off
Remote worker assistance for wellness and home office
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.