This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
As a Data Engineer, you will play a key role in designing, developing, and maintaining our data infrastructure and pipelines. You will collaborate closely with the rest of our Data and Analytics Engineering team and with engineering and operations teams to ensure the smooth flow and availability of high-quality data for analysis and reporting purposes. Your expertise will be essential in optimizing data workflows, ensuring data integrity, and scaling our data infrastructure to support our company's growth.
Job Responsibility:
Design, develop, and maintain scalable and efficient data pipelines in an AWS environment, centered on our Snowflake instance and using Fivetran, Prefect, Argo, and dbt
Collaborate with business analysts, analytics engineers, and software engineers to understand data requirements and deliver reliable solutions
Design, build and maintain tooling that enables users and services to interact with our data platform, including CI/CD pipelines for our data lakehouse, unit/integration/validation testing frameworks for our data pipelines, and command-line tools for ad-hoc data evaluation
Identify and implement best practices for data ingestion, transformation, and storage to ensure data integrity and accuracy
Optimize and tune data pipelines for improved performance, scalability, and reliability
Monitor data pipelines and proactively address any issues or bottlenecks to ensure uninterrupted data flow
Develop and maintain documentation for data pipelines, ensuring knowledge sharing and smooth onboarding of new team members
Implement data governance and security measures to ensure compliance with industry standards and regulations
Keep up to date with emerging technologies and trends in data engineering and recommend their adoption as appropriate
Requirements:
3+ years as a Data Engineer, data-adjacent Software Engineer, or a did-everything small data team member with a focus on building and maintaining data pipelines
Strong Python skills, especially in the context of data orchestration
Strong understanding of database management and design, including experience with Snowflake or an equivalent platform
Proficiency in SQL
Familiarity with data integration patterns, ETL/ELT processes, and data warehousing concepts
Experience with Argo, Prefect, Airflow, or similar data orchestration tools
Excellent problem-solving and analytical skills with a strong attention to detail
Ability to bring a customer-oriented and empathetic approach to understanding how data is used to drive the business
Strong communication skills
Nice to have:
Undergraduate and/or graduate degree in math, statistics, engineering, computer science, or related technical field
Experience with our stack: AWS, Snowflake, Fivetran, Argo, Prefect, dbt, and Github Actions, along with some ancillary tools
Experience with DevOps practices, especially CI/CD
Previous experience managing enterprise-level data pipelines and working with large datasets
Experience in the energy sector
What we offer:
Competitive compensation based on market standards
Flexible Leave Policy
Office is in the heart of the city in case you need to step in for any purpose
Medical Insurance (1+5 Family Members)
We provide comprehensive coverage including accident policy and life Insurance
Annual performance cycle
Quarterly team engagement activities and rewards & recognitions
L&D programs to foster professional growth
A supportive engineering culture that values diversity, empathy, teamwork, trust, and efficiency
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.