This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data infrastructure. If you enjoy working with large datasets, automating workflows, and implementing robust data solutions, this role is for you!
Job Responsibility:
Designing, building, and maintaining scalable data infrastructure
Working with large datasets
Automating workflows
Implementing robust data solutions
Requirements:
Hands-on experience in Data Engineering including build of scalable Data pipelines with strong focus on writing clean, efficient, and maintainable code
Proficiency in relational and non-relational databases (e.g., JSON, KV, table store)
Knowledge of normalization and denormalization techniques (e.g., JSON embeddings)
Understanding of structured, semi-structured, and unstructured data
Experience with distributed, graph, and vector databases (e.g., Azure AI Search, AWS OpenSearch)
Understanding of ACID and CAP principles
Experience with data lakes and data warehousing
Proficiency in gathering and processing data from multiple heterogeneous sources
Experience integrating data from multiple sources
Familiarity with both ETL and ELT processes
Experience with data migration and replication techniques
Ability to implement data solutions on-premises and in private clouds
Experience with cloud-native pipeline orchestration and workflow orchestration using a dedicated processing cluster (e.g., AirFlow, Apache Spark)
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.