This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
PixelPlex is currently looking for an experienced Data Engineer to join our new project. It is a Business Intelligence and Data Visualization service designed especially for NFT enthusiasts. Service uses on-chain, social and other metrics, enriches it to deliver unique insights ready for decisions. Main focus: Data Quality: automating the DQ process using Great Expectations; Data Marts: presenting data marts, optimizing analyst code if necessary; Ensuring the collection and data loading into analytical and hot databases, including obtaining structured and unstructured data from various sources, preparing, cleaning, and pre-processing data from external sources, and building aggregates.
Job Responsibility:
Creating and improving data processing processes (optimizing processor groups, optimizing data marts)
Participating in the development of data processing solutions within ML projects and deploying pipelines
Developing and optimizing procedures for generating detailed data layers (raw to ods) and data mart layers in DataLake and hot database for online reporting
Implementing CI/CD processes and monitoring the developed data processing processes (Grafana, Prometheus)
Handling ad-hoc queries.
Requirements:
Knowledge of database principles and HD design
Experience in ETL process development
Good understanding of ML pipelines and their deployment to production
Experience using Airflow (or other industry-standard pipeline orchestrators, such as Luigi, Dagster, etc.)
Experience with high-load distributed data storage and processing systems
Excellent knowledge of SQL, query optimization experience
Willingness to learn, grow, and be motivated to achieve goals.
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.