This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
Senior Data Engineer position at Checkr, building the data platform to power safe and fair decisions. The role involves working on high-impact projects that directly contribute to the core functionality of Checkr's background check services, improving data ingestion and processing capabilities, and ensuring the reliability and accuracy of the core product.
Job Responsibility:
Create and maintain data pipelines and foundational datasets to support product/business needs
Design and build database architectures with massive and complex data, balancing with computational load and cost
Develop audits for data quality at scale, implementing alerting as necessary
Create scalable dashboards and reports to support business objectives and enable data-driven decision-making
Troubleshoot and resolve complex issues in production environments
Work closely with product managers and other stakeholders to define and implement new features
Requirements:
7+ years of development experience in the field of data engineering
5+ years writing PySpark
Experience building large-scale (100s of Terabytes and Petabytes) data processing pipelines - batch and stream
Experience with ETL/ELT, stream and batch processing of data at scale
Strong proficiency in PySpark and Python
Expertise in understanding of database systems, data modeling, relational databases, NoSQL (such as MongoDB)
Experience with big data technologies such as Kafka, Spark, Iceberg, Datalake and AWS stack (EKS, EMR, Serverless, Glue, Athena, S3, etc.)
Knowledge of security best practices and data privacy concerns
Strong problem-solving skills and attention to detail
Nice to have:
Experience/knowledge of data processing platforms such as Databricks or Snowflake
An understanding of Graph and Vector data stores
What we offer:
Learning and development reimbursement allowance
Competitive compensation and opportunity for professional and personal advancement
100% medical, dental, and vision coverage for employees and dependents
Additional vacation benefits of 5 extra days and flexibility to take time off
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.