This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
10Pearls is seeking a Senior Principal Data Engineer with strong expertise in modern data platforms, cloud technologies, and large-scale data processing. The ideal candidate will be responsible for designing, developing, and maintaining scalable batch and real-time data solutions, enabling data-driven decision-making across the organization while ensuring data quality, governance, and operational excellence.
Job Responsibility
Design, develop, and maintain scalable batch and real-time data pipelines to support growing data volume and complexity
Build and optimize data solutions on cloud-based and on-premises data platforms (Azure, AWS, Google Cloud)
Develop data models, data marts, and data domains including laying the foundation for Data Mesh architecture
Implement and maintain ETL/ELT processes for efficient data integration and transformation
Collaborate with data analysts, data scientists, and business stakeholders to deliver reliable data solutions
Ensure data quality, governance, security, and compliance across the full data ecosystem including access controls, data masking, and encryption
Automate deployment, scheduling, monitoring, and management of data pipelines and datasets
Monitor platform performance and troubleshoot data-related issues while providing L2/L3 production support
Develop and maintain data orchestration frameworks and DataOps best practices
Optimize existing data infrastructure and recommend improvements for scalability and performance
identify potential bottlenecks proactively
Participate in architecture discussions and contribute to data strategy and roadmap initiatives
Implement disaster recovery, business continuity, and risk management controls for data platforms
Support audit, compliance, and regulatory requirements related to data management
Collaborate with the Incident Management team to track, resolve, and report on data platform incidents and follow-up actions
Identify KPIs for data engineering deliverables in alignment with business requirements
Collaborate with cross-functional teams to ensure successful project delivery and production deployments
Maintain technical documentation, standards, and best practices across data engineering initiatives
Requirements
Bachelor's or Master's degree in Computer Science, Engineering, or a related field
Minimum 7+ years of experience in Data Engineering and large-scale data platforms
Strong expertise in Big Data technologies including Hadoop, Spark (including Spark Streaming), Kafka, Hive, Airflow, and Apache NiFi
Advanced proficiency in Python and SQL
Hands-on experience with Azure Data Platform services including Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Azure Functions, and Logic Apps
or equivalent data stack knowledge within Google Cloud or AWS Cloud
Hands-on experience with Google BigQuery, Google Analytics, and Clickstream data modelling
Strong experience in building and maintaining ETL/ELT pipelines
Proficiency in relational SQL, Graph, NoSQL, and distributed database technologies
Proficiency in Elasticsearch and Couchbase databases
Expertise in data modeling techniques including Star Schema, 3NF, and Data Vault
Experience with workflow orchestration tools including Airflow, Oozie, and CI/CD tools
Knowledge of real-time data streaming platforms such as Kafka
Experience with Power BI, Tableau, Qlik, or similar reporting and visualization tools
Strong understanding of Data Governance, Data Architecture, Data Security, and Data Management principles
Experience with cloud-based data migration and modernization initiatives including hybrid on-premises and cloud architectures
Strong analytical, troubleshooting, and problem-solving skills
Excellent communication and stakeholder management abilities
Nice to have
Exposure to AI, Machine Learning, and Advanced Analytics platforms
Financial Services domain experience
Knowledge of Agile and Waterfall delivery methodologies
Program Management and deliverable tracking experience
Experience leading technical teams and mentoring junior engineers