Consultant Specialist

• Lead the design and implementation of ETL processes using all kinds of batch/streaming tools to extract, transform, and load data from various sources into GCP
• collaborate with stakeholders to gather requirements and ensure that ETL solutions meet business needs
• optimize data pipelines for performance, scalability, and reliability, ensuring efficient data processing workflows
• monitor and troubleshoot ETL processes, proactively addressing issues and bottlenecks
• integrate data from diverse sources, including databases, APIs, and flat files, ensuring data quality and consistency
• manage and maintain data storage solutions in GCP (e.g., Big Query, Cloud Storage) to support analytics and reporting
• write Apache Beam based Dataflow Job for data extraction, transformation, and analysis, ensuring optimal performance and accuracy
• collaborate with data analysts and data scientists to prepare data for analysis and reporting
• implement automation for ETL workflows using tools like Apache Airflow or Cloud Composer, enhancing efficiency, and reducing manual intervention
• set up monitoring and alerting mechanisms to ensure the health of data pipelines and compliance with SLAs
• apply best practices for data governance, ensuring compliance with industry regulations (e.g., GDPR, HIPAA) and internal policies
• collaborate with security teams to implement data protection measures and address vulnerabilities
• document ETL processes, data models, and architecture to facilitate knowledge sharing and onboarding of new team members
• conduct training sessions and workshops to share expertise and promote best practices within the team

• Bachelor’s degree in computer science, Information Systems, or a related field
• minimum of 5 years of industry experience in data engineering or ETL development, with a strong focus on Data Stage and GCP
• proven experience in designing and managing ETL solutions, including data modeling, data warehousing, and SQL development
• strong knowledge of GCP services (e.g., Big Query, Dataflow, Cloud Storage, Pub/Sub) and their application in data engineering
• experience of cloud-based solutions, especially in GCP, cloud certified candidate is preferred
• experience and knowledge of Bigdata data processing in batch mode and streaming mode, proficient in Bigdata eco systems, e.g. Hadoop, HBase, Hive, MapReduce, Kafka, Flink, Spark, etc.
• familiarity with Java & Python for data manipulation on Cloud/Bigdata platform
• strong problem-solving skills with a keen attention to detail
• ability to analyze complex data sets and derive meaningful insights

cloud certified candidate is preferred

• competitive salary and comprehensive benefits package
• opportunity to work in a dynamic and collaborative environment on cutting-edge data projects
• professional development opportunities to enhance your skills and advance your career