Azure Data & Analytics DevOps Engineer Job at Metyis (Porto)

Job Responsibility

Define and drive the DevOps strategy for the organization's Azure-based Data Platform, ensuring alignment with business goals and technological advancements
Design, develop, implement, automate, and continuously optimize advanced CI/CD/CT pipelines for complex data workflows, ensuring scalability, reliability, and efficiency
Leverage Azure Data Services (e.g., Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure Data Lake) to integrate DevOps pipelines with big data workflows and frameworks like Apache Spark and Delta Lake
Establish and enforce DevOps best practices, including automated testing, deployment strategies, and compliance with security and regulatory standards
Implement Azure-native security features such as Azure Key Vault, Managed Identities, and Azure Policy to ensure secure infrastructure and data workflows
Lead efforts in observability, monitoring, and incident resolution to ensure the platform's reliability and performance
Stay at the forefront of emerging data technologies, trends, and best practices
Lead the evaluation and adoption of cutting-edge tools and methodologies to enhance the organization's DevOps ecosystem
Mentor and coach data engineers, data scientists, and DevOps professionals, fostering a culture of technical excellence, collaboration, and continuous learning
Act as a bridge between Data Engineering, Data Science, MLOps, and Cloud Infrastructure teams, driving seamless integration and alignment across functions

5+ years of hands-on experience as an Azure DevOps Engineer or in a similar senior role within Data & Analytics
Deep expertise in Microsoft Azure services, with a focus on data platforms, security, and scalability
Extensive experience with CI/CD tools (e.g., Azure DevOps Pipelines, GitHub Actions) and the ability to design robust deployment pipelines
Hands-on experience integrating Databricks into CI/CD pipelines
Proven experience working with Azure Data Services and integrating DevOps pipelines with big data workflows and frameworks like Apache Spark and Delta Lake
Expertise in multi-cloud IaC using tools like Terraform and Azure Resource Manager (ARM) templates
Advanced proficiency in scripting languages (e.g., Python, YAML, Git, Bash, PowerShell) to automate complex workflows
Experience with Python packaging and dependency management tools like Poetry
Skilled in integrating Azure Data Factory into DevOps pipelines
Strong experience in testing frameworks and data quality tools (e.g., pytest, Great Expectations)
Advanced experience with containerization (e.g., Docker) and orchestration technologies (e.g., Kubernetes) for managing distributed systems
Expertise in implementing Azure-native security features such as Azure Key Vault, Managed Identities, and Azure Policy
Demonstrated experience working in and leading Agile environments (e.g., Scrum)

Azure certifications such as Azure DevOps Engineer Expert, Azure Data Engineer Associate, Databricks Certified Data Engineer Associate, Azure Security Engineer Associate, and Terraform Associate (HashiCorp Certified)
Advanced proficiency in GitOps workflows and branching strategies (e.g., GitFlow, trunk-based development)
Experience with artifact management tools like Azure Artifacts
Strong familiarity with software engineering best practices, including coding standards, design patterns, testing, and debugging
In-depth knowledge of DataOps principles, including observability, monitoring, and incident reporting

Develop your professional career working with one of the major brands in the fashion industry
Opportunity to accelerate the pace of digitalization & eCommerce growth through advanced technology, business intelligence, and analytics
Driving high-impact insights enhances decision-making across the entire organization
Driving brand equity and digital sales through enhanced digital experiences
Interaction with senior business and eCommerce leaders regularly to drive their business toward impactful change
Become part of a fast-growing international and diverse team