This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
This role will primarily focus on highly automated processes of administration, monitoring, and support of the Enterprise Information Management (EIM) platform (currently Databricks on Azure with mesh connections to GCP and AWS), including: participation in management of the Cloud infrastructure, DevOps, SecOps, FinOps, etc. and evaluation/deployment of new technologies utilized by the EIM platform.
Job Responsibility
Administer Cloud Platform workspaces: users/groups, workspace objects, permissions, cluster policies, pools, jobs, repos, and access to compute
Lead development of automations and IaC for repeatable workspace provisioning and configuration
Design and enforce platform standards: environment separation (dev/test/prod), workspace segmentation, cluster policy design, catalog structure, secure library/dependency management, etc.
Oversee and refine data platform and operational processes, ensuring high availability and performance of data pipelines
Respond to incidents using defined support processes
assess post-incident learnings and drive preventive actions
Analyze platform performance metrics vs SLA’s, vendor contracts, etc., identifying and driving improvements
Design and implement scalable and efficient data pipelines for various data types from various sources
Partner with Security and Compliance to define requirements and solutions as technology evolves
Operate and support Catalog and access controls over catalogs/schemas/tables, external locations, storage credentials, etc. in accordance with SHC Policies
Configure and maintain secure connectivity to platform services
Assess controls to meet healthcare data security requirements for PHI/PII
Monitor cost governance, usage reporting, cluster sizing guidance, scheduling, idle/overprovision reduction, and tagging/chargeback support
Create comprehensive documentation of solutions and operations processes
Conduct training sessions for internal teams on operational protocols and best practices
Work closely with cross-functional teams and lead discussions on platform capabilities and operational processes/standards
Evaluate and recommend new tools and technologies to enhance the cloud data platform's capabilities
Apply Systems Thinking to designs and solutions
Requirements
BS/BA degree in information technology, information systems, business management, business analytics, business administration or a directly related field
Four or more years of experience as a Cloud Engineer, Data Engineer, or in a similar role with a focus on cloud technologies
Certifications in Azure (e.g., Azure Solutions Architect, Azure Data Engineer) and/or Databricks
Proven experience as a Cloud Engineer, Data Engineer, or in a similar role with a focus on cloud technologies
Strong knowledge of Azure services, including Databricks, Azure Fabric, Azure Data Factory, Azure SQL Database, and Azure Storage
Experience with a variety of cloud database services
Proficiency in infrastructure-as-code tools (e.g., Terraform, ARM templates, Bicep)
Recent experience with architecture, design and implementation of complex, highly available and highly scalable solutions
Experience with data operations, ETL processes, and data pipeline management
Familiarity with data security best practices and compliance standards
Proficiency with CI/CD for production deployments
Current knowledge across the breadth of Databricks product and platform features
Excellent problem-solving skills and the ability to work independently and collaboratively
Strong communication skills, with the ability to convey technical concepts to non-technical stakeholders
Experience with DevOps practices and tools (e.g., Azure DevOps, Git)
Knowledge of programming languages such as Python, PySpark, SQL, R, Scala