This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
Software Resources has an immediate, direct hire job opportunity for a Principal Engineer I – Senior Azure Databricks Administrator with a major corporation in Phoenix, AZ. 4 days per week on-site, Friday Remote.
Job Responsibility:
Responsible for delivery and operations of technologies and platforms required to model, transform, analyze, report, visualize data
Provide SME expertise in designing, building, optimizing, streamlining and automating the Azure Databricks platform
Partner with ML engineers, data scientists, data analysts, and enterprise architects to provide frameworks, set standards, enforce best practices, train and enable users
Develop technical skills of one or more junior team-members
Take assignments that can be worked on individually without supervision, and manage work effort from concept to completion
Design, build, optimize, automate and maintain the Azure Databricks platform, ensuring scalability, security, governance and performance
Design, implement and manage policies, monitoring and observability
Implement data analytics principles aimed at business enablement, reliability practices and sound recovery procedures
Ensure compliance with IT policies, procedures, and industry standards
Work closely with business and analytics teams to ensure reliable and governed data access
Troubleshoot platform issues, optimize performance, and ensure uptime for critical Databricks services
Stay current on emerging data analytics technologies, recommending enhancements
Act as a thought leader on Azure Databricks implementation, usage, end user enablement and training
Requirements:
8+ years of related experience in data analytics administration and development
4+ years of Databricks related experience
Bachelor’s degree in related field required
Advanced proven experience in Azure Databricks (Workspace management, Clusters, Jobs, Unity Catalog, Delta Lake, User access management, Rest APIs and SDKs)
Knowledge of MLFlow & MLOps
Deep understanding of Azure infrastructure and data services, including Azure Data Lake, Azure Data Factory, Azure SQL, Azure Synapse Analytics, Azure Key Vault, Azure Monitor, networking
Experience with CI/CD pipelines (Azure DevOps preferred)
Strong programming skills in SQL, Python, and/or PySpark
Advanced proven experience in leading cross-functional teams and managing multiple projects simultaneously
Advanced ability to see the big picture and align projects with organizational goals
Advanced communication skills, excellent teamwork experience, ability to mentor and develop more junior engineers
Nice to have:
Masters in related field preferred
Previous leadership experience preferred
Advanced to expert knowledge of general Financial Services or Banking preferred