Staff Engineer I – Azure Databricks Engineer

• Responsible for delivery and operations of technologies and platforms required to model, transform, analyze, report, visualize data
• Work in a mid-level role with proficiency needed in building, optimizing, streamlining and automating the Azure Databricks platform to enable analytical workloads like Machine learning (ML), Model Development, Data Insights, Data Science etc
• Partner with ML engineers, data scientists, data analysts, and enterprise architects to enforce best practices, train and enable users using the Azure Databricks platform
• Take assignments that can be worked on individually without supervision and manage work effort from concept to completion
• Build, optimize and maintain the Azure Databricks platform, ensuring scalability, security, governance and performance
• Implement and manage Azure Databricks workspaces, clusters, jobs, access management
• Implement and manage policies, monitoring and observability for the Azure Databricks platform
• Ensure compliance with IT policies, procedures, and industry standards, including reviewing and refining IT control enhancements
• Work closely with business and analytics teams to ensure reliable and governed data access for data needed for analytics
• Troubleshoot platform issues, optimize performance, and ensure uptime for critical Databricks services
• Stay current on emerging data analytics technologies, recommending enhancements to improve efficiency and governance

• 5+ years of related experience in data analytics administration and development
• 2+ years of Databricks related experience
• Bachelor’s degree in related field required
• Hands-on experience in Azure Databricks (Workspace management, Clusters, Jobs, Unity Catalog, Delta Lake, User access management, Rest APIs and SDKs)
• Understanding of Azure infrastructure and data services, including Azure Data Lake, Azure Data Factory, Azure SQL, Azure Synapse Analytics, Azure Key Vault, Azure Monitor, networking
• Experience with CI/CD pipelines (Azure DevOps preferred)
• Strong programming skills in SQL, Python, and/or PySpark
• Proven experience in leading cross-functional teams and managing multiple projects simultaneously
• Intermediate to advanced ability to see the big picture and align projects with organizational goals. Capable of leading and motivating cross-functional teams. Expertise in resolving conflicts and addressing challenges as well as skilled at identifying and mitigating risks at the project level
• Good communication skills, excellent teamwork experience
• Occasional travel might be required

Intermediate to advanced knowledge of general Financial Services or Banking preferred

• Competitive salaries
• An ownership stake in the company
• Medical and dental insurance
• Time off
• A great 401k matching program
• Tuition assistance program
• An employee volunteer program
• A wellness program
• Opportunity to bolster your business knowledge, learning the ins and outs of how successful companies operate and manage their finances, giving you invaluable hands-on experience to help grow your career