CrawlJobs Logo

Principal Engineer I – Senior Azure Databricks Administrator

United States, Phoenix · Job Posted April 01, 2026
Apply Position
Job Link Share

Job Description

Software Resources has an immediate, direct hire job opportunity for a Principal Engineer I – Senior Azure Databricks Administrator with a major corporation in Phoenix, AZ. 4 days per week on-site, Friday Remote.

Job Responsibility

  • Responsible for delivery and operations of technologies and platforms required to model, transform, analyze, report, visualize data
  • Provide SME expertise in designing, building, optimizing, streamlining and automating the Azure Databricks platform
  • Partner with ML engineers, data scientists, data analysts, and enterprise architects to provide frameworks, set standards, enforce best practices, train and enable users
  • Develop technical skills of one or more junior team-members
  • Take assignments that can be worked on individually without supervision, and manage work effort from concept to completion
  • Design, build, optimize, automate and maintain the Azure Databricks platform, ensuring scalability, security, governance and performance
  • Design, implement and manage Azure Databricks workspaces, clusters, jobs, access management
  • Design, implement and manage policies, monitoring and observability
  • Implement data analytics principles aimed at business enablement, reliability practices and sound recovery procedures
  • Ensure compliance with IT policies, procedures, and industry standards
  • Work closely with business and analytics teams to ensure reliable and governed data access
  • Troubleshoot platform issues, optimize performance, and ensure uptime for critical Databricks services
  • Stay current on emerging data analytics technologies, recommending enhancements
  • Act as a thought leader on Azure Databricks implementation, usage, end user enablement and training

Requirements

  • 8+ years of related experience in data analytics administration and development
  • 4+ years of Databricks related experience
  • Bachelor’s degree in related field required
  • Advanced proven experience in Azure Databricks (Workspace management, Clusters, Jobs, Unity Catalog, Delta Lake, User access management, Rest APIs and SDKs)
  • Knowledge of MLFlow & MLOps
  • Deep understanding of Azure infrastructure and data services, including Azure Data Lake, Azure Data Factory, Azure SQL, Azure Synapse Analytics, Azure Key Vault, Azure Monitor, networking
  • Experience with CI/CD pipelines (Azure DevOps preferred)
  • Strong programming skills in SQL, Python, and/or PySpark
  • Advanced proven experience in leading cross-functional teams and managing multiple projects simultaneously
  • Advanced ability to see the big picture and align projects with organizational goals
  • Advanced communication skills, excellent teamwork experience, ability to mentor and develop more junior engineers

Nice to have

  • Masters in related field preferred
  • Previous leadership experience preferred
  • Advanced to expert knowledge of general Financial Services or Banking preferred

What we offer

  • Competitive salaries
  • An ownership stake in the company
  • Medical and dental insurance
  • Time off
  • A great 401k matching program
  • Tuition assistance program
  • An employee volunteer program
  • A wellness program

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Principal Engineer I – Senior Azure Databricks Administrator

8 matching positions

Principal Cloud Solution Architect - Cloud & AI - Federal - CTJ - POLY

Join Microsoft Federal—where mission, trust, and cutting-edge innovation converg...
Location
Location
United States , Washington D.C.
Salary
Salary:
130900.00 - 251900.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, Information Technology, Engineering, Business, Liberal Arts, or related field AND 7+ years experience in cloud/infrastructure technologies, information technology (IT) consulting/support, systems administration, network operations, software development/support, technology solutions, practice development, architecture, and/or consulting OR equivalent experience.
  • Security Clearance Requirements: Candidates must be able to meet Microsoft, customer and/or government security screening requirements required for this role. These requirements include, but are not limited to the following specialized security screenings: The successful candidate must have an active U.S. Government Top Secret Clearance with access to Sensitive Compartmented Information (SCI) based on a Single Scope Background Investigation (SSBI) with Polygraph. Ability to meet Microsoft, customer and/or government security screening requirements are required pre-offer and post-hire for this role. Failure to maintain or obtain the appropriate U.S. Government clearance and/or customer screening requirements may result in employment action up to and including termination.
  • Clearance Verification: This position requires successful verification of the stated security clearance to meet federal government customer requirements. You will be asked to provide clearance verification information prior to an offer of employment.
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
  • Citizenship & Citizenship Verification: This position requires verification of U.S. citizenship due to citizenship-based legal restrictions. Specifically, this position supports United States federal, state, and/or local United States government agency customer and is subject to certain citizenship-based restrictions where required or permitted by applicable law. To meet this legal requirement, citizenship will be verified via a valid passport, or other approved documents, or verified US government Clearance
Job Responsibility
Job Responsibility
  • Ensure successful project delivery by providing technical leadership and orchestration across engagements, driving high-quality execution, removing blockers, and ensuring projects are delivered on time and aligned to customer objectives.
  • Build trusted relationships with IT executives and business leaders to shape their Cloud and AI strategy, acting as a technical advisor and champion for customer success.
  • Lead and coordinate across Microsoft, partner, and customer technical teams to manage dependencies, technical risks, and delivery milestones across complex engagements.
  • Lead architectural design sessions and guide the implementation of secure, scalable, and resilient solutions using Microsoft best practices and frameworks such as CAF and WAF.
  • Drive technical excellence across Azure workloads—including AI, applications, infrastructure, and data—ensuring mission-critical workloads are optimized for performance, security, and production-scale AI readiness.
  • Align technical delivery to customer success plans and consumption priorities, ensuring solutions deliver measurable business value and long-term platform adoption.
  • Accelerate Azure consumption and customer outcomes by developing repeatable intellectual property (IP), resolving technical blockers, and providing delivery oversight for key engagements.
  • Collaborate with internal teams and partners to design impactful delivery proposals and support execution.
  • Translate complex technical concepts into clear business outcomes and executive-level messaging for senior stakeholders.
  • Contribute to Microsoft’s technical community by mentoring peers, sharing insights, and serving as a spokesperson in internal and external forums.
What we offer
What we offer
  • The typical base pay range for this role across the U.S. is USD $130,900 - $251,900 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $165,600 - $272,300 per year.
  • Certain roles may be eligible for benefits and other compensation.
  • Fulltime
Read More
Arrow Right

Principal Consultant A2- Data & AI

The Principal Consultant is a senior leader responsible for the successful techn...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 20+ years of experience in software/solution engineering, with at least 3–5 years in delivery leadership roles
  • Proven experience in leading delivery of complex, multi-disciplinary projects
  • Strong understanding of modern delivery methodologies (Agile, Scrum, DevOps, etc.)
  • Excellent communication, stakeholder management, problem-solving, and team leadership skills
  • Bachelor’s degree in computer science, Engineering, or related field (or equivalent experience)
  • Relevant certifications are a plus
  • Areas of Expertise: Enterprise Data Architecture & Modern Platforms
  • Data Engineering & Large Scale Data Processing
  • Database Platforms, Performance & Capacity Engineering
  • RealTime Analytics & Operational Intelligence
Job Responsibility
Job Responsibility
  • AI-First Delivery Leadership: Embed AI-first principles into delivery workflows
  • Lead end-to-end delivery of complex projects
  • Drive engineering excellence through reusable components, accelerators, and scalable architecture
  • Oversee technical execution across multiple projects
  • Collaborate with clients and internal stakeholders to define strategies, delivery plans, milestones, and risk mitigation approaches
  • Act as a technical point of contact for clients
  • Ensure delivery models are optimized for modern AI-native execution
  • Ability to step into at‑risk projects, quickly assess issues, and establish a credible path to recovery or exit
  • Engineering Excellence: Champion high-quality engineering practices across all delivery engagements
  • Ensure adherence to coding standards, architectural integrity, and performance benchmarks
  • Fulltime
Read More
Arrow Right

Principal Consultant - Data & AI

The Principal Consultant is a senior leader responsible for the successful techn...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 20+ years of experience in software/solution engineering, with at least 3–5 years in delivery leadership roles
  • Proven experience in leading delivery of complex, multi-disciplinary projects
  • Strong understanding of modern delivery methodologies (Agile, Scrum, DevOps, etc.)
  • Excellent communication, stakeholder management, problem-solving, and team leadership skills
  • Bachelor’s degree in computer science, Engineering, or related field (or equivalent experience)
  • Relevant certifications are a plus
  • Enterprise Data Architecture & Modern Platforms expertise
  • Data Engineering & Large Scale Data Processing expertise
  • Database Platforms, Performance & Capacity Engineering expertise
  • RealTime Analytics & Operational Intelligence expertise
Job Responsibility
Job Responsibility
  • AI-First Delivery Leadership: Embed AI-first principles into delivery workflows, leveraging automation and intelligent orchestration where applicable
  • Lead end-to-end delivery of complex projects, ensuring solutions are scalable, robust, and aligned with client business outcomes
  • Drive engineering excellence through reusable components, accelerators, and scalable architecture
  • Oversee technical execution across multiple projects, ensuring adherence to best practices, quality standards, and compliance requirements
  • Collaborate with clients and internal stakeholders to define strategies, delivery plans, milestones, and risk mitigation approaches
  • Act as a technical point of contact for clients, translating business requirements into scalable technical solutions
  • Ensure delivery models are optimized for modern AI-native execution, including integration of automation and intelligent processes
  • Ability to step into at‑risk projects, quickly assess issues, and establish a credible path to recovery or exit
  • Engineering Excellence: Champion high-quality engineering practices across all delivery engagements
  • Ensure adherence to coding standards, architectural integrity, and performance benchmarks
  • Fulltime
Read More
Arrow Right

Agentic AI Engineer Co-Op

An Agentic AI Engineer designs, builds, and deploys autonomous AI systems that c...
Location
Location
Canada
Salary
Salary:
Not provided
campbellsoupcompany.com Logo
Campbell Soup Company
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years in AI/ML system design, deployment, or autonomous agent development
  • Programming: Proficiency in Python (and sometimes Java, C#) for AI/ML solution development
  • Agent & Workflow Expertise: Experience with agent orchestration frameworks and multi-agent communication protocols
  • RAG & LLM Integration: Hands-on with RAG architectures, evaluation methodologies, and LLM integration
  • Cloud & DevOps: Experience with cloud platforms (e.g., Azure, AWS) and CI/CD pipelines
  • Governance & Compliance: Understanding of responsible AI, security, and compliance in regulated domains (e.g., retail)
Job Responsibility
Job Responsibility
  • Design & Develop Agentic Systems: Build intelligent agents capable of autonomous planning, reasoning, and task execution, often using LLMs (e.g., GPT-class, LLaMA), multi-modal models, and autonomous workflows
  • Orchestration & Frameworks: Implement agent orchestration using frameworks like LangChain, AutoGen, CrewAI, Semantic Kernel, or custom solutions
  • Retrieval-Augmented Generation (RAG): Design and optimize RAG pipelines for enhanced reasoning with external knowledge, including document ingestion, chunking, embeddings, vector stores, and retrieval ranking
  • Tool & Memory Integration: Develop agents that call APIs, databases, and other tools, maintain memory, and adapt based on outcomes
  • Evaluation & Monitoring: Create evaluation frameworks for accuracy, grounding, latency, and cost
  • build observability for agent behavior and failure modes
  • Model Adaptation: Fine-tune or adapt foundation models (e.g., via LoRA, adapters) for domain-specific use cases
  • Production Deployment: Deploy GenAI/agentic systems in cloud-native environments with CI/CD, versioning, and runtime safeguards
  • Cross-Functional Collaboration: Work with data scientists, ML engineers, product teams, and governance/compliance stakeholders
What we offer
What we offer
  • Medical, dental, short and long-term disability, AD&D, and life insurance
  • Matching 401(k) plan with immediate vesting
  • Unlimited sick time
  • Paid time off and holiday pay
  • Free access to fitness center
  • Access to on-site day care operated by Bright Horizons
  • Company store
  • Employee donation/volunteer match up to $1,500 annually via Campbell's Cares program
  • Employee Resource Groups (ERGs)
  • Fulltime
Read More
Arrow Right

Stabilization Case Manager

A large provider for homelessness is looking to add Case Managers to their suppo...
Location
Location
United States , Boston
Salary
Salary:
24.00 - 26.00 USD / Hour
bhsg.com Logo
Beacon Hill
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Human Services or related field
  • 1+ years community case management experience required
  • Must understand and have ability to work with Harm Reduction, Motivational Interviewing and Trauma Informed Care best practices
  • Valid Driver’s license
Job Responsibility
Job Responsibility
  • Work with all aspects of the program, including outreach, community referrals, Rapid Resolution, intake and assessment, case management, rapid housing and housing stabilization
  • Develop relationships with landlords and property managers for permanent housing placement and retention
  • Fulltime
Read More
Arrow Right

Traffic Clerk - Logan PM

Reporting to the Shift Lead, this selected individual will Support the shift lea...
Location
Location
United States , Logan
Salary
Salary:
24.50 USD / Hour
campbellsoupcompany.com Logo
Campbell Soup Company
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High School Diploma or GED required
  • Previous experience in a clerical role is required
Job Responsibility
Job Responsibility
  • Interact with the drivers to include giving directions for dropping and picking up trailers, providing paperwork and seal
  • Print load sheets by entering information into the SAP program and make the correct number of copies
  • Create and coordinate completion of Pick Tasks in SAP
  • Assist in troubleshooting task related issues including coordination with Leads and Inventory control on inventory issues, Voice Pick issues, Task Confirmation issues
  • Coordinate with the corporate team, check for updates, make corrections, print and post shipping schedule appointments
  • Use SAP to verify load sheet accuracy, print and file Bills
  • Understand Yard View preforms input functions and perform audits
  • Communicate information to Lead and Manager
  • Accurately file of paperwork by carrier and date
  • Update and post Receiving schedule through contact with the carriers and corporate coordinators
What we offer
What we offer
  • competitive health
  • dental
  • 401k
  • wellness benefits
  • Fulltime
Read More
Arrow Right

Maintenance Technician

Since 1869 we've connected people through food they love. Our history was create...
Location
Location
United States , Columbus
Salary
Salary:
31.30 USD / Hour
campbellsoupcompany.com Logo
Campbell Soup Company
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High School Diploma or GED is preferred, but not required
  • Minimum 2 Year prior experience
Job Responsibility
Job Responsibility
  • Understands and adheres to the governmental regulatory programs and policies
  • Practices and complies with all plant and maintenance department safety procedures
  • Understands the concept of Permit Required Confined Spaces and assists with proper alternate entry
  • Follows all applicable good manufacturing practices (GMP's)
  • Maintains and uses appropriate personal protective equipment (PPE)
  • Attends classes, seminars, and in-house training as needed
  • Assists in making improvements and suggestions to optimize maintenance program
  • Executes and documents planned and unplanned work findings and data
  • Repairs and installation of parts, tools and equipment
  • Performs Preventative Maintenance (PM), inspections, corrective repairs, special projects/equipment rebuilds
What we offer
What we offer
  • competitive health
  • dental
  • 401k
  • wellness benefits beginning on the first day of employment
  • Fulltime
Read More
Arrow Right

Relief Security Officer

Do you have what it takes to be a Relief Security Officer with SGS? We are curre...
Location
Location
United Kingdom , Exeter
Salary
Salary:
12.71 GBP / Hour
sgs-ltd.com Logo
Sentinel Group Security Limited
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Must hold a valid SIA Security Guarding / Door Supervisor License
  • Must have the right to work in the UK
  • Have a five year checkable employment history or be able to produce documentary evidence of any period of unemployment, self-employment or full and part-time education during that period
Job Responsibility
Job Responsibility
  • Work night shift and provide security services
  • Protect the customer's employees, property and other assets in line with the relevant Assignment Instructions and site-specific customer requirements
  • Parttime
Read More
Arrow Right