CrawlJobs Logo

Databricks on Azure Administrator

nttdata.com Logo

NTT DATA

Location Icon

Location:
United States , Atlanta

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

The Databricks on Azure Administrator role requires a seasoned professional with over 8 years of experience in cloud data platforms, particularly Azure Databricks. The candidate will be responsible for provisioning and managing Databricks environments, ensuring compliance with PCI DSS standards, and collaborating with various teams for security and governance. A bachelor's degree in Computer Science or Engineering is required, and the role mandates onsite work in Atlanta three days a week.

Job Responsibility:

  • Provision, configure, and operate Azure Databricks environments across development and production
  • Design and maintain PCI DSS–compliant data architectures for analytics and data processing workloads
  • Implement and enforce enterprise security, governance, and access controls using Azure IAM and Databricks Unity Catalog
  • Manage role-based access, data masking, lineage, and audit logging to meet regulatory and risk requirements
  • Standardize environment configuration and promotion using cluster policies, CI/CD pipelines, and Infrastructure as Code
  • Integrate Databricks audit logs and telemetry with Azure Monitor and Log Analytics for compliance-ready observability
  • Partner closely with security, risk, compliance, and data engineering teams to support audits and regulatory reviews
  • Support incident response, root cause analysis, and production issue resolution
  • Maintain operational documentation, runbooks, and governance standards
  • Work on-site in the Atlanta office 3 days per week to support collaboration with engineering and compliance stakeholders

Requirements:

  • 8+ years of experience administering enterprise data platforms in cloud environments
  • 5+ years of hands-on experience with Azure Databricks in production environments
  • 5+ years of strong experience with: Azure Databricks, Delta Lake, Unity Catalog
  • 5+ years of strong understanding of Azure identity and security services, including: Azure AD / Entra ID, Managed Identities, Azure Key Vault
  • 5+ years of experience with Azure storage and networking: ADLS Gen2, Private Endpoints, VNET Injection
  • Bachelor’s degree in Computer Science, Engineering, or equivalent work experience

Nice to have:

  • Experience implementing CI/CD pipelines using Azure DevOps or GitHub Actions
  • Hands-on experience with Infrastructure as Code (Terraform and/or ARM templates)
  • Proven experience operating in PCI DSS–compliant environments
  • Prior experience in the payments, banking, or financial services industry
  • Experience supporting regulated or audit-heavy data platforms
  • Familiarity with cost management and performance optimization in Databricks
  • Experience working directly with security, risk, and compliance teams
  • Strong documentation and operational runbook creation skills
  • Exposure to incident management and production support models

Additional Information:

Job Posted:
February 18, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Databricks on Azure Administrator

Cloud System Administrator

This role is at the intersection of computer services and support, with a focus ...
Location
Location
United States , West Chester
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Azure Active Directory
  • Familiarity with Azure API Management
  • Knowledge of Azure Data Factory
  • Experience with Azure Databricks
  • Proficiency in Office 365
  • Expertise in Active Directory
Job Responsibility
Job Responsibility
  • Strategize, manage and execute technology within the respective departments
  • Implement and maintain Active Directory, Azure & Office 365 on a daily basis
  • Manage Azure resources and tools such as Azure Data Factory and Databricks
  • Handle Azure API management with API Management and Azure Container Apps hosting API’s
  • Oversee load balancing with Azure Application Gateway and CDN web routing via Azure Front Door
  • Administer Azure Role Management for all resources, including custom role creations and auditing of permissions
  • Utilize Infrastructure as Code tooling, with a preference for Terraform and BICEP
  • Apply a strong understanding of cloud system architecture and application design
  • Build and troubleshoot Azure DevOps Pipelines, including YAML, Service Connections, and Code Review
  • Maintain a strong understanding of both traditional and cloud networking concepts
What we offer
What we offer
  • Access to top jobs
  • Competitive compensation
  • Benefits including medical, vision, dental, and life and disability insurance
  • Free online training
  • Eligible to enroll in company 401(k) plan
  • Fulltime
Read More
Arrow Right

Database Administrator II

We are seeking a highly skilled Cloudera Hadoop Administrator (DBA) with hands-o...
Location
Location
Salary
Salary:
100900.00 - 126100.00 USD / Year
acehardware.com Logo
ACE Hardware
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of hands-on experience administering Cloudera Hadoop clusters
  • 2–3+ years of Databricks experience in production environments
  • 2+ years of Databricks administration experience on Azure (preferred)
  • Strong knowledge of Spark and Delta Lake architecture
  • Experience with IAM, Active Directory, and SSO integration
  • Familiarity with DevOps and CI/CD for data platforms
  • Deep understanding of Hadoop ecosystem: Hive, Impala, Spark, HDFS, YARN
  • Experience integrating data from DB2 to Hadoop/Databricks using tools like Sqoop or custom connectors
  • Scripting skills in Shell and/or Python for automation and system administration
  • Solid foundation in Linux/Unix system administration
Job Responsibility
Job Responsibility
  • Manage and support Cloudera Hadoop clusters and services (HDFS, YARN, Hive, Impala, Spark, Oozie, etc.)
  • Perform cluster upgrades, patching, performance tuning, capacity planning, and health monitoring
  • Secure the Hadoop platform using Kerberos, Ranger, or Sentry
  • Develop and maintain automation and monitoring scripts
  • Ingest data using tools such as Sqoop, NiFi, DEI Informatica, Qlik
  • Support release and deployment activities, including deployment of new across Dev/Test and Production environments
  • Integration of CI/CD pipelines (Git, or custom tooling) for automated code deployment
  • Ensuring minimal downtime, rollback capability, and alignment with change management policies
  • Maintain detailed release documentation, track changes in version control systems, and collaborate with development and operations teams to streamline deployment workflows
  • Administer and maintain Databricks workspaces in cloud environments (Azure, or GCP)
What we offer
What we offer
  • Incentive opportunities
  • Generous 401(k) retirement savings plan with matching and discretionary contributions
  • Comprehensive health coverage (medical, dental, vision and disability) & life insurance benefits
  • 21 days of vacation
  • Up to 6 paid holidays
  • Annual Ace Cares Week
  • 20 hours off work per year to volunteer
  • Opportunities to help Children’s Miracle Network Hospitals and the Ace Helpful Fund
  • On-site classes, facilitator-led courses, and a generous tuition assistance program
  • Frequent campus events (Employee Appreciation Week, vendor demos, cookouts, merchandise sales)
  • Fulltime
Read More
Arrow Right

Data Architect

We are seeking a talented and experienced Data Architect/ Modeller to join our t...
Location
Location
India , Gurugram
Salary
Salary:
Not provided
https://www.circlek.com Logo
Circle K
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Full-Time bachelor’s or master’s degree in engineering/technology, computer science, information technology, or related fields
  • 10+ years of total experience in data modeling and database design and experience in Retail domain will be added advantage
  • 8+ years of experience in data engineering development and support
  • 3+ years of experience in leading technical team of data engineers and BI engineers
  • Proficiency in data modeling tools such as Erwin, ER/Studio, or similar tools
  • Strong knowledge of Azure cloud infrastructure and development using SQL/Python/PySpark using ADF, Synapse and Databricks
  • Hands-on experience with Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Azure Databricks, Blob Storage, Python/PySpark, Logic Apps, Key Vault, and Azure functions
  • Strong communication, interpersonal, collaboration skills along with leadership capabilities
  • Ability to work effectively in a fast-paced, dynamic environment as cloud SME
  • Act as single point of contact for all kinds of data management related queries to make data decisions
Job Responsibility
Job Responsibility
  • Collaborate with solution architect, data engineers, business stakeholders, business analysts, and DQ testers to ensure data management and data governance framework is defined as critical components
  • Design and develop data models using industry-standard modeling techniques and tools
  • Perform data profiling, data lineage and analysis to understand data quality, structure, and relationships
  • Optimize data models for performance, scalability, and usability by creating optimal data storage layer
  • Define and enforce data modeling standards, best practices, and guidelines
  • Participate in data governance initiatives to ensure compliance with data management policies and standards
  • Work closely with database administrators and developers to implement data models in relational and non-relational database systems
  • Conduct data model reviews and provide recommendations for improvements
  • Stay updated on emerging trends and technologies in data modeling and data management
  • Fulltime
Read More
Arrow Right

Data Architect

We are seeking a talented and experienced Data Architect to join our team. The D...
Location
Location
India , Gurugram
Salary
Salary:
Not provided
https://www.circlek.com Logo
Circle K
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Full-Time bachelor’s or master’s degree in engineering/technology, computer science, information technology, or related fields
  • 10+ years of total experience in data modeling and database design
  • experience in Retail domain will be added advantage
  • 8+ years of experience in data engineering development and support
  • 3+ years of experience in leading technical team of data engineers and BI engineers
  • Proficiency in data modeling tools such as Erwin, ER/Studio, or similar tools
  • Strong knowledge of Azure cloud infrastructure and development using SQL/Python/PySpark using ADF, Synapse and Databricks
  • Hands-on experience with Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Azure Databricks, Blob Storage, Python/PySpark, Logic Apps, Key Vault, and Azure functions
  • Strong communication, interpersonal, collaboration skills along with leadership capabilities
  • Ability to work effectively in a fast-paced, dynamic environment as cloud SME
Job Responsibility
Job Responsibility
  • Collaborate with solution architect, data engineers, business stakeholders, business analysts, and DQ testers to ensure data management and data governance framework is defined as critical components
  • Design and develop data models using industry-standard modeling techniques and tools
  • Perform data profiling, data lineage and analysis to understand data quality, structure, and relationships
  • Optimize data models for performance, scalability, and usability by creating optimal data storage layer
  • Define and enforce data modeling standards, best practices, and guidelines
  • Participate in data governance initiatives to ensure compliance with data management policies and standards
  • Work closely with database administrators and developers to implement data models in relational and non-relational database systems
  • Conduct data model reviews and provide recommendations for improvements
  • Stay updated on emerging trends and technologies in data modeling and data management
  • Conduct continuous audits of data management system performance and refine where necessary
  • Fulltime
Read More
Arrow Right

Business Intelligence Analyst

What we're looking for: Overall 10 years of experience in Industry including 6+Y...
Location
Location
Malaysia , Penang
Salary
Salary:
Not provided
arrow.com Logo
Arrow Electronics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Overall 10 years of experience in Industry including 6+Years of experience as developer using Databricks/Spark Ecosystems
  • Hands on experience on Unified Data Analytics with Databricks, Databricks Workspace User Interface, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL
  • Good understanding of Spark Architecture with Databricks, Structured Streaming. Setting Microsoft Azure with Databricks, Databricks Workspace for Business Analytics, Manage Clusters In Databricks, Managing the Machine Learning Lifecycle
  • Hands on experience Data extraction (extract, Schemas, corrupt record handling and parallelized code), transformations and loads (user - defined functions, join optimizations) and Production (optimize and automate Extract, Transform and Load)
  • TECHNICAL SKILLS: Spark Data Frame API
  • Python for Data Science
  • Spark Programming
  • SQL for Data Analysis
  • Simplify Data analysis With Python
  • Manage Clusters Databricks
Job Responsibility
Job Responsibility
  • Experience in developing Spark applications using Spark-SQL in Databricks for data extraction, transformation, and aggregation from multiple file formats for Analyzing & transforming the data to uncover insights into the customer usage patterns
  • Extract Transform and Load data from sources Systems to Azure Data Storage services using a combination of Azure Data factory, T-SQL, Spark SQL, and U-SQL Azure Data Lake Analytics
  • Data ingestion to one or more Azure services (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in Azure Databricks
  • Develop Spark applications using pyspark and spark SQL for data extraction, transformation, and aggregation from multiple file formats for analyzing and transforming the data uncover insight into the customer usage patterns
  • Hands on experience on developing SQL Scripts for automation
  • Responsible for estimating the cluster size, monitoring, and troubleshooting of the Spark databricks cluster
  • Ability to apply the spark DataFrame API to complete Data manipulation within spark session
  • Good understanding of Spark Architecture including spark core, spark SQL, DataFrame, Spark streaming, Driver Node, Worker Node, Stages, Executors and Tasks, Deployment modes, the Execution hierarchy, fault tolerance, and collection
  • Collaborate with delivery leadership to deliver projects on time adhering to the quality standards
  • Contribute to the growth of the Microsoft Azure practice by helping with solutioning for prospects
What we offer
What we offer
  • Medical Insurance
  • Life Insurance
  • Year-end bonus
  • Performance Bonus
  • 5-Day Work Week
  • Growth Opportunities
  • Fulltime
Read More
Arrow Right

Data Engineer

Data sits at the heart of the company. This role is to ensure that Awin is able ...
Location
Location
Romania , Iași
Salary
Salary:
Not provided
awin.com Logo
Awin Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree or higher in Data Science, Data Engineering, Business Intelligence, Business Administration, or a related field with a focus on data engineering, analytics, or business intelligence
  • 2+ years of working experience as a Data Engineer or Data Warehouse Developer using Python or similar technologies
  • Hands-on experience with Microsoft Azure and AWS data engineering pipelines
  • Excellent knowledge of database and dimensional modeling techniques
  • Strong experience with Azure Data Factory, Azure Databricks, Python (NumPy, Pandas), ADLS, Azure Event Hub, and Azure SQL DB
  • Excellent command of SQL, T-SQL, Python, and PySpark
  • Practical experience with Agile and Scrum methodologies
  • Strong communication and analytical skills
Job Responsibility
Job Responsibility
  • Write clean, elegant, and maintainable code following data warehousing best practices and modeling techniques (Kimball, Star Schema, etc.)
  • Troubleshoot data transformation errors by debugging and developing effective solutions
  • Clearly and confidently present findings, bugs, and proposed system improvements to stakeholders
  • Design and implement new Azure and AWS data pipelines and Databricks notebooks to integrate additional data sources
  • Add new data points to existing Azure Analysis Services (AAS) cubes or equivalent data models
  • Continuously identify and implement performance improvements
  • Ensure the quality, accuracy, and reliability of all data and reports
What we offer
What we offer
  • Flexi-Week and Work-Life Balance: We prioritise your mental health and wellbeing, offering you a flexible four-day Flexi-Week at full pay and with no reduction to your annual holiday allowance. We also offer a variety of different paid special leaves
  • Flexi-Office: We offer an international culture and flexibility through our Flexi-Office and hybrid/remote work possibilities to work across Awin regions
  • Remote Working Allowance: You will receive a monthly allowance to cover part of your running costs. In addition, we will support you in setting up your remote workspace appropriately
  • Health & Well Being: With our support and access to various initiatives and sports offers, you can devote yourself to your mental and physical well-being. Additionally to our initiatives on our Awin platform, we offer Multisport Card, and Medicover or Luxmed health insurance
  • Development: We’ve built our extensive multidisciplinary training suite Awin Academy (to cover a wide range of skills that nurture you professionally and personally,) with trainings conveniently packaged together to support your overall development. You can also improve your foreign language skills by participating in our local language course
  • Appreciation: Thank and reward colleagues by sending them a voucher through our peer-to-peer program
  • Fulltime
Read More
Arrow Right

Data Engineer

Purpose of position: Data sits at the heart of the company. This role is to ensu...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
awin.com Logo
Awin Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree or higher in Data Science, Data Engineering, Business Intelligence, Business Administration, or a related field with a focus on data engineering, analytics, or business intelligence
  • 2+ years of working experience as a Data Engineer or Data Warehouse Developer using Python or similar technologies
  • Hands-on experience with Microsoft Azure and AWS data engineering pipelines
  • Excellent knowledge of database and dimensional modeling techniques
  • Strong experience with Azure Data Factory, Azure Databricks, Python (NumPy, Pandas), ADLS, Azure Event Hub, and Azure SQL DB
  • Excellent command of SQL, T-SQL, Python, and PySpark
  • Practical experience with Agile and Scrum methodologies
  • Strong communication and analytical skills
Job Responsibility
Job Responsibility
  • Write clean, elegant, and maintainable code following data warehousing best practices and modeling techniques (Kimball, Star Schema, etc.)
  • Troubleshoot data transformation errors by debugging and developing effective solutions
  • Clearly and confidently present findings, bugs, and proposed system improvements to stakeholders
  • Design and implement new Azure and AWS data pipelines and Databricks notebooks to integrate additional data sources
  • Add new data points to existing Azure Analysis Services (AAS) cubes or equivalent data models
  • Continuously identify and implement performance improvements
  • Ensure the quality, accuracy, and reliability of all data and reports
What we offer
What we offer
  • Flexi-Week at full pay with no reduction to annual holiday allowance
  • Various paid special leaves
  • Flexi-Office and hybrid/remote work possibilities
  • Monthly remote working allowance
  • Support for mental and physical well-being initiatives
  • Multisport Card
  • Medicover or Luxmed health insurance
  • Access to Awin Academy training suite
  • Local language courses
  • Peer-to-peer voucher program
  • Fulltime
Read More
Arrow Right

Azure DevOps Engineer

Location
Location
India , Bangalore; Kolkata
Salary
Salary:
Not provided
inxiteout.ai Logo
InXiteOut
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Cloud Fundamentals (Azure)
  • Strong understanding on cloud concepts (IaaS, PaaS, SaaS) and hands-on experience deploying/managing Azure resources (VMs, ADLS Gen2, ADF, Azure Databricks, Web Apps, Azure Functions, AKS, ACR etc)
  • Azure Administration & Operations
  • Manage Azure user/identity access (RBAC, Azure AD)
  • Optimize cloud costs and performance through monitoring, scaling etc
  • Troubleshooting issues on cloud resources
  • Managing secrets with Azure Key Vault, enforcing RBAC
  • Monitoring of Azure resources by using Azure Monitor, Application Insights, and Log Analytics
  • Experience on networking components like VNET, service and private endpoints, firewall and security etc
  • DevOps, CI/CD Pipelines & Infrastructure as Code (IaC)
  • Fulltime
Read More
Arrow Right