CrawlJobs Logo

Databricks Devops

United States, Dallas 135000.00 USD / Year · Job Posted May 04, 2026
Apply Position
Job Link Share

Requirements

  • 7+ years of experience developing APIs and integrating with 3rd party APIs. Strong SQL skills (SQL Server or Oracle).
  • Familiarity with scripting languages (Python, Bash, Powershell).
  • Experience with version control systems (Git, GitHub, GitLab).
  • Knowledge of CI/CD pipelines and DevOps best practices.
  • Azure AD, OAuth, JWT, Microsoft Teams SDK, Building apps for teams, Azure hands with AD B2C, BOT, SignalR, AKS, App Registrations, App Insights
  • Azure Databricks
  • CI/CD: Jenkins, Terraform, GitLab CI/CD
  • Terraform Module Development

Nice to have

  • Data Engineer
  • Strong understanding of ETL/ELT processes, data modeling, data warehousing, and big data concepts.
  • Understanding of workflow automations is a plus.

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Databricks Devops

8 matching positions

New

Systems Integration Senior Specialist

We are currently seeking a Systems Integration Senior Specialist to join our tea...
Location
Location
India , bengaluru
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced SQL programming for more than 4 years
  • Experience with Agile delivery frameworks/methodologies (e.g. Scrum, SAFe) and tools (i.e. Jira, Azure DevOps)
  • Demonstrate a proven track record of having implemented solutions using one or more agile methodologies in conjunction with a large system integration partner
  • Experience with Azure Data Factory and Databricks including orchestrating and designing data pipelines for secure data solutions are preferred
  • Industry certifications in Azure, Databricks or data architecture is advantageous
  • Understanding and knowledge of system development life cycle methodologies (such as agile software development, rapid prototyping, incremental, synchronize and stabilize, and DevOps)
  • Experience in migrating data and associated systems from on prem to Cloud environments
  • Knowledge of advanced analytics (models, tools, etc.) and their operational support is a plus
  • Excellent verbal and written communication
  • Knowledge of data warehousing and ETL/ELT pipelines
Job Responsibility
Job Responsibility
  • Participate in reviews and analysis of business/system requirements
  • PowerApps development
  • Power Automate development
  • Working with the test team and support User Acceptance Testing (UAT) as applicable.
  • Fulltime
Read More
Arrow Right
New

Software Development Specialist

We are currently seeking a Software Development Specialist to join our team in G...
Location
Location
Mexico , Guadalajara
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Understand the Microsoft Azure Cloud - ideally Azure Fundamentals certified OR Computer Science/Information Systems Management degree
  • Familiar with PaaS and IaaS - VMs, Storage, EventHub, Service Fabric Cluster (SFC), Azure Kubernetes Service (AKS), CosmosDB, SQL Server, IoT Hub, Databricks, KeyVault, Datalake
  • Understand the concept of Internet of Things (IoT) - telemetry, ingestion, processing, data storage, reporting
  • Understand and know on-prem virtualization (VMWare, or Hyper-V, or Nutanix)
  • Understand the concept tools - Octopus, Bamboo, Terraform, Azure DevOps, Jenkins, Github, Ansible
  • Understand the concept of container orchestration platforms (e.g. Kubernetes)
  • Understand the concept of scripts: Powershell, Python
  • Understand the difference between NoSQL and SQL databases, and how to maintain them
  • Understand monitoring and logging systems (LogAnalytics, Splunk, ELK, Prometheus, Nagios, Zabbix, etc.)
  • Independent thinker - why does it break, what can I proactively do to fix it
Job Responsibility
Job Responsibility
  • Perform L1.5 activities such as monitoring, deployment, rollback
  • Monitor the efficiency of the Azure cloud systems to prevent outages and initiate an Incident Management bridge in case of an outage
  • Troubleshoot Azure resources, escalate to Level 3 (Software Development Team)
  • Fulltime
Read More
Arrow Right
New

Applications Development Manager Java

We are looking for a Senior Java Spark Developer who is passionate about coding,...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of hands-on experience in Java and Apache Spark / Big Data development
  • Strong foundation in object-oriented programming, design patterns, and clean coding practices
  • Proven experience building and optimizing large-scale distributed data processing systems
  • Experience with REST APIs, RDBMS, and Kafka or similar messaging systems
  • Exposure to microservices and containerization (Docker/Kubernetes) is preferred
  • Experience in Databricks is preferred
  • Familiarity with or interest in AI-powered solutions / AI agents is a plus
  • Experience working in Agile environments with strong collaboration and ownership mindset
  • Bachelor’s degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Design and develop scalable, high-performance applications using Java and Apache Spark
  • Translate business requirements into clean, efficient, and reliable technical solutions
  • Write modular, testable, and maintainable code following OOP principles and design patterns
  • Continuously refactor and optimize applications for performance, scalability, and maintainability
  • Troubleshoot and resolve complex data processing and performance issues
  • Perform and participate in code reviews, promoting engineering best practices
  • Collaborate with architects, product owners, DevOps, and Agile teams for high-quality delivery
  • Mentor junior developers and contribute to a culture of craftsmanship and continuous improvement
  • Fulltime
Read More
Arrow Right
New

Technical Business Analyst

We are looking for a Technical Business Analyst/ Specialist IS Analyst with a pr...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s OR bachelor's degree with 8 to 12 years of experience in Information Systems experience
  • Excellent problem-solving skills and a passion for tackling complex challenges in data and analytics with technology
  • Experience working in a Scaled Agile Framework (SAFe)
  • Excellent interpersonal skills, strong attention to detail, and ability to influence based on data and business value
  • Has experience with writing user requirements and acceptance criteria in agile project management systems such as Jira
  • Ability to explain sophisticated technical concepts to non-technical clients
  • Able to work effectively across multiple geographies (primarily India, Portugal, and the United States) under minimal supervision
  • Demonstrated proficiency in written and verbal communication in English language
  • Intellectual curiosity and the ability to question partners across functions
  • Ability to prioritize successfully based on business value
Job Responsibility
Job Responsibility
  • Collaborate with senior leaders on the Field Analytics product team within the Commercial Data & Analytics organization, focused on operations within the United States
  • Interact with business clients and technology management to create technology roadmaps, build cases, and drive DevOps to achieve the roadmaps
  • Help to mature Agile operating principles through deployment of creative and consistent practices for user story development, robust testing and quality oversight, and focus on user experience
  • Ability to connect and understand our vast array Commercial and other functional data sources including Sales, Activity, and Digital data, etc. into consumable and user-friendly modes (e.g., dashboards, reports, mobile, etc.) for key decision makers such as executives, brand leads, account managers, and field representatives
  • Become the lead subject matter expert in Reporting and Incentive Compensation capabilities by researching and implementing new tools and features, internal and external methodologies
  • Fulltime
Read More
Arrow Right
New

Sr Data Engineer

As a Senior Data Engineer at Amgen, you will be responsible for managing and opt...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master's degree with 8 - 13 years of experience in Computer Science, IT or related field
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies
  • Proficiency in workflow orchestration, performance tuning on big data processing
  • Strong understanding of AWS services
  • Experience with Data Fabric, Data Mesh, or similar enterprise-wide data architectures
  • Ability to quickly learn, adapt and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
  • Excellent analytical and troubleshooting skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable ETL/ELT pipelines to support structured, semi-structured, and unstructured data processing across the Enterprise Data Engineering for Biotech or Pharma functional knowledge of R&D
  • Implement real-time and batch data processing solutions, integrating data from multiple sources into a unified, governed data fabric architecture
  • Optimize big data processing frameworks using Apache Spark, Hadoop, or similar distributed computing technologies to ensure high availability and cost efficiency
  • Work with metadata management and data lineage tracking tools to enable enterprise-wide data discovery and governance
  • Ensure data security, compliance, and role-based access control (RBAC) across data environments
  • Optimize query performance, indexing strategies, partitioning, and caching for large-scale data sets
  • Develop CI/CD pipelines for automated data pipeline deployments, version control, and monitoring
  • Implement data virtualization techniques to provide seamless access to data across multiple storage systems
  • Collaborate with cross-functional teams, including data architects, business analysts, and DevOps teams, to align data engineering strategies with enterprise goals
  • Stay up to date with emerging data technologies and best practices, ensuring continuous improvement of Enterprise Data Fabric architectures
  • Fulltime
Read More
Arrow Right
New

Associate Business Analyst

We are looking for a Business Analyst with a proven versatile skillset, includin...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s OR bachelor's degree with 2 to 5 years of experience in Information Systems experience
  • Excellent problem-solving skills and a passion for tackling complex challenges in data and analytics with technology
  • Experience working in a Scaled Agile Framework (SAFe)
  • Excellent interpersonal skills, strong attention to detail, and ability to influence based on data and business value
  • Has experience with writing user requirements and acceptance criteria in agile project management systems such as Jira
  • Ability to explain sophisticated technical concepts to non-technical clients
Job Responsibility
Job Responsibility
  • Collaborate with senior leaders on the Field Analytics product team within the Commercial Data & Analytics organization, focused on operations within the United States
  • Interact with business clients and technology management to create technology roadmaps, build cases, and drive DevOps to achieve the roadmaps
  • Help to mature Agile operating principles through deployment of creative and consistent practices for user story development, robust testing and quality oversight, and focus on user experience
  • Ability to connect and understand our vast array Commercial and other functional data sources including Sales, Activity, and Digital data, etc. into consumable and user-friendly modes (e.g., dashboards, reports, mobile, etc.) for key decision makers such as executives, brand leads, account managers, and field representatives
  • Become the lead subject matter expert in Reporting and Incentive Compensation capabilities by researching and implementing new tools and features, internal and external methodologies
Read More
Arrow Right
New

Lead Data Engineer

Lead Data Engineer | Databricks | Azure | PySpark. You are an experienced Data E...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
levy-professionals.com Logo
Levy Professionals
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Around 10 years of experience in Data Engineering
  • Extensive hands-on experience with Databricks, PySpark, and Python
  • Strong experience with Azure Data Factory, Azure DevOps, CI/CD practices
  • Automated testing frameworks
  • Software engineering best practices
  • Ability to mentor engineers
Job Responsibility
Job Responsibility
  • Design, build, and optimise scalable data pipelines using PySpark and Databricks
  • Develop and maintain high-quality Python code
  • Contribute to automated testing frameworks using pytest
  • Support and enhance CI/CD pipelines within Azure DevOps
  • Collaborate with cross-functional teams
  • Mentor junior and medior Data Engineers
  • Fulltime
Read More
Arrow Right
New

Data Engineer – Azure Cloud Infrastructure

Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
levy-professionals.com Logo
Levy Professionals
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience with Azure data services such as Data Factory, Synapse, and Key Vault
  • Proficiency in Infrastructure as Code tools like Terraform, ARM, or Bicep
  • Hands-on experience with CI/CD tools, preferably Azure DevOps
  • Experience with MSSQL and Databricks
  • Understanding of data modelling and data warehouse concepts
  • Experience in financial or regulatory reporting environments
  • Relevant certifications such as Azure DevOps Engineer or Azure Data Engineer
  • Experience with cloud migration or hybrid cloud setups
Job Responsibility
Job Responsibility
  • Design and deliver end-to-end data pipelines for reporting and analytics
  • Develop and manage Azure infrastructure using Infrastructure as Code (Terraform, ARM, Bicep)
  • Build and maintain CI/CD pipelines for infrastructure and data deployments
  • Collaborate with engineers and business stakeholders to ensure secure, compliant solutions
  • Automate monitoring, testing, and deployment processes to improve operational reliability
Read More
Arrow Right