CrawlJobs Logo
HonorVet Technologies Logo HonorVet Technologies · IT - Software Development

Backend Data Engineer

United States, Cincinnati · Job Posted December 09, 2025
Apply Position
Job Link Share

Job Description

The mission of the Data & Analytics (D&A) team is to enable data users to easily Client, understand, and access trusted data products. A critical enabler of this mission is robust governance and automation within Databricks and Unity Catalog. The Senior Backend Engineer will design, build, and scale automation capabilities that enforce governance standards, improve data quality, and provide transparency into metadata, lineage, and usage. This role will ensure that the Metadata Catalog UI and supporting services are powered by trusted, well-governed, and observable data infrastructure

Job Responsibility

  • Databricks & Unity Catalog Engineering: Build and maintain backend services leveraging Databricks (SQL, PySpark, Delta Lake, Jobs/Workflows)
  • Administer Unity Catalog including metadata, permissions, lineage, and tags
  • Integrate Unity Catalog APIs to surface data into the Metadata Catalog UI
  • Governance Automation: Develop automation scripts and pipelines to enforce access controls, tagging, and role-based policies
  • Implement governance workflows integrating with tools such as ServiceNow for request and approval processes
  • Automate compliance checks for regulatory and security requirements (IAM, PII handling, encryption)
  • Data Quality & Observability: Implement data quality frameworks (Great Expectations, Deequ, or equivalent) to validate datasets
  • Build monitoring and observability pipelines for logging, usage metrics, audit trails, and alerts
  • Ensure high system reliability and proactive issue detection
  • API Development & Integration: Design and implement APIs to integrate Databricks services with external platforms (ServiceNow, monitoring tools)
  • Build reusable automation utilities and integration frameworks for governance at scale
  • DevOps & CI/CD: Manage source control and CI/CD pipelines (GitHub, Azure DevOps, Jenkins) for backend workflows
  • Deploy scalable and secure backend services in cloud environments (Azure preferred)
  • Document, test, and industrialize automation solutions for production environments

Requirements

  • Strong proficiency in Databricks (SQL, PySpark, Delta Lake, Jobs/Workflows)
  • Deep knowledge of Unity Catalog administration and APIs
  • Expertise in Python for automation scripts, API integrations, and data quality checks
  • Experience with governance frameworks (access control, tagging enforcement, lineage, compliance)
  • Solid foundation in security & compliance best practices (IAM, encryption, PII)
  • Experience with CI/CD and deployment pipelines (GitHub Actions, Azure DevOps, Jenkins)
  • Familiarity with monitoring/observability tools and building custom logging & alerting pipelines
  • Experience integrating with external systems (ServiceNow, monitoring platforms)
  • Experience with modern data quality frameworks (Great Expectations, Deequ, or equivalent)
  • Strong problem-solving and debugging skills in distributed systems
  • Clear communication and documentation skills to collaborate across GT and D&A teams
  • Bachelor's degree in Computer Science, Engineering, or related field OR equivalent professional experience
  • 5+ years of backend engineering experience in data platforms
  • 3+ years working with Databricks and/or Unity Catalog in enterprise environments
  • Demonstrated ability to design and deliver automation solutions for governance, quality, and compliance at scale
HonorVet Technologies - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Backend Data Engineer

8 matching positions

Backend Data Engineer — Data Platform

We're looking for an engineer to support hands-on implementation and migration w...
Location
Location
Poland
Salary
Salary:
140.00 - 170.00 PLN / Hour
devire.pl Logo
Devire
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong Java development skills, with experience in data platform or data engineering contexts
  • Practical experience with at least one JVM-based data processing framework — Flink experience is a plus
  • Beam, Dataflow, or Spark also relevant
  • Comfortable with SQL and cloud data analytics platforms, particularly BigQuery
  • DevOps is part of your day-to-day: you work with cloud infrastructure, containerised applications, and are familiar with Kubernetes basics
  • Experience working with data engineering pipelines in Scala and/or Python
  • You write quality code and understand what it means to ship reliably in a production environment
  • You can work autonomously in an ambiguous environment and move quickly without waiting to be directed
Job Responsibility
Job Responsibility
  • Support hands-on implementation and migration work as we evolve our data processing stack
  • Contribute to company wide migration efforts and platform development
  • Embedded in a team in Data Infrastructure PA, contributing to hands-on engineering work including large-scale pipeline migrations — validating performance and cost outcomes and helping move workloads to our evolving stack
  • Contribute to platform development across our Flink platform, Lakehouse architecture and beyond
What we offer
What we offer
  • Access to benefits package at attractive prices (medical care, Multisport card, life insurance, cafeteria system)
  • Long-term cooperation
  • Fulltime
Read More
Arrow Right

Senior Software Engineer (Backend) - Data & Storage Platforms

As a Senior Software Engineer in the Storage, Search, and Data (SSD) group, you ...
Location
Location
United States , Seattle, Washington; San Francisco, California; Sunnyvale, California
Salary
Salary:
202000.00 - 224000.00 USD / Year
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ Years of Engineering Experience: Proven track record of building and maintaining large-scale distributed systems
  • Deep Storage Knowledge: Practical, hands-on experience with: Relational & NoSQL: Distributed MySQL, Cassandra, or Redis
  • Batch & Object: HDFS, S3/GCS, and Metadata services
  • Distributed Systems: If you’ve worked on systems like Google Spanner or TiDB, you’ll be a great fit for our Transactional Storage (Docstore) team
  • Coding Mastery: Expert-level proficiency in Java, Go, or C++, with a strong focus on concurrency, memory management, and performance tuning
  • Query Engines: Experience with large-scale analytical engines like Presto, Hive, or Trino
Job Responsibility
Job Responsibility
  • Own & Execute: Lead the design and implementation of major features for Uber’s storage and data platforms (e.g., Docstore, Pinot, or OpenSearch)
  • Cloud-Native Modernization: Build and optimize services that leverage GCP and OCI Object Storage, focusing on high-throughput metadata management and S3-compatible API support
  • Storage Optimization: Drive efficiency across our HDFS and Blobstore layers, using table formats like Apache Hudi or Iceberg to improve data freshness and reduce cost
  • AI/ML Integration: Work with AI teams to design high-performance data pipelines, ensuring our storage layers can handle the intense IO demands of GPU-based model training
  • Operational Leadership: Ensure 99.99% availability for your services. You will lead root-cause analyses (RCAs), improve observability, and mentor L3/L4 engineers on best practices for distributed systems
What we offer
What we offer
  • Uber's bonus program
  • equity award & other types of comp
  • 401(k) plan
  • various benefits
  • Fulltime
Read More
Arrow Right

Senior/ Principal Backend Engineer - Data & AI Security (Cortex Cloud)

At Palo Alto Networks®, we’re united by a shared mission—to protect our digital ...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on software engineering experience, with deep expertise in at least one of the following: Kotlin/Java, Python, or Go
  • Experience working with different cloud services on at least one major cloud provider (AWS, Azure, GCP)
  • Proven experience designing and building large-scale, scalable cloud-based applications
  • Expertise in microservices architecture, including technologies like Kubernetes, Docker, GKE, EKS, or AKS
  • Experience with relational or NoSQL databases (e.g., MYSQL, PostgreSQL, MongoDB) and ORMs (e.g., JPA, Hibernate)
  • Bachelor of Science in Computer Science or equivalent practical experience (e.g., elite software unit in the military).
Job Responsibility
Job Responsibility
  • Drive innovation by designing and implementing impactful solutions that address client needs, contributing to the full feature development lifecycle from design to deployment
  • Take ownership of specific feature segments, ensuring high-quality code and robust functionality through meticulous attention to detail and a focus on execution
  • Proactively collaborate and exchange information with cross-functional teams, including product and infrastructure, to ensure seamless integration and alignment on shared objectives
  • Challenge the status quo by generating innovative ideas and actively participating in brainstorming sessions to foster product and architectural improvements
  • Actively engage in technical discussions, openly sharing knowledge and learning from others to solve complex problems and elevate team expertise
  • Design and build highly scalable, resilient, and secure cloud-based applications and microservices
  • Contribute to an agile and dynamic engineering culture, demonstrating a strong drive and outstanding communication skills to deliver results efficiently.
  • Fulltime
Read More
Arrow Right

Senior/ Principal Backend Engineer - Data & AI Security (Cortex Cloud)

In this role, you will be dedicated to safeguarding our clients’ data within the...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
paloaltonetworks.it Logo
Palo Alto Networks Italia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on software engineering experience, with deep expertise in at least one of the following: Kotlin/Java, Python, or Go
  • Experience working with different cloud services on at least one major cloud provider (AWS, Azure, GCP)
  • Proven experience designing and building large-scale, scalable cloud-based applications
  • Expertise in microservices architecture, including technologies like Kubernetes, Docker, GKE, EKS, or AKS
  • Experience with relational or NoSQL databases (e.g., MYSQL, PostgreSQL, MongoDB) and ORMs (e.g., JPA, Hibernate)
  • Bachelor of Science in Computer Science or equivalent practical experience (e.g., elite software unit in the military)
Job Responsibility
Job Responsibility
  • Drive innovation by designing and implementing impactful solutions that address client needs, contributing to the full feature development lifecycle from design to deployment
  • Take ownership of specific feature segments, ensuring high-quality code and robust functionality through meticulous attention to detail and a focus on execution
  • Proactively collaborate and exchange information with cross-functional teams, including product and infrastructure, to ensure seamless integration and alignment on shared objectives
  • Challenge the status quo by generating innovative ideas and actively participating in brainstorming sessions to foster product and architectural improvements
  • Actively engage in technical discussions, openly sharing knowledge and learning from others to solve complex problems and elevate team expertise
  • Design and build highly scalable, resilient, and secure cloud-based applications and microservices
  • Contribute to an agile and dynamic engineering culture, demonstrating a strong drive and outstanding communication skills to deliver results efficiently
  • Fulltime
Read More
Arrow Right

Backend Engineer - Data Pipeline

Coralogix is a modern, full-stack observability platform transforming how busine...
Location
Location
Germany , Berlin
Salary
Salary:
Not provided
coralogix.com Logo
Coralogix
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 5 years of software development experience
  • At least 2 years of experience developing and operating Rust-based systems in production
  • Experience with AWS/ GCP cloud
Job Responsibility
Job Responsibility
  • Design and develop backend services using Rust along with other exciting technologies, all deployed in AWS on Kubernetes
  • Fulltime
Read More
Arrow Right

Software Engineer - Backend & Data

Spate is the machine intelligence platform used by top industry beauty brands. W...
Location
Location
Romania; Serbia; Moldova; Belarus; Poland; Czechia; Hungary; Bulgaria; Slovakia
Salary
Salary:
Not provided
helpcare.ai Logo
Helpcare AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3 years of experience as a software engineer, working on backend and ETL for web applications
  • Experience collecting, cleaning, and analyzing large data sets
  • Proficiency in Python, Pandas, SQL
  • Strong oral and written communication skills
  • Project management skills and ability to handle multiple priorities at different timescales
  • Proven problem-solving skills using deductive reasoning, understanding hierarchical relationships, and identifying gaps in logic
  • Self-starter and ability to work independently
  • Located in Western Europe
Job Responsibility
Job Responsibility
  • Support customers and staff in understanding and exploiting the platform, data and tools
  • Ensure the availability of the platform, data and tools
  • Define and implement improvements for the platform, data and tools related to security, quality, testing, automation, documentation and new features
  • Contribute to sprint planning, backlog grooming, and task prioritization
  • Estimate the effort required for development tasks and help create project timelines
  • Track and report on progress, addressing any delays or roadblocks proactively
What we offer
What we offer
  • Join a well-funded company that is working with the top brands in consumer goods
  • Work directly with the founders to set the direction of the company
  • Compensation --> €60K to 80K, depending on experience
  • Always be up-to-date on the latest trends
  • Fulltime
Read More
Arrow Right

Backend Engineer - Data Pipeline

Coralogix is a modern, full-stack observability platform transforming how busine...
Location
Location
Israel , Ramat Gan
Salary
Salary:
Not provided
coralogix.com Logo
Coralogix
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 5 years of software development experience
  • At least 2 years of experience developing and operating Rust-based systems in production-MUST
  • Experience with AWS/ GCP cloud
  • Experience with Kafka - Advantage
  • Experience using ClickHouse in production- an advantage
Job Responsibility
Job Responsibility
  • Design and develop our backend services using Rust along with other exciting technologies, all deployed in AWS on Kubernetes
  • Fulltime
Read More
Arrow Right

Senior/Principal Backend Engineer - Data Classification

Our engineering team is at the core of how modern data security is built. We are...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional experience as a Software Engineer
  • BSc degree in Computer Science, or equivalent background
  • Proven ability to design and deliver complex systems end-to-end
  • Strong algorithmic thinking, including the ability to design efficient solutions under real-world constraints such as scale, latency, and resource usage
  • Familiarity with CI/CD pipelines and cloud infrastructure
  • Ability to make things work beyond writing good code - hands-on, practical, and execution-oriented
  • Strong ownership, communication skills, and a proactive mindset
Job Responsibility
Job Responsibility
  • Build and scale AI-driven data classification and detection capabilities for next-generation data security products
  • Design systems that identify, classify, and protect sensitive data in real time across cloud and endpoint environments
  • Lead technical design discussions and influence architecture for large-scale data processing systems
  • Partner with product, infrastructure, and other engineering teams to deliver tightly integrated solutions
  • Solve complex engineering challenges related to scale, performance, reliability, and operations
  • Raise the technical and collaborative bar by mentoring, sharing knowledge, and improving team practices
  • Proactively suggest ideas, lead initiatives, and drive continuous improvement across the product and engineering processes
  • Fulltime
Read More
Arrow Right