CrawlJobs Logo

Backend Data Engineer

honorvettech.com Logo

HonorVet Technologies

Location Icon

Location:
United States , Cincinnati

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

The mission of the Data & Analytics (D&A) team is to enable data users to easily Client, understand, and access trusted data products. A critical enabler of this mission is robust governance and automation within Databricks and Unity Catalog. The Senior Backend Engineer will design, build, and scale automation capabilities that enforce governance standards, improve data quality, and provide transparency into metadata, lineage, and usage. This role will ensure that the Metadata Catalog UI and supporting services are powered by trusted, well-governed, and observable data infrastructure

Job Responsibility:

  • Databricks & Unity Catalog Engineering: Build and maintain backend services leveraging Databricks (SQL, PySpark, Delta Lake, Jobs/Workflows)
  • Administer Unity Catalog including metadata, permissions, lineage, and tags
  • Integrate Unity Catalog APIs to surface data into the Metadata Catalog UI
  • Governance Automation: Develop automation scripts and pipelines to enforce access controls, tagging, and role-based policies
  • Implement governance workflows integrating with tools such as ServiceNow for request and approval processes
  • Automate compliance checks for regulatory and security requirements (IAM, PII handling, encryption)
  • Data Quality & Observability: Implement data quality frameworks (Great Expectations, Deequ, or equivalent) to validate datasets
  • Build monitoring and observability pipelines for logging, usage metrics, audit trails, and alerts
  • Ensure high system reliability and proactive issue detection
  • API Development & Integration: Design and implement APIs to integrate Databricks services with external platforms (ServiceNow, monitoring tools)
  • Build reusable automation utilities and integration frameworks for governance at scale
  • DevOps & CI/CD: Manage source control and CI/CD pipelines (GitHub, Azure DevOps, Jenkins) for backend workflows
  • Deploy scalable and secure backend services in cloud environments (Azure preferred)
  • Document, test, and industrialize automation solutions for production environments

Requirements:

  • Strong proficiency in Databricks (SQL, PySpark, Delta Lake, Jobs/Workflows)
  • Deep knowledge of Unity Catalog administration and APIs
  • Expertise in Python for automation scripts, API integrations, and data quality checks
  • Experience with governance frameworks (access control, tagging enforcement, lineage, compliance)
  • Solid foundation in security & compliance best practices (IAM, encryption, PII)
  • Experience with CI/CD and deployment pipelines (GitHub Actions, Azure DevOps, Jenkins)
  • Familiarity with monitoring/observability tools and building custom logging & alerting pipelines
  • Experience integrating with external systems (ServiceNow, monitoring platforms)
  • Experience with modern data quality frameworks (Great Expectations, Deequ, or equivalent)
  • Strong problem-solving and debugging skills in distributed systems
  • Clear communication and documentation skills to collaborate across GT and D&A teams
  • Bachelor's degree in Computer Science, Engineering, or related field OR equivalent professional experience
  • 5+ years of backend engineering experience in data platforms
  • 3+ years working with Databricks and/or Unity Catalog in enterprise environments
  • Demonstrated ability to design and deliver automation solutions for governance, quality, and compliance at scale

Additional Information:

Job Posted:
December 09, 2025

Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Backend Data Engineer

Senior Backend Engineer - Data Ingestion (ClickPipes)

About ClickHouse: Recognized on the 2025 Forbes Cloud 100 list, ClickHouse is on...
Location
Location
Netherlands
Salary
Salary:
Not provided
clickhouse.com Logo
ClickHouse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of industry experience building as a backend engineer
  • Golang
  • Kubernetes
  • Terraform (or comparable IaC tool)
  • cloud-native architecture
  • solid knowledge of at least one major cloud service provider
  • Customer Focus
  • Attention to Detail
  • Collaboration
  • Problem Solver
Job Responsibility
Job Responsibility
  • Enhance and scale our high-performance data onboarding platform to handle increasing volumes of data in real-time
  • Own and evolve our infrastructure across multiple cloud providers (AWS, with expansion to GCP and Azure)
  • Drive improvements to our deployment pipelines, infrastructure automation, and operational processes
  • Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience
  • Participate in on-call rotations to ensure system reliability and respond to production incidents
  • Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements
What we offer
What we offer
  • Flexible work environment
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company
  • Time off
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings
Read More
Arrow Right

Senior Backend Engineer - Data Ingestion

The ClickPipes Platform plays a critical role in driving the growth of our compa...
Location
Location
United Kingdom
Salary
Salary:
Not provided
clickhouse.com Logo
ClickHouse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of industry experience building as a backend engineer
  • Golang
  • Kubernetes
  • Terraform (or comparable IaC tool)
  • cloud-native architecture
  • solid knowledge of at least one major cloud service provider
  • Customer Focus
  • Attention to Detail
  • Collaboration
  • Problem Solver
Job Responsibility
Job Responsibility
  • Enhance and scale our high-performance data onboarding platform to handle increasing volumes of data in real-time
  • Own and evolve our infrastructure across multiple cloud providers (AWS, with expansion to GCP and Azure)
  • Drive improvements to our deployment pipelines, infrastructure automation, and operational processes
  • Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience
  • Participate in on-call rotations to ensure system reliability and respond to production incidents
  • Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements
What we offer
What we offer
  • Flexible work environment
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company
  • Time off
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings
Read More
Arrow Right

Senior Backend Engineer - Data Ingestion

The ClickPipes Platform plays a critical role in driving the growth of our compa...
Location
Location
Canada
Salary
Salary:
Not provided
clickhouse.com Logo
ClickHouse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant software development industry experience building data-intensive software solutions
  • Strong knowledge of Golang and experience with its ecosystem
  • Experience with distributed systems and microservices architecture
  • The ability to design and build robust ETL data pipelines that can handle large volumes of data reliably and efficiently
  • Understanding data replication methodologies like CDC
  • Good knowledge of cloud-native architecture and practical experience with at least one major CSP
  • You have excellent communication skills and the ability to work well within a team and across engineering teams
  • You are a strong problem solver and have solid production debugging skills
Job Responsibility
Job Responsibility
  • Develop and enhance integrations with various data sources including streaming platforms, databases, data lakes, and object stores
  • Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements
  • Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience
  • Participate in on-call rotations to ensure system reliability and respond to production incidents
What we offer
What we offer
  • Flexible work environment
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company - Every new team member who joins our company receives stock options
  • Time off - Flexible time off in the US, generous entitlement in other countries
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings – We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites
Read More
Arrow Right

Senior Backend Engineer - Data Ingestion

The ClickPipes Platform plays a critical role in driving the growth of our compa...
Location
Location
Spain
Salary
Salary:
Not provided
clickhouse.com Logo
ClickHouse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant software development industry experience building data-intensive software solutions
  • Strong knowledge of Golang and experience with its ecosystem
  • Experience with distributed systems and microservices architecture
  • The ability to design and build robust ETL data pipelines that can handle large volumes of data reliably and efficiently
  • Understanding data replication methodologies like CDC
  • Good knowledge of cloud-native architecture and practical experience with at least one major CSP
  • Excellent communication skills and the ability to work well within a team and across engineering teams
  • Strong problem solver and have solid production debugging skills
Job Responsibility
Job Responsibility
  • Develop and enhance integrations with various data sources including streaming platforms, databases, data lakes, and object stores
  • Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements
  • Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience
  • Participate in on-call rotations to ensure system reliability and respond to production incidents
What we offer
What we offer
  • Flexible work environment
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company - Every new team member who joins our company receives stock options
  • Time off - Flexible time off in the US, generous entitlement in other countries
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings – opportunities to engage with colleagues at company-wide offsites
Read More
Arrow Right

Senior Backend Engineer- Data Ingestion - (ClickPipes Platform)

The ClickPipes Platform plays a critical role in driving the growth of our compa...
Location
Location
United States
Salary
Salary:
133450.00 - 197200.00 USD / Year
clickhouse.com Logo
ClickHouse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant software development industry experience building data-intensive software solutions
  • Strong knowledge of Golang and experience with its ecosystem
  • Experience with distributed systems and microservices architecture
  • The ability to design and build robust ETL data pipelines that can handle large volumes of data reliably and efficiently
  • Understanding data replication methodologies like CDC
  • Good knowledge of cloud-native architecture and practical experience with at least one major CSP
  • You have excellent communication skills and the ability to work well within a team and across engineering teams
  • You are a strong problem solver and have solid production debugging skills
Job Responsibility
Job Responsibility
  • Develop and enhance integrations with various data sources including streaming platforms, databases, data lakes, and object stores
  • Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements
  • Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience
  • Participate in on-call rotations to ensure system reliability and respond to production incidents
What we offer
What we offer
  • Flexible work environment - ClickHouse is a globally distributed company and remote-friendly
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company - Every new team member who joins our company receives stock options
  • Time off - Flexible time off in the US, generous entitlement in other countries
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings – We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites
  • Fulltime
Read More
Arrow Right

Backend Engineer, Growth and Data

As a Backend Software Engineer on Hebbia’s Growth and Data team, you will build ...
Location
Location
United States , New York City; San Francisco
Salary
Salary:
160000.00 - 300000.00 USD / Year
hebbia.ai Logo
Hebbia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field
  • 5+ years software development experience at a venture-backed startup or top technology firm, with a focus on backend software engineering
  • Proficiency in building backend and API systems using technologies such as Python, Java, or Go
  • Extensive experience with cloud platforms (e.g., AWS)
  • Working experience with one or more of the following: Kafka, ElasticSearch, PostgreSQL, and/or Redis
  • Ability to analyze complex problems, propose innovative solutions, and effectively communicate technical concepts to both technical and non-technical stakeholders
  • Proven experience in leading software development projects and collaborating with cross-functional teams
  • Enthusiasm for continuous learning and professional growth
  • Embraces rapid prototyping with an emphasis on user feedback
  • Autonomous and excited about taking ownership over major initiatives
Job Responsibility
Job Responsibility
  • Own critical system components: Take complex requirements and turn them into robust, scaled solutions that solve real customer needs
  • Unlock O(1) universal indexing: Build and iterate on our high-scale document build system that enables constant time latency for indexing any content in the world, regardless of data volume
  • Drive performance optimization: Architect and implement performance-tuning solutions to ensure our systems operate efficiently at scale, minimizing latency and maximizing throughput across millions of documents
  • Mentor and guide: Provide technical leadership, mentorship, and guidance to junior engineers, fostering a culture of learning and growth
What we offer
What we offer
  • PTO: Unlimited
  • Insurance: Medical + Dental + Vision + 401K
  • Eats: Catered lunch daily + doordash dinner credit if you ever need to stay late
  • Parental leave policy: 3 months non-birthing parent, 4 months for birthing parent
  • Fertility benefits: $15k lifetime benefit
  • New hire equity grant: competitive equity package with unmatched upside potential
  • Fulltime
Read More
Arrow Right

Backend Engineer - Data Pipeline

Coralogix is a modern, full-stack observability platform transforming how busine...
Location
Location
Israel , Ramat Gan
Salary
Salary:
Not provided
coralogix.com Logo
Coralogix
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of development experience with Scala or another JVM language
  • Extensive hands-on experience with scalable and distributed systems architecture and design
  • 4+ years of hands-on experience with Data Streaming technologies, including Apache Kafka, Spark Streaming, KafkaStreams, or Apache Flink
  • Proficiency in data modeling and designing systems to handle large-scale, distributed datasets efficiently
  • Experience with containerization and orchestration tools, including Kubernetes and Docker containers
  • Strong knowledge of distributed computing paradigms and principles, such as consistency, partitioning, and resilience
  • B.Sc. in Computer Science or an equivalent field
Job Responsibility
Job Responsibility
  • End-to-end development and ownership of our products and features, from design to scalable and predictable production behavior
  • Solve diverse complex problems of high scale
  • Collaborate with other engineers and product managers in order to improve our products
  • Review code, architecture, and data to identify and troubleshoot problems
  • Fulltime
Read More
Arrow Right

Senior Backend Engineer / Tech Lead (Data Management)

As a Senior Backend Software Engineer at Aignostics, you work hand in hand with ...
Location
Location
Germany , Berlin
Salary
Salary:
Not provided
aignostics.com Logo
Aignostics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor and/or Master in a relevant field or extensive work experience
  • 6+ years of software development experience in a data intensive environment
  • Experience leading a technical initiative ideally with cross-team impact
  • Strong background in software development ideally with Python
  • Experience with cloud providers (GCP, AWS) and their services
  • Experience with container orchestration (preferable Kubernetes)
  • Experience with database systems
  • Familiar with CI/CD pipelines, code reviews and other standards to keep up code quality
  • Driven self-starter, well-organized, excellent communication skills and a strong team player
Job Responsibility
Job Responsibility
  • Design and develop services and core libraries that enable our SaaS platform
  • Ensure reliable, high throughput access to our data for machine learning
  • Maintain and expand our data management infrastructure
  • Lead initiatives, evaluate new technologies and their integration into our current codebase
  • Eagerness to take ownership - from inception to completion - without losing focus on the business context
  • Communicate closely with our frontend and machine learning teams
  • Perform code reviews, considering readability, design and performance
What we offer
What we offer
  • Learning & Development yearly budget of 1,000€ (plus 2 L&D days)
  • Language classes and internal development programs
  • Mentoring program
  • Flexible working hours and teleworking policy
  • 30 paid vacations days per year
  • Family & pet friendly and support flexible parental leave options
  • Subsidized membership of your choice among public transport, sports and well-being
  • Social gatherings, lunches, and off-site events
  • Optional company pension scheme
Read More
Arrow Right