CrawlJobs Logo
Orbis Consultants Logo Orbis Consultants · IT - Software Development

Data Engineer

United States, New York · Job Posted April 24, 2026
Apply Position
Job Link Share

Job Description

Data Engineer – AI Data Platform. The Role: We’re partnering with a fast-growing AI startup building the analytics and observability layer for AI search – essentially "Google Analytics for LLMs." As more users discover products through tools like ChatGPT, Claude, and Perplexity, companies lack visibility into how they appear in those responses. This platform solves that – and the data challenges are significant. They’re hiring a Data Engineer to help scale the core data infrastructure powering this system – handling large-scale, real-time data and enabling analytics, experimentation, and ML-driven insights.

Job Responsibility

  • Build and maintain reliable, production-grade data pipelines
  • Design scalable batch and real-time ingestion systems
  • Optimize performance and cost across Snowflake, ClickHouse, AWS, dbt, and Dagster
  • Own data quality, validation, and monitoring end-to-end
  • Develop and maintain transformation logic powering analytics and product features
  • Support ML workflows (MLOps) with clean, structured, high-quality data
  • Work closely with product, data, and engineering teams

Requirements

  • Proven experience building and maintaining production data pipelines
  • Strong SQL skills (must-have)
  • You’ve written complex queries, optimized performance, and worked deeply with analytical datasets
  • Comfortable modeling data and transforming large datasets efficiently
  • Strong Python experience
  • Hands-on experience with: dbt
  • Orchestration tools (Dagster, Airflow, or Prefect)
  • AWS (or similar cloud environments)
  • Experience with modern data warehouses such as Snowflake or ClickHouse
  • Strong ownership mindset with a focus on data quality and reliability
  • Interest in or exposure to ML pipelines / MLOps

What we offer

  • Competitive compensation
  • meaningful equity
Orbis Consultants - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer

8 matching positions

New

Data Engineer

We are looking for a Data Engineer to support and enhance critical data operatio...
Location
Location
United States , Greenville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience working in data engineering or data platform operations roles
  • Strong hands-on knowledge of Python for scripting, automation, and operational support
  • Experience managing or supporting Apache Kafka environments and related streaming data workflows
  • Familiarity with Snowflake administration, performance tuning, and resource management
  • Solid understanding of ETL processes, including data ingestion, transformation, and delivery concepts
  • Experience working with AWS services in support of modern data infrastructure
  • Knowledge of Terraform or similar infrastructure-as-code tools for environment management and automation
Job Responsibility
Job Responsibility
  • Oversee the health and performance of data pipelines that run across Snowflake, Kafka, and connected platforms
  • Investigate operational issues affecting data ingestion, transformation, or downstream delivery and drive timely resolution
  • Maintain stable batch and streaming processes by improving resiliency, uptime, and overall execution efficiency
  • Administer Snowflake resources, including warehouses, databases, permissions, and usage optimization
  • Manage Kafka infrastructure by tuning clusters, topics, partitions, and consumer group behavior for reliable throughput
  • Create and maintain automated solutions for deployment, monitoring, failure recovery, and routine workflow support
  • Develop operational scripts and utilities using Python, Bash, and related tools to reduce manual effort and improve consistency
  • Contribute to CI/CD practices that strengthen the release and maintenance process for data infrastructure
  • Partner with engineering and analytics teams to improve pipeline design, data performance, and delivery accuracy
  • Support data governance, security, compliance, and data quality standards through validation checks and alerting frameworks
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are seeking a skilled Data Engineer with strong experience in ETL development...
Location
Location
United States , Fort Lauderdale
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field, or equivalent experience
  • 3+ years of experience in data engineering or ETL development
  • Strong hands-on experience with Snowflake
  • Proficiency in Python for data processing and automation
  • Experience developing and supporting ETL/ELT workflows
  • Strong SQL skills and experience with relational databases
  • Familiarity with cloud data platforms and modern data warehouse architecture
  • Experience with data integration, transformation, and orchestration tools
  • Strong analytical, troubleshooting, and communication skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain robust ETL/ELT pipelines for ingesting, transforming, and loading data from multiple sources
  • Build and optimize data solutions within Snowflake
  • Develop reusable scripts and workflows using Python
  • Integrate data from APIs, databases, flat files, and third-party platforms
  • Monitor, troubleshoot, and enhance data pipeline performance, reliability, and scalability
  • Collaborate with analytics, engineering, and business teams to understand data requirements
  • Ensure data quality, integrity, governance, and security across platforms
  • Support data modeling, warehouse design, and performance tuning
  • Document technical designs, workflows, and operational processes
  • Participate in code reviews, testing, and deployment activities
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Free online training
Read More
Arrow Right
New

Data Engineer

We are seeking a Data Engineer to design and build scalable data pipelines and p...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience in cloud environments (AWS and/or Azure)
  • Hands‑on experience with Databricks, Apache Spark, and Delta Lake
  • Strong skills in Python / PySpark and SQL
  • Experience with data pipelines, ETL/ELT, and data modeling
  • Familiarity with orchestration tools (Airflow or similar) and modern data architectures
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines using Databricks, Spark, and cloud-native services
  • Develop and optimize ETL/ELT workflows for batch and streaming data across AWS and Azure environments
  • Build and manage data models, data lakes, and warehousing solutions for analytics and AI use cases
  • Ensure data quality, reliability, and governance across the data lifecycle
  • Collaborate with data science, analytics, and platform teams to deliver data solutions
Read More
Arrow Right

Data Engineer

We’re hiring a Data Engineer to support AI and analytics initiatives by building...
Location
Location
United States , Jacksonville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience
  • Strong proficiency in Python and SQL
  • Experience with Azure data stack (ADF, Databricks, Synapse)
  • Knowledge of data modeling and ETL best practices
Job Responsibility
Job Responsibility
  • Design and maintain data pipelines and ETL processes
  • Work with large datasets to support AI/ML model training
  • Build and optimize data architectures (data lakes, warehouses)
  • Collaborate with data scientists on feature engineering and model deployment
  • Ensure data quality, governance, and performance optimization
  • Integrate cloud-based data services (Azure Data Factory, Databricks)
Read More
Arrow Right

Data Engineer

Welcome to an exciting opportunity at Ericsson, where you'll step into the role ...
Location
Location
India , Kolkata
Salary
Salary:
Not provided
ericsson.com Logo
Ericsson
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong Python and Java expertise with experience building production-grade systems
  • Hands-on experience with Apache Spark (PySpark/Scala/Java) and distributed processing
  • Proven experience in high-volume, low-latency system design and optimization
  • Strong knowledge of Cassandra, OpenSearch/Elasticsearch, and NoSQL data modeling
  • Experience building scalable APIs and microservices (Spring Boot)
  • Hands-on experience with cloud platforms (AWS or GCP)
  • Strong working knowledge of Docker and Kubernetes
  • Experience with vulnerability management and non functional features ( alarm , logging , fault management etc.)
  • Good understanding of LLMs, embeddings, RAG, and GenAI data pipelines
  • Exposure to developer copilots / AI-assisted coding tools
Job Responsibility
Job Responsibility
  • Build and operate large-scale, high-throughput data systems handling massive datasets
  • Develop complex, scalable solutions using Python and Java
  • Design and optimize distributed data pipelines using Apache Spark
  • Engineer low-latency, high-performance data processing systems (batch + streaming)
  • Work with Cassandra and OpenSearch/Elasticsearch for high availability and scale
  • Develop scalable backend services and REST APIs (Spring Boot-based microservices)
  • Experience to work with AWS (Kiro) / Microsoft Copilot stack
  • Develop MCP-based applications and integrations with enterprise systems
  • Build RAG pipelines across network, service, customer, and operational data
  • Engineer data pipelines for embeddings, vector stores, and retrieval systems
  • Fulltime
Read More
Arrow Right

Data Engineer

Location
Location
Bulgaria; Georgia; Lithuania; Mexico; Moldova; Poland; Romania; Ukraine
Salary
Salary:
Not provided
coherentsolutions.com Logo
Coherent Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience as a Data Engineer
  • Solid proficiency in SQL
  • Experience working in Azure cloud environment
  • Experience with Azure SQL Pools
  • Strong understanding of performance tuning for data workloads
  • Experience working in Azure cloud environment
  • Excellent communication skills
  • English level: B2 (Upper-Intermediate) or higher
Job Responsibility
Job Responsibility
  • Develop and maintain data pipelines in the Azure environment
  • Work with Azure SQL Pools for data storage and processing
  • Write and optimize SQL queries
  • Perform performance tuning for queries and data workflows
  • Collaborate with a team of engineers on Databricks-based solutions
  • Build and orchestrate data workflows using Synapse Pipelines / Azure Data Factory
  • Ensure reliability and consistency of data pipelines
What we offer
What we offer
  • Technical and non-technical training for professional and personal growth
  • Internal conferences and meetups to learn from industry experts
  • Support and mentorship from an experienced employee to help you professional grow and development
  • Health insurance
  • English courses
  • Sports activities to promote a healthy lifestyle
  • Flexible work options, including remote and hybrid opportunities
  • Referral program for bringing in new talent
  • Work anniversary program and additional vacation days
  • Fulltime
Read More
Arrow Right

Data Engineer

The Associate Data Engineer is an entry level role within the Data Engineering j...
Location
Location
Malaysia , Selangor Darul Ehsan, Selangor
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Knowledge of the definition and management of scoping requirements, definition and prioritization activities
  • Understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models
  • Knowledge of Microsoft Azure Data Factory, SQL Analysis Server, SAP Data Services, SAP BTP
  • Understanding of data architecture landscape between physical and logical data models
  • Analytical mindset with good business acumen skills
  • Problem-solving aptitude with the ability to communicate effectively, both written and verbal
  • Ability to build effective relationships at all levels within the organization
  • Programming languages (Perl, bash, Shell Scripting, Python, etc.)
  • Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field
  • Basic experience as a data engineering, data mining within a fast-paced environment
Job Responsibility
Job Responsibility
  • Supports the creation of data models in a structured data format to enable analysis thereof
  • Assists with the design and development of scalable extract, transform and loading (ETL) packages from the business source systems and the development of ETL routines to populate data from sources
  • Participates in the transformation of object and data models into appropriate database schemas within design constraints. Interpret installation standards to meet project needs and produce database components as required
  • Takes direction from various stakeholders to create test scenarios and be responsible for participating in thorough testing and validation to support the accuracy of data transformations
  • Assists with running data migrations across different databases and applications, for example, MS Dynamics, Oracle, SAP and other ERP systems
  • Supports the definition and implementation of data table structures and data models based on requirements
  • Takes part in analysis, and development of ETL and migration documentation
  • Receives detailed instructions from various stakeholders to evaluate potential data requirements
  • Assists with the definition and management of scoping, requirements, definition, and prioritization activities for small-scale changes and assist with more complex change initiatives
  • Takes direction from various stakeholders, contributing to the recommendation of improvements in automated and non-automated components of the data tables, data queries and data models
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a Data Engineer to join a long-term contract opportunity base...
Location
Location
United States , Austin
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Senior-level experience in data engineering, data architecture, or a closely related discipline
  • Extensive hands-on background designing and building ETL and ELT solutions in modern cloud data environments
  • Demonstrated experience working with Snowflake and transformation tooling such as DBT
  • exposure to Matillion or similar platforms is highly valued
  • Ability to translate conceptual architecture into practical, maintainable implementation patterns with minimal supervision
  • Solid understanding of data integration tradeoffs across application-to-application flows, warehouse-centric design, and operational reporting needs
  • Proven ability to document technical standards, communicate design rationale, and support knowledge transfer to internal teams
  • Comfortable partnering with architects, BI leaders, integration specialists, and business stakeholders in a collaborative setting
Job Responsibility
Job Responsibility
  • Convert architectural guidance into scalable data pipeline designs and warehouse implementation patterns that support consistent delivery
  • Build and maintain workflows that ingest source data, prepare it for downstream use, and organize it across raw, staging, curated, and consumption layers
  • Assess integration approaches and recommend when data should move directly between applications versus through the warehouse for better governance and reuse
  • Create repeatable standards for orchestration, transformation, testing, monitoring, documentation, and support handoff
  • Develop and support cloud data warehouse solutions using Snowflake, Matillion, DBT, or comparable data engineering tools based on platform needs
  • Collaborate closely with integration and cross-functional team members to explain technical choices, guide implementation decisions, and strengthen team capability
  • Produce clear documentation covering data flows, lineage, dependencies, architecture decisions, and operational expectations
  • Deliver hands-on engineering leadership that enables durable solutions without creating long-term dependency on external support
What we offer
What we offer
  • medical insurance
  • vision insurance
  • dental insurance
  • life insurance
  • disability insurance
  • 401(k) plan
Read More
Arrow Right