Real-Time Data Engineer Job at Bright Vision Technologies (Bridgewater)

Principal Data Engineer

PointClickCare is searching for a Principal Data Engineer who will contribute to...

Location

United States

Salary:

183200.00 - 203500.00 USD / Year

PointClickCare

Expiration Date

Until further notice

Requirements

Principal Data Engineer with at least 10 years of professional experience in software or data engineering, including a minimum of 4 years focused on streaming and real-time data systems
Proven experience driving technical direction and mentoring engineers while delivering complex, high-scale solutions as a hands-on contributor
Deep expertise in streaming and real-time data technologies, including frameworks such as Apache Kafka, Flink, and Spark Streaming
Strong understanding of event-driven architectures and distributed systems, with hands-on experience implementing resilient, low-latency pipelines
Practical experience with cloud platforms (AWS, Azure, or GCP) and containerized deployments for data workloads
Fluency in data quality practices and CI/CD integration, including schema management, automated testing, and validation frameworks (e.g., dbt, Great Expectations)
Operational excellence in observability, with experience implementing metrics, logging, tracing, and alerting for data pipelines using modern tools
Solid foundation in data governance and performance optimization, ensuring reliability and scalability across batch and streaming environments
Experience with Lakehouse architectures and related technologies, including Databricks, Azure ADLS Gen2, and Apache Hudi
Strong collaboration and communication skills, with the ability to influence stakeholders and evangelize modern data practices within your team and across the organization

Job Responsibility

Lead and guide the design and implementation of scalable streaming data pipelines
Engineer and optimize real-time data solutions using frameworks like Apache Kafka, Flink, Spark Streaming
Collaborate cross-functionally with product, analytics, and AI teams to ensure data is a strategic asset
Advance ongoing modernization efforts, deepening adoption of event-driven architectures and cloud-native technologies
Drive adoption of best practices in data governance, observability, and performance tuning for streaming workloads
Embed data quality in processing pipelines by defining schema contracts, implementing transformation tests and data assertions, enforcing backward-compatible schema evolution, and automating checks for freshness, completeness, and accuracy across batch and streaming paths before production deployment
Establish robust observability for data pipelines by implementing metrics, logging, and distributed tracing for streaming jobs, defining SLAs and SLOs for latency and throughput, and integrating alerting and dashboards to enable proactive monitoring and rapid incident response
Foster a culture of quality through peer reviews, providing constructive feedback and seeking input on your own work

What we offer

Benefits starting from Day 1!
Retirement Plan Matching
Flexible Paid Time Off
Wellness Support Programs and Resources
Parental & Caregiver Leaves
Fertility & Adoption Support
Continuous Development Support Program
Employee Assistance Program
Allyship and Inclusion Communities
Employee Recognition … and more!

Fulltime

Software Engineer (Data Engineering)

We are seeking a Software Engineer (Data Engineering) who can seamlessly integra...

Location

India , Hyderabad

Salary:

Not provided

NStarX

Expiration Date

Until further notice

Requirements

4+ years in Data Engineering and AI/ML roles
Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field
Python, SQL, Bash, PySpark, Spark SQL, boto3, pandas
Apache Spark on EMR (driver/executor model, sizing, dynamic allocation)
Amazon S3 (Parquet) with lifecycle management to Glacier
AWS Glue Catalog and Crawlers
AWS Step Functions, AWS Lambda, Amazon EventBridge
CloudWatch Logs and Metrics, Kinesis Data Firehose (or Kafka/MSK)
Amazon Redshift and Redshift Spectrum
IAM (least privilege), Secrets Manager, SSM

Job Responsibility

Design, build, and maintain scalable ETL and ELT pipelines for large-scale data processing
Develop and optimize data architectures supporting analytics and ML workflows
Ensure data integrity, security, and compliance with organizational and industry standards
Collaborate with DevOps teams to deploy and monitor data pipelines in production environments
Build predictive and prescriptive models leveraging AI and ML techniques
Develop and deploy machine learning and deep learning models using TensorFlow, PyTorch, or Scikit-learn
Perform feature engineering, statistical analysis, and data preprocessing
Continuously monitor and optimize models for accuracy and scalability
Integrate AI-driven insights into business processes and strategies
Serve as the technical liaison between NStarX and client teams

What we offer

Competitive salary and performance-based incentives
Opportunity to work on cutting-edge AI and ML projects
Exposure to global clients and international project delivery
Continuous learning and professional development opportunities
Competitive base + commission
Fast growth into leadership roles

Fulltime

Senior Data Engineer

Adtalem is a data driven organization. The Data Engineering team builds data sol...

Location

United States , Lisle

Salary:

84835.61 - 149076.17 USD / Year

Adtalem Global Education

Expiration Date

Until further notice

Requirements

Bachelor's Degree Computer Science, Computer Engineering, Software Engineering, or other related technical field.
Master's Degree Computer Science, Computer Engineering, Software Engineering, or other related technical field.
Two (2) plus years experience in Google cloud with services like BigQuery, Composer, GCS, DataStream, Dataflows, BQML, Vertex AI.
Six (6) plus years experience in data engineering solutions such as data platforms, ingestion, data management, or publication/analytics.
Hands-on experience working with real-time, unstructured, and synthetic data.
Experience in Real Time Data ingestion using GCP PubSub, Kafka, Spark or similar.
Expert knowledge on Python programming and SQL.
Experience with cloud platforms (AWS, GCP, Azure) and their data services
Experience working with Airflow as workflow management tools and build operators to connect, extract and ingest data as needed.
Familiarity with synthetic data generation and unstructured data processing

Job Responsibility

Architect, develop, and optimize scalable data pipelines handling real-time, unstructured, and synthetic datasets
Collaborate with cross-functional teams, including data scientists, analysts, and product owners, to deliver innovative data solutions that drive business growth.
Design, develop, deploy and support high performance data pipelines both inbound and outbound.
Model data platform by applying the business logic and building objects in the semantic layer of the data platform.
Leverage streaming technologies and cloud platforms to enable real-time data processing and analytics
Optimize data pipelines for performance, scalability, and reliability.
Implement CI/CD pipelines to ensure continuous deployment and delivery of our data products.
Ensure quality of critical data elements, prepare data quality remediation plans and collaborate with business and system owners to fix the quality issues at its root.
Document the design and support strategy of the data pipelines
Capture, store and socialize data lineage and operational metadata

What we offer

Health, dental, vision, life and disability insurance
401k Retirement Program + 6% employer match
Participation in Adtalem’s Flexible Time Off (FTO) Policy
12 Paid Holidays
Eligible to participate in an annual incentive program

Fulltime

Data & Analytics Engineer

As a Data & Analytics Engineer with MojoTech you will work with our clients to s...

Location

United States

Salary:

90000.00 - 150000.00 USD / Year

MojoTech

Expiration Date

Until further notice

Requirements

3+ years of experience in Data Engineering, Data Science, Data Warehousing
Strong experience in Python
Experience building and maintaining ETL/ELT pipelines, data warehouses, or real-time analytics systems
BA/BS in Computer Science, Data Science, Engineering, or a related field or equivalent experience in data engineering or analytics
Track record of developing and optimizing scalable data solutions and larger-scale data initiatives
Strong understanding of best practices in data management, including sustainment, governance, and compliance with data quality and security standards
Commitment to continuous learning and sharing knowledge with the team

Job Responsibility

Work with our clients to solve complex problems and to deliver high quality solutions as part of a team
Collaborating with product managers, designers, and clients, you will lead discussions to define data requirements and deliver actionable insights and data pipelines to support client analytics needs

What we offer

Performance based end of year bonus
Medical, Dental, FSA
401k with 4% match
Trust-based time off
Catered lunches when in office
5 hours per week dedicated to self-directed learning, innovation projects, or skill development
Dog Friendly Offices
Paid conference attendance/yearly education stipend
Custom workstation
6 weeks parental leave

Fulltime

Senior Data Engineer

Provectus, a leading AI consultancy and solutions provider specializing in Data ...

Location

Salary:

Not provided

Provectus

Expiration Date

Until further notice

Requirements

Experience handling real-time and batch data flow and data warehousing with tools and technologies like Airflow, Dagster, Kafka, Apache Druid, Spark, dbt, etc.
Experience in AWS
Proficiency in programming languages relevant to data engineering, such as Python and SQL
Proficiency with Infrastructure as Code (IaC) technologies like Terraform or AWS CloudFormation
Experience in building scalable APIs
Familiarity with Data Governance aspects like Quality, Discovery, Lineage, Security, Business Glossary, Modeling, Master Data, and Cost Optimization
Upper-Intermediate or higher English skills
Ability to take ownership, solve problems proactively, and collaborate effectively in dynamic settings

Job Responsibility

Collaborate closely with clients to deeply understand their existing IT environments, applications, business requirements, and digital transformation goals
Collect and manage large volumes of varied data sets
Work directly with ML Engineers to create robust and resilient data pipelines that feed Data Products
Define data models that integrate disparate data across the organization
Design, implement, and maintain ETL/ELT data pipelines
Perform data transformations using tools such as Spark, Trino, and AWS Athena to handle large volumes of data efficiently
Develop, continuously test, and deploy Data API Products with Python and frameworks like Flask or FastAPI

What we offer

Participate in internal training programs (Leadership, Public Speaking, etc.) with full support for AWS and other professional certifications
Work with the latest AI tools, premium subscriptions, and the freedom to use them in your daily work
Collaboration with an international, cross-functional team
Comprehensive private medical insurance or budget for your medical needs
Paid sick leave, vacation, and public holidays
Equipment and all the tech you need for comfortable, productive work
Special gifts for weddings, childbirth, and other personal milestones

Senior Data Engineer

Senior Data Engineer to design, develop, and optimize data platforms, pipelines,...

Location

United States , Chicago

Salary:

160555.00 - 176610.00 USD / Year

Adtalem Global Education

Expiration Date

Until further notice

Requirements

Master's degree in Engineering Management, Software Engineering, Computer Science, or a related technical field
3 years of experience in data engineering
Experience building data platforms and pipelines
Experience with AWS, GCP or Azure
Experience with SQL and Python for data manipulation, transformation, and automation
Experience with Apache Airflow for workflow orchestration
Experience with data governance, data quality, data lineage and metadata management
Experience with real-time data ingestion tools including Pub/Sub, Kafka, or Spark
Experience with CI/CD pipelines for continuous deployment and delivery of data products
Experience maintaining technical records and system designs

Job Responsibility

Design, develop, and optimize data platforms, pipelines, and governance frameworks
Enhance business intelligence, analytics, and AI capabilities
Ensure accurate data flows and push data-driven decision-making across teams
Write product-grade performant code for data extraction, transformations, and loading (ETL) using SQL/Python
Manage workflows and scheduling using Apache Airflow and build custom operators for data ETL
Build, deploy and maintain both inbound and outbound data pipelines to integrate diverse data sources
Develop and manage CI/CD pipelines to support continuous deployment of data products
Utilize Google Cloud Platform (GCP) tools, including BigQuery, Composer, GCS, DataStream, and Dataflow, for building scalable data systems
Implement real-time data ingestion solutions using GCP Pub/Sub, Kafka, or Spark
Develop and expose REST APIs for sharing data across teams

What we offer

Health, dental, vision, life and disability insurance
401k Retirement Program + 6% employer match
Participation in Adtalem’s Flexible Time Off (FTO) Policy
12 Paid Holidays
Annual incentive program

Fulltime

Senior Data Engineer

Figure is an AI Robotics company developing a general-purpose humanoid. Our huma...

Location

United States , San Jose

Salary:

140000.00 - 350000.00 USD / Year

Figure

Expiration Date

Until further notice

Requirements

Bachelor's or Master’s degree in Computer Science, Data Engineering, or a related field
3+ years of experience in data engineering, preferably with time-series or log data processing
Proficiency in Python with experience in Pandas, Polars, or PySpark for large-scale data processing
Strong understanding of database design, indexing, and query optimization (SQL and NoSQL)
Experience handling complex data formats such as Parquet, MCAP, or protobuf
Experience building custom web based data visualization tools (JavaScript, React…)
Familiarity with data visualization tools like Grafana for real-time analysis and monitoring
Experience with distributed computing frameworks and cloud-based data storage solutions
Strong debugging skills and ability to work with lab teams to interpret robotic system logs

Job Responsibility

Develop and maintain pipelines and tools to transform robot logs to make it easier to access, visualize, and automatically detect events of interest
Optimize data processing to reduce the time needed between data offload and the availability of the data to our engineering teams
Design and optimize data storage solutions for handling complex, high-volume time-series and structured data
Build and maintain database schemas and queries to support analytics and visualization of extracted patterns
Support mechanical, electrical, software, integration and test engineers with their needs to extract and visualize data
Develop dashboards and custom data visualizations tools to enable engineers to quickly extract information from the data and track robot performance
Integrate your solutions with existing data pipelines and our robot testing framework

Fulltime

Security Data Specialist

We are seeking a Security Data Specialist with strong systems engineering leader...

Location

United States , Maryland

Salary:

Not provided

Assurit

Expiration Date

Until further notice

Requirements

Bachelor’s degree in Information Systems, Engineering, Computer Science, or related technical field
or equivalent hands-on experience
3+ years of experience supervising system engineers or leading technical teams
Demonstrated experience working with real-time, online, interactive systems requiring accurate data acquisition and system responsiveness
Strong analytical skills with the ability to evaluate workflows, identify issues, and develop practical technical solutions
Experience supporting systems engineering activities across complex IT environments
Strong communication and leadership skills, including the ability to provide direction and collaborate across teams
Ability to document findings, corrective actions, and procedures clearly and effectively

Job Responsibility

Analyze information requirements to understand data flows, operational needs, and system dependencies
Evaluate workflow inefficiencies, organizational challenges, and planning gaps across system operations
Develop and recommend corrective actions that enhance system performance, data quality, and operational efficiency
Provide daily supervision, guidance, and technical direction to system engineers and supporting staff
Oversee the use, integration, and optimization of interactive and interpretative systems for real-time data acquisition
Collaborate with engineering, security, and operations teams to ensure systems function reliably and securely
Document system processes, improvement plans, and technical procedures to support ongoing operations
Ensure that system activities align with mission requirements, security policies, and performance expectations
Support troubleshooting efforts, identify root causes, and coordinate timely resolution of complex technical issues

What we offer

medical and dental coverage
paid time off

Select Country

Real-Time Data Engineer

Job Description

Requirements

What we offer

Looking for more opportunities?