CrawlJobs Logo

Data Engineer II

United States, St Louis · Job Posted January 29, 2026
Apply Position
Job Link Share

Job Description

We have a 6 month contract to hire for a motivated Data Engineer with 2–4 years of experience building and supporting production-grade ETL pipelines in Snowflake and Teradata, with strong expertise in advanced SQL and cloud-based data processing. They are a self-starter who thrives in fast-paced, business-critical environments and can partner closely with architects and SMEs to deliver high-quality provider data solutions under tight timelines. 100% Remote.

Job Responsibility

  • Develops and operationalizes data pipelines to make data available for consumption
  • Engages with the DevSecOps Engineer during continuous integration and continuous deployment
  • Designs and implements standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction
  • Designs, develops, implements, tests, documents, and operates large-scale, high-volume, high-performance data structures for business intelligence analytics
  • Designs, develops, and maintains real-time processing applications and real-time data pipelines
  • Ensure quality of technical solutions as data moves across the internal environments
  • Provides insight into the changing data environment, data processing, data storage, and utilization requirements for the company and offers suggestions for solutions
  • Develops, constructs, tests, and maintains architectures using programming language and tools
  • Identifies ways to improve data reliability, efficiency, and quality
  • use data to discover tasks that can be automated

Requirements

  • Bachelor's degree
  • 2-4 years of experience
  • Strong experience building ETL pipelines using Snowflake and IDMC
  • Experience with Big Data
  • Data Processing CI/CD pipelines for: Schema changes
  • SQL deployments
  • Advance level knowledge in SQL

Nice to have

  • Healthcare Experience
  • Self starter
  • Strong Communication

What we offer

  • Weekly Direct Deposit
  • 401K Matching
  • Competitive medical, dental and vision insurance
  • Consistent communication throughout your project
  • ZeekTek Referral Program

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer II

8 matching positions

Data Engineer II

Microsoft is a company where passionate innovators come to collaborate, envision...
Location
Location
United States , Redmond
Salary
Salary:
102100.00 - 219200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Intermediate knowledge and experience with Microsoft data tools including Microsoft Fabric, Azure Data Factory, Azure Synapse, and Azure Databricks
  • Intermediate knowledge and experience with GIT operations and CICD flows
  • Advanced experience using a work management tool such as Azure DevOps
  • Advanced experience in time management and prioritization
  • Excellent written & verbal communication skills
  • Passion for data and the desire to learn & adopt new technologies
Job Responsibility
Job Responsibility
  • Extract and transform disparate data into actionable insights that will drive business decisions
  • Drive development projects to evolve our platform and operations, leveraging the newest Microsoft technologies
  • Contribute to the success of Azure Data by trying out and testing new products and features, contributing to design of major feature enhancements, and providing direct feedback to Product Group
  • Work directly with business stakeholders to refine requirements, iterate and finalize design, deliver proofs of concept, and develop final data solution
  • Live site and on call DRI duty for maintaining high availability of analytics solutions
  • Collaborate with peers and maintain flexibility on domain ownership
  • Work with other data teams within Microsoft on understanding their data products and onboarding them
  • Fulltime
Read More
Arrow Right

Data Engineer II

The Cloud & AI organization accelerates Microsoft's mission and bold ambitions t...
Location
Location
United States , Multiple Locations
Salary
Salary:
102100.00 - 202200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR equivalent experience
  • Candidates must be able to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • Citizenship & Citizenship Verification
Job Responsibility
Job Responsibility
  • Design, build, and optimize data pipelines to ingest, process, and prepare data for use in insider risk detection models
  • Join, filter, and integrate diverse data sources to create comprehensive datasets that enable effective and accurate insider risk detections
  • Work with large datasets, applying advanced data transformation techniques to ensure data quality and accessibility for risk detection
  • Develop, test, and deploy insider risk detection models based on data-driven insights to proactively identify anomalous or risky behavior patterns
  • Collaborate with insider risk team members to define and refine detection use cases, ensuring they are accurate, scalable, and aligned with business needs
  • Share knowledge and actively contribute ideas in team technical discussions
  • Maintain and monitor insider risk engineering systems to ensure reliable operation, security, and compliance with internal engineering standards and policies
  • Join on-call rotations, lead incident response, and drive thorough root-cause analysis
  • Document data processes, detection workflows, and system configurations to support future development and maintenance
  • Use development and coding best practices (e.g., reusable, modular)
What we offer
What we offer
  • Benefits and other compensation
  • Fulltime
Read More
Arrow Right

Data Engineer II

Do you have a relentless passion for data engineering and building platforms tha...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering. OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering. OR equivalent experience.
  • Ability to work and communicate effectively across disciplines and teams.
  • Familiarity with distributed data processing and analysis, such as Map-Reduce or Apache Spark.
Job Responsibility
Job Responsibility
  • Authoring and design of Big Data ETL platforms and pipelines in SCOPE, Scala, SQL, Python, or C#.
  • Data extraction across a wide variety of data sources.
  • Data cleaning, preprocessing, and transformation for further analysis by data analysts.
  • Data Validation framework from source to endpoints ensuring data quality and integrity.
  • Enable the Data Scientists and Analysts to do more with data across all aspects of the development lifecycle.
  • Contribute to a data-driven culture as well as a culture of experimentation across the organization.
  • Provide new and improve upon existing data platform offerings with a fundamental understanding of the end-to-end scenarios.
  • Enable Data Scientists and other partners to do more with data across all aspects of the development lifecycle by helping democratize data.
  • Fulltime
Read More
Arrow Right

Data Engineer II

The Copilot and Platform Ecosystem (CAPE) team at Microsoft is responsible for e...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering.
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering.
  • OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Partner with stakeholders to define and document data requirements (access, cadence, ownership) and assess feasibility and total cost of ownership (TCO).
  • Define data contracts and ownership boundaries with upstream system owners.
  • Design and maintain scalable data pipelines that ingest and load data into analytical platforms (e.g., Azure Data Explorer/Kusto).
  • Implement data validation and quality checks to meet SLAs for accuracy, completeness, freshness, and reliability.
  • Build orchestration and automation for dependable, repeatable data movement.
  • Transform and model data (joins, aggregations, enrichment) to power downstream datasets, dashboards, alerts, and agent experiences
  • contribute through code reviews and shared tooling.
  • Operationalize pipelines with monitoring, troubleshooting/runbooks, root-cause analysis, performance/cost optimization, and compliance/governance (classification, tagging, lineage, and access control).
  • Fulltime
Read More
Arrow Right

Data Engineer II

MU-Data Engineers II located in Costa Mesa, CA will provide direct data engineer...
Location
Location
United States , Costa Mesa
Salary
Salary:
128676.72 - 130000.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree (or foreign equivalent) in computer science, any engineering, data science or closely related field
  • 2 years of relevant experience
  • Advanced level in SQL and Python for data engineering and backend development
  • Understanding of popular code development approaches: Test-driven development & Continuous Integration/Continuous Deployment (CI/CD)
  • Experienced working with AWS services (Lambda, S3, Glue, Redshift etc.) and Cloud Data Warehouse
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management
  • Define digital data collection methods and implementations to DWH and customer management platforms
  • Provide guidance to website tagging, digital data integration and collections
  • Experienced with QA testing process to verify data is collected & rendered as expected
  • Prior working knowledge of Braze or other Customer Management Platforms
Job Responsibility
Job Responsibility
  • Work collaboratively with cross-functional teams to determine data transformation needs, establish data collection requirements, and deploy & maintain accurate data to ensure metrics & dimensions are addressed for analytics/reporting requirements
  • Participate in daily/weekly SCRUM ceremonies
  • Transform required data conditions into performance code logic
  • Develop high-performance code in SQL and Python
  • Develop, automate, and enhance ELT processes for continuous data flow
  • Onboard domain data as custom attributes and events to external systems such as Braze, Customer Journey
  • Maintain data daily updates and core logic integrity
  • Provide support to troubleshoot data anomalies and apply resolutions
  • Create, modify, and deploy code to production via AWS resources including Lambda, S3, Glue, Redshift, etc.
  • Partner with stakeholders to support the implementation and development of data requirements. Troubleshoot data anomalies and provide applicable solutions
What we offer
What we offer
  • Competitive base salary and compensation package
  • Annual stock grant
  • Employee stock purchase plan
  • 401(k)
  • Access to free, year-round money coaches
  • Medical, dental and vision insurance
  • Flexible spending account
  • Paid time off
  • Up to 12 paid holidays
  • Paid parental and family leave
  • Fulltime
Read More
Arrow Right

Data Engineer II

Delivery Data Solutions (DDS) is a horizontal team responsible to transform data...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science or a related technical field, or equivalent practical experience
  • Experience coding using a general-purpose programming language such as Java, Python, Go or similar
  • Experience working with data processing frameworks such as Spark, Hive or similar technologies
  • Understanding of data warehousing concepts and analytical data modeling
  • Experience writing data transformation logic, queries and scripts for data processing workflows
  • Strong problem-solving skills and ability to work collaboratively with cross-functional teams
Job Responsibility
Job Responsibility
  • Build and maintain data pipelines and data products that power analytics, reporting and machine learning use cases across the Delivery organization
  • Develop batch and real-time data processing workflows that transform large datasets into reliable and well-structured data assets
  • Contribute to the development of core business metrics and analytical datasets used by product, data science and engineering teams
  • Work closely with product engineers, data scientists and analysts to understand data requirements and implement scalable solutions
  • Ensure data quality, reliability and timeliness across pipelines by following established data engineering best practices
  • Support performance optimizations and infrastructure improvements to improve pipeline efficiency and maintain SLA commitments
  • Participate in improving data engineering tools, processes and documentation within the team
Read More
Arrow Right

Data Engineer II

Delivery Data Solutions (DDS) is a horizontal team responsible to transform data...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science or a related technical field, or equivalent practical experience
  • Experience coding using a general-purpose programming language such as Java, Python, Go or similar
  • Experience working with data processing frameworks such as Spark, Hive or similar technologies
  • Understanding of data warehousing concepts and analytical data modeling
  • Experience writing data transformation logic, queries and scripts for data processing workflows
  • Strong problem-solving skills and ability to work collaboratively with cross-functional teams
Job Responsibility
Job Responsibility
  • Build and maintain data pipelines and data products that power analytics, reporting and machine learning use cases across the Delivery organization
  • Develop batch and real-time data processing workflows that transform large datasets into reliable and well-structured data assets
  • Contribute to the development of core business metrics and analytical datasets used by product, data science and engineering teams
  • Work closely with product engineers, data scientists and analysts to understand data requirements and implement scalable solutions
  • Ensure data quality, reliability and timeliness across pipelines by following established data engineering best practices
  • Support performance optimizations and infrastructure improvements to improve pipeline efficiency and maintain SLA commitments
  • Participate in improving data engineering tools, processes and documentation within the team
Read More
Arrow Right

Data Engineer II

Zachary Piper Solutions is seeking a Data Engineer II to join a leading federal ...
Location
Location
United States , Rockville
Salary
Salary:
95000.00 - 110000.00 USD / Year
pipercompanies.com Logo
Piper Companies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of related experience plus a bachelors degree in computer science, computer engineering, or a related field
  • Strong technical skills including Python, Apache Spark, R, SAS, and solid understanding of software design patterns, data structures, algorithms, and distributed computing
  • Experience building data pipelines (ETL/ELT) and managing databases and SQL performance
  • Experience working with cloud platforms (AWS/AZURE/GCP)
  • SQL (heavy)
  • Python/Scala
  • ETL Pipelines
  • Cloud Platforms (AWS/GCP/Azure)
  • Databricks/Spark
  • dbt/airflow
Job Responsibility
Job Responsibility
  • Build and maintain PySpark data pipelines in the Databricks environment, Optimize Spark jobs performance and resource usage, identifying and addressing bottlenecks and inefficiencies in backend systems
  • Design, develop, and maintain high-quality backend software components and services, ensuring functionality, performance, and scalability
  • Research and build proof of concepts in the data space
  • Write clean, well-structured, and maintainable code, adhering to established coding standards and best practices
  • Perform thorough code reviews, providing constructive feedback to peers and identifying potential risks or areas for improvement
  • Debug and resolve defects, proactively identifying and addressing potential issues before they impact users
  • Create and maintain comprehensive technical documentation
What we offer
What we offer
  • Cigna Medical, Dental, Vision, 401k Plan, PTO, Holidays, Sick Leave if required by law
  • Fulltime
Read More
Arrow Right