CrawlJobs Logo
Piper Companies Logo Piper Companies · IT - Software Development

Data Engineer II

United States, Rockville 95000.00 - 110000.00 USD / Year · Job Posted March 25, 2026
Apply Position
Job Link Share

Job Description

Zachary Piper Solutions is seeking a Data Engineer II to join a leading federal health IT solutions provider located in Rockville, MD for a *Fully Remote* role. The Data Engineer II will Focus on building the systems, pipelines, and infrastructure that make data usable for analysts and data scientists. Seize your opportunity to make a personal impact as a Data Engineer while making meaningful contributions to challenging projects and grow a rewarding career at a company, who's people, are their differentiator.

Job Responsibility

  • Build and maintain PySpark data pipelines in the Databricks environment, Optimize Spark jobs performance and resource usage, identifying and addressing bottlenecks and inefficiencies in backend systems
  • Design, develop, and maintain high-quality backend software components and services, ensuring functionality, performance, and scalability
  • Research and build proof of concepts in the data space
  • Write clean, well-structured, and maintainable code, adhering to established coding standards and best practices
  • Perform thorough code reviews, providing constructive feedback to peers and identifying potential risks or areas for improvement
  • Debug and resolve defects, proactively identifying and addressing potential issues before they impact users
  • Create and maintain comprehensive technical documentation

Requirements

  • 5+ years of related experience plus a bachelors degree in computer science, computer engineering, or a related field
  • Strong technical skills including Python, Apache Spark, R, SAS, and solid understanding of software design patterns, data structures, algorithms, and distributed computing
  • Experience building data pipelines (ETL/ELT) and managing databases and SQL performance
  • Experience working with cloud platforms (AWS/AZURE/GCP)
  • SQL (heavy)
  • Python/Scala
  • ETL Pipelines
  • Cloud Platforms (AWS/GCP/Azure)
  • Databricks/Spark
  • dbt/airflow
  • Data Modeling (star schemas, warehouses)

Nice to have

  • Experience working in Agile development environments
  • Databricks/Apache Spark certifications

What we offer

Cigna Medical, Dental, Vision, 401k Plan, PTO, Holidays, Sick Leave if required by law

Piper Companies - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer II

8 matching positions

Data Engineer II

Microsoft is a company where passionate innovators come to collaborate, envision...
Location
Location
United States , Redmond
Salary
Salary:
102100.00 - 219200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Intermediate knowledge and experience with Microsoft data tools including Microsoft Fabric, Azure Data Factory, Azure Synapse, and Azure Databricks
  • Intermediate knowledge and experience with GIT operations and CICD flows
  • Advanced experience using a work management tool such as Azure DevOps
  • Advanced experience in time management and prioritization
  • Excellent written & verbal communication skills
  • Passion for data and the desire to learn & adopt new technologies
Job Responsibility
Job Responsibility
  • Extract and transform disparate data into actionable insights that will drive business decisions
  • Drive development projects to evolve our platform and operations, leveraging the newest Microsoft technologies
  • Contribute to the success of Azure Data by trying out and testing new products and features, contributing to design of major feature enhancements, and providing direct feedback to Product Group
  • Work directly with business stakeholders to refine requirements, iterate and finalize design, deliver proofs of concept, and develop final data solution
  • Live site and on call DRI duty for maintaining high availability of analytics solutions
  • Collaborate with peers and maintain flexibility on domain ownership
  • Work with other data teams within Microsoft on understanding their data products and onboarding them
  • Fulltime
Read More
Arrow Right

Data Engineer II

The Cloud & AI organization accelerates Microsoft's mission and bold ambitions t...
Location
Location
United States , Multiple Locations
Salary
Salary:
102100.00 - 202200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR equivalent experience
  • Candidates must be able to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • Citizenship & Citizenship Verification
Job Responsibility
Job Responsibility
  • Design, build, and optimize data pipelines to ingest, process, and prepare data for use in insider risk detection models
  • Join, filter, and integrate diverse data sources to create comprehensive datasets that enable effective and accurate insider risk detections
  • Work with large datasets, applying advanced data transformation techniques to ensure data quality and accessibility for risk detection
  • Develop, test, and deploy insider risk detection models based on data-driven insights to proactively identify anomalous or risky behavior patterns
  • Collaborate with insider risk team members to define and refine detection use cases, ensuring they are accurate, scalable, and aligned with business needs
  • Share knowledge and actively contribute ideas in team technical discussions
  • Maintain and monitor insider risk engineering systems to ensure reliable operation, security, and compliance with internal engineering standards and policies
  • Join on-call rotations, lead incident response, and drive thorough root-cause analysis
  • Document data processes, detection workflows, and system configurations to support future development and maintenance
  • Use development and coding best practices (e.g., reusable, modular)
What we offer
What we offer
  • Benefits and other compensation
  • Fulltime
Read More
Arrow Right

Data Engineer II

Do you have a relentless passion for data engineering and building platforms tha...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering. OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering. OR equivalent experience.
  • Ability to work and communicate effectively across disciplines and teams.
  • Familiarity with distributed data processing and analysis, such as Map-Reduce or Apache Spark.
Job Responsibility
Job Responsibility
  • Authoring and design of Big Data ETL platforms and pipelines in SCOPE, Scala, SQL, Python, or C#.
  • Data extraction across a wide variety of data sources.
  • Data cleaning, preprocessing, and transformation for further analysis by data analysts.
  • Data Validation framework from source to endpoints ensuring data quality and integrity.
  • Enable the Data Scientists and Analysts to do more with data across all aspects of the development lifecycle.
  • Contribute to a data-driven culture as well as a culture of experimentation across the organization.
  • Provide new and improve upon existing data platform offerings with a fundamental understanding of the end-to-end scenarios.
  • Enable Data Scientists and other partners to do more with data across all aspects of the development lifecycle by helping democratize data.
  • Fulltime
Read More
Arrow Right

Data Engineer II

The Copilot and Platform Ecosystem (CAPE) team at Microsoft is responsible for e...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering.
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering.
  • OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Partner with stakeholders to define and document data requirements (access, cadence, ownership) and assess feasibility and total cost of ownership (TCO).
  • Define data contracts and ownership boundaries with upstream system owners.
  • Design and maintain scalable data pipelines that ingest and load data into analytical platforms (e.g., Azure Data Explorer/Kusto).
  • Implement data validation and quality checks to meet SLAs for accuracy, completeness, freshness, and reliability.
  • Build orchestration and automation for dependable, repeatable data movement.
  • Transform and model data (joins, aggregations, enrichment) to power downstream datasets, dashboards, alerts, and agent experiences
  • contribute through code reviews and shared tooling.
  • Operationalize pipelines with monitoring, troubleshooting/runbooks, root-cause analysis, performance/cost optimization, and compliance/governance (classification, tagging, lineage, and access control).
  • Fulltime
Read More
Arrow Right

Data Engineer II

MU-Data Engineers II located in Costa Mesa, CA will provide direct data engineer...
Location
Location
United States , Costa Mesa
Salary
Salary:
128676.72 - 130000.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree (or foreign equivalent) in computer science, any engineering, data science or closely related field
  • 2 years of relevant experience
  • Advanced level in SQL and Python for data engineering and backend development
  • Understanding of popular code development approaches: Test-driven development & Continuous Integration/Continuous Deployment (CI/CD)
  • Experienced working with AWS services (Lambda, S3, Glue, Redshift etc.) and Cloud Data Warehouse
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management
  • Define digital data collection methods and implementations to DWH and customer management platforms
  • Provide guidance to website tagging, digital data integration and collections
  • Experienced with QA testing process to verify data is collected & rendered as expected
  • Prior working knowledge of Braze or other Customer Management Platforms
Job Responsibility
Job Responsibility
  • Work collaboratively with cross-functional teams to determine data transformation needs, establish data collection requirements, and deploy & maintain accurate data to ensure metrics & dimensions are addressed for analytics/reporting requirements
  • Participate in daily/weekly SCRUM ceremonies
  • Transform required data conditions into performance code logic
  • Develop high-performance code in SQL and Python
  • Develop, automate, and enhance ELT processes for continuous data flow
  • Onboard domain data as custom attributes and events to external systems such as Braze, Customer Journey
  • Maintain data daily updates and core logic integrity
  • Provide support to troubleshoot data anomalies and apply resolutions
  • Create, modify, and deploy code to production via AWS resources including Lambda, S3, Glue, Redshift, etc.
  • Partner with stakeholders to support the implementation and development of data requirements. Troubleshoot data anomalies and provide applicable solutions
What we offer
What we offer
  • Competitive base salary and compensation package
  • Annual stock grant
  • Employee stock purchase plan
  • 401(k)
  • Access to free, year-round money coaches
  • Medical, dental and vision insurance
  • Flexible spending account
  • Paid time off
  • Up to 12 paid holidays
  • Paid parental and family leave
  • Fulltime
Read More
Arrow Right

Data Engineer II

Delivery Data Solutions (DDS) is a horizontal team responsible to transform data...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science or a related technical field, or equivalent practical experience
  • Experience coding using a general-purpose programming language such as Java, Python, Go or similar
  • Experience working with data processing frameworks such as Spark, Hive or similar technologies
  • Understanding of data warehousing concepts and analytical data modeling
  • Experience writing data transformation logic, queries and scripts for data processing workflows
  • Strong problem-solving skills and ability to work collaboratively with cross-functional teams
Job Responsibility
Job Responsibility
  • Build and maintain data pipelines and data products that power analytics, reporting and machine learning use cases across the Delivery organization
  • Develop batch and real-time data processing workflows that transform large datasets into reliable and well-structured data assets
  • Contribute to the development of core business metrics and analytical datasets used by product, data science and engineering teams
  • Work closely with product engineers, data scientists and analysts to understand data requirements and implement scalable solutions
  • Ensure data quality, reliability and timeliness across pipelines by following established data engineering best practices
  • Support performance optimizations and infrastructure improvements to improve pipeline efficiency and maintain SLA commitments
  • Participate in improving data engineering tools, processes and documentation within the team
Read More
Arrow Right

Data Engineer II

Delivery Data Solutions (DDS) is a horizontal team responsible to transform data...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science or a related technical field, or equivalent practical experience
  • Experience coding using a general-purpose programming language such as Java, Python, Go or similar
  • Experience working with data processing frameworks such as Spark, Hive or similar technologies
  • Understanding of data warehousing concepts and analytical data modeling
  • Experience writing data transformation logic, queries and scripts for data processing workflows
  • Strong problem-solving skills and ability to work collaboratively with cross-functional teams
Job Responsibility
Job Responsibility
  • Build and maintain data pipelines and data products that power analytics, reporting and machine learning use cases across the Delivery organization
  • Develop batch and real-time data processing workflows that transform large datasets into reliable and well-structured data assets
  • Contribute to the development of core business metrics and analytical datasets used by product, data science and engineering teams
  • Work closely with product engineers, data scientists and analysts to understand data requirements and implement scalable solutions
  • Ensure data quality, reliability and timeliness across pipelines by following established data engineering best practices
  • Support performance optimizations and infrastructure improvements to improve pipeline efficiency and maintain SLA commitments
  • Participate in improving data engineering tools, processes and documentation within the team
Read More
Arrow Right

Data Engineer II

At Retail Insight, we turn data into action. Our products are trusted by some of...
Location
Location
United States , Chicago
Salary
Salary:
85000.00 - 110000.00 USD / Year
retailinsight.io Logo
Retail Insight
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in data or analytics engineering, with strong foundations in data warehousing, ETL/ELT, and large‑scale analytics environments
  • Hands‑on expertise with SQL‑based databases (MS SQL Server, Azure SQL, Postgres) and cloud platforms such as Azure and Snowflake
  • Strong SQL skills plus working knowledge of Python, PowerShell, and integrating data via APIs
  • Familiarity with agile delivery, GitHub, Atlassian tooling, and production troubleshooting/incident resolution
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines across ingestion, transformation, orchestration, monitoring, and quality assurance
  • Develop and optimise data solutions, including database schemas and SQL performance tuning to ensure reliable, accessible data for analytics and downstream systems
  • Integrate data solutions into production environments, collaborating with software engineers and supporting delivery for new and existing clients
  • Write clean, maintainable code and documentation, covering SQL, Python, PowerShell, models, pipelines, and platform architecture
  • Support production operations, providing 3rd‑line incident investigation/resolution and contributing to code reviews and engineering best practices
What we offer
What we offer
  • Hybrid & Flexible Working: Work from anywhere benefits, plus summer hours and extra days off for life’s big moments (including your birthday and wedding)
  • Generous Time Off: 26 days PTO (increasing with service), paid volunteer days, and full support for your wellbeing, including mental health resources
  • Career & Learning: Access to a top-tier learning platform, career progression plans, and support to create your ideal home workspace
  • Health & Financial Benefits: Comprehensive medical, dental, and vision coverage, plus a 6% matched retirement plan
  • Personal Perks: Annual phone reimbursement, onsite gym access, and customizable benefits via our online platform
  • Fulltime
Read More
Arrow Right