CrawlJobs Logo

Data Engineer II

pipercompanies.com Logo

Piper Companies

Location Icon

Location:

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

100000.00 - 115000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

Piper Companies is seeking a Data Engineer II to support a key federal healthcare initiative under the HQRII CMS contract. This role offers the opportunity to work with a highly collaborative Agile team to design and optimize modern data pipelines, backend systems, and scalable data solutions supporting mission-critical federal health programs. As a Data Engineer II, you will contribute to building efficient data architectures, optimizing Spark workloads, and ensuring the reliability of backend data services.

Job Responsibility:

  • Build and maintain PySpark data pipelines within the Databricks platform
  • Optimize Spark job performance, addressing bottlenecks, and improving resource utilization across distributed systems
  • Design, develop, and maintain backend data components and services that support large-scale data processing
  • Conduct research and develop proof-of-concepts for new tools, frameworks, and solutions in the data engineering ecosystem
  • Write clean, maintainable, and scalable code following best practices and coding standards
  • Perform code reviews to ensure quality, consistency, and reliability across the team
  • Debug and troubleshoot backend data issues, proactively identifying potential system risks
  • Develop and maintain thorough technical documentation
  • Actively participate in Agile ceremonies (standups, sprint planning, retrospectives)
  • Support estimation, task breakdown, and prioritization to meet delivery timelines
  • Stay current with emerging technologies and share insights with the engineering team

Requirements:

  • Bachelor’s Degree in Computer Science, Computer Engineering, or related technical discipline
  • 5+ years of experience in data engineering, backend engineering, or similar roles
  • Strong experience with Python and Apache Spark
  • Working knowledge of R
  • Solid understanding of data modeling, ETL processes, and distributed computing architectures
  • Strong foundation in software engineering fundamentals, including data structures, algorithms, and design patterns
  • Experience working within Agile/Scrum development teams
  • Ability to work independently and collaboratively
  • Strong analytical thinking and problem-solving skills
  • Excellent written and verbal communication abilities

Nice to have:

  • Experience with AWS services (S3, EC2, Glue, Lambda, etc.)
  • Additional hands-on experience with R
  • Databricks or Apache Spark professional certifications
  • Experience with SAS

Additional Information:

Job Posted:
February 19, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Icon
Piper Companies - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data Engineer II

Data Engineer II

As a data engineer in the People DE team, you will have the opportunity to apply...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 2 years professional experience as a software engineer or data engineer
  • A BS in Computer Science or equivalent experience
  • Strong programming skills (some combination of Python, Java, and Scala preferred)
  • Experience with data modeling
  • Experience in modern software development practices (Agile, TDD, CICD)
  • Knowledge of data warehousing concepts
  • Experience writing SQL, structuring data, and data storage practices
  • Experience building data pipelines, platforms, micro services, and REST APIs
  • Experience with Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data
  • A willingness to accept failure, learn and try again
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Data Engineer II

You will be part of a world-class Data Engineering team, where you will influenc...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s / Masters degree (or equivalent work experience) in a STEM field
  • 2+ Years of Experience in Data Engineering or related fields
  • Expertise in Python or other modern programming language development experience
  • Knowledge of advanced level capabilities in SQL and relational databases experience
  • Solid working knowledge of ETL (ELT), Data modeling, DataQuality, and Data Visualization/Dashboarding
  • Experience working with product analytics
Job Responsibility
Job Responsibility
  • influence product teams
  • inform Data Science and Analytics Platform teams
  • partner closely with data consumers and producers to ensure quality and usefulness of data assets
  • Defining metrics
  • Instrumenting logging
  • Acquiring/ingesting data
  • Architecting & modeling data
  • Transforming data
  • Ensuring data quality, governance, and enablement
  • Alerting, visualization, and reporting
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Data Engineer II

You will be part of a world-class Data Engineering team, where you will influenc...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s / Masters degree (or equivalent work experience) in a STEM field
  • 2+ Years of Experience in Data Engineering or related fields
  • Expertise in Python or other modern programming language development experience
  • Knowledge of advanced level capabilities in SQL and relational databases experience
  • Solid working knowledge of ETL (ELT), Data modeling, DataQuality, and Data Visualization/Dashboarding
  • Experience working with product analytics
Job Responsibility
Job Responsibility
  • influence product teams
  • inform Data Science and Analytics Platform teams
  • partner closely with data consumers and producers to ensure quality and usefulness of data assets
  • Defining metrics
  • Instrumenting logging
  • Acquiring/ingesting data
  • Architecting & modeling data
  • Transforming data
  • Ensuring data quality, governance, and enablement
  • Alerting, visualization, and reporting
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Data Engineer - II

The Data Engineer will design, develop, and maintain scalable data pipelines and...
Location
Location
India , Pune
Salary
Salary:
Not provided
aticaglobal.com Logo
Atica Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, Engineering, Mathematics, a related field, or equivalent practical experience
  • 3-5 years of experience in data engineering or a similar mid-level role
  • Proficiency in Python and SQL
  • experience with Java is a plus
  • Hands-on experience with AWS, Airbyte, DBT, PostgreSQL, MongoDB, Airflow, and Spark
  • Familiarity with data storage solutions such as PostgreSQL, MongoDB
  • Experience with BigQuery (setup, management and scaling)
  • Strong understanding of data modeling, ETL/ELT processes, and database systems
  • Experience with data extraction, batch processing and data warehousing
  • Excellent problem-solving skills and a keen attention to detail
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable data pipelines and ETL/ELT processes using tools like Airflow, Airbyte and PySpark
  • Collaborate with software engineers and analysts to ensure data availability and integrity for various applications
  • Design and implement robust data pipelines to extract, transform, and load (ETL) data from various sources
  • Utilize Airflow for orchestrating complex workflows and managing data pipelines
  • Implement batch processing techniques using Airflow/PySpark to handle large volumes of data efficiently
  • Develop ELT processes to optimize data extraction and transformation within the target data warehouse
  • Leverage AWS services (e.g., S3, RDS, Lambda) for data storage, processing, and orchestration
  • Ensure data security, reliability, and performance when utilizing AWS resources
  • Work closely with developers, analysts, and other stakeholders to understand data requirements and provide the necessary data infrastructure
  • Assist in troubleshooting and optimizing existing data workflows and queries
What we offer
What we offer
  • Competitive salary and benefits package
  • Comprehensive Health Care benefits (best in the country, includes IPD+OPD, covers Employee, Spouse and two children)
  • Growth and advancement opportunities within a rapidly expanding company
  • Fulltime
Read More
Arrow Right

Data Engineer II

The purpose of the Data Engineer is to migrate and convert data from foreign dat...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
sspinnovations.com Logo
SSP Innovations
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree in Information Technology or related field
  • 1+ year of experience with managed telecommunications databases
  • 3+ years of experience in data conversion, data mapping, and data analysis
  • 3+ years of experience using ESRI, FME, or a combination of both
  • Intermediate database experience including SQL relationship statements
  • Intermediate Programming/Report Analysis experience
  • Communication skills, both oral and written
  • Strong organizational skills and attention to detail
  • Deadline driven, ability to work independently as well as a team player
Job Responsibility
Job Responsibility
  • responsible for supporting data migrations and data conversions from disparate systems into the 3-GIS Data Model
  • oversee data mapping exercises and work closely with customers to understand their data models and to provide mapping between systems
  • employ a variety of tools including but not limited to Python Scripting, Database Scripting languages such as SQL, advanced knowledge of ESRI applications, FME workbenches and internally developed tools, as the assignment dictates
  • exhibit strong communication skills to ensure customer understanding of data migrations and conversions and must work with various team members such as Solutions Engineers, Data Technicians, Sales Executives and Project Managers to ensure project success
  • must be detail oriented and maintain proper time management as projects generally have specific timelines and milestones required for project success
  • ability to provide references for users by writing and maintaining documentation
  • design, develop, and test data transformation, extraction, and migration activities
  • prepare technical reports by collecting, analyzing, and summarizing information
  • perform tasks efficiently while validating methodology
  • interact directly (face-to-face and remotely) with clients and project teams
  • Fulltime
Read More
Arrow Right

Data Engineer II

We’re looking for a Data Engineer II to join our Decisions & Insights team — the...
Location
Location
United States , San Francisco
Salary
Salary:
101250.00 - 162000.00 USD / Year
axon.com Logo
Axon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience as a Data Engineer, Analytics Engineer, or similar hybrid role
  • Advanced SQL skills with strong understanding of schema design and analytical database patterns
  • Strong Python experience for data manipulation, scripting, and automation
  • Strong analytical mindset, attention to detail, and a passion for turning complex datasets into clear insights
  • Solid Git experience for collaboration and version control
  • Experience integrating and analyzing data from AWS services (e.g., Redshift, S3, APIs)
Job Responsibility
Job Responsibility
  • Design, develop, and maintain automated ETL/ELT pipelines and analytical models in Redshift using SQL, dbt, or SQLMesh
  • Build clean, structured datasets that enable fast, self-serve insights for PMs, analysts, and operational agents
  • Create dashboards and analytical tools (e.g., Tableau) that make insights intuitive and actionable
  • Optimize SQL queries, schemas, and table designs for high-volume analytics workloads
  • Partner with product managers, data scientists, and engineering teams to deliver analysis that supports product and operational decisions
  • Use Python to automate processing, improve pipeline reliability, and support advanced analytical workflows
  • Apply best practices for Git-based version control, testing, documentation, and data quality monitoring
  • Participate in design reviews for new analytical features and data systems
What we offer
What we offer
  • Competitive salary and 401k with employer match
  • Discretionary paid time off
  • Paid parental leave for all
  • Medical, Dental, Vision plans
  • Fitness Programs
  • Emotional & Mental Wellness support
  • Learning & Development programs
  • Snacks in our offices
  • Fulltime
Read More
Arrow Right

Data Engineer II

As a Data Engineer II on our Core Engineering Data Team, you will focus on build...
Location
Location
United States , Boston
Salary
Salary:
93200.00 - 136600.00 USD / Year
simplisafe.com Logo
SimpliSafe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field or equivalent practical experience
  • 2+ years of experience in software engineering, data engineering, or a related field
  • Foundational knowledge of AWS or other public cloud platforms (e.g., Azure, GCP)
  • Strong SQL knowledge and experience optimizing for data warehousing technologies like AWS Athena
  • Strong knowledge of Python for use in data transformation
  • Experience with ETL/ELT, schema design, and datalake technologies
  • Familiarity with various data and table formats (JSON, Avro, Parquet, Iceberg)
  • Love of data and a passion for building reliable data products
Job Responsibility
Job Responsibility
  • Develop and maintain efficient and reliable ETL/ELT data pipelines from product and service data sources to our centralized analytical platforms
  • Implement and monitor data pipeline orchestration using tools like Airflow or Dagster to ensure timely and accurate data delivery
  • Collaborate with senior engineers and analysts to understand requirements and implement technical solutions for data workflows
  • Perform routine monitoring of pipeline performance and reliability, assisting with troubleshooting and optimizing for efficiency
  • Contribute to the optimization of table structures and data storage to support various query and usage patterns
  • Support and maintain data discovery, catalog, and analytics tooling for internal teams
  • Assist in implementing data security measures and ensuring compliance with data governance policies
  • Write and maintain data quality validation checks and unit tests to ensure the integrity and reliability of data pipelines
  • Participate in team-wide discussions to help develop and refine team norms and engineering best practices
What we offer
What we offer
  • A mission- and values-driven culture and a safe, inclusive environment where you can build, grow and thrive
  • A comprehensive total rewards package that supports your wellness and provides security for SimpliSafers and their families
  • Free SimpliSafe system and professional monitoring for your home
  • Employee Resource Groups (ERGs) that bring people together, give opportunities to network, mentor and develop, and advocate for change
  • Participation in our annual bonus program, equity, and other forms of compensation, in addition to a full range of medical, retirement, and lifestyle benefits
  • Fulltime
Read More
Arrow Right

Data Engineer II

PagerDuty is looking for a Data Engineer II to join their global Enterprise Data...
Location
Location
Portugal , Lisbon
Salary
Salary:
Not provided
https://www.pagerduty.com Logo
PagerDuty
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience working in data integration, pipelines, and data modeling
  • experience designing and deploying code in Data platforms in a cloud-based and Agile environment
  • knowledge and experience of relational databases and being capable of writing complex SQL
  • experience working with Cloud-based Data Warehousing Platform such as Snowflake or AWS, or Databricks
  • experience with Python and SQL
  • experience working with SQL, AWS S3, and ETL/Automation Workflow tools like Workato
Job Responsibility
Job Responsibility
  • translate business requirements into data models that are easy to understand
  • design, implement, and build pipelines that deliver data with measurable quality under the SLA
  • partner with business domain experts, data analysts, and engineering teams to build foundational data sets
  • be a champion of the overall strategy for data governance, security, privacy, quality, and retention
  • own and document foundational company metrics with a clear definition and data lineage
  • contribute to the data ecosystem and build a strong data foundation for the company
  • design, implement, and scale data pipelines that transform billions of records into actionable data models
  • provide hands-on technical support to build trusted and reliable domain-specific datasets and metrics
What we offer
What we offer
  • competitive salary
  • comprehensive benefits package
  • flexible work arrangements
  • company equity
  • ESPP (Employee Stock Purchase Program)
  • retirement or pension plan
  • generous paid vacation time
  • paid holidays and sick leave
  • Dutonian Wellness Days & HibernationDuty
  • paid parental leave
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy