CrawlJobs Logo

Data Engineer II

United States, San Francisco 101250.00 - 162000.00 USD / Year · Job Posted December 23, 2025
Apply Position
Job Link Share

Job Description

We’re looking for a Data Engineer II to join our Decisions & Insights team — the team responsible for transforming raw sensor and product data into automated, scalable insights. Everything we build enables rapid, data-driven decision-making across Dedrone and empowers product managers, analysts, and operational agents to quickly surface patterns, understand system behavior, and take action. In this role, you’ll work at the intersection of analytics and engineering. You’ll build and maintain the pipelines, datasets, dashboards, and analytical models that drive our insights. You’ll shape how data flows through the organization — ensuring our hardware and software signals are collected, structured, and visualized in ways that highlight meaningful trends and operational intelligence.

Job Responsibility

  • Design, develop, and maintain automated ETL/ELT pipelines and analytical models in Redshift using SQL, dbt, or SQLMesh
  • Build clean, structured datasets that enable fast, self-serve insights for PMs, analysts, and operational agents
  • Create dashboards and analytical tools (e.g., Tableau) that make insights intuitive and actionable
  • Optimize SQL queries, schemas, and table designs for high-volume analytics workloads
  • Partner with product managers, data scientists, and engineering teams to deliver analysis that supports product and operational decisions
  • Use Python to automate processing, improve pipeline reliability, and support advanced analytical workflows
  • Apply best practices for Git-based version control, testing, documentation, and data quality monitoring
  • Participate in design reviews for new analytical features and data systems

Requirements

  • 3+ years of experience as a Data Engineer, Analytics Engineer, or similar hybrid role
  • Advanced SQL skills with strong understanding of schema design and analytical database patterns
  • Strong Python experience for data manipulation, scripting, and automation
  • Strong analytical mindset, attention to detail, and a passion for turning complex datasets into clear insights
  • Solid Git experience for collaboration and version control
  • Experience integrating and analyzing data from AWS services (e.g., Redshift, S3, APIs)

Nice to have

Proficiency with Tableau

What we offer

  • Competitive salary and 401k with employer match
  • Discretionary paid time off
  • Paid parental leave for all
  • Medical, Dental, Vision plans
  • Fitness Programs
  • Emotional & Mental Wellness support
  • Learning & Development programs
  • Snacks in our offices

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer II

8 matching positions

New

Data Engineer II

We have a 6 month contract to hire opportunity for a hands-on Data Engineer with...
Location
Location
United States , Charlotte
Salary
Salary:
Not provided
zeektek.com Logo
Zeektek
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree
  • 2+ years of experience
  • Proven SQL experience
  • GIT
  • Teradata
Job Responsibility
Job Responsibility
  • Writes basic SELECT, INSERT, UPDATE, and DELETE statements with occasional guidance
  • Run a FastLoad or MultiLoad script with guidance
  • Independently writes multi-table joins, subqueries, and aggregations
  • Applies Teradata-specific syntax (QUALIFY, SAMPLE, DATE arithmetic) without guidance
  • Performs daily Git operations independently — commit, push, pull, branch
  • Resolves simple merge conflicts with guidance
  • Applies branching strategies (GitFlow or trunk-based) consistently
  • Performs rebases, cherry-picks, and resolves complex conflicts independently
  • Writes clear MR descriptions with context, testing notes, and linked issues
  • Gives specific, actionable review feedback
What we offer
What we offer
  • Weekly Direct Deposit
  • 401K Matching
  • Competitive medical, dental and vision insurance
  • Consistent communication throughout your project
  • ZeekTek Referral Program
  • Fulltime
Read More
Arrow Right
New

Data Engineer II

Data Engineering is the production engine behind Global Skilling's data-driven d...
Location
Location
United States , Multiple Locations
Salary
Salary:
102100.00 - 202200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years of experience in business analytics, data science, software development, data modeling, or data engineering
  • OR equivalent experience
  • Ability to meet Microsoft, customer, and/or government security screening requirements may be required for this role. These requirements include, but are not limited to, the following specialized security screenings: Microsoft Cloud Background Check — this position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Build and maintain production ETL pipelines ingesting data from 1st-party, 2nd-party, partner, and 3rd-party sources
  • Design and implement data-sharing patterns and access controls (RBAC) across organizational boundaries
  • Contribute to data mesh patterns, including data contracts, domain-owned datasets, and product-style publishing
  • Develop and maintain data governance solutions, including lineage, cataloging, data quality, and compliance
  • Design, build, and operate REST APIs and backend services that expose WISE datasets as data products
  • Define and manage API contracts, including schema design, versioning, and lifecycle management
  • Build serving layers supporting low-latency, request-response data access
  • Design and deliver Power BI semantic models, curated datasets, and reporting solutions
  • Build and support self-serve analytics experiences, including discoverability and performance optimization
  • Instrument pipelines and services through observability practices (metrics, logs, traces)
  • Fulltime
Read More
Arrow Right

Data Engineer II

The Data Engineer II is responsible for delivering and implementing software sol...
Location
Location
United States , Tampa
Salary
Salary:
Not provided
bstglobal.com Logo
BST Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong command of SQL and relational database concepts
  • Experience with ETL/data integration tools (e.g., SSIS or modern equivalents)
  • Experience with Microsoft Azure SQL (Azure SQL Database or Managed Instance)
  • Familiarity with Microsoft Fabric, including Lakehouse, Data Warehouse and Direct Lake concepts
  • Hands-on experience with Power BI, including report development, semantic models and visualization best practices
  • Experience working with notebook-based data engineering (Microsoft Fabric, Databricks or similar) using Python, Spark SQL or PySpark
  • Understanding of modern data architecture patterns, including medallion architecture (Bronze/Silver/Gold), ELT processing and layered data modeling
  • Understanding of DAX, MDX and tabular data modeling concepts
  • Strong verbal and written communication skills
  • Ability to work collaboratively in a high-performing team environment
Job Responsibility
Job Responsibility
  • Participate in requirements gathering sessions with internal teams and clients
  • Develop technical specifications, designs and estimates for project deliverables
  • Conduct unit testing and validate deliverables for quality and performance
  • Create and maintain comprehensive documentation for all solutions
  • Participate in design and code reviews to ensure quality and adherence to standards
  • Deliver efficient, high-quality solutions aligned with technical and business requirements
  • Collaborate closely with project teams and management to ensure successful project execution
  • Provide training and overviews to team members and clients as needed
  • Support and troubleshoot custom-built solutions
  • Adhere to all company policies, procedures and development standards
  • Fulltime
Read More
Arrow Right

Data Engineer II

Microsoft is a company where passionate innovators come to collaborate, envision...
Location
Location
United States , Redmond
Salary
Salary:
102100.00 - 219200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Intermediate knowledge and experience with Microsoft data tools including Microsoft Fabric, Azure Data Factory, Azure Synapse, and Azure Databricks
  • Intermediate knowledge and experience with GIT operations and CICD flows
  • Advanced experience using a work management tool such as Azure DevOps
  • Advanced experience in time management and prioritization
  • Excellent written & verbal communication skills
  • Passion for data and the desire to learn & adopt new technologies
Job Responsibility
Job Responsibility
  • Extract and transform disparate data into actionable insights that will drive business decisions
  • Drive development projects to evolve our platform and operations, leveraging the newest Microsoft technologies
  • Contribute to the success of Azure Data by trying out and testing new products and features, contributing to design of major feature enhancements, and providing direct feedback to Product Group
  • Work directly with business stakeholders to refine requirements, iterate and finalize design, deliver proofs of concept, and develop final data solution
  • Live site and on call DRI duty for maintaining high availability of analytics solutions
  • Collaborate with peers and maintain flexibility on domain ownership
  • Work with other data teams within Microsoft on understanding their data products and onboarding them
  • Fulltime
Read More
Arrow Right

Data Engineer II

The Cloud & AI organization accelerates Microsoft's mission and bold ambitions t...
Location
Location
United States , Multiple Locations
Salary
Salary:
102100.00 - 202200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR equivalent experience
  • Candidates must be able to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • Citizenship & Citizenship Verification
Job Responsibility
Job Responsibility
  • Design, build, and optimize data pipelines to ingest, process, and prepare data for use in insider risk detection models
  • Join, filter, and integrate diverse data sources to create comprehensive datasets that enable effective and accurate insider risk detections
  • Work with large datasets, applying advanced data transformation techniques to ensure data quality and accessibility for risk detection
  • Develop, test, and deploy insider risk detection models based on data-driven insights to proactively identify anomalous or risky behavior patterns
  • Collaborate with insider risk team members to define and refine detection use cases, ensuring they are accurate, scalable, and aligned with business needs
  • Share knowledge and actively contribute ideas in team technical discussions
  • Maintain and monitor insider risk engineering systems to ensure reliable operation, security, and compliance with internal engineering standards and policies
  • Join on-call rotations, lead incident response, and drive thorough root-cause analysis
  • Document data processes, detection workflows, and system configurations to support future development and maintenance
  • Use development and coding best practices (e.g., reusable, modular)
What we offer
What we offer
  • Benefits and other compensation
  • Fulltime
Read More
Arrow Right

Data Engineer II

Do you have a relentless passion for data engineering and building platforms tha...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering. OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering. OR equivalent experience.
  • Ability to work and communicate effectively across disciplines and teams.
  • Familiarity with distributed data processing and analysis, such as Map-Reduce or Apache Spark.
Job Responsibility
Job Responsibility
  • Authoring and design of Big Data ETL platforms and pipelines in SCOPE, Scala, SQL, Python, or C#.
  • Data extraction across a wide variety of data sources.
  • Data cleaning, preprocessing, and transformation for further analysis by data analysts.
  • Data Validation framework from source to endpoints ensuring data quality and integrity.
  • Enable the Data Scientists and Analysts to do more with data across all aspects of the development lifecycle.
  • Contribute to a data-driven culture as well as a culture of experimentation across the organization.
  • Provide new and improve upon existing data platform offerings with a fundamental understanding of the end-to-end scenarios.
  • Enable Data Scientists and other partners to do more with data across all aspects of the development lifecycle by helping democratize data.
  • Fulltime
Read More
Arrow Right

Data Engineer II

The Copilot and Platform Ecosystem (CAPE) team at Microsoft is responsible for e...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering.
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering.
  • OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Partner with stakeholders to define and document data requirements (access, cadence, ownership) and assess feasibility and total cost of ownership (TCO).
  • Define data contracts and ownership boundaries with upstream system owners.
  • Design and maintain scalable data pipelines that ingest and load data into analytical platforms (e.g., Azure Data Explorer/Kusto).
  • Implement data validation and quality checks to meet SLAs for accuracy, completeness, freshness, and reliability.
  • Build orchestration and automation for dependable, repeatable data movement.
  • Transform and model data (joins, aggregations, enrichment) to power downstream datasets, dashboards, alerts, and agent experiences
  • contribute through code reviews and shared tooling.
  • Operationalize pipelines with monitoring, troubleshooting/runbooks, root-cause analysis, performance/cost optimization, and compliance/governance (classification, tagging, lineage, and access control).
  • Fulltime
Read More
Arrow Right

Data Engineer II

MU-Data Engineers II located in Costa Mesa, CA will provide direct data engineer...
Location
Location
United States , Costa Mesa
Salary
Salary:
128676.72 - 130000.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree (or foreign equivalent) in computer science, any engineering, data science or closely related field
  • 2 years of relevant experience
  • Advanced level in SQL and Python for data engineering and backend development
  • Understanding of popular code development approaches: Test-driven development & Continuous Integration/Continuous Deployment (CI/CD)
  • Experienced working with AWS services (Lambda, S3, Glue, Redshift etc.) and Cloud Data Warehouse
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management
  • Define digital data collection methods and implementations to DWH and customer management platforms
  • Provide guidance to website tagging, digital data integration and collections
  • Experienced with QA testing process to verify data is collected & rendered as expected
  • Prior working knowledge of Braze or other Customer Management Platforms
Job Responsibility
Job Responsibility
  • Work collaboratively with cross-functional teams to determine data transformation needs, establish data collection requirements, and deploy & maintain accurate data to ensure metrics & dimensions are addressed for analytics/reporting requirements
  • Participate in daily/weekly SCRUM ceremonies
  • Transform required data conditions into performance code logic
  • Develop high-performance code in SQL and Python
  • Develop, automate, and enhance ELT processes for continuous data flow
  • Onboard domain data as custom attributes and events to external systems such as Braze, Customer Journey
  • Maintain data daily updates and core logic integrity
  • Provide support to troubleshoot data anomalies and apply resolutions
  • Create, modify, and deploy code to production via AWS resources including Lambda, S3, Glue, Redshift, etc.
  • Partner with stakeholders to support the implementation and development of data requirements. Troubleshoot data anomalies and provide applicable solutions
What we offer
What we offer
  • Competitive base salary and compensation package
  • Annual stock grant
  • Employee stock purchase plan
  • 401(k)
  • Access to free, year-round money coaches
  • Medical, dental and vision insurance
  • Flexible spending account
  • Paid time off
  • Up to 12 paid holidays
  • Paid parental and family leave
  • Fulltime
Read More
Arrow Right