CrawlJobs Logo

Data Engineer II

United States, Multiple Locations Employment contract 102100.00 - 202200.00 USD / Year · Job Posted May 29, 2026
Apply Position
Job Link Share

Job Description

The Cloud & AI organization accelerates Microsoft's mission and bold ambitions to ensure that our company and industry is securing digital technology platforms, devices, and clouds in our customers' heterogeneous environments, as well as ensuring the security of our own internal estate. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world. Microsoft is one of the largest enterprise service companies in the world. TEAM OVERVIEW: The Microsoft Insider Risk Program protects our people, data, and intellectual property from internal threats that could compromise the security and integrity of the company. Built on a foundation of collaboration, innovation, and analytical rigor, the program leverages advanced detections, behavioral analytics, and cross-disciplinary expertise to identify and mitigate insider risks across Microsoft's global environments. ROLE OVERVIEW: We are looking for a talented Data Engineer II to join our growing and fast-paced Insider Risk Engineering team. In this role, you will work on developing and managing data pipelines, joining and filtering data sets, and building advanced insider risk detections to proactively identify and address potential threats.

Job Responsibility

  • Design, build, and optimize data pipelines to ingest, process, and prepare data for use in insider risk detection models
  • Join, filter, and integrate diverse data sources to create comprehensive datasets that enable effective and accurate insider risk detections
  • Work with large datasets, applying advanced data transformation techniques to ensure data quality and accessibility for risk detection
  • Develop, test, and deploy insider risk detection models based on data-driven insights to proactively identify anomalous or risky behavior patterns
  • Collaborate with insider risk team members to define and refine detection use cases, ensuring they are accurate, scalable, and aligned with business needs
  • Share knowledge and actively contribute ideas in team technical discussions
  • Maintain and monitor insider risk engineering systems to ensure reliable operation, security, and compliance with internal engineering standards and policies
  • Join on-call rotations, lead incident response, and drive thorough root-cause analysis
  • Document data processes, detection workflows, and system configurations to support future development and maintenance
  • Use development and coding best practices (e.g., reusable, modular)
  • Own end-to-end quality for the code you deliver, including testing and DevOps automation

Requirements

  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR equivalent experience
  • Candidates must be able to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • Citizenship & Citizenship Verification

Nice to have

  • 4+ years of experience in data engineering, data science, or a hybrid data engineering/data science role
  • Proficiency in query languages (e.g., SQL, KQL)
  • Experience with object-oriented programming languages (e.g., Python, C#, Java, or C++)
  • Experience with security product usage such as Insider Risk Management or Sentinel
  • Demonstrated ability to build and manage data systems in the cloud
  • Experience with big data systems and tools, such as PySpark, Databricks, or Azure Synapse
  • Familiar with data engineering best practices like layered data architecture, data modeling, and developing reliable and scalable data pipelines
  • Strong understanding of engineering and security compliance standards, with experience in regulated environments
  • Excellent problem-solving skills and attention to detail
  • Experienced working within agile frameworks such as Scrum and Kanban

What we offer

Benefits and other compensation

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer II

8 matching positions

Data Engineer - II

The Data Engineer will design, develop, and maintain scalable data pipelines and...
Location
Location
India , Pune
Salary
Salary:
Not provided
aticaglobal.com Logo
Atica Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, Engineering, Mathematics, a related field, or equivalent practical experience
  • 3-5 years of experience in data engineering or a similar mid-level role
  • Proficiency in Python and SQL
  • experience with Java is a plus
  • Hands-on experience with AWS, Airbyte, DBT, PostgreSQL, MongoDB, Airflow, and Spark
  • Familiarity with data storage solutions such as PostgreSQL, MongoDB
  • Experience with BigQuery (setup, management and scaling)
  • Strong understanding of data modeling, ETL/ELT processes, and database systems
  • Experience with data extraction, batch processing and data warehousing
  • Excellent problem-solving skills and a keen attention to detail
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable data pipelines and ETL/ELT processes using tools like Airflow, Airbyte and PySpark
  • Collaborate with software engineers and analysts to ensure data availability and integrity for various applications
  • Design and implement robust data pipelines to extract, transform, and load (ETL) data from various sources
  • Utilize Airflow for orchestrating complex workflows and managing data pipelines
  • Implement batch processing techniques using Airflow/PySpark to handle large volumes of data efficiently
  • Develop ELT processes to optimize data extraction and transformation within the target data warehouse
  • Leverage AWS services (e.g., S3, RDS, Lambda) for data storage, processing, and orchestration
  • Ensure data security, reliability, and performance when utilizing AWS resources
  • Work closely with developers, analysts, and other stakeholders to understand data requirements and provide the necessary data infrastructure
  • Assist in troubleshooting and optimizing existing data workflows and queries
What we offer
What we offer
  • Competitive salary and benefits package
  • Comprehensive Health Care benefits (best in the country, includes IPD+OPD, covers Employee, Spouse and two children)
  • Growth and advancement opportunities within a rapidly expanding company
  • Fulltime
Read More
Arrow Right

Data Engineer II

The purpose of the Data Engineer is to migrate and convert data from foreign dat...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
sspinnovations.com Logo
SSP Innovations
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree in Information Technology or related field
  • 1+ year of experience with managed telecommunications databases
  • 3+ years of experience in data conversion, data mapping, and data analysis
  • 3+ years of experience using ESRI, FME, or a combination of both
  • Intermediate database experience including SQL relationship statements
  • Intermediate Programming/Report Analysis experience
  • Communication skills, both oral and written
  • Strong organizational skills and attention to detail
  • Deadline driven, ability to work independently as well as a team player
Job Responsibility
Job Responsibility
  • responsible for supporting data migrations and data conversions from disparate systems into the 3-GIS Data Model
  • oversee data mapping exercises and work closely with customers to understand their data models and to provide mapping between systems
  • employ a variety of tools including but not limited to Python Scripting, Database Scripting languages such as SQL, advanced knowledge of ESRI applications, FME workbenches and internally developed tools, as the assignment dictates
  • exhibit strong communication skills to ensure customer understanding of data migrations and conversions and must work with various team members such as Solutions Engineers, Data Technicians, Sales Executives and Project Managers to ensure project success
  • must be detail oriented and maintain proper time management as projects generally have specific timelines and milestones required for project success
  • ability to provide references for users by writing and maintaining documentation
  • design, develop, and test data transformation, extraction, and migration activities
  • prepare technical reports by collecting, analyzing, and summarizing information
  • perform tasks efficiently while validating methodology
  • interact directly (face-to-face and remotely) with clients and project teams
  • Fulltime
Read More
Arrow Right

Data Engineer II

We’re looking for a Data Engineer II to join our Decisions & Insights team — the...
Location
Location
United States , San Francisco
Salary
Salary:
101250.00 - 162000.00 USD / Year
axon.com Logo
Axon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience as a Data Engineer, Analytics Engineer, or similar hybrid role
  • Advanced SQL skills with strong understanding of schema design and analytical database patterns
  • Strong Python experience for data manipulation, scripting, and automation
  • Strong analytical mindset, attention to detail, and a passion for turning complex datasets into clear insights
  • Solid Git experience for collaboration and version control
  • Experience integrating and analyzing data from AWS services (e.g., Redshift, S3, APIs)
Job Responsibility
Job Responsibility
  • Design, develop, and maintain automated ETL/ELT pipelines and analytical models in Redshift using SQL, dbt, or SQLMesh
  • Build clean, structured datasets that enable fast, self-serve insights for PMs, analysts, and operational agents
  • Create dashboards and analytical tools (e.g., Tableau) that make insights intuitive and actionable
  • Optimize SQL queries, schemas, and table designs for high-volume analytics workloads
  • Partner with product managers, data scientists, and engineering teams to deliver analysis that supports product and operational decisions
  • Use Python to automate processing, improve pipeline reliability, and support advanced analytical workflows
  • Apply best practices for Git-based version control, testing, documentation, and data quality monitoring
  • Participate in design reviews for new analytical features and data systems
What we offer
What we offer
  • Competitive salary and 401k with employer match
  • Discretionary paid time off
  • Paid parental leave for all
  • Medical, Dental, Vision plans
  • Fitness Programs
  • Emotional & Mental Wellness support
  • Learning & Development programs
  • Snacks in our offices
  • Fulltime
Read More
Arrow Right

Data Engineer II

As a Data Engineer II on our Core Engineering Data Team, you will focus on build...
Location
Location
United States , Boston
Salary
Salary:
93200.00 - 136600.00 USD / Year
simplisafe.com Logo
SimpliSafe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field or equivalent practical experience
  • 2+ years of experience in software engineering, data engineering, or a related field
  • Foundational knowledge of AWS or other public cloud platforms (e.g., Azure, GCP)
  • Strong SQL knowledge and experience optimizing for data warehousing technologies like AWS Athena
  • Strong knowledge of Python for use in data transformation
  • Experience with ETL/ELT, schema design, and datalake technologies
  • Familiarity with various data and table formats (JSON, Avro, Parquet, Iceberg)
  • Love of data and a passion for building reliable data products
Job Responsibility
Job Responsibility
  • Develop and maintain efficient and reliable ETL/ELT data pipelines from product and service data sources to our centralized analytical platforms
  • Implement and monitor data pipeline orchestration using tools like Airflow or Dagster to ensure timely and accurate data delivery
  • Collaborate with senior engineers and analysts to understand requirements and implement technical solutions for data workflows
  • Perform routine monitoring of pipeline performance and reliability, assisting with troubleshooting and optimizing for efficiency
  • Contribute to the optimization of table structures and data storage to support various query and usage patterns
  • Support and maintain data discovery, catalog, and analytics tooling for internal teams
  • Assist in implementing data security measures and ensuring compliance with data governance policies
  • Write and maintain data quality validation checks and unit tests to ensure the integrity and reliability of data pipelines
  • Participate in team-wide discussions to help develop and refine team norms and engineering best practices
What we offer
What we offer
  • A mission- and values-driven culture and a safe, inclusive environment where you can build, grow and thrive
  • A comprehensive total rewards package that supports your wellness and provides security for SimpliSafers and their families
  • Free SimpliSafe system and professional monitoring for your home
  • Employee Resource Groups (ERGs) that bring people together, give opportunities to network, mentor and develop, and advocate for change
  • Participation in our annual bonus program, equity, and other forms of compensation, in addition to a full range of medical, retirement, and lifestyle benefits
  • Fulltime
Read More
Arrow Right

Data Engineer II

PagerDuty is looking for a Data Engineer II to join their global Enterprise Data...
Location
Location
Portugal , Lisbon
Salary
Salary:
Not provided
https://www.pagerduty.com Logo
PagerDuty
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience working in data integration, pipelines, and data modeling
  • experience designing and deploying code in Data platforms in a cloud-based and Agile environment
  • knowledge and experience of relational databases and being capable of writing complex SQL
  • experience working with Cloud-based Data Warehousing Platform such as Snowflake or AWS, or Databricks
  • experience with Python and SQL
  • experience working with SQL, AWS S3, and ETL/Automation Workflow tools like Workato
Job Responsibility
Job Responsibility
  • translate business requirements into data models that are easy to understand
  • design, implement, and build pipelines that deliver data with measurable quality under the SLA
  • partner with business domain experts, data analysts, and engineering teams to build foundational data sets
  • be a champion of the overall strategy for data governance, security, privacy, quality, and retention
  • own and document foundational company metrics with a clear definition and data lineage
  • contribute to the data ecosystem and build a strong data foundation for the company
  • design, implement, and scale data pipelines that transform billions of records into actionable data models
  • provide hands-on technical support to build trusted and reliable domain-specific datasets and metrics
What we offer
What we offer
  • competitive salary
  • comprehensive benefits package
  • flexible work arrangements
  • company equity
  • ESPP (Employee Stock Purchase Program)
  • retirement or pension plan
  • generous paid vacation time
  • paid holidays and sick leave
  • Dutonian Wellness Days & HibernationDuty
  • paid parental leave
  • Fulltime
Read More
Arrow Right

Software Engineer II - Connector Engineering

We are seeking a resourceful and versatile Software Engineer to join the team to...
Location
Location
India , Chennai
Salary
Salary:
Not provided
arcadia.com Logo
Arcadia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong technical skills in Core Java with prior experience working in support or maintenance projects
  • Strong understanding of data structures
  • Ability to work in kanban delivery model with good exposure to process
  • Ensure best practices in coding and quality standards for delivery
  • Worked on Kanban methodologies
  • Taking full ownership of converting requirements into design, code, unit test, deployment and delivery of functionality as per agreed timelines
  • Being a good team player with strong interpersonal skills
  • Know-how of troubleshooting/debugging application and code to resolve any issues in the platform
  • Being able to review other engineers work output and provide constructive feedback for the betterment of the solutions
  • Self-starter and should be willing to plunge to the bottom of a business problem to resolve
What we offer
What we offer
  • Competitive compensation based on market standards
  • Flexible Leave Policy
  • Office is in the heart of the city in case you need to step in for any purpose
  • Medical Insurance (1+5 Family Members)
  • We provide comprehensive coverage including accident policy and life Insurance
  • Annual performance cycle
  • Quarterly team engagement activities and rewards & recognitions
  • L&D programs to foster professional growth
  • A supportive engineering culture that values diversity, empathy, teamwork, trust, and efficiency
Read More
Arrow Right

Software Engineer II, Cloud Engineering

We’re seeking a Cloud Infrastructure Engineer to design, build, and maintain the...
Location
Location
United States , San Francisco
Salary
Salary:
120750.00 - 193200.00 USD / Year
axon.com Logo
Axon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience managing AWS infrastructure in production environments
  • Experience with CDK, Terraform, or CloudFormation for infrastructure as code is a must
  • Strong experience with Lambda, Fargate, S3, SNS/SQS, EC2, and CloudWatch
  • Hands-on experience with Docker and CI/CD tools
  • Solid understanding of Python-based data workflows and microservice design patterns
  • Excellent problem-solving and communication skills, with a focus on reliability and automation
Job Responsibility
Job Responsibility
  • Design, deploy, and manage AWS infrastructure (S3, EC2, Lambda, Fargate, SNS, CloudWatch, IAM, Code Pipelines etc)
  • Build and maintain data ingestion and processing pipelines, ensuring reliability and scalability
  • Set up and monitor notification and alerting systems for data processing and model operations
  • Manage Dockerized workloads across Fargate and EC2 for compute-heavy analytics jobs
  • Support CI/CD pipelines for model deployment and internal tools
  • Optimize cost, performance, and security posture across AWS accounts and services
  • Collaborate with DA/DE/DS to operationalize workflows in a cloud-native, automated fashion
What we offer
What we offer
  • Competitive salary and 401k with employer match
  • Discretionary paid time off
  • Paid parental leave for all
  • Medical, Dental, Vision plans
  • Fitness Programs
  • Emotional & Mental Wellness support
  • Learning & Development programs
  • Snacks in our offices
  • Fulltime
Read More
Arrow Right

Electrical Engineer II, RF Test Engineer

As an RF Test Engineer, your work will be essential in ensuring that the wireles...
Location
Location
United States , Scottsdale
Salary
Salary:
Not provided
axon.com Logo
Axon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Electrical Engineering, RF Engineering or similar discipline
  • Minimum of 3 years of hands-on RF and wireless device testing experience
  • Minimum of 3 years of wireless device test plan development for evaluating performance of various wireless interfaces against system and product requirements
  • Solid understanding of basic RF principles and theory, familiar with basic RF technology circuitry stages and topologies
  • Experience with modern RF technology including multiband Wi-Fi, Bluetooth, Cellular (LTE, 5G FR1), and multi-constellation GNSS and their test methodologies
  • Cellular experience is a must-have
  • High level of familiarity of cellular certification processes, test requirements, and test methods (PTCRB, CTIA, GCF, Carrier testing, etc), with hands on experience with device pretesting
  • Familiarity of worldwide EMC and intentional radiator regulatory standards and test methods (FCC, CE, ETSI, etc)
  • Proficient with operation of RF equipment such as RF communication testers (CMW, CMX, Litepoint), Network Analyzers, Spectrum Analyzers, RF power meters, Signal Generators, RF Test chambers
  • Experience with collaborative RF debug at device and circuit level
Job Responsibility
Job Responsibility
  • Design and implement test plans to evaluate the performance of wirelessly connected devices, ensuring they meet stringent product and regulatory requirements
  • Record RF test data and organize results, creating clear, actionable reports
  • Present findings and recommendations to cross-functional teams, enabling swift resolution of design challenges
  • Evaluate RF performance characteristics such as Total Radiated Power (TRP), Total Isotropic Sensitivity (TIS), and other over-the-air (OTA) metrics for cellular-enabled wireless devices using advanced equipment
  • Use instruments like spectrum analyzers and radio communication testers to assess conducted performance of wireless technologies, including LTE, 5G, Wi-Fi, Bluetooth, and GNSS
  • Support product field evaluations to validate RF performance under diverse real-world conditions, such as urban or rural environments
  • Investigate and debug issues such as poor sensitivity, low transmit power, or signal interference in wireless devices
  • Assist in the regulatory pre-certification and formal certification test efforts for hardware by preparing test samples, working closely with external test labs, troubleshooting issues, and ensuring successful completion of certification activities
  • Expand your knowledge of RF systems, testing methodologies, and certification standards while working closely with experienced engineers to develop your technical expertise and contribute to innovative designs
What we offer
What we offer
  • Competitive salary and 401k with employer match
  • Discretionary paid time off
  • Paid parental leave for all
  • Medical, Dental, Vision plans
  • Fitness Programs
  • Emotional & Mental Wellness support
  • Learning & Development programs
  • Fulltime
Read More
Arrow Right