CrawlJobs Logo
Microsoft Corporation Logo Microsoft Corporation · IT - Software Development

Sr Data Engineer

United States, Redmond Employment contract 119800.00 - 234700.00 USD / Year · Job Posted May 03, 2026
Apply Position
Job Link Share

Job Description

We are looking for a full stack Azure Data Engineer to serve as the primary technical partner for our Legal Business Operations team. This is a hands-on role focused on deeply understanding the end-to-end technology stack that supports legal operations and provides technical guidance and support on platform modernization using AI. You will be the person who knows how all the pieces connect: how data flows between systems, where integrations are fragile, what the downstream impact of a schema change is, and how to evaluate whether a new tool or approach is worth adopting. You will manage proof-of-concept evaluations, support production operations, and act as the bridge between legal operations stakeholders and engineering resources. This is not a pure backend engineering role. It requires someone who is equally comfortable digging into data pipelines, troubleshooting a dashboard, and walking a non-technical stakeholder through the implications of a platform migration. Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Job Responsibility

  • Technology Stack Ownership & Operations
  • Proof-of-Concept Management & Evaluation
  • Data Engineering & Pipeline Development
  • Stakeholder Partnership & Communication

Requirements

Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience.

Nice to have

  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 8+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience
  • 2+ years experience with data governance, data compliance and/or data security
  • Proficiency in SQL and Python for data processing, pipeline development, and analysis
  • Hands-on experience building and maintaining data pipelines on cloud platforms (Azure, AWS, GCP, or similar)
  • Demonstrated ability to understand and document complex multi-system technology environments end to end
  • Experience managing or contributing to proof-of-concept or pilot evaluations of new technologies
  • Familiarity with API design, integration patterns (REST, event-driven), and middleware
  • Exposure to AI/ML tools or agentic workflows for document processing, search, or automation
  • Experience supporting legal, compliance, or business operations teams in a technology capacity
  • Understanding of data governance, privacy requirements, and access control in regulated or sensitive environments
  • Project management skills or experience with agile methodologies
Microsoft Corporation - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Sr Data Engineer

8 matching positions

New

Sr Data Engineer

As a Senior Data Engineer at Amgen, you will be responsible for managing and opt...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master's degree with 8 - 13 years of experience in Computer Science, IT or related field
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies
  • Proficiency in workflow orchestration, performance tuning on big data processing
  • Strong understanding of AWS services
  • Experience with Data Fabric, Data Mesh, or similar enterprise-wide data architectures
  • Ability to quickly learn, adapt and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
  • Excellent analytical and troubleshooting skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable ETL/ELT pipelines to support structured, semi-structured, and unstructured data processing across the Enterprise Data Engineering for Biotech or Pharma functional knowledge of R&D
  • Implement real-time and batch data processing solutions, integrating data from multiple sources into a unified, governed data fabric architecture
  • Optimize big data processing frameworks using Apache Spark, Hadoop, or similar distributed computing technologies to ensure high availability and cost efficiency
  • Work with metadata management and data lineage tracking tools to enable enterprise-wide data discovery and governance
  • Ensure data security, compliance, and role-based access control (RBAC) across data environments
  • Optimize query performance, indexing strategies, partitioning, and caching for large-scale data sets
  • Develop CI/CD pipelines for automated data pipeline deployments, version control, and monitoring
  • Implement data virtualization techniques to provide seamless access to data across multiple storage systems
  • Collaborate with cross-functional teams, including data architects, business analysts, and DevOps teams, to align data engineering strategies with enterprise goals
  • Stay up to date with emerging data technologies and best practices, ensuring continuous improvement of Enterprise Data Fabric architectures
  • Fulltime
Read More
Arrow Right

Sr Data Engineer

Designing, building, maintaining, analyzing, and interpreting data to provide ac...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s / Master’s degree and 8 to 13 years of Computer Science, IT or related field experience
  • Hands-on experience with big data technologies and platforms, such as Databricks, Apache Spark (PySpark, SparkSQL), workflow orchestration, performance tuning on big data processing
  • Proficiency in data analysis tools (e.g. SQL) and experience with data visualization tools
  • Excellent problem-solving skills and the ability to work with large, complex datasets
  • Strong understanding of data governance frameworks, tools, and best practices
  • Excellent critical-thinking and problem-solving skills
  • Strong communication and collaboration skills
  • Demonstrated awareness of how to function in a team setting
  • Demonstrated presentation skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data solutions for data generation, collection, and processing
  • Be a key team member that assists in design and development of the data pipeline
  • Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems
  • Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
  • Take ownership of data pipeline projects from inception to deployment, manage scope, timelines, and risks
  • Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs
  • Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency
  • Implement data security and privacy measures to protect sensitive data
  • Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions
  • Collaborate and communicate effectively with product teams
  • Fulltime
Read More
Arrow Right

Sr Data Engineer

We’re seeking a Data Engineer with strong Databricks and Azure experience.
Location
Location
United States , Jacksonville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Databricks + Spark
  • Azure Data Factory or similar
  • SQL and Python
Job Responsibility
Job Responsibility
  • Build and maintain data pipelines
  • Work with large-scale data processing frameworks
  • Optimize data flows and storage solutions
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • Company 401(k) plan
  • Free online training
Read More
Arrow Right

Sr Data Engineer

The purpose of the Data Engineer position is to leverage their technical experti...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 03, 2026
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Data Science, Information Technology, or a related field with a focus on data engineering or data analytics
  • Strong proficiency in programming languages such as Python, SQL, Java, or Scala for data processing and analysis
  • Experience with data modeling, ETL processes, data warehousing, data integration, and data pipeline development
  • Proficiency in relational databases (e.g., SQL, PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra)
  • Working knowledge of cloud platforms such as Snowflake, AWS, Azure, or Google Cloud Platform for data storage and processing
  • Experience with data visualization tools (e.g., Power BI) to create meaningful insights from data
  • Understanding of data quality principles, data governance, and data validation processes
  • Ability to analyze complex data sets, identify trends, patterns, and insights to drive data-driven decision-making
  • Proficiency in troubleshooting data-related issues, identifying root causes, and implementing solutions
  • Familiarity with project management methodologies to contribute effectively to project planning and execution
Job Responsibility
Job Responsibility
  • Build pipelines using standard patterns for data pipelines and workflows utilizing Streamsets, Kestra, dbt, Git
  • Design and Implement data storage and processing solutions employing Snowflake
  • Utilize AWS services for cloud-based platform tooling infrastructure including but not limited to Lambda,ECS,MSK,RDS,EC2, Secrets Manager, ALB, Cloud Watch, Event Bridge
  • Utilize Terraform for AWS and Azure deployments
  • Leverage and integrate APIs for data access and manipulation
  • Write Python scripts for data common processing and automation tasks
  • Leverage Platform API’s and Web Applications to enforce Platform Security
  • Create and execute comprehensive test plans to ensure the pipelines functionality and performance
  • Develop unit tests, integration tests, and end-to-end tests for data pipelines and workflows
  • Ensure data accuracy and consistency through rigorous testing processes
What we offer
What we offer
  • Commitment to your ongoing development, including on the job opportunities and formal programs
  • Inclusive parental leave entitlements for both parents
  • Values led culture
  • Flexible work options
  • Generous annual leave, sick leave and casual leave
  • Cultural and religious leave with flexible public holiday opportunities
  • A competitive remuneration package featuring performance based incentives with uncapped Employer Provident Fund
  • Fulltime
Read More
Arrow Right

Sr Data Engineer

Roku is changing how the world watches TV. Roku is the #1 TV streaming platform ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive SQL Skills
  • Proficiency in at least one scripting language, Python is required
  • Experience in big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc.
  • Proficiency in data modeling, including designing, implementing, and optimizing conceptual, logical, and physical data models to support scalable and efficient data architectures
  • 8+ years professional experience as a data Engineer
  • BS in Computer Science
  • AI Literacy / AI growth mindset
Job Responsibility
Job Responsibility
  • Build highly scalable, available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 10s of terabytes of data ingested every day and petabyte-sized data warehouse
  • Build quality data solutions and refine existing diverse datasets to simplified data models encouraging self-service
  • Build data pipelines that optimise on data quality and are resilient to poor quality data sources
  • Own the data mapping, business logic, transformations and data quality
  • Low level systems debugging, performance measurement & optimization on large production clusters
  • Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects
  • Maintain and support existing platforms and evolve to newer technology stacks and architectures
What we offer
What we offer
  • Global access to mental health and financial wellness support and resources
  • Local benefits include statutory and voluntary benefits which may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension)
  • Employees are supported in taking time off, in accordance with local leave policies and other personal needs to support their evolving work and life needs
  • Fulltime
Read More
Arrow Right

Sr Data Engineer

The Senior Data Engineer plays a critical role in delivering strategic and opera...
Location
Location
United States
Salary
Salary:
120000.00 - 160000.00 USD / Year
personifyhealth.com Logo
Personify Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least one AWS certification (e.g., AWS Certified Data Analytics – Specialty, Big Data – Specialty, Developer – Associate)
  • 7+ years in data engineering or analytics engineering, with a strong focus on cloud-native architectures. Proven experience designing and operating scalable data platforms in AWS
  • 5+ years in healthcare, insurance, or claims processing, including 5+ years working with EDI (834, 835, 837, 2222, 2223, 999), X12 file standards or HL7 standards and familiarity with HIPAA and CMS compliance
  • Expert-level proficiency in SQL (including pivots, window functions, and complex date calculations) and Python for data processing, transformation, and application development
  • Hands-on experience with orchestration tools like Airflow, containerization with Docker, and CI/CD pipelines. Strong bias for automation and continuous improvement
  • Proficient in consuming and transforming REST APIs and JSON data into relational models. Skilled in building robust data ingestion and transformation pipelines
  • Experience with JIRA, BitBucket Git, BitBucket Pipelines, and collaboration with cross-functional teams including Data Analysts, Data Scientists, Product, and Account Management
  • Proficient in Excel and BI tools such as Tableau, Power BI, and MicroStrategy for data analysis and reporting
  • Detail-oriented with a strong focus on data quality, accuracy, and performance tuning for large-scale data systems. Background in cost optimization and system reliability
  • Ability to mentor engineers, share technical knowledge, and communicate effectively with both technical and non-technical stakeholders. Strong documentation and systems thinking
Job Responsibility
Job Responsibility
  • Build data applications and processes using Python, SQL, and Django
  • manage and query data in PostgreSQL, Oracle, and cloud-native databases
  • Examine, extract, cleanse, and load data while implementing quality assurance rules and tools to ensure consistent and accurate data
  • Work with healthcare-specific data processes such as EDI file transfers, claims adjudication, audits, eligibility verification, and reporting workflows
  • Collaborate with cross-functional teams (Data Analysts, Data Scientists, Product, Reporting, Account Management) to define requirements and deliver data-driven solutions
  • Ensure data quality, integrity, and security through automated validation, auditing, and monitoring, with compliance to HIPAA and CMS regulations
  • Monitor, maintain, and tune pipeline performance
  • proactively troubleshoot and resolve complex data flow and system issues
  • Provide technical mentorship to Data Engineers, sharing expertise in data modeling, pipeline development, and troubleshooting practices
  • Research and propose improvements to the tech stack and data engineering processes
What we offer
What we offer
  • Competitive base salary and benefits effective day one
  • Comprehensive medical and dental through our own health solutions (yes, we use what we build)
  • Unlimited PTO—rest and recharge time is non-negotiable
  • Mental health support, retirement planning, and financial protection
  • Professional development with clear career progression and learning budgets
  • Mission-driven culture where diverse perspectives drive real impact on people's health
  • Fulltime
Read More
Arrow Right

Sr Data Engineer

The Senior Data Engineer role involves leading data architecture and modernizati...
Location
Location
India , Chennai
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong expertise in Azure and Databricks
  • Focus on data modeling and integration
  • Azure
  • Databricks
  • Data Modeling
  • Team Leadership
  • Client Interviews
  • SQL
Job Responsibility
Job Responsibility
  • Engage heavily with business users across North America and Europe, facilitating workshops and data discovery sessions
  • Drive consensus on business rules, data definitions, and data sources, especially where regional processes differ
  • Serve as the architectural thought leader enabling teams to transition from manual, inconsistent processes to standardized, modernized workflows
  • Partner closely with business analysts, data analysts, product owners, and engineering teams across multiple geographies
  • Architect a unified master stitched data model to replace downstream reliance on Varicent for data assembly
  • Lead the re‑architecture of compensation data processing—including internal and external compensation flows—into a scalable, cloud‑native Azure environment
  • Define patterns, frameworks, and integration strategies across Azure services (Data Factory, Databricks, Data Lake, SQL, etc.)
  • Evaluate and evolve the use of rules engines/ODM/Drools to externalize and modernize embedded business logic currently locked in application code
  • Guide decisions to shift logic and data ownership into enterprise‑owned systems rather than third‑party tools
  • Analyze current‑state processes (38 in NA, 9 in Europe) and identify opportunities for re‑engineering, automation, and consolidation
Read More
Arrow Right

Sr Data Engineer

The mission of Roku's Data Engineering team is to develop a world-class big data...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive SQL Skills
  • Proficiency in at least one scripting language, Python is required
  • Experience in big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc.
  • Proficiency in data modeling, including designing, implementing, and optimizing conceptual, logical, and physical data models to support scalable and efficient data architectures.
  • Experience with AWS, GCP, Looker is a plus
  • Collaborate with cross-functional teams such as developers, analysts, and operations to execute deliverables
  • 8+ years professional experience as a data Engineer
  • BS in Computer Science
  • MS in Computer Science preferred
  • AI Literacy / AI growth mindset
Job Responsibility
Job Responsibility
  • Build highly scalable, available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 10s of terabytes of data ingested every day and petabyte-sized data warehouse
  • Build quality data solutions and refine existing diverse datasets to simplified data models encouraging self-service
  • Build data pipelines that optimise on data quality and are resilient to poor quality data sources
  • Own the data mapping, business logic, transformations and data quality
  • Low level systems debugging, performance measurement & optimization on large production clusters
  • Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects
  • Maintain and support existing platforms and evolve to newer technology stacks and architectures
What we offer
What we offer
  • global access to mental health and financial wellness support and resources
  • Local benefits include statutory and voluntary benefits which may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension)
  • vacation and other personal time off
  • Fulltime
Read More
Arrow Right