CrawlJobs Logo

Data & Service Engineer

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
Spain , Multiple Locations

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

You’ll sit inside Microsoft’s most advanced AI and search organization, a collective of creators, engineers, and product teams building the next generation of human-centered AI. The Microsoft AI org is built on quality, simplicity, and trust and consists of global products like Copilot, Bing, Edge, Clarity, SwiftKey and MSN. You’ll join the SwiftKey team that powers how hundreds of millions of people communicate every day - directly shaping the cloud services, telemetry pipelines, data processing systems, and reliability foundations that serve them worldwide. We build secure, compliant, resilient, and observable services that enable AI-powered mobile experiences. As a Data Engineer, you will build and operate high‑quality data ingestion, transformation, and validation pipelines that power experimentation, insights, and AI features across SwiftKey. This opportunity allows you to grow deep service engineering skills, develop hands‑on expertise with large‑scale data systems, and contribute to Microsoft’s mission of delivering trusted, intelligent experiences.

Job Responsibility:

  • Build and operate production services that ingest, validate, transform, and serve data in cloud-hosted environments (we use containerized and serverless services in Azure)
  • Design, maintain, and improve data and model infrastructure used to process, store, distribute, and access large datasets, ensuring availability and correctness (we use modern data lake storage and platforms such as Databricks, Azure Synapse, and Spark)
  • Monitor the health and performance of live data services using telemetry and alerts, investigate service issues, and participate in incident response [and on-call rotations] to reduce disruption for users and downstream systems
  • Partner with other engineers, product managers, and applied scientists to deliver high-quality data and production-ready services that support analytics, experimentation, and AI feature development
  • Apply security, privacy, and compliance standards across pipelines and services, managing data access and ensuring adherence to applicable policies and regulations

Requirements:

  • Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, data modeling or data engineering work
  • OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, data modeling or data engineering work
  • OR equivalent experience
  • Experience writing code in Python and SQL, or other relevant data-focused programming languages
  • Experience building or operating production data pipelines using distributed data processing platforms, such as Apache Spark–based systems (e.g., Databricks or Azure Synapse)
  • Experience working with large-scale data storage and table formats commonly used in data lake architectures
  • Familiarity with cloud platforms (Azure preferred) and service engineering practices, including building, deploying, and operating containerized workloads using modern orchestration platforms, monitoring system health, and supporting the ongoing reliability of distributed cloud services

Nice to have:

  • Experience working with event-driven or streaming data ingestion systems (for example Azure Event Hubs, Kafka or similar technologies)
  • Experience working with large-scale consumer data in production services
  • Experience applying data governance, data compliance, and data security practices in production data systems

Additional Information:

Job Posted:
March 26, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data & Service Engineer

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in data engineering and data platform development
  • Strong hands-on experience with: AWS Glue
  • Amazon EMR (Spark)
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
Job Responsibility
Job Responsibility
  • Design, develop, and optimize scalable data pipelines using AWS native services
  • Lead the implementation of batch and near-real-time data processing solutions
  • Architect and manage data ingestion, transformation, and storage layers
  • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
  • Orchestrate complex data workflows using Apache Airflow (MWAA)
  • Develop and manage serverless data processing using AWS Lambda
  • Design and optimize data warehouses using Amazon Redshift
  • Implement and manage NoSQL data models using Amazon DynamoDB
  • Utilize AWS DataZone for data governance, cataloging, and access management
  • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
  • Fulltime
Read More
Arrow Right

Forward Deployed Engineer - Data-as-a-Service

Snorkel AI is hiring data scientists and engineers who will work directly on Sno...
Location
Location
United States , New York City; Redwood City; San Francisco
Salary
Salary:
172000.00 - 300000.00 USD / Year
snorkel.ai Logo
Snorkel AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of experience in data science and engineering roles
  • Strong practical experience with Python, SQL, and data tooling (e.g., pandas, Plotly, Streamlit, Dash)
  • Familiarity with LLM-based workflows and applying ML techniques in production contexts
  • Experience leveraging Backend APIs and interpreting associated technical documentation
Job Responsibility
Job Responsibility
  • Partner with the Sales Team on client discovery calls to provide technical depth, assess solution fit, and scope Data-as-a-Service opportunities
  • Develop and present tailored technical assets including specifications, data dictionaries, sample datasets, and client-specific demonstrations to illustrate feasibility and value
  • Define project scope and success criteria in collaboration with customer stakeholders and internal delivery teams, ensuring alignment on technical requirements and capacity
  • Design and execute calibration processes including baseline batches, benchmark reports, and evaluation frameworks that establish measurable project success metrics
  • Build and deploy evaluators, design and implement quality measurement systems to validate project outputs and ensure deliverables meet client expectations
  • Generate synthetic datasets by developing or adapting existing pipelines to accelerate client engagements and augment training data
  • Package and deliver production-grade datasets with standardized formatting, comprehensive documentation, and quality assurance
  • Configure and build custom applications and off-platform solutions for non-standard or specialized client requirements
  • Define production specifications and workflows, securing technical alignment with client teams to enable seamless go-live transitions
  • Provide ongoing technical support to Delivery Managers, addressing complex questions, resolving technical blockers, and supporting customer rebuttals
What we offer
What we offer
  • Equity in the form of employee stock options
  • Fulltime
Read More
Arrow Right

Service & Commissioning Engineer – Data Centre Cooling

Madrid is fast becoming one of Europe’s key data centre hubs – and with liquid c...
Location
Location
Spain , Madrid
Salary
Salary:
55000.00 - 65000.00 EUR / Year
perigonsearch.co.uk Logo
Perigon Search
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in HVAC, mechanical, or AC engineering – ideally in commissioning or field service
  • Solid understanding of chilled water and hydronic systems
  • Comfortable with BMS/PLC integration and technical documentation
  • Confident working in active, customer-facing environments
  • Willing to travel when needed – mostly Spain and EU sites
Job Responsibility
Job Responsibility
  • Lead the commissioning and support of liquid-to-chip and liquid-to-liquid cooling systems across high-performance data centre environments
  • Thermal testing and system fine-tuning
  • Troubleshooting controls
  • Preparing handover documentation
  • Cover the full lifecycle
  • Based in the Madrid area, with occasional travel to customer sites across Europe
What we offer
What we offer
  • OTE up to €75,000
  • 35 days’ paid leave (including public holidays)
  • Private healthcare, income protection, life and critical illness cover
  • 6% employer pension contribution
  • Long-term development opportunities with a global organisation
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data Engineering

Join us in building the future of finance. Our mission is to democratize finance...
Location
Location
United States , Menlo Park
Salary
Salary:
146000.00 - 198000.00 USD / Year
robinhood.com Logo
Robinhood
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional experience building end-to-end data pipelines
  • Hands-on software engineering experience, with the ability to write production-level code in Python for user-facing applications, services, or systems (not just data scripting or automation)
  • Expert at building and maintaining large-scale data pipelines using open source frameworks (Spark, Flink, etc)
  • Strong SQL (Presto, Spark SQL, etc) skills
  • Experience solving problems across the data stack (Data Infrastructure, Analytics and Visualization platforms)
  • Expert collaborator with the ability to democratize data through actionable insights and solutions
Job Responsibility
Job Responsibility
  • Help define and build key datasets across all Robinhood product areas. Lead the evolution of these datasets as use cases grow
  • Build scalable data pipelines using Python, Spark and Airflow to move data from different applications into our data lake
  • Partner with upstream engineering teams to enhance data generation patterns
  • Partner with data consumers across Robinhood to understand consumption patterns and design intuitive data models
  • Ideate and contribute to shared data engineering tooling and standards
  • Define and promote data engineering best practices across the company
What we offer
What we offer
  • Market competitive and pay equity-focused compensation structure
  • 100% paid health insurance for employees with 90% coverage for dependents
  • Annual lifestyle wallet for personal wellness, learning and development, and more
  • Lifetime maximum benefit for family forming and fertility benefits
  • Dedicated mental health support for employees and eligible dependents
  • Generous time away including company holidays, paid time off, sick time, parental leave, and more
  • Lively office environment with catered meals, fully stocked kitchens, and geo-specific commuter benefits
  • Bonus opportunities
  • Equity
  • Fulltime
Read More
Arrow Right

Software Engineer, Data Engineering

Join us in building the future of finance. Our mission is to democratize finance...
Location
Location
Canada , Toronto
Salary
Salary:
124000.00 - 145000.00 CAD / Year
robinhood.com Logo
Robinhood
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of professional experience building end-to-end data pipelines
  • Hands-on software engineering experience, with the ability to write production-level code in Python for user-facing applications, services, or systems (not just data scripting or automation)
  • Expert at building and maintaining large-scale data pipelines using open source frameworks (Spark, Flink, etc)
  • Strong SQL (Presto, Spark SQL, etc) skills
  • Experience solving problems across the data stack (Data Infrastructure, Analytics and Visualization platforms)
  • Expert collaborator with the ability to democratize data through actionable insights and solutions
Job Responsibility
Job Responsibility
  • Help define and build key datasets across all Robinhood product areas. Lead the evolution of these datasets as use cases grow
  • Build scalable data pipelines using Python, Spark and Airflow to move data from different applications into our data lake
  • Partner with upstream engineering teams to enhance data generation patterns
  • Partner with data consumers across Robinhood to understand consumption patterns and design intuitive data models
  • Ideate and contribute to shared data engineering tooling and standards
  • Define and promote data engineering best practices across the company
What we offer
What we offer
  • bonus opportunities
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Software Engineer - Data Engineering

Akuna Capital is a leading proprietary trading firm specializing in options mark...
Location
Location
United States , Chicago
Salary
Salary:
130000.00 USD / Year
akunacapital.com Logo
AKUNA CAPITAL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS/MS/PhD in Computer Science, Engineering, Physics, Math, or equivalent technical field
  • 5+ years of professional experience developing software applications
  • Java/Scala experience required
  • Highly motivated and willing to take ownership of high-impact projects upon arrival
  • Prior hands-on experience with data platforms and technologies such as Delta Lake, Spark, Kubernetes, Kafka, ClickHouse, and/or Presto/Trino
  • Experience building large-scale batch and streaming pipelines with strict SLA and data quality requirements
  • Must possess excellent communication, analytical, and problem-solving skills
  • Recent hands-on experience with AWS Cloud development, deployment and monitoring necessary
  • Demonstrated experience working on an Agile team employing software engineering best practices, such as GitOps and CI/CD, to deliver complex software projects
  • The ability to react quickly and accurately to rapidly changing market conditions, including the ability to quickly and accurately respond and/or solve math and coding problems are essential functions of the role
Job Responsibility
Job Responsibility
  • Work within a growing Data Engineering division supporting the strategic role of data at Akuna
  • Drive the ongoing design and expansion of our data platform across a wide variety of data sources, supporting an array of streaming, operational and research workflows
  • Work closely with Trading, Quant, Technology & Business Operations teams throughout the firm to identify how data is produced and consumed, helping to define and deliver high impact projects
  • Build and deploy batch and streaming pipelines to collect and transform our rapidly growing Big Data set within our hybrid cloud architecture utilizing Kubernetes/EKS, Kafka/MSK and Databricks/Spark
  • Mentor junior engineers in software and data engineering best practices
  • Produce clean, well-tested, and documented code with a clear design to support mission critical applications
  • Build automated data validation test suites that ensure that data is processed and published in accordance with well-defined Service Level Agreements (SLA’s) pertaining to data quality, data availability and data correctness
  • Challenge the status quo and help push our organization forward, as we grow beyond the limits of our current tech stack
What we offer
What we offer
  • Discretionary performance bonus
  • Comprehensive benefits package that may encompass employer-paid medical, dental, vision, retirement contributions, paid time off, and other benefits
  • Fulltime
Read More
Arrow Right

Technology Services Engineer – Data Protection & Disaster Recovery

Immediate need for a Data Protection & Disaster Recovery Technical Services Engi...
Location
Location
United States , Alpharetta, Georgia
Salary
Salary:
Not provided
tier4group.com Logo
Tier4 Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years in an MSP setting focused on backup/DR and Windows server environments
  • Deep Veeam proficiency
  • Solid grounding in Windows Server/AD, virtualization (preferably Hyper-V, working knowledge of VMware), storage (SMB/NFS, iSCSI), networking basics, and change control
  • PowerShell and basic API/JSON skills to automate deployments, checks, and reports
  • Security & compliance mindset: RBAC/least privilege, MFA, encryption in transit/at rest, audit artifacts for SOC 2/HIPAA
  • Excellent documentation and incident communications
  • willing to support maintenance windows/on-call
Job Responsibility
Job Responsibility
  • Own backup, restore, and resiliency outcomes for all MSP clients
  • act as the primary technical liaison for backup/DR platforms and service delivery
  • Veeam platform ownership: design, configure, and maintain Veeam Backup & Replication (SOBR, backup copy, replication, Instant Recovery, SureBackup labs)
  • manage repositories, retention, encryption, and job health
  • Immutable off-site copies: build and operate (bucket policies, retention/immutability, lifecycle/usage controls) as the off-site tier
  • Monitoring & compliance reporting: implement and tune end-to-end success/failure monitoring, alerting/escalation, daily health checks, and compliance evidence packs
  • 3-2-1 architectures: design and run three-copy / two-media / one off-site strategies using NAS appliances (QNAP/Synology) for local copy and off-site
  • document RPO/RTO per workload
  • Recovery testing & documentation: execute regular restore drills (file/VM/app-item, Instant Recovery, SureBackup verification), record results, and maintain DR runbooks with clear owners and contact trees
  • Incident response & escalation: lead backup/restore and DR events (containment, comms, status cadence, executive updates), perform RCA, and drive corrective and preventive actions
What we offer
What we offer
  • Competitive salary
  • comprehensive benefits (medical, dental, vision, life, disability, 401(k) match)
  • robust PTO
  • Fulltime
Read More
Arrow Right

Backend Software Engineer - Reference Data Services

The role is for an experienced Software Engineer on the FACT Team at Clear Stree...
Location
Location
United States , New York
Salary
Salary:
200000.00 - 250000.00 USD / Year
clearstreet.io Logo
Clear Street
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least eight (8) years of professional experience implementing highly scalable services (we implement our code in Golang)
  • Confidence in designing and building flexible APIs which enable a microservice architecture to reliably deliver consistent data
  • Contributed to systems that deliver solutions to complex business problems that handle massive amounts of data
  • Drawn towards scale, distributed systems, and associated technologies
  • Strong command over object-oriented design patterns, data structures, and algorithms
  • Communicate technical ideas with ease and always look to collaborate to deliver high quality products
  • Experience will help you mentor team members, define our engineering standards, and drive a system design approach to building new services
Job Responsibility
Job Responsibility
  • Work with a team of passionate and highly collaborative engineers to build out our core Platform
  • Own the design and implementation of new features and services
  • Turn the complexity of processing financial transactions across various asset classes into highly scalable services
  • Tackle non trivial problems that will challenge you to flex your system design muscles, balance trade offs, and implement clean efficient code
  • As a voice of experience in the team, you will help mentor teammates, evolve our technical standards and best practices, and further our culture of system designs
What we offer
What we offer
  • Competitive compensation packages
  • Company equity
  • 401k matching
  • Gender neutral parental leave
  • Full medical, dental and vision insurance
  • Lunch stipends
  • Fully stocked kitchens
  • Happy hours
  • A great location
  • Amazing views
  • Fulltime
Read More
Arrow Right