CrawlJobs Logo

Senior Data Engineer, Risk

United States, Bay Area · Job Posted July 04, 2026
Apply Position
Job Link Share

Job Description

As a Data Engineer you will handle everything from data architecture and modeling to data pipeline tooling and dashboarding. You will enable other compliance and risk teams to make impactful business decisions by laying the foundation of our large and unique datasets that span across multiple products. This role will support compliance or risk product data engineering teams.

Job Responsibility

  • Lead the creation and optimization of existing data models through AI code generation on eventing, customer level, and process level data
  • Standardize business and product metric definitions in curated and optimized datasets, and develop data dictionaries and other related documentation
  • Build monitoring to assess data quality and lineage and on top build AI agents for false positive reduction and automated resolution
  • Participate in on-call rotation, monitor daily execution, diagnose and log issues, and fix business critical pipelines to ensure SLAs are met with internal stakeholders
  • Automate this process through AI agents to focus human effort on highest priority tasks
  • Work with non-technical partners and product teams to understand their needs, translate business requirements into applicable data requirements, and come up with automated end-to-end solutions

Requirements

  • A minimum of 10 years of related experience with a Bachelor’s degree
  • or 8 years and a Master’s degree
  • or equivalent experience
  • High proficiency in SQL, Python, and Dbt
  • Experience designing medium-to-large data engineering solutions and responsible for the entire lifecycle of projects including scoping, design, development, testing, deployment, and documentation
  • Experience with ETL scheduling technologies with dependency checking, such as Airflow or Prefect, as well as
  • Experience in schema design and dimensional data modeling
  • Experience with setting up data quality and data lineage monitoring
  • Experience with data driven decisions through AI and agentic automation

What we offer

  • Remote work
  • medical insurance
  • flexible time off
  • retirement savings plans
  • modern family planning

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Data Engineer, Risk

8 matching positions

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
  • Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
  • Experience building data lake or data engineering products, tools, or pipelines
  • Familiarity with container-based architectures (Docker, Kubernetes)
  • Ability to debug complex distributed systems on Linux and/or Windows platforms
Job Responsibility
Job Responsibility
  • Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
  • Use AI tools and coding best practices across the development lifecycle
  • Design data refresh, scheduling, and query optimisation features with minimal supervision
  • Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
  • Coach junior engineers through code reviews
  • Debug complex issues in distributed systems running on Azure, Linux, and Windows
  • Run live site operations on a rotational, on-call basis
  • Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
  • Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features
  • Fulltime
Read More
Arrow Right

Senior Staff Engineer – Cybersecurity Data Protection Engineer

GEICO’s Cybersecurity organization has an exciting opportunity for an accomplish...
Location
Location
United States , Chevy Chase; Palo Alto; Seattle
Salary
Salary:
115000.00 - 260000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience with data discovery, classification, handling, access, inventory, and retention
  • Proven experience with data protection technologies, such as encryption, tokenization and data loss prevention tools
  • Familiar with programming languages such as Python, Java, or .NET
  • Experience with designing and implementing data security solutions for enterprise environments
  • Experience in managing and supervising other Data Protection Engineers
  • Experience in developing and managing data protection programs focused on data discovery, data inventory, data risk assessments, and encryption for both structured and unstructured data
  • Strong knowledge of cybersecurity laws, regulations, and best practices
  • Knowledge of data security frameworks, standards, and protocols
  • Strong understanding of data privacy laws and regulations (i.e. NYDFS, PCI, etc.)
  • Strong analytical and problem-solving skills
Job Responsibility
Job Responsibility
  • Develop and Implement data protection strategies and initiatives, including classification and handling, data access controls, inventory, encryption, and retention
  • Work closely with other stakeholders to enforce data protection related policy and respond to regulatory requirements
  • Develop and maintain data security policies, procedures, standards, and ensure that they are followed by the entire organization
  • Create and maintain data inventories and data flows, and manage data sharing controls
  • Drive the design and implementation of data access controls, ensuring only authorized access to sensitive data
  • CO-develop and implement data retention policy and procedures, ensure compliance with internal policy and external regulations
  • Enforce data encryption standards and strategies to secure data at rest and in transit
  • Lead incident response efforts related to data breach and work with stakeholders to mitigate impact
  • Lead and conduct regular data risk assessments to identify potential vulnerabilities and threats to the organization's data and information systems
  • Stay abreast of new developments in the field of cybersecurity and ensure that the organization's risk assessment and data security processes are aligned with industry standards and best practices
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right

Senior Python Tech Lead - Market Risk Quant Engineer - Senior Vice President

The senior python market risk engineer is a senior level position responsible fo...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years of relevant experience
  • Experience in implementing projects
  • Experience in systems analysis and programming of software applications
  • Demonstrated Subject Matter Expert (SME) in area(s) of Applications Development
  • Demonstrated knowledge of client core business functions
  • Demonstrated leadership, project management, and development skills
  • Relationship and consensus building skills
  • Bachelor’s degree/University degree or equivalent experience
  • Highly Experienced Python Professional with great exposure to architecting and building horizontally scalable, highly available, highly resilient and performant applications
  • Extensive development expertise in building efficient software platforms for data computation and processing
Job Responsibility
Job Responsibility
  • Lead integration of functions to meet goals, deploy new products, and enhance processes
  • Analyze complex business processes, system processes, and industry standards to define and develop solutions to high level problems
  • Provide expertise in area of advanced knowledge of applications programming and plan assignments involving large budgets, cross functional project, or multiple projects
  • Develop application methodologies and standards for program analysis, design, coding, testing, debugging, and implementation
  • Utilize advanced knowledge of supported main system flows and comprehensive knowledge of multiple areas to achieve technology goals
  • Consult with end users to identify system function specifications and incorporate into overall system design
  • Allocate work, and act as an advisor/coach developers, analysts, and new team members
  • Influence and negotiate with senior leaders and communicate with external parties
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

This role is categorized as hybrid. This means the successful candidate is expec...
Location
Location
United States , Austin
Salary
Salary:
133000.00 - 188600.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant full-time experience
  • or equivalent knowledge
  • Bachelor’s degree in Computer Science, Data Science, Engineering, or a related technical field, or equivalent practical experience.
  • Strong proficiency in Scala, Python, SQL, Spark, and Databricks, with production-quality software engineering practices.
  • Strong experience building and supporting cloud-based ETL/ELT pipelines, data platforms, and pipeline orchestration patterns for both batch and streaming operations.
  • Experience deploying machine learning models into production environments and supporting model development through operational release.
  • Strong experience with Databricks jobs, workflows, repos, Unity Catalog, and MLflow-based experimentation and model lifecycle management.
  • Experience building CI/CD pipelines with Git-based workflows, automated testing, and deployment of data or ML products.
  • Strong troubleshooting, communication, and cross-functional collaboration skills.
Job Responsibility
Job Responsibility
  • Design and develop batch and streaming ETL/ELT pipelines in Azure Databricks to support ingestion, transformation, curation, and delivery of manufacturing and enterprise data
  • Build reusable Bronze, Silver, and Gold data pipelines, data quality frameworks, and governed data products in Unity Catalog
  • Build and operationalize ML workflows for data preparation, feature engineering, model training, evaluation, deployment, batch scoring, retraining, and inference
  • Establish and maintain MLflow-based model lifecycle controls, including experiment tracking, model registration, versioning, lineage, traceability, and controlled promotion across environments
  • Implement CI/CD pipelines for data products, ML code, workflows, and deployment bundles using Git-based development practices, automated testing, and release automation
  • Build and support Databricks jobs and workflows for orchestration, scheduled execution, retraining, scoring, and downstream operational consumption
  • Improve reliability, observability, and production readiness through testing, monitoring, validation, alerting, documentation, and automation that reduce deployment risk and manual intervention
  • Partner with data scientists, data engineers, platform teams, architecture, manufacturing, and business stakeholders to productionize scalable, supportable solutions aligned to production constraints
  • Support modernization of legacy data and ML workflows into standardized cloud-native Databricks patterns and help bridge proof-of-concept work into repeatable production solutions
What we offer
What we offer
  • Medical
  • Dental
  • Vision
  • Health Savings Account
  • Flexible Spending Accounts
  • Retirement savings plan
  • Sickness and accident benefits
  • Life insurance
  • Paid vacation & holidays
  • Tuition assistance programs
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Senior Data Engineer - The Senior Data Engineer is responsible for executing the...
Location
Location
Canada , Toronto
Salary
Salary:
110000.00 - 130000.00 USD / Year
fourseasons.com Logo
Four Seasons
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 5-8 years experience Data Engineering
  • with experience in Azure using Databricks
  • Bachelor’s degree Required
  • Expert in Data Engineering in Microsoft Azure Environment + Toolsets (ADF, Synapse, Data Bricks, Cosmos DB, FunctionApps, Logic Apps etc)
  • Lakehouse experience using Databricks
  • Azure platform administration
  • Data Governance Software experience
  • Microsoft Power BI delivery and support
  • Strong SQL query skills
  • Strong history in Python, Pyspark, or Scala
Job Responsibility
Job Responsibility
  • Leading the delivery of finance domain data migration projects with clear milestones, quality controls, and operational readiness
  • Designing and maintaining reusable data ingestion and transformation frameworks aligned with enterprise engineering standards
  • Ensuring data consistency, lineage, and trustworthiness across finance and enterprise data domains
  • Collaborating with business and technical stakeholders to enable analytics, forecasting, and AI readiness for finance data
  • Driving operational excellence across engineering practices, optimizing for cost, performance, and maintainability
  • Design, develop, and maintain robust batch and streaming data pipelines across Azure Data Factory, Databricks, Informatica, and SQL environments
  • Closely work with vendors, contractors and other FS teams to operationalize the data migration process for the hotels
  • Implement and oversee CI/CD workflows, Infrastructure as Code (IaC), and automated testing frameworks
  • Operationalize data quality by integrating Informatica IDQ into finance workflows
  • Apply governance standards by embedding metadata, cataloging, and lineage practices
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

We are looking for an enthusiastic, numerically minded individual with a strong ...
Location
Location
United Kingdom , Cardiff
Salary
Salary:
Not provided
admiralgroup.co.uk Logo
Admiral Group Plc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expert knowledge and experience administering Looker, including user access, roles and permissions, GCP IAM integration, environment management, and service accounts
  • Good understanding of LookML, deployment workflows and version control practices
  • Experience supporting BI platforms, with strong troubleshooting and performance optimisation skills
  • Strong experience with CI/CD, release management, and automation tools using Azure DevOps and Terraform
  • Strong SQL skills, with the ability to investigate data issues and support platform users effectively
  • Knowledge of Git and experience working within engineering standards, governance processes and controlled change environments
  • Strong written and verbal communication skills, both technical and non-technical, with the ability to build effective relationships horizontally and vertically across the business
  • A proactive, collaborative approach and experience working effectively in agile, fast-paced environments
  • Adaptable and open to change, with a willingness to upskill in MicroStrategy administration
  • Able to drive change and innovation, with strong strategic awareness and a broader business perspective
Job Responsibility
Job Responsibility
  • Provide platform administration support for our BI tools, primarily Looker and MicroStrategy, ensuring high-quality, reliable services
  • Own and administer the Looker platform, maintaining availability, performance, stability and security
  • Manage platform configuration, user access, roles, permissions, service accounts and governance controls in line with security and audit requirements
  • Manage LookML deployments and source control processes using Azure DevOps to support safe, efficient and repeatable change delivery
  • Support release planning and controlled platform changes to ensure smooth, low-risk delivery
  • Monitor platform usage, performance and incidents, identify root causes, and implement lasting improvements
  • Promote BI administration best practice, including standards for naming, folder structures, access models, content lifecycle and environment management
  • Work closely with engineers, analysts and stakeholders to understand requirements, resolve issues and support effective use of Looker across the business
  • Use automation and infrastructure-as-code approaches where possible to improve consistency, reduce manual effort and strengthen platform controls
  • Contribute to technical design, change management and release planning for BI platform enhancements and strategic initiatives
What we offer
What we offer
  • 33 days holiday (including bank holidays) when they join us, increasing the longer you stay with us, up to a maximum of 38 days (including bank holidays)
  • Option to buy or sell up to an additional five days of annual leave
  • Up to £3,600 of free shares each year after one year of service
  • Flexible working
  • 24-Hour Ecare
  • Cycle to Work Scheme
  • Simply Health
  • Private Health Cover
  • Critical Illness Cover
  • Financial & Mortgage Advice
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

As Senior Data Engineer you will be responsible for designing, building, maintai...
Location
Location
Portugal , Lisbon
Salary
Salary:
35571.65 - 48126.35 EUR / Year
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree and 3 to 5 years of Computer Science, IT or related field experience
  • Proficiency in Python, PySpark, and Scala for data processing and ETL (Extract, Transform, Load) workflows, with hands-on experience in using Databricks for building ETL pipelines and handling big data processing
  • Experience with data warehousing platforms such as Amazon Redshift, or Snowflake
  • Strong knowledge of SQL and experience with relational (e.g., PostgreSQL, MySQL) databases
  • Familiarity with big data frameworks like Apache Hadoop, Spark, and Kafka for handling large datasets
  • Experienced with software engineering best-practices, including but not limited to version control (GitLab, Subversion, etc.), CI/CD (Jenkins, GITLab etc.), automated unit testing, and Dev Ops
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data solutions for data generation, collection, and processing
  • Be a key team member that assists in design and development of the data pipeline
  • Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems
  • Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
  • Take ownership of data pipeline projects from inception to deployment, manage scope, timelines, and risks
  • Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs
  • Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency
  • Implement data security and privacy measures to protect sensitive data
  • Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions
  • Collaborate and communicate effectively with product teams
What we offer
What we offer
  • Work That Matters – Build tech that accelerates scientific breakthroughs and helps patients worldwide
  • Modern Tech Stack – Cloud-first, automation-focused, AI-powered
  • Global Scale, Agile Mindset – Collaborate across continents while working in nimble, high-impact teams
  • Continuous Learning – Access to certifications, trainings, mentorship, and career mobility
  • AMGEN Total Rewards Plan – Comprehensive benefits in healthcare, finance, and well-being
  • Flexibility – Hybrid work model with time split between our Lisbon office and remote work
  • Fulltime
Read More
Arrow Right

Senior Risk Engineer

The Senior Risk Engineer is responsible for leading and accomplishing risk manag...
Location
Location
United States , Round Lake
Salary
Salary:
96000.00 - 132000.00 USD / Year
https://www.baxter.com/ Logo
Baxter
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Engineering or related field with 3+ years of progressive experience in medical device risk management or product development, including ownership of complex systems or programs
  • Proven experience leading risk management activities across the product lifecycle using tools such as FMEA, FTA, and hazard analysis
  • Advanced proficiency with requirements and risk management tools (e.g., DOORS), bug tracking systems, and end-to-end traceability and documentation in regulated environments
  • Excellent analytical and data-driven decision-making skills, with the ability to independently assess risk, influence design decisions, and balance patient safety, product performance, and compliance
  • Demonstrated ability to lead and influence cross-functional teams, communicate complex risk concepts clearly, and drive alignment across engineering, quality, and regulatory stakeholders
Job Responsibility
Job Responsibility
  • Lead risk management activities following ISO 14971 and corporate procedures concerning risk management plans, hazard analyses, FMEAs, fault tree analyses, and risk reports
  • Identify hazards associated with infusion pumps, including mechanical, electrical, software, usability, and cybersecurity-related risks
  • Collaborate with cross-functional teams during the build and development to ensure risk controls are incorporated, verified, and validated
  • Ensure traceability between hazards, hazardous situations, risk controls, and verification activities
  • Perform robust risk impact assessments of issue records, change controls, complaint trends, and NCR/SNCs using appropriate severity and probability models, ensuring risks are reduced to acceptable levels
  • Update risk management files based on build changes and post-market information, ensuring ongoing product safety
  • Facilitate risk reviews and risk management team meetings
  • Train and mentor team members on risk management principles and tools
What we offer
What we offer
  • Support for Parents
  • Continuing Education/ Professional Development
  • Employee Heath & Well-Being Benefits
  • Paid Time Off
  • 2 Days a Year to Volunteer
  • Medical and dental coverage that start on day one
  • Insurance coverage for basic life, accident, short-term and long-term disability, and business travel accident insurance
  • Employee Stock Purchase Plan (ESPP), with the ability to purchase company stock at a discount
  • 401(k) Retirement Savings Plan (RSP), with options for employee contributions and company matching
  • Flexible Spending Accounts
  • Fulltime
Read More
Arrow Right