CrawlJobs Logo

Data Engineer - Regulatory Reporting

clearstreet.io Logo

Clear Street

Location Icon

Location:
United States , New York

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

140000.00 - 190000.00 USD / Year

Job Description:

As an experienced Software Engineer on the Controls Engineering team, you will play an integral role in automating our Compliance & Finance regulatory processes. You'll build on your analytical skills to create solutions that process large amounts of data from our data warehouse to generate clean, correct reporting, including building out reconciliations. You will partner with key stakeholders across the Compliance, Finance, and Treasury teams to understand regulatory/financial obligations and business requirements, and translate them into clean designs and scalable solutions. As the tech lead in the team, you will provide technical guidance, prioritizing work, perform hands-on design and development and code review, as well as evolve our technical standards and best practices.

Job Responsibility:

  • Play an integral role in automating our Compliance & Finance regulatory processes
  • Create solutions that process large amounts of data from our data warehouse to generate clean, correct reporting, including building out reconciliations
  • Partner with key stakeholders across the Compliance, Finance, and Treasury teams to understand regulatory/financial obligations and business requirements, and translate them into clean designs and scalable solutions
  • Provide technical guidance, prioritizing work, perform hands-on design and development and code review, as well as evolve our technical standards and best practices

Requirements:

  • At least five (5) years of software design and development experience including CI/CD, source code control, testing, and quality management
  • Highly proficient in Python, SQL, database design
  • Experience working with data warehouses like Snowflake to generate complex solutions at scale
  • Self-starter with a sense of urgency and an eagerness to learn and explore new technologies
  • Strong communicator who can interact in a clear and concise manner with non-technical business stakeholders, product managers as well engineers
  • Ability to troubleshoot and logically assess problems and determine solutions

Nice to have:

  • Experience working in the post-trade automation space designing and architecting systems that deliver solutions to complex data problems
  • Experience generating complex financial industry regulatory reports like EMIR, MFID, SFTR, CPR, K Factor etc.
What we offer:
  • Competitive compensation, benefits, and perks
  • Company equity
  • 401k matching
  • Gender neutral parental leave
  • Full medical, dental and vision insurance
  • Lunch stipends
  • Fully stocked kitchens
  • Happy hours

Additional Information:

Job Posted:
December 07, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data Engineer - Regulatory Reporting

Data Engineering & Analytics Lead

Premium Health is seeking a highly skilled, hands-on Data Engineering & Analytic...
Location
Location
United States , Brooklyn
Salary
Salary:
Not provided
premiumhealth.org Logo
Premium Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred
  • Proven track record and progressively responsible experience in data engineering, data architecture, or related technical roles
  • healthcare experience preferred
  • Strong knowledge of data engineering principles, data integration, ETL processes, and semantic mapping techniques and best practices
  • Experience implementing data quality management processes, data governance frameworks, cataloging, and master data management concepts
  • Familiarity with healthcare data standards (e.g., HL7, FHIR, etc), health information management principles, and regulatory requirements (e.g., HIPAA)
  • Understanding of healthcare data, including clinical, operational, and financial data models, preferred
  • Advanced proficiency in SQL, data modeling, database design, optimization, and performance tuning
  • Experience designing and integrating data from disparate systems into harmonized data models or semantic layers
  • Hands-on experience with modern cloud-based data platforms (e.g Azure, AWS, GCP)
Job Responsibility
Job Responsibility
  • Collaborate with the CDIO and Director of Technology to define a clear data vision aligned with the organization's goals and execute the enterprise data roadmap
  • Serve as a thought leader for data engineering and analytics, guiding the evolution of our data ecosystem and championing data-driven decision-making across the organization
  • Build and mentor a small data team, providing technical direction and performance feedback, fostering best practices and continuous learning, while remaining a hands-on implementor
  • Define and implement best practices, standards, and processes for data engineering, analytics, and data management across the organization
  • Design, implement, and maintain a scalable, reliable, and high-performing modern data infrastructure, aligned with the organizational needs and industry best practices
  • Architect and maintain data lake/lakehouse, warehouse, and related platform components to support analytics, reporting, and operational use cases
  • Establish and enforce data architecture standards, governance models, naming conventions ,and documentation
  • Develop, optimize, and maintain scalable ETL/ELT pipelines and data workflows to collect, transform, normalize, and integrate data from diverse systems
  • Implement robust data quality processes, validation, monitoring, and error-handling frameworks
  • Ensure data is accurate, timely, secure, and ready for self-service analytics and downstream applications
What we offer
What we offer
  • Paid Time Off, Medical, Dental and Vision plans, Retirement plans
  • Public Service Loan Forgiveness (PSLF)
  • Fulltime
Read More
Arrow Right

Data Engineering Tech Lead/Architect

Andersen is hiring a Data Engineering Tech Lead/Architect in the EU to lead the ...
Location
Location
Salary
Salary:
Not provided
andersenlab.com Logo
Andersen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience as a Data Engineering Tech Lead/Architect for 6+ years
  • Ability to design complex systems, not just create reports
  • Expertise in MicroStrategy / Power BI (dashboards, semantic layer, data modeling) and Talend DMP (integration, ETL/ELT)
  • At least 6 months of experience with the MicroStrategy SDK, including embedding reports into Typo3 CMS and Java application servers (Tomcat)
  • Experience with Data Warehouse architecture, role-based access models, and incremental data loading
  • Understanding of regulatory reporting (Meldewesen) and ability to translate business requirements into technical solutions
  • Ability to work autonomously, make architectural decisions, and clearly explain them to stakeholders
  • Level of English – from Upper-Intermediate and above
  • Level of German – from Advanced and above
Job Responsibility
Job Responsibility
  • Designing data architecture from scratch, including modeling the data warehouse, defining security, performance, and data structure
  • Configuring and developing ETL/ELT processes in Talend DMP: integrating data from multiple sources (DB-Link, FTP, API), cleaning, transforming, and loading it into the data warehouse
  • Implementing Full-Load and Delta-Load strategies and optimizing data refresh workflows
  • Developing analytical reports and dashboards in MicroStrategy, including configuring the business-oriented semantic data layer
  • Designing and configuring a role-based data access model (Zugriffsberechtigung) at both BI and database levels
  • Participating in building the corporate reporting system (Meldewesen): understanding business needs and translating them into technical architecture
  • Consulting the customer on BI infrastructure design and optimization of business processes
What we offer
What we offer
  • Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others
  • The opportunity to change the project and/or develop expertise in an interesting business domain
  • Guarantee of professional, financial, and career growth
  • The opportunity to earn up to an additional 1,000 USD per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities
  • Access to the corporate training portal
  • Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies)
  • Certification compensation (AWS, PMP, etc)
  • Referral program
  • English courses
  • Private health insurance and compensation for sports activities
Read More
Arrow Right

Audit Director – U.S. Regulatory Reporting Transaction Testing

The Audit Director is a senior level management position responsible for contrib...
Location
Location
India , Mumbai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BA/BS or equivalent
  • Related certifications (CPA, ACA, CFA, CIA, CISA or similar) are a plus
  • Statistical, Computer Science or Computer Engineering qualifications will be an advantage
  • 15+ years of experience in a related role
  • Understanding of industry best practices and regulatory expectations for Data management (e.g. BCBS 239)
  • Knowledge of data quality software including Big Data (e.g. Paxata, Hadoop) will be an advantage
  • Detailed knowledge of substantive testing methodologies designed to assess the material accuracy of key reports, including data tracing and transaction vouching
  • Demonstrated experience in managing teams and managing integrated internal audit and assurance delivery within a matrix reporting environment
Job Responsibility
Job Responsibility
  • Development and completion (and ongoing update) of an effective audit strategy and plan (including budgets) that provides thorough, risk based substantive coverage of the data utilized in certain U.S. Regulatory Reports
  • Working closely with Product and Function Chief Auditors to ensure delivery of a plan of work that provides assurance for the accuracy of these reports
  • Interacting with U.S. regulators to provide updates and briefings on audit perspectives of the quality of the data utilized in report production
  • Contributes to strategic direction of Citi’s Internal Audit (IA) function in the establishment of reporting methodologies, organizational design and effective positioning of the function to ensure provision of independent assurance
  • Uses excellent communication, leadership and strong management skills to influence a wide range of internal audiences including respective product or, function, executive management partners and external audiences including regulators and external auditors
  • Responsible for the delivery of a high quality, value-added regulatory-required audits on time and to specification
  • Ensures the delivery of an audit reports that is complete, insightful, timely, error free and concise
  • Ensures timely delivery of high-quality comprehensive regulatory and internal audit issue validation, and, where determined appropriate, issue validation on other remediation actions, including issues arising from the external auditors, consultants and other parties
  • Contributes towards the delivery of high impact reports of IA's contributions to executive management, regulators, and Citigroup and Citibank boards' sub-committees, developing trend analyses and thematic reporting
  • Manages multiple teams of professionals
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

We are seeking an experienced Principal Data Engineer to define, lead, and scale...
Location
Location
United Kingdom , Thame; Leeds
Salary
Salary:
80000.00 - 100000.00 GBP / Year
pexa.co.uk Logo
PEXA UK
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Broad experience as a Data Engineer including technical leadership
  • Broad cloud experience, ideally both Azure and AWS
  • Deep expertise in PySpark and distributed data processing at scale
  • Extensive experience designing and optimising in Databricks
  • Advanced SQL optimisation and schema design for analytical workloads
  • Strong understanding of data security, privacy, and GDPR/PII compliance
  • Experience implementing and leading data governance frameworks
  • Proven experience leading the design and operation of a complex data platform
  • Track record of mentoring engineers and raising technical standards
  • Ability to influence senior stakeholders and align data initiatives with wider business goals
Job Responsibility
Job Responsibility
  • Design and oversee scalable, performant, and secure architectures on Databricks and distributed systems
  • Anticipate scaling challenges and ensure platforms are future-proof
  • Lead the design and development of robust, high-performance data pipelines using PySpark and Databricks
  • Define and ensure testing frameworks for data workflows
  • Ensure end-to-end data quality from raw ingestion to curated, trusted datasets powering analytics
  • Establish and enforce best practices for data governance, lineage, metadata, and security controls
  • Ensure compliance with GDPR and other regulatory frameworks
  • Act as a technical authority and mentor, guiding data engineers
  • Influence cross-functional teams to align on data strategy, standards, and practices
  • Partner with product, engineering, and business leaders to prioritise and deliver high-impact data initiatives
  • Fulltime
Read More
Arrow Right

Data Engineer, Solutions Architecture

We are seeking a talented Data Engineer to design, build, and maintain our data ...
Location
Location
United States , Scottsdale
Salary
Salary:
90000.00 - 120000.00 USD / Year
clearwayenergy.com Logo
Clearway Energy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2-4 years of hands-on data engineering experience in production environments
  • Bachelor's degree in Computer Science, Engineering, or a related field
  • Proficiency in Dagster or Airflow for pipeline scheduling, dependency management, and workflow automation
  • Advanced-level Snowflake administration, including virtual warehouses, clustering, security, and cost optimization
  • Proficiency in dbt for data modeling, testing, documentation, and version control of analytical transformations
  • Strong Python and SQL skills for data processing and automation
  • 1-2+ years of experience with continuous integration and continuous deployment practices and tools (Git, GitHub Actions, GitLab CI, or similar)
  • Advanced SQL skills, database design principles, and experience with multiple database platforms
  • Proficiency in AWS/Azure/GCP data services, storage solutions (S3, Azure Blob, GCS), and infrastructure as code
  • Experience with APIs, streaming platforms (Kafka, Kinesis), and various data connectors and formats
Job Responsibility
Job Responsibility
  • Design, deploy, and maintain scalable data infrastructure to support enterprise analytics and reporting needs
  • Manage Snowflake instances, including performance tuning, security configuration, and capacity planning for growing data volumes
  • Optimize query performance and resource utilization to control costs and improve processing speed
  • Build and orchestrate complex ETL/ELT workflows using Dagster to ensure reliable, automated data processing for asset management and energy trading
  • Develop robust data pipelines that handle high-volume, time-sensitive energy market data and asset generation and performance metrics
  • Implement workflow automation and dependency management for critical business operations
  • Develop and maintain dbt models to transform raw data into business-ready analytical datasets and dimensional models
  • Create efficient SQL-based transformations for complex energy market calculations and asset performance metrics
  • Support advanced analytics initiatives through proper data preparation and feature engineering
  • Implement comprehensive data validation, testing, and monitoring frameworks to ensure accuracy and consistency across all energy and financial data assets
What we offer
What we offer
  • generous PTO
  • medical, dental & vision care
  • HSAs with company contributions
  • health FSAs
  • dependent daycare FSAs
  • commuter benefits
  • relocation
  • a 401(k) plan with employer match
  • a variety of life & accident insurances
  • fertility programs
  • Fulltime
Read More
Arrow Right

Data Analyst - Regulatory

Guide Regulatory Reporting product strategy by connecting business, technical, a...
Location
Location
Brazil , São José dos Campos
Salary
Salary:
Not provided
adyen.com Logo
Adyen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Availability to work 3 days in person on São José dos Campos (SP)
  • 4+ years of experience as a Data Analyst or in a related role
  • Proficiency in SQL, Python, and BI tools (e.g., Looker)
  • Familiarity with big data tools is a strong advantage
  • Expert executor able to break down complex problems, prioritize effectively, and align work with strategic goals
  • Strong collaborator and communicator able to manage diverse stakeholders and translate complex insights for technical and non-technical audiences in a global team
  • Curious and experimental mindset with a drive to iterate, improve, and find better solutions
Job Responsibility
Job Responsibility
  • Take ownership of high-impact data initiatives from start to finish
  • Shape business and product strategy by using deep customer understanding to challenge assumptions and identify new opportunities
  • Translate data into a compelling vision and communicate a clear technical vision and strategy to align technical and business leaders
  • Set the standard by finding simple and scalable solutions to complex problems and establishing best practices for data use across the company
  • Act as a multiplier across engineering by unblocking other teams and mentoring colleagues through feedback and code reviews
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

The Data Engineer will build scalable pipelines and data models, implement ETL w...
Location
Location
United States , Fort Bragg
Salary
Salary:
Not provided
barbaricum.com Logo
Barbaricum
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Active DoD TS/SCI clearance (required or pending verification)
  • Bachelor’s degree in Computer Science, Data Science, Engineering, or related field (or equivalent experience) OR CSSLP / CISSP-ISSAP
  • Strong programming skills in Python, Java, or Scala
  • Strong SQL skills
  • familiarity with analytics languages/tools such as R
  • Experience with data processing frameworks (e.g., Apache Spark, Hadoop) and orchestration tools (e.g., Airflow)
  • Familiarity with cloud-based data services (e.g., AWS Redshift, Google BigQuery, Azure Data Factory)
  • Experience with data modeling, database design, and data architecture concepts
  • Strong analytical and problem-solving skills with attention to detail
  • Strong written and verbal communication skills
Job Responsibility
Job Responsibility
  • Build and maintain scalable, reliable data pipelines to collect, process, and store data from multiple sources
  • Design and implement ETL processes to support analytics, reporting, and operational needs
  • Develop and maintain data models, schemas, and standards to support enterprise data usage
  • Collaborate with data scientists, analysts, and stakeholders to understand requirements and deliver solutions
  • Analyze large datasets to identify trends, patterns, and actionable insights
  • Present findings and recommendations through dashboards, reports, and visualizations
  • Optimize database and pipeline performance for scalability and reliability across large datasets
  • Monitor and troubleshoot pipeline issues to minimize downtime and improve system resilience
  • Implement data quality checks, validation routines, and integrity controls
  • Implement security measures to protect data and systems from unauthorized access
Read More
Arrow Right

Big Data Scala Engineering Developer

The Applications Development Senior Programmer/Lead Analyst is an senior level p...
Location
Location
India , Pune; Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
  • 9+ years of experience working with Hive, Impala and Hbase, Kudu Spark for data curation/conformance related work
  • Strong proficiency in Spark for development work related to curation/conformance
  • Strong Scala developer (with previous Java background) preferred
  • Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging
  • Strong data analysis skills and the ability to slice and dice the data as needed for business reporting
  • Experience working in an agile environment with a fast paced changing requirements
  • Excellent planning and organizational skills
  • Strong Communication skills
  • Bachelor's degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation
  • Provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Interface with product teams to understand their requirements to build the ingestion pipelines and conformance layer
  • Work closely with the data ingestion team to track the requirements and drive the build out of the canonical models
  • Fulltime
Read More
Arrow Right