Data Platform Lead Job at Social Value Portal Ltd (Birmingham)

Data Platform Lead

The Data Platform Lead is responsible for designing, building, and evolving Beaz...

Location

United Kingdom , Birmingham

Salary:

Not provided

Social Value Portal Ltd

Expiration Date

Until further notice

Requirements

Strong expertise in data platform architecture and cloud-based data solutions
Proven track record of leading technical teams and influencing stakeholders across the organisation
Demonstrated ability to design and implement enterprise-scale data platform components, working closely with Data Architecture, Enterprise Architecture and Solution Architecture teams
Hands-on experience with Confluent (Kafka), Azure Data Lake, Snowflake, and FiveTran, including data ingestion, storage, processing and consumption patterns
Strong understanding of data governance, security and compliance frameworks, enabling resilient, scalable and cost-efficient platforms
Good expertise in Data Visualisation tools such as Power BI
Proficiency in data integration, ETL/ELT pipelines, and streaming data solutions
Excellent communication and collaboration skills to work effectively with cross-functional teams
Strategic thinker with strong problem-solving and decision-making abilities
Ability to balance innovation with operational stability and cost optimisation

Job Responsibility

Define and implement the roadmap for the data platform, ensuring it meets current and future business needs
Establish platform standards, governance, and best practices for data ingestion, storage, processing, and consumption
Lead the design and implementation of core platform components leveraging technologies such as Confluent, Azure Data Lake, Snowflake, Power BI, and FiveTran
Ensure platform scalability, reliability, and security across all environments
Act as a key liaison between horizontal platform teams and vertical data product teams, enabling seamless integration and delivery
Provide guidance and support to engineering teams on platform capabilities and usage
Monitor platform performance and optimise for cost, efficiency, and resilience
Implement robust observability, monitoring, and incident management processes
Stay current with emerging technologies and industry trends to enhance platform capabilities
Drive automation and self-service capabilities for data engineering and analytics teams

Fulltime

Senior Product Designer, Data Platform - Online Data Stores and Movement Platform

We're seeking a Senior Product Designer to shape the next generation of data mov...

Location

United States

Salary:

350000.00 - 520000.00 USD / Year

DesignX Community

Expiration Date

Until further notice

Requirements

5+ years as a Product Designer (or equivalent experience)
Experience designing orchestration and/or data movement tools, databases, developer/data platform tools, or analogous complex technical products
Strong portfolio showing system‑level product work and the impact of your design leadership, including initiatives that span multiple teams
Proven track record of leading design initiatives from concept to launch
Proficient in design tools (Figma, etc.) and prototyping technologies
Strong systems thinking and ability to design scalable solutions for complex data/analytics challenges
Successfully led design strategy for complex technical products
Proven track record of influencing and aligning cross-functional partners without direct authority
Ability to navigate ambiguity, create clarity, and move complex initiatives forward with partners
Excellence in communicating design decisions to technical audiences

Job Responsibility

Shape and own design for ODS and movement platform
creating intuitive workflows that enhance data practitioner and software engineer productivity and delight
Contribute to and help drive adoption of patterns and components for operational, data‑dense UIs (runs, pipelines, lineage, diffs) that scale across the platform
Identify opportunities for innovation through research, incident analysis, and technical insight
sequence delivery for measurable impact
Create cohesive, end‑to‑end experiences with guardrails over gates (paved paths, templates, defaults) to reduce errors
Partner with product and engineering to define and improve how we measure experiences
Anticipate emerging needs and help frame design problems early
Drive end‑to‑end design for interdependent workflows
Craft and validate prototypes that effectively communicate solutions

What we offer

Health Plans
Mental Health support
401(k) Retirement Plan with employer match
Stock Option Program
Disability Programs
Health Savings and Flexible Spending Accounts
Family-forming benefits
Life and Serious Injury Benefits
Paid leave of absence programs
Flexible time off

Fulltime

Snowflake Data Platform Lead

Snowflake Data Platform Lead Position Overview Lead the design, implementation,...

Location

India

Salary:

Not provided

Codvo AI

Expiration Date

Until further notice

Requirements

7+ years enterprise data platform experience with focus on cloud-native architectures
4+ years hands-on Snowflake experience (development, administration, optimization)
Expert-level SQL and experience with Snowpark (Python/Scala)
Strong understanding of cloud data architecture, security, and governance
Experience with data integration tools and modern data stack components
Multi-source data integration including databases, APIs, files, and streaming data
Performance optimization, cost management, and warehouse scaling strategies
Data governance, compliance, and security framework implementation
Enterprise-scale data migration and platform consolidation projects
Proven track record leading technical teams and complex data initiatives

Job Responsibility

Lead the design, implementation, and optimization of enterprise Snowflake data platform solutions
Drive cloud-native data architecture initiatives
Establish scalable analytics capabilities
Design and implement enterprise-scale Snowflake data platform architectures
Establish modern data lakehouse patterns using Snowflake's cloud data platform capabilities
Define data governance, security, and access control frameworks
Lead platform assessments, optimization initiatives, and strategic planning
Architect robust data ingestion pipelines using Snowpipe, external stages, and partner integrations
Design efficient ELT processes using Snowflake SQL, Snowpark, and Python/Scala
Implement data sharing capabilities, marketplace integrations, and cross-cloud connectivity

Fulltime

Azure Data Platform Lead

Lead the design, implementation, and optimization of enterprise-scale Azure data...

Location

India

Salary:

Not provided

Codvo AI

Expiration Date

Until further notice

Requirements

7+ years Azure data platform experience (Data Factory, Synapse Analytics, SQL Database, Storage)
Expert-level SQL, Python, and experience with Apache Spark (PySpark/Scala)
Strong understanding of data architecture patterns, data modeling, and distributed systems
Experience with Azure DevOps, ARM templates, and infrastructure automation
Knowledge of data governance tools and frameworks (Microsoft Purview preferred)
Hands-on experience with modern data stack components and cloud-native architectures
RESTful API integration, real-time streaming, and batch processing systems
Enterprise data warehouse and analytics platform implementation
Performance tuning, cost optimization, and capacity planning experience
Proven ability to lead technical teams and mentor junior engineers

Job Responsibility

Design and implement scalable data platform architectures using Azure services (Synapse, Data Factory, Fabric, SQL Database)
Establish data lakehouse and data warehouse solutions with medallion architecture patterns
Define data governance frameworks, security protocols, and compliance standards
Lead platform evaluations, vendor selections, and technology roadmap planning
Architect data ingestion pipelines from diverse sources including databases, APIs, files, and streaming systems
Design and optimize ETL/ELT processes using SQL, Python, Spark, and Azure native services
Implement data quality frameworks, monitoring, and alerting systems
Establish CI/CD pipelines for data workflows and infrastructure as code
Design seamless integrations with BI tools, analytics platforms, and downstream systems
Optimize performance, cost, and scalability through automated resource management

Fulltime

Sr Data Platform Lead

At Amgen, if you feel like you’re part of something bigger, it’s because you are...

Location

India , Hyderabad

Salary:

Not provided

Amgen

Expiration Date

Until further notice

Requirements

Master's degree OR Bachelor's degree in computer science or engineering field and 8 to 13 years of relevant experience
Strong hands‑on experience with various capabilities of Databricks, from Compute to Storage and from Unity Catalog to Data Engineering to BI and AI/ML capabilities, with a focus on governance and enterprise enablement
Proven hands‑on experience with cloud platforms, with strong preference for AWS (experience with Azure or GCP also acceptable)
Experience leading Data Quality platform initiatives (e.g., Ataccama, Monte Carlo), including tool evaluation, implementation, enterprise-wide adoption, and integration with enterprise DQ solutions
Experience owning and managing Databricks platform environments, including workspace architecture, environment strategy (dev/test/prod), and lifecycle management at scale
Proven ability to establish and enforce platform standards and operating models, including cluster policies, cost management, and workload orchestration frameworks
Strong focus on platform enablement and developer experience, including building reusable frameworks, defining best practices, and supporting engineering teams in adopting the platform effectively
Exposure to AI/ML capabilities on Databricks, including enabling AI‑driven features or accelerating adoption of AI‑assisted engineering practices
Solid knowledge of SQL and relational / dimensional data modelling, sufficient to support platform integrations, governance, and observability use cases
Experience working with core AWS services such as EKS, EC2, S3, Lambda, Glue, EMR, RDS, and Redshift/Spectrum, particularly in platform or shared‑services contexts

Job Responsibility

Act as a platform lead for delivery of data platform capabilities that enable next-gen data platform architecture, with a strong focus on Databricks platform and DQ platform features and services
Evaluate and enable Databricks platform capabilities through technical assessments and proof‑of‑concepts (PoCs), ensuring alignment with next-gen data platform architectural patterns and enterprise standards
Design, build, and productionize reusable platform frameworks, accelerators, and reference implementations that can be leveraged by next-gen data platform delivery teams (excluding ownership of data pipeline architecture or implementation)
Enable data governance, metadata layer, and data bundle capabilities by designing and implementing platform‑level integrations between Databricks and Collibra, Amgen’s enterprise data governance platform
Build platform‑level tooling and automation to support proactive governance, cost optimization, and best‑practice enforcement across Databricks and related data platform services
Define and enable platform observability capabilities, including KPIs, metrics, and telemetry for monitoring performance, usage, reliability, and cost of Databricks services
Identify and implement governed self‑service platform capabilities for data engineers through self-service portal, using Python‑based microservices deployed on Docker and Kubernetes
Lead user enablement and adoption initiatives, including onboarding content, guided learning experiences, workshops, and best‑practice sharing for the Databricks user community
Drive engineering excellence and adoption of AI across platform capabilities and solutions built, promoting modern engineering practices, automation, and responsible use of AI‑driven features
Enable key business programs and strategic initiatives by translating initiative‑driven requirements into scalable, reusable data platform capabilities, in alignment with next-gen data platform principles

Fulltime

Equities Data Platform Lead

We are seeking a strategic and hands‑on Technology Leader to define and execute ...

Location

United Kingdom , London

Salary:

Not provided

Barclays

Expiration Date

Until further notice

Requirements

Expertise in data engineering, platform development, or quantitative technology, including in leadership roles
Deep experience in capital markets data - market data, trading systems, risk, or quantitative research platforms
Strong technical foundation in time-series databases (KDB+/Q preferred), Python, and modern data stack (Kafka, Spark, Iceberg, cloud)
Track record of building and scaling high-performing engineering teams
Experience delivering self-service data platforms for technical users (quants, developers)
Excellent stakeholder management - able to translate between business needs and technical execution

Job Responsibility

Define and execute the multi-year technology strategy for the Equities Data Platform
Lead, grow, and mentor a cross-functional team of 10-15+ engineers (KDB developers, data engineers, platform engineers)
Own the end-to-end delivery of platform capabilities including APIs, SDK, MCP/AI integration, and dashboards
Partner with quant research, trading, and risk stakeholders to translate business needs into scalable technical solutions
Drive adoption of modern data architecture patterns (event-driven, lakehouse, real-time + historical)
Establish production-grade operations: SLAs, monitoring, support models, data quality frameworks
Manage vendor relationships and build-vs-buy decisions across the data stack
Represent the platform to senior technology and business leadership
Provision of guidance and expertise to engineering teams to ensure alignment with best practices and foster a culture of technical excellence
Contribution to strategic planning by aligning technical decisions with business goals, anticipating future technology trends, and providing insights to optimize product roadmaps

What we offer

Competitive holiday allowance
Life assurance
Private medical care
Pension contribution

Fulltime

Lead Data Platform Engineer

Build the foundation of data-driven transformation. At Riverflex, we design and ...

Location

Netherlands , Amsterdam

Salary:

Not provided

Riverflex

Expiration Date

Until further notice

Requirements

6+ years of experience in data engineering or data infrastructure roles
Strong proficiency in Python, SQL, and distributed data frameworks (e.g., Spark, Kafka, Airflow)
Proven experience building data platforms in a cloud-native environment (Azure preferred)
Deep understanding of data lakehouse architectures and modern data warehousing (e.g., Databricks)
Hands-on experience with DevOps practices for data (CI/CD, IaC, Terraform, Docker)
Strong understanding of data governance, privacy, and compliance frameworks
Comfortable working in fast-paced, cross-functional Agile teams
Excellent communication and stakeholder management skills

Job Responsibility

Architect and maintain end-to-end data platforms across cloud environments (Azure, Databricks)
Design and implement secure, scalable, and automated data pipelines
Collaborate with analytics, product, and engineering teams to translate business needs into data solutions
Own data platform reliability, performance, monitoring, and incident response
Implement and champion best practices in data modelling, governance, testing, and documentation
Mentor junior engineers and help shape a high-performing data engineering team
Evaluate and integrate new technologies to improve data stack performance, scalability, and cost-efficiency
Build reusable tooling, components, and internal frameworks for data pipeline development
Ensure compliance with data privacy, protection, and security regulations (e.g. GDPR)

What we offer

25 days off per year plus closure between Christmas and New Year's
Flexible remote work from abroad options for up to 6 weeks per year
Learning & Development budget, including full access to Udemy courses
Classpass membership to support well-being
Latest tech & tools, including home office budget and professional software subscriptions
Equity share scheme to give long-term team members ownership in Riverflex
Annual company trips to celebrate successes together

Lead Data Engineer (Platform)

As a Lead Data Engineer (Platform), you are passionate about engineering excelle...

Location

North Macedonia

Salary:

Not provided

Valtech

Expiration Date

Until further notice

Requirements

Strong proficiency in Python for building frameworks, automation tooling and reusable components
Hands-on experience with Databricks (including notebooks, workflows, jobs and Unity Catalog)
Strong SQL skills and experience with distributed processing frameworks such as Apache Spark
Deep experience with dbt Core, including project structure, models, tests, macros and deployment at scale
Proven experience designing and maintaining CI/CD pipelines (e.g. GitHub Actions, Azure DevOps or GitLab CI)
Experience with data engineering platform design, including scalable pipeline and workflow architectures
Strong understanding of software engineering principles (DRY, SOLID, modular design)
Experience working with version control systems and modern Git workflows
Experience with cloud platforms (preferably AWS) and infrastructure-as-code concepts (e.g. Terraform)
Experience implementing automated testing strategies (unit, integration, data quality)

Job Responsibility

Design, build, and maintain scalable data engineering frameworks and platform utilities used across engineering teams
Develop reusable patterns, templates, and abstractions to standardise and accelerate delivery
Define and evolve platform architecture decisions, ensuring scalability, maintainability and consistency
Design and implement CI/CD pipelines and automation frameworks to improve engineering velocity
Define and enforce engineering standards for testing, code quality, deployment and documentation
Identify and eliminate manual or repetitive processes through automation and tooling improvements
Integrate AI-assisted development tools into engineering workflows to improve productivity
Develop and maintain AI engineering assets such as coding guidelines, prompt frameworks and reusable agent configurations
Lead the development and operational support of core data transformation frameworks (including dbt Core at enterprise scale)
Investigate and resolve framework-level issues, including deployment failures, dependency conflicts and production incidents

What we offer

Private health insurance
Education program
Wellbeing program
Free beverages
Events
Competitive conditions
Challenging projects
Cool colleagues
Honest feedback

Fulltime

Select Country

Data Platform Lead

Job Description

Job Responsibility

Requirements

Nice to have

Looking for more opportunities?

Data Platform Lead

Data Platform Lead

Senior Product Designer, Data Platform - Online Data Stores and Movement Platform

Snowflake Data Platform Lead

Azure Data Platform Lead

Sr Data Platform Lead

Equities Data Platform Lead

Lead Data Platform Engineer

Lead Data Engineer (Platform)

Our AI answers in your language