CrawlJobs Logo

Senior Squad Lead – Data Engineering

United Kingdom, Newcastle Employment contract 130000.00 GBP / Year · Job Posted May 19, 2026
Apply Position
Job Link Share

Job Description

As Senior Squad Lead – Data Engineering, key responsibilities will include: Leading a pod/squad of 6 Data Engineers building data intensive application and pipelines. You’ll have broad experience in platform, deployment and hosting (AWS, Azure or GCP), as well as tools like Airflow, Spark and Databricks. You’ll be working on a range of defence applications from data analytics and Intelligence platforms, defence AI, drones to command-and-control systems.

Job Responsibility

  • Leading a pod/squad of 6 Data Engineers building data intensive application and pipelines
  • Working on a range of defence applications from data analytics and Intelligence platforms, defence AI, drones to command-and-control systems

Requirements

  • Leading a pod/squad of 6 Data Engineers building data intensive application and pipelines
  • Broad experience in platform, deployment and hosting (AWS, Azure or GCP), as well as tools like Airflow, Spark and Databricks
  • Curious leader, with high EQ, who enjoys solving stakeholder problems
  • Track record of performant pod or squad leadership
  • Must be eligible for or already hold SC clearance
  • Sole UK nationals only

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Squad Lead – Data Engineering

8 matching positions

Senior Squad Lead – Application Development

You've spent years shipping code at scale. You're exceptional at it. But somewhe...
Location
Location
United Kingdom , Newcastle
Salary
Salary:
130000.00 GBP / Year
t2mresourcing.com Logo
T2M Resourcing
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Leading a pod/squad of 6 developers on a range of applications development, primarily back-end development
  • Broad experience in platform, deployment and hosting (AWS or Azure), SQL database experience and a range of web frameworks exposure as well as API design and development
  • C#, Java or Python and their associated frameworks
  • Curiosity as a leader, with high EQ
  • Track record of performant pod or squad leadership
  • Sole UK nationals only
  • Eligible for or already hold SC clearance
Job Responsibility
Job Responsibility
  • Leading a pod/squad of 6 developers on a range of applications development, primarily back-end development
  • Working on a range of defence applications from data analytics and Intelligence platforms, defence AI, drones to command-and-control systems
  • Solving complex engineering problems with brilliant people
What we offer
What we offer
  • Highly competitive salary, without the London cost of living eating most of it
  • Fulltime
Read More
Arrow Right

Digital Software Engineering Senior Group Manager – Head of Quality & Performance Engineering

We are seeking a visionary and experienced Digital Software Engineering Senior G...
Location
Location
India , Chennai; Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years of relevant experience, with significant time in a product line management, e-commerce, or strategic planning role
  • Proven track record of managing the full SDLC for large-scale, complex software projects and succeeding in delivering high-quality technology products/services in a high-growth environment where priorities shift rapidly
  • Extensive experience in designing and implementing CI/CD pipelines and automated testing frameworks
  • First-class leadership, influencing, and talent management skills, with significant experience managing and developing a Software Engineering Team
  • Ability to use hard data and metrics to back up assumptions and develop business cases
  • Deep understanding of various testing methodologies, including performance, functional, and non-functional testing
  • Strong knowledge of agile development methodologies (Scrum, Kanban) and modern software architecture patterns
  • Familiarity with AI/ML concepts and their application in software development is highly desirable
  • Excellent communication and negotiation skills, with experience negotiating internally at a senior level
  • Bachelor’s/University degree required
Job Responsibility
Job Responsibility
  • Lead an AI-first testing strategy to transform quality engineering across applications and platforms
  • Leverage AI to generate test cases, predict risks, accelerate defect detection, and enable synthetic data generation for comprehensive testing
  • Implement AI-powered solutions & automation for functional, integration, smoke, and performance testing, as well as self-healing automation
  • Enable developers to incorporate testing as part of the development lifecycle, including integration and smoke tests within the pipeline
  • Maximize test coverage and reliability by leveraging AI tools and techniques
  • Drive the adoption of autonomous, self-healing testing in the code and deployment pipeline to enhance speed, quality, and release confidence
  • Synthetic test data management
  • Oversee the end-to-end Software Development Lifecycle (SDLC), implementing best practices for agile development, continuous integration, and continuous delivery (CI/CD)
  • Design, build, and manage a highly automated testing pipeline that enables rapid, high-quality releases
  • Champion a "shift-left" approach to quality, embedding testing throughout the development lifecycle
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Ready to lead data engineering that powers critical financial decisions at scale...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
edfenergy.com Logo
EDF UK
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Experience leading small to medium sized engineering teams within agile delivery environments
  • Strong expertise in at least one server-side language such as Python, Java, Kotlin or NodeJS
  • Knowledge of serverless, event-driven, and loosely coupled architectures
  • Experience designing and integrating REST APIs and third-party services
  • Commercial experience working with React or React Native and state management libraries
  • Strong experience with CI/CD tooling such as Jenkins, GitHub or Terraform
  • Experience applying test-driven development or behaviour-driven development practices
  • Proven experience working within the energy industry
  • Ability to communicate complex technical concepts to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Leading the day-to-day engineering capability within the Finance Data Squad
  • Delivering scalable data products and software components aligned to business priorities
  • Driving quality through code reviews, testing practices, and engineering standards
  • Mentoring and developing engineers to build capability and performance
  • Collaborating with product owners, architects, and stakeholders to deliver value-focused solutions
What we offer
What we offer
  • Competitive salary
  • Potential for an annual bonus
  • Market-leading pension scheme
  • Customisable benefits including electric vehicle leasing
  • Discounted gym membership
  • Life assurance
  • Tech vouchers
  • Experience days
  • Fulltime
Read More
Arrow Right
New

Senior Engineering Manager

EverCommerce [Nasdaq: EVCM] is a leading service commerce platform, providing ve...
Location
Location
Canada
Salary
Salary:
175000.00 - 195000.00 CAD / Year
evercommerce.com Logo
EverCommerce
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience leading engineers as their direct manager in a product development environment, preferably managing teams that span multiple technology stacks
  • 5+ years of professional industry experience as a software developer working in agile teams
  • A successful record of mentoring and growing other engineers during your years of experience
  • A proven ability to take ownership of software projects, from scoping and estimation all the way to being live in production
  • You know how to join and partner with Product Management to experiment, iterate, and ship fast for customers
  • The ability to communicate clearly and concisely about deeply technical topics in an easy-to-understand way
  • You hold strong opinions about how to build great software and products but are receptive to the views of others
  • you know when to be flexible and when to hold steady
  • You are an expert in agile software development processes, and know what it takes to operate high performing engineering squads
Job Responsibility
Job Responsibility
  • Leadership: You have the ability to guide a team by example. As a leader on our development team, you are able to instill the values of kindness, quality, and ownership in the people around you and provide feedback on how to improve as a team
  • Teamwork: Many of the problems we encounter require insight from many parts of the business. Your ability to coordinate and communicate with your peers both in and out of engineering is essential to our success
  • Delivery Focused: You know that a project is only done once it's delivered to customers. You are able to guide your teams to set clear objectives, continuously communicate up-to-date delivery timelines, and remove roadblocks
  • Architecture: You have a strong understanding of the building blocks of a robust and scalable system. You are able to dissect business problems into well-designed systems with the help of your engineers. You have the experience to know what to build and the discipline to know what not to do
  • CS Fundamentals: You have an understanding of algorithms, data structures, design patterns and data storage technologies. You are able to select the right tool for the right job
  • Passion: Hard problems are not solved overnight. It takes a special kind of attitude and hunger to disrupt an entrenched industry. Your passion is what you share with every teammate at Joist. Passion for technology, passion for working as a team, passion for change, and passion for building an industry revolutionizing product
What we offer
What we offer
  • Flexibility to work where/how you want within your country of employment – in-office, remote, or hybrid
  • Robust wellness benefits, including an annual wellness stipend
  • Flexible and generous (FTO) time-off
  • Employee Stock Purchase Program
  • Registered Retirement Savings Plan (RRSP) with 4% company match
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

You will join a team of data scientists developing the next generation of Genius...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
geniussports.com Logo
Genius Sports
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A BSc, MSc or PhD in Data Science, Mathematics, Computer Science, Computational Statistics, Machine Learning or other STEM subject
  • Expert understanding of probability and statistics fundamentals
  • Proficiency with Python or other scripting/programming languages (R, Matlab, etc)
  • Expertise in a broad range of data science / machine learning algorithms (Monte Carlo simulation, neural networks, logistic regression, random forest, etc.) with a proven track record of delivering solutions to complex problems
  • Ability to bring clarity to complex domains, rapidly developing a deep understanding and challenging unclear requirements
  • Mentoring of other team members, helping them develop their skills and deliver effectively
  • Curiosity and strong desire to learn and improve
  • Social skills, being able to act as a facilitator, can balance enabling others with individual contributions
  • Time management and asynchronous communication skills relevant for a geographically diverse engineering organization
  • Enthusiasm and ability to work collaboratively within a team
Job Responsibility
Job Responsibility
  • Join a team of data scientists developing the next generation of Genius Sports’ market leading sports models
  • Prototype, implement, evaluate and optimize algorithms to calculate the probabilities of sporting outcomes
  • Play a major role in developing and implementing predictive models across all major sporting codes
  • Join a specially formed, highly skilled team delivering an innovative & intelligent product
  • Form part of a multi-disciplinary Agile team of Software Engineers, Data Scientists, QA Engineers and a Product Manager
  • Work closely to the fundamental principles of continuous delivery and empowered, high-performing teams
  • Operate in a squad model to allow focus on the business top priorities
  • Collaborate with high calibre engineers and deliver smart solutions with an autonomous & performance focused approach
What we offer
What we offer
  • Competitive salary and range of benefits
  • Committed to supporting employee wellbeing and helping you grow your skills, experience and career
  • Fulltime
Read More
Arrow Right

Delivery Lead (Data)

As a Data Delivery Lead, you will be responsible for the predictable, transparen...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
collinsongroup.com Logo
Collinson
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience in delivery management, scrum leadership or agile project management within data engineering, integration or cloud platform teams
  • Good understanding of modern data platform work, such as data pipelines, integrations, cloud services, observability, incidents, operational support and platform improvement work
  • Strong command of agile delivery practices, backlog management, sprint planning, dependency management and risk control
  • Comfortable working with senior engineers and technical leaders, challenging assumptions constructively without taking over technical ownership
  • Able to operate in an environment where delivery work spans both BAU/service support and roadmap change
  • Able to effectively support and coach squad members at various levels of seniority and familiarity with agile ceremonies
  • Strong stakeholder management, communication and organisational skills
  • Experience with Aha, Jira or similar delivery tooling
  • Able to act with ownership, pace and judgement in a cross-functional squad, including moments where the role needs to operate almost like a product owner
Job Responsibility
Job Responsibility
  • Own and run the squad delivery cadence, including stand-ups, planning, refinement, review, retrospective and quarterly planning activities
  • Partner with the Data Platform Manager and Principal Engineer to translate priorities into epics, stories, milestones and sprint plans
  • Maintain a clear, prioritized and realistic backlog, ensuring at least two sprints of ready work and strong hygiene in work management systems (Aha and Jira)
  • Drive delivery of a mixed portfolio of BAU support, operational improvements and new features, helping the squad make good trade-offs across urgent support, technical debt and roadmap commitments
  • Track progress, milestones, risks, issues, dependencies, capacity and delivery health, and provide clear reporting and escalation where required
  • Facilitate cross-team coordination with business stakeholders, other engineering squads and analytics teams to remove blockers and keep delivery moving
  • Support scope clarification, acceptance criteria and prioritisation decisions, stepping into light product-owner responsibilities where needed
  • Help improve ways of working, planning quality and delivery predictability across the squad and, where capacity allows, across wider data initiatives
  • Fulltime
Read More
Arrow Right

Pyspark Big Data Senior Developer - Vice President

We are building an A-team of highly skilled and autonomous engineers, and we are...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of extensive, hands-on experience as a Senior Big Data Developer, with a strong emphasis on PySpark and the Apache Spark ecosystem, operating as a player/coach
  • Expert proficiency in Python, with a proven track record of developing robust, scalable, and high-performance PySpark applications for large-scale data processing
  • Deep understanding and extensive hands-on experience with Apache Spark (Spark Core, Spark SQL, Spark Streaming) and its ecosystem
  • Experience with distributed computing frameworks such as Hadoop (HDFS, YARN)
  • Expert proficiency in SQL and extensive experience with data warehousing concepts and technologies (e.g., Hive, Snowflake, Redshift, Databricks SQL)
  • Proven experience with various data storage formats (e.g., Parquet, ORC, Avro) and data lake solutions (e.g., Delta Lake, Iceberg)
  • Experience with NoSQL databases (e.g., MongoDB, Cassandra, HBase) is a significant plus
  • Strong experience with Apache Kafka for building real-time data pipelines and event-driven architectures
  • Demonstrated experience with big data services on major cloud platforms (e.g., AWS EMR/Glue/Redshift, Azure Databricks/Data Factory/Synapse, GCP Dataflow/Dataproc/BigQuery) is highly desirable
  • Proven effectiveness with AI coding tools (e.g., Claude Code, Codex, Antigravity) is a mandatory requirement
Job Responsibility
Job Responsibility
  • Operate end-to-end in the design, development, and implementation of robust big data solutions, ensuring optimal performance, scalability, data quality, and security
  • Collaborate closely within small, co-located squads (4-7 person teams), fostering high communication and low coordination overhead, to translate complex business requirements into technical specifications for big data processing and analytical solutions
  • Act as a player/coach within the team, mentoring junior members and leading by example in the development of efficient and innovative big data architectures
  • Design, develop, and optimize large-scale data pipelines using PySpark for data ingestion, transformation, and aggregation, always with an eye towards efficiency and domain relevance
  • Implement and manage real-time data streaming and event-driven architectures using technologies like Apache Kafka
  • Design and implement sophisticated data warehousing solutions and dimensional models for efficient data storage and retrieval, ensuring alignment with business needs
  • Work with various distributed data storage technologies, including distributed file systems (e.g., HDFS, S3) and NoSQL databases (e.g., MongoDB, Cassandra), selecting the right tool for the right problem
  • Implement efficient data processing and storage strategies to optimize the performance and scalability of big data applications, with a strong focus on the 'why' behind the technology choices
  • Champion best practices in software development, including rigorous code reviews, implementing comprehensive testing, and supporting continuous integration and continuous deployment (CI/CD) pipelines
  • Demonstrate high autonomy and agency in driving projects forward, making informed decisions, and proactively identifying areas for improvement
  • Fulltime
Read More
Arrow Right

Senior Data & Insights Analyst

As Flight Centre Travel Group’s (FCTG) Senior Data & Insights Analyst you will d...
Location
Location
Australia , Brisbane
Salary
Salary:
Not provided
fctgcareers.com Logo
Flight Centre Brand
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in product and customer analytics
  • 3+ years of full-time working experience in quantitative analysis roles
  • Experience using relational databases and big data via writing performant queries in SQL against multi-terabyte and billion row datasets in Azure Data Lake, EDW, AWS or Hadoop environments
  • Experience with modern web analytics tools (Adobe analytics, Google Analytics, Mixpanel, etc.)
  • Experience using modern visualisation tools (Power BI, Tableau, Looker, Qlik)
  • Solid experience hiring, building, mentoring and leading a team
  • Experience in a relevant area – travel, E-commerce, or technology is a strong plus
  • Excellent oral and written skills to communicate complex issues and influence others internally and externally
  • Strong interpersonal skills and ability to gain the respect of senior management and external executives and partners
  • Excellent quantitative, analytical and critical thinking skills
Job Responsibility
Job Responsibility
  • Extract data from multiple data sources and combine them into the required datasets for model building or analytics
  • Conduct exploratory data profiling techniques, product crosstabs, common summary descriptive statistics, etc.
  • Pick analytically valid approaches, appropriate in terms of level of effort, favouring iterative delivery that solve for the objective, not the ask
  • Demonstrate understanding of business domain and can recommend model changes, continuously evolving information and requirements
  • Become knowledgeable in visualisation tools (Power BI), creating complex calculations using advanced features
  • Clearly and confidently articulate decision-making rationale, solutions, methodologies and frameworks to team members and both technical and non-technical partners
  • Leverage data to shape your product squad's strategy, providing support and/or leadership wherever needed
  • Play a critical role in attacking opaque, unstructured problems
  • develop core analytic frameworks that shape the way the company thinks about our business
  • Own projects that span disparate groups with varying levels of technical fluency from end-to-end
What we offer
What we offer
  • Salary: generous base salary package up to $140 k (+ super), based on experience
  • Culture: inclusive company, team culture, certified Great Place To Work® Australia New Zealand Pty Ltd
  • Our People: Equal Opportunity Employer
  • Development: Individualised Learning & Development pathway options
  • Access to 'LinkedIn Learning' for ongoing skills development: over 24,500 courses in over 20 languages
  • Exclusive Staff Discounts: accessible via employee-only portal with 500+ of Australia’s leading retailers, health and wellness discounts, financial planning advice, employee share plan and more
  • Travel Discounts: including family and friends - on flights, hotels, tours, cruises, travel insurance and more
  • Brightness of Future: career opportunities in a network of brands and businesses across the globe, promote from within
  • Corporate Health Discounts: access exclusive discounts on health insurance plans for you and your family with partner BUPA, access to internal gym
  • Mental Health: Support and Employee Assistance Program for staff and family
  • Fulltime
Read More
Arrow Right