CrawlJobs Logo
Lawrence Harvey Logo Lawrence Harvey · IT - Software Development

Senior Data Engineer

United States, New York City or Los Angeles · Job Posted June 09, 2026
Apply Position
Job Link Share

Job Description

Senior Data Engineer - Media Org (Hybrid NYC or LA). I’m working on a Senior Data Engineer search with a leading media and digital platform organization that is building out a modern cloud data ecosystem and expanding its AI-driven data capabilities. This team is focused on building and scaling a next-generation data platform supporting analytics, audience insights, machine learning, and large-scale media datasets across streaming and digital products. The role will involve designing batch and real-time data pipelines, working heavily within a Databricks environment, helping shape modern lakehouse architecture, and partnering closely with analytics, product, and data science teams. The engineering group is very collaborative and looking for someone who enjoys hands-on technical ownership while helping scale a modern data ecosystem.

Job Responsibility

  • Designing batch and real-time data pipelines
  • Working heavily within a Databricks environment
  • Helping shape modern lakehouse architecture
  • Partnering closely with analytics, product, and data science teams

Requirements

  • Strong Data Engineering experience building production data pipelines
  • Strong PySpark and SQL expertise
  • Experience with Databricks or similar Spark-based cloud platforms
  • Experience building batch and streaming pipelines
  • Experience with orchestration tools such as Airflow or similar
  • Familiarity with AWS environments, data lakes, and modern cloud data architecture
  • Experience with modern Lakehouse design patterns, including Medallion Architecture (Bronze, Silver / Gold layers) for structuring scalable and modular data pipelines
Lawrence Harvey - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Data Engineer

8 matching positions

New

Senior Data Engineer

At AO, we’re all about using data to make smarter decisions and create brilliant...
Location
Location
United Kingdom , Bolton
Salary
Salary:
Not provided
ao.com Logo
AO
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid experience in data engineering, building and maintaining data pipelines
  • Strong hands-on knowledge of AWS services like Redshift, Glue, Spectrum and Lambda
  • Confidence working with Python and TSQL
  • A good understanding of data modelling, ETL processes and data warehousing
  • Experience (or exposure to) Infrastructure as Code tools such as Terraform or CloudFormation
  • Familiarity with CI/CD pipelines and automated deployment practices
  • A natural problem solver who enjoys improving and optimising the way things work
  • Comfortable collaborating with different teams and bringing ideas to life together
  • Someone who’s keen to share knowledge and support others’ development
Job Responsibility
Job Responsibility
  • designing and building robust data pipelines that keep our data flowing smoothly and reliably, using AWS tools like Redshift, Glue, Spectrum and Lambda
  • Working closely with teams across AO, you’ll turn business needs into practical, scalable solutions that help unlock the value of our data
  • continuously improve performance, reliability and cost-efficiency across our data systems, while making sure everything is secure and compliant
  • setting up automated deployments using Infrastructure as Code and CI/CD pipelines, to troubleshooting issues and documenting your work, you’ll help keep things running seamlessly
  • share your knowledge with others in the team, helping to coach and support colleagues as we grow
What we offer
What we offer
  • 25 days holidays, plus bank holidays (increasing to 27 days after 2 years with us)
  • Pension
  • Contribute 5% of your annual salary and we'll do the same
  • Be a VIP at the AO Arena
  • discounted gym membership
  • an onsite spa
  • Help @ Hand scheme giving you access to virtual GP’s, Mental Health support and much more
  • exclusive discounts across our product range
  • Enhanced Maternity, Paternity and Adoption leave
  • 2 fully paid days a year to donate your time to any charity of your choice
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Are you a Senior Data professional who enjoys mentoring talent and designing hig...
Location
Location
Greece , Athens
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 10, 2026
Flip Icon
Requirements
Requirements
  • University degree in Computer Science, Statistics, Mathematics, or a related Quantitative field.
  • 5+ years of professional experience in Data Engineering with a mastery of MS SQL Server (T-SQL, SSIS, Performance Tuning).
  • Proven experience in mentoring or leading technical team members.
  • Exposure to VBM methodologies or a strong understanding of financial/business data modeling.
  • Hands-on experience with QlikSense or Qlikview (or similar BI visualization tools like Tableau/Power BI).
  • Excellent command of the English language.
  • A proactive leader with an analytical mindset and a passion for knowledge sharing.
Job Responsibility
Job Responsibility
  • Lead the design and implementation of robust data architectures using on-premise MS SQL Server technologies.
  • Mentor and guide junior developers, assisting them in technical design and ensuring best practices in database management and ETL processes.
  • Develop complex data models that drive strategic business decisions and high-level reporting.
  • Collaborate with business stakeholders to translate VBM methodologies into technical requirements.
  • Oversee the integration of data flows into visualization tools, ensuring data accuracy and top-tier performance.
Read More
Arrow Right
New

Senior Data Engineer

We're looking for an experienced Senior Data Engineer to lead the design, develo...
Location
Location
United Kingdom; Netherlands; Germany; Sweden , Luton; Rijswijk; Hanover; Stockholm
Salary
Salary:
Not provided
https://www.tui.com Logo
TUI
Expiration Date
June 22, 2026
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent professional experience in data engineering or software development
  • Master's degree in Computer Science, Data Science, or related field would be beneficial
  • Proven experience in data engineering and leading technical teams
  • Strong data engineering skills including SQL and Python, with experience managing codebases, CI/CD pipelines, and code reviews
  • Knowledge of cloud-based data systems such as Google Cloud Platform and cloud storage solutions like Snowflake/AWS
  • Deep understanding of data pipeline design, ETL processes, and data integration tools
  • Expertise in relational and NoSQL databases
  • Knowledge of data quality assurance methodologies
  • Excellent problem-solving, analytical, communication, and leadership skills
  • Professional certifications in cloud platforms
Job Responsibility
Job Responsibility
  • Lead the design and implementation of data pipelines and integration processes for customer and marketing data from digital sales channels
  • Design scalable ETL processes for analytics data
  • Develop data integration solutions between various platforms
  • Implement data transformation and enrichment processes
  • Establish and maintain data quality frameworks
  • Develop automated data quality checks and validation processes
  • Implement monitoring systems for data pipeline health
  • Create documentation and standards for data quality assurance
  • Collaborate with the Architect to implement technical designs
  • Translate architectural designs into implementation plans
What we offer
What we offer
  • Attractive remuneration
  • Discretionary bonus schemes
  • Generous travel benefits
  • Extensive health & well-being support
  • Flexible working
  • Access the TUI Learning Hub
  • Opportunities to work on global projects and teams
  • Local charity and sustainability initiatives
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Within COO Technology, Wells Fargo is seeking a Senior Data Engineer to help sha...
Location
Location
United States , Iselin; Charlotte; Irving
Salary
Salary:
100000.00 - 196000.00 USD / Year
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
June 11, 2026
Flip Icon
Requirements
Requirements
  • 4+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 4+ years of data management experience within Public Cloud (GCP, AWS, Azure)
  • 4+ years of hands on experience of Python or Java, plus Spark SQL for building data pipelines, libraries, and automation tooling
  • 4+ years with orchestration tools (Cloud Composer/Airflow) and CI/CD (Cloud Build, Git-based workflows) for data workloads
Job Responsibility
Job Responsibility
  • Design and implement scalable, secure data platforms on Google Cloud using managed services (BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer)
  • Build reusable frameworks and tooling (ingestion, transformation, quality, orchestration) that can be adopted by multiple product and domain teams
  • Enable self-service data consumption and governance by standardizing patterns, templates, and platform capabilities rather than one-off pipelines
  • Design logical and physical data platform architectures leveraging BigQuery, Dataflow/Apache Beam, Dataproc/Spark, Pub/Sub, and Cloud Storage
  • Define and implement standardized ingestion, transformation, and serving patterns (batch and streaming) as reusable blueprints
  • Optimize cost, performance, and reliability of GCP data workloads (partitioning, clustering, storage classes, autoscaling strategies)
  • Build opinionated data ingestion frameworks (e.g., config-driven pipelines, connectors, schema handling, error handling) on top of Dataflow, Dataproc, or Composer
  • Develop shared transformation libraries in Python/SQL/Beam (e.g., common SCD patterns, data quality checks, masking/tokenization routines)
  • Provide orchestration capabilities via Cloud Composer or Cloud Workflows with reusable DAGs/templates and CI/CD integration
  • Implement robust data modeling (dimensional, data vault, or canonical models) and semantic layers in BigQuery and related tools
What we offer
What we offer
  • Health benefits
  • 401(k) Plan
  • Paid time off
  • Disability benefits
  • Life insurance, critical illness insurance, and accident insurance
  • Parental leave
  • Critical caregiving leave
  • Discounts and savings
  • Commuter benefits
  • Tuition reimbursement
  • Fulltime
!
Read More
Arrow Right

Senior Data Engineer

Identify and implement internal process improvements for data management such as...
Location
Location
United States , Thousand Oaks
Salary
Salary:
138325.00 - 172744.00 USD / Year
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree (or foreign equivalent) in Computer Science, Information Systems, Software Engineering or related field & 2 years of experience involving the following: 1. Creating Data Quality dashboards and report results
  • 2. Coding languages including: Python, Java, or Scala
  • 3. Writing SQL using RDBMS including: Redshift, Postgres, MySQL, Teradata, or Oracle
  • 4. Software DevOps CI/CD tools including: Git, Jenkins, Linux, or Shell Script
  • 5. Using Databricks, Jupyter, or similar notebook environment
  • and 6. Working with test-driven development or software test automation.
Job Responsibility
Job Responsibility
  • Identify and implement internal process improvements for data management such as automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability
  • Collaborate with Product Owner, Release Train Engineer, and Scrum Master to plan and execute work
  • Work with Data Architects to optimize the technical environment for reuse, agility, and performance
  • Ensure data requirements for applications, data scientists, and cross-functional use cases are met
  • Maintain high performance and reliability of the system
  • Contribute to the Exploration and understanding of new tools, and techniques and propose improvements to the existing and new data pipelines
  • Collaborate cross-functionally with analysts, engineers, data scientists to identify & prioritize requirements, brainstorm solutions, and clarify business objectives for data-centric solutions to achieve continuous improvement
  • and Assist with data discovery for enhancing reports and designing efficient data stores.
What we offer
What we offer
  • stock
  • retirement
  • medical
  • life and disability insurance
  • eligibility for an annual bonus
  • other incentive compensation
  • Retirement and Savings Plan with generous company contributions
  • group medical, dental and vision coverage
  • flexible spending accounts
  • discretionary annual bonus program
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Senior Data Engineer The Opportunity We are currently partnering with several le...
Location
Location
United Kingdom , United Kingdom
Salary
Salary:
350.00 - 600.00 GBP / Day
myn.co.uk Logo
Myn
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • data engineering experience
  • python
  • sql
  • etl/elt design
  • cloud platforms
  • data modelling
  • ci/cd and iac
  • technical leadership
  • data observability
  • 5+ years of professional experience in data engineering or a related field
Job Responsibility
Job Responsibility
  • Take ownership of the end-to-end development of robust, performant, and cost-effective data pipelines, ensuring the reliability of critical data infrastructure
  • Collaborate closely with cross-functional teams, including data scientists and product managers, to translate complex business needs into high-quality data models and analytical solutions
  • Act as a technical leader, establishing engineering standards, implementing observability frameworks, and mentoring team members to drive continuous improvement
Read More
Arrow Right

Senior Data Engineer

The Senior Data Engineer enables the delivery of modern, scalable data solutions...
Location
Location
United States , Atlanta
Salary
Salary:
96000.00 - 192000.00 USD / Year
berettaclima.it Logo
Beretta Clima Italia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree
  • 5+ years of experience in data engineering
  • 5+ years of experience in open lakehouse architecture in Azure, GCP, AWS and/or Snowflake
  • 5+ years of experience creating automated data pipelines and performing data modeling
  • 5+ years of experience writing SQL, Python, and modern ETL/ELT frameworks
Job Responsibility
Job Responsibility
  • Design, build, and optimize data ingestion, transformation, and delivery pipelines that support batch, micro‑batch, and streaming workloads
  • Develop ETL/ELT workflows that integrate data from enterprise systems, operational platforms, external sources, and commercial applications
  • Implement scalable data processing patterns that support open lakehouse architectures and medallion‑layered data products
  • Ensure pipelines are reliable, maintainable, cost‑efficient, and aligned with enterprise engineering standards
  • Design data models that support analytics, reporting, and data product consumption across raw, refined, and curated layers
  • Apply medallion architecture principles to ensure data quality, reusability, and consistency across domains
  • Contribute to architectural decisions that balance performance, scalability, governance, and operational simplicity
  • Support integration of ERP and enterprise systems
  • Implement data quality checks, validation rules, and monitoring frameworks
  • Apply foundational data governance practices including lineage, metadata management, cataloging, and access controls
What we offer
What we offer
  • Health Care Benefits: Medical, Dental, Vision
  • Wellness incentives
  • Retirement Benefits
  • Time off and Leave: Paid vacation days, up to 15 days
  • paid sick days, up to 5 days
  • paid personal leave, up to 5 days
  • paid holidays, up to 13 days
  • birth and adoption leave
  • parental leave
  • family and medical leave
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

We are seeking a highly skilled and motivated Data Engineer to join our growing ...
Location
Location
Romania , Cluj
Salary
Salary:
Not provided
8x8
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering or a similar role
  • Strong proficiency in Python for data processing and scripting
  • Hands-on experience with Snowflake(or similar platform), including SQL optimization, schema design, and performance tuning
  • Proficient in dbt (data build tool) for data transformations and model management
  • Experience with Airflow (or similar workflow orchestration tools like Prefect or Luigi)
  • Solid understanding of ELT/ETL principles, data warehousing concepts, and data modeling
  • Experience with CI/CD tools and version control (e.g., Git)
  • Familiarity with cloud platforms (AWS, GCP, or Azure)
Job Responsibility
Job Responsibility
  • Build and Maintain Data Pipelines
  • Optimize Data Infrastructure
  • Collaborate Cross-functionally
  • Data Modeling
  • Implement and Enforce Data Quality Standards
  • Documentation and Best Practices
  • Fulltime
Read More
Arrow Right