CrawlJobs Logo
BlackLine Logo BlackLine · IT - Software Development

Staff Data Engineer

United States, New York 193000.00 - 242000.00 USD / Year · Job Posted January 18, 2026
Apply Position
Job Link Share

Job Description

We’re looking for a Lead Data Engineer to design, build, and optimize data pipelines that power our next-generation AI-driven accounting agents. You’ll lead the development of scalable, high-performance data infrastructure while collaborating closely across teams.

Job Responsibility

  • Lead data pipeline development: Build and maintain PySpark ETL pipelines with high data quality and performance
  • Manage integrations: Establish robust connections to client data sources via APIs and tools like FiveTran, Plaid, and BlackLine’s own internal connector ecosystem
  • Ensure reliability: Monitor pipeline performance, automate testing, and validate data accuracy
  • Optimize for scale: Implement performance improvements (e.g., CDC mechanisms, indexing strategies) for large-scale datasets
  • Collaborate & innovate: Work with business stakeholders to refine data requirements and integrate cutting-edge AI and big data technologies

Requirements

  • 3+ years of experience as a Data Engineer or a similar role
  • Bachelor’s degree in Computer Science, Engineering or a related field
  • Expertise in PySpark and data transformation pipelines
  • Familiarity with AI technologies and cloud platforms (AWS, Azure) is a plus
  • Strong communication skills and a proactive, ownership-driven mindset
  • Thrive in a fast-paced, in-office-first startup environment

Nice to have

  • Understanding of data privacy and security best practices particularly in the age of AI
  • Strong analytical and problem-solving skills
  • Experience in fin-tech or financial services industry a plus

What we offer

Short-term and long-term incentive programs, based on eligibility, along with a robust offering of benefit and wellness plans

BlackLine - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Staff Data Engineer

8 matching positions

Staff Data Engineer

At YouVersion, we build technology that helps people around the world connect wi...
Location
Location
United States , Edmond
Salary
Salary:
Not provided
life.church Logo
Life.Church
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep Data Expertise
  • Staff-Level Leadership
  • Architectural Vision
  • Strategic Thinking
  • Clear Communication
  • Mission-Driven Mindset
  • Heart for Ministry
  • Programming
  • SQL Expertise
  • Data Warehousing
Job Responsibility
Job Responsibility
  • Own the Data Problem Space
  • Architect Data Platforms
  • Set Technical Standards
  • Champion Data Quality & Trust
  • Influence Across Chapters
  • Resolve Complex Issues
  • Enable Insight at Scale
  • Mentor & Develop
  • Drive Governance & Security
What we offer
What we offer
  • Paid parental leave, including maternity, paternity, and adoption leave
  • Generous employer-paid leave for the use of vacation, sick time, and other qualifying reasons
  • Innovative and comprehensive Medical, Dental, and Vision insurance that provides team members with useful resources and savings to navigate their holistic health
  • Life insurance policy provided for all staff members at 2x annual salary at no cost
  • Short-Term and Long-Term disability is covered at 100% for full-time qualified staff members
  • Comprehensive wellness and mental health benefits allow staff to proactively invest in their physical and emotional health
  • Generous 401(k) retirement plan allowing a team member to have up to 12.5% (including employee contribution, employer match, and employer discretionary contribution) contributed into their account in their first year
  • $160 annually in development dollars for team members to invest in their professional growth
  • Casual dress and work environment
  • Fulltime
Read More
Arrow Right

Staff Data Engineer

Data Idols are working with one of the best-known retail brands in the UK that a...
Location
Location
United Kingdom , London
Salary
Salary:
85000.00 - 95000.00 GBP / Year
dataidols.com Logo
Data Idols
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Azure data platforms
  • Advanced SQL skills
  • Commercial experience using Databricks and PySpark
  • Proven background building and maintaining scalable data pipelines
Job Responsibility
Job Responsibility
  • Take ownership of complex, production-grade data pipelines
  • Act as a technical leader within the data engineering team
  • Work on cloud-native solutions built on Azure and Databricks
  • Make key decisions around data processing, modelling, and performance
  • Help set best practices
  • Support other engineers
  • Influence how data engineering is done across the organisation
  • Fulltime
Read More
Arrow Right

Staff Data Engineer

As a member of the Data & BI Engineering team you will primarily focus on advanc...
Location
Location
United States , New York
Salary
Salary:
193000.00 - 242000.00 USD / Year
blackline.com Logo
BlackLine
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years as a data engineer
  • 10+ years of experience using RDBMS, SQL, Python languages
  • 10+ years of experience with ETL/ELT tools like Matillion, Cloud Data Fusion, Informatica, Talend, Airflow, SSIS
  • 8+ years of experience with BI Tools like Tableau, Power BI, Looker
  • 3+ years of experience with cloud-native architecture and data solutions such as EMR, RDS, BigQuery and RedShift
  • Strong familiarity with GCP, AWS, SQL Server, BigQuery
  • Proficient in writing advanced SQL procedures, tuning SQL execution plans
  • Demonstrated knowledge of development processes and agile methodologies
  • Strong analytical and interpersonal skills, comfortable presenting complex ideas in simple terms
  • Comfortable handling large amounts of data
Job Responsibility
Job Responsibility
  • Design and build infrastructure for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources, including data identification, mapping, aggregation, conditioning, cleansing, and analyzing
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver valuable insights
  • Effectively communicate complex technical concepts to non-technical audiences
  • Desire to automate everything
  • Maintain documentation and operational knowledge base
  • Coach and technically train junior staff on design and development standards and best practices
  • Design and implement data security and governance protocols to ensure the accuracy and reliability of data
What we offer
What we offer
  • short-term and long-term incentive programs
  • robust offering of benefit and wellness plans
  • Fulltime
Read More
Arrow Right

Staff Data Engineer

As a member of the Data & BI Engineering team you will primarily focus on advanc...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
blackline.com Logo
BlackLine
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Data Science, or a related field
  • 10+ years as a data engineer
  • 10+ years of experience using RDBMS, SQL, NoSQL, Python, Java, or other programming languages
  • 10+ years of experience designing, developing, testing, and implementing Extract, Transform and Load (ELT/ETL) solutions using enterprise ELT/ETL tools and Open source
  • 5+ years working experience with SQL and familiarity with Snowflake data warehouse, strong working knowledge in stored procedures, CTEs, and UDFs, RBAC
  • Knowledge of data integration and data quality best practices
  • Familiarity with data security and privacy regulations
  • Experience in working in a startup-type environment, good team player, and can work independently with minimal supervision
  • Experience with cloud-native architecture and data solutions
  • Strong working knowledge in data modeling, data partitioning, and query optimization
Job Responsibility
Job Responsibility
  • Provide technical expertise and leadership in technology direction, road-mapping, architecture definition, design, development, and delivery of enterprise-class solutions
  • Architect, design, develop, test, troubleshoot, debug, optimize, scale, perform the capacity planning, deploy, maintain, and improve software applications
  • Work collaboratively across the company to design, communicate and further assist with adoption of best practices in architecture and implementation
  • Deliver robust architectural solutions for complex design problems
  • Implement, refine, and enforce data engineering best practices
  • Research, test, benchmark, and evaluate new tools and technologies, and recommend ways to implement them in data platform
  • Actively participate in research, development, support, management, and other company initiatives
  • Inspire a forward-thinking team of developers, acting as an agent of change and evangelist for a quality-first culture
  • Mentor and coach key technical staff
  • Act as a conduit for questions and information flow
What we offer
What we offer
  • A technology-based company with a sense of adventure and a vision for the future
  • A culture that is kind, open, and accepting
  • A culture where continued growth and learning is empowered
  • BlackLine offers a wide variety of professional development seminars and inclusive affinity groups
  • Fulltime
Read More
Arrow Right

Staff Data Engineer

As a Staff Data Engineer, you will be a technical leader and subject matter expe...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
optimizely.com Logo
Optimizely
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience as a Data Engineer or in a similar role, with a proven track record of technical leadership and accomplishment
  • Deep expertise in data modelling, data warehousing, ETL, and data pipeline design and development
  • Mastery of SQL, Python, and other relevant programming languages
  • Extensive experience with building, testing, and deploying dbt models
  • Expert-level proficiency in AWS Big Data Technologies (S3, MWAA, ECR, ECS) and Snowflake
  • Experience with Terraform, Docker, and Kubernetes
  • Strong understanding of Engineering and Operational Excellence methodologies
  • Deep knowledge of CI/CD concepts and implementation
  • Exceptional problem-solving skills and ability to navigate complex technical challenges
  • Excellent written and verbal communication skills and ability to succinctly summarize key findings
Job Responsibility
Job Responsibility
  • Design and build end-to-end data pipelines, incorporating best practices to address a wide range of business requirements
  • Take ownership of major projects, providing technical guidance and direction to ensure successful delivery
  • Continuously evaluate and enhance the data infrastructure to ensure optimal performance, reliability, and scalability to meet the evolving needs of the business
  • Share knowledge and expertise with other data engineers, fostering professional growth and development within the team. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Python, Snowflake and AWS
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics
  • Partner with data scientists, analysts, product managers, and other stakeholders to understand their data needs and deliver solutions that empower them to achieve their goals
Read More
Arrow Right

Staff Data Engineer

Data Idols are working with one of the best-known retail brands in the UK that a...
Location
Location
United Kingdom , London
Salary
Salary:
85000.00 - 95000.00 GBP / Year
dataidols.com Logo
Data Idols
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Azure data platforms
  • Advanced SQL skills
  • Commercial experience using Databricks and PySpark
  • Proven background building and maintaining scalable data pipelines
Job Responsibility
Job Responsibility
  • Play a key role in scaling production data systems and raising engineering standards across the wider data function
  • Take ownership of complex, production-grade data pipelines and act as a technical leader within the data engineering team
  • Work on cloud-native solutions built on Azure and Databricks, making key decisions around data processing, modelling, and performance
  • Help set best practices, support other engineers, and influence how data engineering is done across the organisation
  • Fulltime
Read More
Arrow Right

Staff Data Engineer

The Staff Data Engineer role is part of the Bamboo Health Engineering Team. You ...
Location
Location
United States
Salary
Salary:
Not provided
bamboohealth.com Logo
Bamboo Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, Analytics, a related field, or equivalent experience
  • 8+ years total software and relational database development experience
  • 3+ years with a strong demonstrated ability to develop and maintain ETL solutions, ideally using Python and various Application Programming Interfaces (API)
  • 3+ years’ experience with AWS Cloud Solutions/Services
  • Experience working in an Agile environment include using ticketing software such as JIRA
  • Strong technical problem-solving abilities
  • Hands on experience maintaining databases on Redshift, PostgreSQL, MySQL or Oracle relational database systems.
  • Experience with software development using Python, Ruby, or other modern scripting languages, ideally in container solutions such as Docker or Kubernetes.
  • Proficiency with modern data stack tools such as dbt, Starburst, AWS Glue.
  • The ability to travel periodically for work.
Job Responsibility
Job Responsibility
  • Develop, debug and support ETL processes utilizing AWS services
  • Lead ideation and development of data models used for data science and analytics
  • Meet the delivery expectations of the Agile Project Management methodology
  • Maintain and optimize reports and extracts that serve as lifesaving information sources to customers
  • Create clear and concise documentation regarding technical solutions, while sharing knowledge and documentation with teammates via “Lunch and Learns”
  • Collaborate with internal and external customers to deliver modern data products
  • Explore opportunities to enhance workflows through AI or automation tools (e.g., document summarization, task routing, or data parsing).
  • Identify repetitive tasks and partner with team leads to implement scalable automation solutions.
What we offer
What we offer
  • Receive competitive compensation, including health, dental, vision and other benefits
Read More
Arrow Right

Staff Data Engineer

In the Marktplaats data and analytics teams, data is at the heart of everything ...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of hands-on experience in Software Development/Data Engineering
  • Experience with Databricks (Lakehouse, ML/MosaicAI, Unity Catalog, MLflow, Mosaic AI, model serving etc)
  • Proven experience on building cloud native data intensive applications (both real time and batch based)
  • AWS experience is preferred
  • Strong background in Data Engineering to support other Data Engineers, Back Enders and Data Scientists
  • Hands-on experience of building and maintaining Spark applications
  • Python and PySpark(Scala Spark is a plus)
  • Experienced in AWS Cloud usage and data management (automation, data governance, cost optimisation, delivering reliable & scalable data solutions)
  • Ensure data quality, schema governance and monitoring across pipelines
  • Experience with orchestrators such as Airflow, Databricks workflows
Job Responsibility
Job Responsibility
  • Independently develop and deliver high-quality features for our new Data/ML Platform
  • Refactor and translate our data products and finish various tasks to a high standard
  • Be the cornerstone of the platform’s reliability, scalability and performance
  • Work hands on with batch and streaming data pipelines, storage solutions and APIs that serve complex analytical and ML workloads
  • Encompass ownership of the self-serve data platform, including data collection, lake management, orchestration, processing, and distribution
What we offer
What we offer
  • An attractive Base Salary
  • Participation in our Short Term Incentive plan (annual bonus)
  • Work From Anywhere: Enjoy up to 20 days a year of working from anywhere
  • A 24/7 Employee Assistance Program for you and your family
  • A collaborative environment with an opportunity to explore your potential and grow
  • A range of locally relevant benefits
  • Fulltime
Read More
Arrow Right