CrawlJobs Logo
Solomon Page Logo Solomon Page · IT - Software Development

Sr. Data Engineer

United States, Boston Employment contract · Job Posted June 16, 2026
Apply Position
Job Link Share

Job Description

We are seeking a highly skilled Data Engineer with strong backend engineering expertise and solid finance/analytics domain knowledge. This role is focused on building, optimizing, and maintaining scalable data pipelines, improving data architecture, enhancing operational reliability, and driving data quality initiatives. The ideal candidate will have extensive experience with Python, PostgreSQL, AWS services, and modern data engineering practices, along with exposure to AI/RAG-based solutions. Contract Duration: 6+ Months Rate Range: $50-60/hr on W2

Job Responsibility

  • Design, develop, optimize, and maintain scalable data pipelines and ETL/ELT workflows
  • Refactor and enhance existing data processing frameworks to improve performance and reliability
  • Perform extensive data validation, testing, and quality assurance across data platforms
  • Optimize SQL queries, database structures, and table performance within PostgreSQL environments
  • Implement and support backend services and APIs using Python and FastAPI
  • Develop and maintain data solutions leveraging AWS services including EKS and Lambda
  • Work with Parquet files and large-scale datasets to support analytics and reporting requirements
  • Improve overall data architecture, operational stability, and system performance
  • Maintain detailed task tracking, status reporting, and execution transparency through Excel-based project tracking
  • Proactively identify risks, communicate project status, and manage timelines effectively
  • Collaborate with business, analytics, and engineering teams to support data-driven initiatives
  • Contribute to AI and Retrieval-Augmented Generation (RAG) use cases and data integrations

Requirements

  • 6+ years of experience in Data Engineering, Backend Engineering, or related roles
  • Strong hands-on experience with Python development
  • Extensive experience with PostgreSQL and advanced SQL optimization
  • Experience building and maintaining ETL/ELT pipelines and data integration workflows
  • Strong knowledge of data engineering concepts, data modeling, and data architecture
  • Experience working with Parquet file formats and large-scale datasets
  • Hands-on experience with AWS services including EKS, Lambda, and cloud-native architectures
  • Experience developing APIs and microservices using FastAPI or similar frameworks
  • Strong data testing, validation, troubleshooting, and performance tuning skills
  • Excellent organizational skills with the ability to manage timelines, priorities, and status reporting
  • Strong communication skills and ability to work independently in a remote environment
  • Must be located within the EST time zone

Nice to have

  • Experience within financial services, investment management, analytics, or related domains
  • Experience with AI solutions and Retrieval-Augmented Generation (RAG) frameworks
  • Familiarity with machine learning data pipelines and AI-powered applications
  • Experience working in highly data-intensive environments
  • Strong understanding of operational monitoring and reliability practices

What we offer

  • medical
  • dental
  • 401(k)
  • direct deposit
  • commuter benefits
Solomon Page - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Sr. Data Engineer

8 matching positions

Sr. Data Engineer

The Senior Data Engineer supports enterprise data unification and analytics init...
Location
Location
United States , Deerfield
Salary
Salary:
Not provided
tier4group.com Logo
Tier4 Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience designing, developing, and supporting data pipelines (ETL/ELT) that integrate data from multiple systems
  • Strong SQL skills, including writing and optimizing complex queries, joins, and stored procedures in Microsoft SQL Server or comparable relational databases
  • Hands-on experience with Azure Synapse Analytics, Azure Data Factory, or similar cloud-based data warehousing and integration platforms
  • Experience working with large datasets in cloud or hybrid data environments
  • Working knowledge of data modeling concepts, including fact and dimension tables and schema design for analytics and reporting
  • Experience supporting business intelligence tools, particularly Microsoft Power BI, including datasets and dataflows
  • Ability to use scripting or programming languages such as SQL, Python, or PySpark for data transformation and automation
  • Approximately 3–5 years of professional experience in data engineering, analytics engineering, or a related role
  • Approximately 1–3 years of experience in data modeling or database design for analytics use cases
  • Undergraduate degree or equivalent experience in Computer Science, Information Systems, or a related field
Job Responsibility
Job Responsibility
  • Design, build, and maintain automated ETL/ELT data pipelines that ingest and transform data from Microsoft Dynamics 365 and legacy systems into an Azure Synapse data lake and enterprise data warehouse
  • Monitor, optimize, and support data pipeline performance to ensure reliable, timely data refreshes and efficient resource utilization
  • Implement data quality checks, validation rules, and cleansing processes to ensure data accuracy, consistency, and readiness for enterprise-wide analysis
  • Support data unification efforts by integrating data from multiple business units and systems without altering source system integrity
  • Contribute to the design and evolution of enterprise data models, including dimensional and star schemas, to support standardized reporting and unified business definitions
  • Define and maintain master data structures and relationships that enable analysis across both ERP and non-ERP data sources
  • Prepare curated and optimized datasets for business intelligence and analytics use cases, including Power BI dashboards and self-service reporting
  • Write and optimize SQL queries and develop new pipeline components to support reporting, analytics, and ad hoc data needs
  • Collaborate with business analysts, business intelligence developers, ERP specialists, and other stakeholders to translate reporting and analytics requirements into technical solutions
  • Apply data engineering and analytics best practices, including version control, documentation, code review, and performance tuning
  • Fulltime
Read More
Arrow Right

Sr. Data Engineer

We are seeking an experienced candidate to drive our data engineering initiative...
Location
Location
United States , Las Vegas
Salary
Salary:
80000.00 - 90000.00 USD / Year
techmahindra.com Logo
Tech Mahindra
Expiration Date
June 30, 2026
Flip Icon
Requirements
Requirements
  • 7-8+ years of hands-on experience in data engineering or related fields
  • Strong proficiency in: Apache Airflow (DAG development, workflow orchestration)
  • Snowflake
  • Advanced SQL (complex queries, performance tuning)
  • Apache Kafka (streaming, event-driven architectures)
  • API development and integration (REST/SOAP)
  • Proven experience leading technical teams (3+ years preferred)
  • Strong problem-solving and communication skills
  • Experience with Agile/Scrum methodologies
  • A Bachelor's or Higher Degree is the minimum entry required for the position
Job Responsibility
Job Responsibility
  • Lead and mentor a team of 5-6 data engineers, fostering technical growth and collaboration
  • Design and implement scalable data pipelines using Apache Airflow
  • Understanding of Snowflake architecture
  • Integrate and maintain real-time streaming applications using Apache Kafka / Spark Streaming
  • Build and integrate APIs across multiple systems and platforms
  • Drive technical decision-making and establish best practices
  • Ensure code quality through reviews and implementation
What we offer
What we offer
  • Medical
  • Vision
  • Dental
  • Life
  • Disability insurance
  • Paid time off (including holidays, parental leave, and sick leave, as required by law)
  • Opportunity to lead impactful data initiatives
  • Collaborative and innovative work environment
  • Fulltime
Read More
Arrow Right

Sr. Data Engineer

Join Amgen’s Mission of Serving Patients. At Amgen, if you feel like you’re part...
Location
Location
United States , Thousand Oaks
Salary
Salary:
138325.00 - 172744.00 USD / Year
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree (or foreign equivalent) in Computer Science, Computer Engineering, Clinical Informatics or related field and 2 years of experience in the job offered or in a Data Engineer – related occupation. The position requires 2 years of experience in the following: Manage and tune Hadoop, MapReduce, or Spark SQL
  • Build ETL pipelines to transfer data
  • Optimize database for usage
  • Manage data stewardship and governance
  • Configure cloud services to orchestrate, monitor, and run end-to-end data warehousing solutions
  • and Model data for translation, linking, and consumption from source to data warehouse.
Job Responsibility
Job Responsibility
  • Responsible for managing and optimizing the company's data infrastructure and architecture for Clinical Data Hub, including cloud-based distributed compute and storage
  • Design and implement data pipelines, develop data models, perform data integration, and ensure data quality and governance
  • Contributes to the effective storage, processing, and utilization of large-scale data sets
  • Work with Product Owner, Product Management, Agile Team, and Data Architects to plan and deliver prioritized Clinical Data Hub backlog items and optimize the technical environment
  • Ensure data requirements for applications, data scientists, and cross-functional use cases are met, and ensure high performance and reliability of the system
  • Provide insights and actionable solutions for business clients.
What we offer
What we offer
  • stock
  • retirement
  • medical
  • life and disability insurance
  • eligibility for an annual bonus
  • health and welfare plans
  • financial plans
  • work/life balance
  • career development opportunities
  • Retirement and Savings Plan
  • Fulltime
Read More
Arrow Right

Sr. Data Engineer

We are looking for an accomplished Sr. Data Engineer to join a team building res...
Location
Location
United States , Dallas
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, or a related technical discipline
  • At least 7 years of experience in data engineering with a strong record of designing and supporting production data pipelines
  • Advanced hands-on knowledge of Kafka, Airflow, NiFi, Databricks, Spark, Hadoop, Flink, and Amazon S3
  • Proficiency in Python plus working ability in Scala or Java for automation, transformation, and data processing tasks
  • Solid SQL skills and experience working with both relational and NoSQL database technologies
  • Background supporting data engineering solutions in on-premises and Kubernetes-based environments
  • Understanding of data modeling, governance practices, and data quality controls
  • Strong analytical, troubleshooting, and communication skills
  • experience in hybrid or multi-cloud settings is preferred
Job Responsibility
Job Responsibility
  • Build and enhance robust data pipelines that support ingestion, transformation, and delivery using platforms such as Airflow, NiFi, Databricks, and Spark
  • Create streaming and event-driven data solutions with Kafka and Flink to enable timely processing of high-volume data flows
  • Architect and refine storage patterns across Hadoop and Amazon S3 with attention to scalability, performance, and cost control
  • Establish monitoring, validation, and governance practices that strengthen data quality, security, and operational reliability
  • Coordinate complex workflow orchestration across hybrid and multi-cloud environments, including enterprise data processing operations where needed
  • Work with structured and semi-structured file types such as Parquet and Avro to improve usability and interoperability across systems
  • Diagnose bottlenecks in distributed processing environments and implement improvements that increase efficiency and stability
  • Provide technical guidance to less experienced engineers and contribute to a strong engineering culture centered on quality and continuous improvement
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Sr. Data Engineer

We are seeking an experienced Senior Data Engineer to be a core member of agile ...
Location
Location
Egypt , Giza
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or related discipline
  • 3+ years experience delivering data engineering solutions across complex multi-disciplinary projects
  • confident in collaborating and influencing across organisational, technical, and stakeholder boundaries
  • skilled in understanding business requirements and translating them into effective data solutions
  • strong analytical thinking, problem-solving capability, attention to detail, proactive improvement-focused mindset
Job Responsibility
Job Responsibility
  • Design, build, test, monitor, and maintain highly scalable and reusable data pipelines and ETL solutions across multiple platforms
  • Deliver end-to-end data management capabilities including data profiling, ingestion, transformation, storage, and usage
  • Establish, monitor, and report on data quality benchmarks with a strong focus on data accuracy, validation, and governance
  • Collaborate closely with data scientists, BI engineers, architecture, and TechOps teams to align data solutions with business and technical needs
  • Contribute to research, proof-of-concepts, and technical studies to evaluate emerging data technologies and inform platform roadmaps
  • Ensure high code quality through automated testing, production monitoring, alerting, defect tracking, and continuous improvement
  • Support the design and implementation of secure, resilient, and supportable data solutions including disaster recovery, encryption, and observability best practices
  • Establish and promote best-practice design and coding standards, providing technical mentoring and guidance to other engineers as needed
What we offer
What we offer
  • Exposure to large-scale enterprise data platforms within a global organisation
  • Opportunities to influence data engineering standards, tooling, and architectural direction
  • Collaborative agile environment that values learning, innovation, and shared ownership
  • Chance to work with modern cloud, big data, and data governance technologies on impactful use cases
  • Fulltime
Read More
Arrow Right

Sr. Data Engineer

Roku is changing how the world watches TV. Roku is the #1 TV streaming platform ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive SQL Skills
  • Proficiency in at least one scripting language, Python is required
  • Experience in big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc.
  • Proficiency in data modeling, including designing, implementing, and optimizing conceptual, logical, and physical data models to support scalable and efficient data architectures
  • 8+ years professional experience as a data Engineer
  • BS in Computer Science
  • MS in Computer Science preferred
  • AI Literacy / AI growth mindset
Job Responsibility
Job Responsibility
  • Build highly scalable, available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 10s of terabytes of data ingested every day and petabyte-sized data warehouse
  • Build quality data solutions and refine existing diverse datasets to simplified data models encouraging self-service
  • Build data pipelines that optimise on data quality and are resilient to poor quality data sources
  • Own the data mapping, business logic, transformations and data quality
  • Low level systems debugging, performance measurement & optimization on large production clusters
  • Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects
  • Maintain and support existing platforms and evolve to newer technology stacks and architectures
What we offer
What we offer
  • Global access to mental health and financial wellness support and resources
  • Local benefits include statutory and voluntary benefits which may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension)
  • Employees are supported in taking time off, in accordance with local leave policies and other personal needs to support their evolving work and life needs
  • Fulltime
Read More
Arrow Right

Sr. Data Engineer

Our vision is to enable profitable growth to Aramark’s Accounts by providing the...
Location
Location
United States , Philadelphia
Salary
Salary:
Not provided
aramark.com Logo
Aramark
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A minimum of 7 years of software development experience in the data domain
  • Proven expertise in: Python
  • CI/CD
  • Advanced SQL
  • Cloud platforms (Azure/AWS)
  • Data modeling
  • ETL/ELT processes
  • Apache Spark and real-time streaming experience
  • Experience in high influence models guiding teams/groups of diverse professionals and managing operations in a distributed organization
  • BS/MS in Computer Science or equivalent experience
Job Responsibility
Job Responsibility
  • Design and implementation for high-performance data product components
  • Building robust data ingestion framework(s)
  • Synchronizing data across on-prem and cloud-native technologies
  • Developing scalable data/ML processing pipelines
  • Managing sprint tasks and deliverables
  • Implementing and enforcing data engineering best practices
  • Mentoring data engineers in best practices and professional development
  • Leading technical discussions and decision-making processes within the team
  • Contribute to the strategic direction of data engineering initiatives and projects
  • Fulltime
Read More
Arrow Right

Sr. Data Engineer

We are looking for a Sr. Data Engineer to join our growing Quality Engineering t...
Location
Location
Salary
Salary:
Not provided
dataideology.com Logo
Data Ideology
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Systems, or a related field (or equivalent experience)
  • 5+ years of experience in data engineering, data warehousing, or data architecture
  • Expert-level experience with Snowflake, including data modeling, performance tuning, security, and migration from legacy platforms
  • Hands-on experience with Azure Data Factory (ADF) for building, orchestrating, and optimizing data pipelines
  • Strong experience with Informatica (PowerCenter and/or IICS) for ETL/ELT development, workflow management, and performance optimization
  • Deep knowledge of data modeling techniques (dimensional, tabular, and modern cloud-native patterns)
  • Proven ability to translate business requirements into scalable, high-performance data solutions
  • Experience designing and supporting end-to-end data pipelines across cloud and hybrid architectures
  • Strong proficiency in SQL and experience optimizing large-scale analytic workloads
  • Experience working within SDLC frameworks, CI/CD practices, and version control
Job Responsibility
Job Responsibility
  • Ability to collect and understand business requirements and translate those requirements into data models, integration strategies, and implementation plans
  • Lead modernization and migration initiatives to move clients from legacy systems into Snowflake, ensuring functionality, performance and data integrity
  • Ability to work within the SDLC framework in multiple environments and understand the complexities and dependencies of the data warehouse
  • Optimize and troubleshoot ETL/ELT workflows, applying best practices for scheduling, orchestration, and performance tuning
  • Maintain documentation, architecture diagrams, and migration plans to support knowledge transfer and project tracking
What we offer
What we offer
  • PTO Policy
  • Eligibility for Health Benefits
  • Retirement Plan
  • Work from Home
  • Fulltime
Read More
Arrow Right