CrawlJobs Logo

Senior Data Engineer

crusoe.ai Logo

Crusoe

Location Icon

Location:
United States , San Francisco

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

Join Crusoe Energy as a Senior Data Engineer, an early and pivotal hire on our growing central Data Science and Engineering team. This full-time position offers you the unique opportunity to architect and build the foundational data platform infrastructure that powers Crusoe's AI and cloud operations. You'll go beyond building pipelines—you'll design and implement the systems that make those pipelines possible, playing a key role in Crusoe's mission to meet the ever-increasing demand for AI infrastructure and innovate sustainably.

Job Responsibility:

  • Architect Data Platform Infrastructure: Design and build scalable, reliable data infrastructure systems that serve as the foundation for analytics, machine learning, and operational intelligence across Crusoe
  • Build High-Performance Data Systems: Develop robust data processing frameworks and storage solutions optimized for the unique demands of AI infrastructure and cloud operations
  • Champion Data Quality & Reliability: Implement data validation, monitoring, and observability systems that ensure data integrity and platform reliability at scale
  • Collaborate Across Engineering Teams: Partner with software engineers, data scientists, and operations teams to understand requirements and deliver infrastructure that accelerates their work
  • Drive Technical Excellence: Establish best practices for data engineering, contribute to architectural decisions, and mentor team members as the team grows

Requirements:

  • Strong Software Engineering Foundation: Demonstrate proficiency in Python and at least one systems-level language (Go preferred
  • Java, C, or C++ also valued), with the ability to write production-quality, maintainable code
  • Data Infrastructure Expertise: Possess deep experience designing and building data platforms, including data warehouses, data lakes, streaming systems, and ETL/ELT frameworks
  • Distributed Systems Knowledge: Show understanding of distributed computing principles, with experience building systems that scale reliably
  • SQL Mastery: Exhibit advanced SQL skills for data modeling, query optimization, and database design
  • Infrastructure-as-Code Mindset: Demonstrate familiarity with modern DevOps practices including CI/CD, containerization, and infrastructure automation
  • Ownership & Autonomy: As an early hire on the data engineering team, you'll be expected to drive projects from conception to production with minimal supervision
  • Collaboration Skills: Communicate effectively with technical and non-technical stakeholders to translate requirements into robust solutions

Nice to have:

  • Experience with Google Cloud Platform (GCP) data services (BigQuery, Dataflow, Pub/Sub, Cloud Storage)
  • Experience with Apache Beam
  • Background in building infrastructure for AI/ML workloads or cloud computing platforms
  • Experience on a growing or early-stage data team, contributing to foundational development
  • Familiarity with data orchestration tools (e.g., Airflow, Dagster, Prefect)
  • Experience with real-time data processing and streaming architectures
What we offer:
  • Industry competitive pay
  • Restricted Stock Units in a fast growing, well-funded technology company
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Subscription to the Calm app
  • MetLife Legal
  • Company paid commuter benefit
  • $300 per month

Additional Information:

Job Posted:
January 08, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Data Engineer

Senior Data Engineer

Our Data Engineering Team is comprised of data experts. We build world-class dat...
Location
Location
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A BS in Computer Science or equivalent experience with 5+ years of professional experience as a Sr. Data Engineer or in a similar role
  • Strong programming skills using Python
  • Working knowledge of relational databases and query authoring (SQL)
  • Experience designing data models for optimal storage and retrieval to meet product and business requirements
  • Experience building scalable data pipelines using Spark (SparkSQL) with Airflow scheduler/executor framework or similar scheduling tools
  • Experience working with AWS data services or similar Apache projects (Spark, Flink, Hive, and Kafka)
  • Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team
  • Well versed in modern software development practices (Agile, TDD, CICD)
Job Responsibility
Job Responsibility
  • You'll partner with the product analytics and data scientist team to build the data solutions that allow them to obtain more insights from our data and use that to support important business decisions
  • You'll work with different stakeholders to understand their needs and architect/build the data models, data acquisition/ingestion processes and data applications to address those requirements
  • You'll add new sources, code business rules, and produce new metrics that support the product analysts and data scientists
  • You'll be the data domain expert who understand all the nitty-gritty of our products
  • You'll own a problem end-to-end
  • You'll improve data quality by using & improving internal tools/frameworks to automatically detect DQ issues
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
Read More
Arrow Right

Senior Data Engineer

Binariks is looking for a highly motivated and skilled Senior Data Engineer to j...
Location
Location
Salary
Salary:
Not provided
binariks.com Logo
Binariks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years as a Data Engineer with experience in working with AWS
  • Experience with Terraform
  • Experience with Datalakes, Medallion Architecture
  • Experience with SQL
  • Professional experience with Python
  • Experience with Athena, Glue, Glue Streaming, Kinesis, dbt
  • Able to work as a team to deliver against requirements in a collaborative and agile way
  • Excellent communication skills in English
Job Responsibility
Job Responsibility
  • Managing and improving our cloud data lakehouse for analytic and aggregate data
  • Building data pipelines
  • Developing foundations for handling larger volumes of streaming data
  • Manage our cloud data infrastructure using IaC tooling
  • Assist teams on integrating with the data lake and consuming from it
  • Developing customer-facing data products, such as APIs and data timelines
  • Help develop our machine learning data capabilities
What we offer
What we offer
  • 18 days of paid annual leave
  • 10 sick leaves
  • Additional days off for special occasions
  • Medical Care
  • Health check-up
  • English Class
  • Play Room
  • IT Cluster membership
  • Business Trip
  • Tech Talks
Read More
Arrow Right

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in data engineering and data platform development
  • Strong hands-on experience with: AWS Glue
  • Amazon EMR (Spark)
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
Job Responsibility
Job Responsibility
  • Design, develop, and optimize scalable data pipelines using AWS native services
  • Lead the implementation of batch and near-real-time data processing solutions
  • Architect and manage data ingestion, transformation, and storage layers
  • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
  • Orchestrate complex data workflows using Apache Airflow (MWAA)
  • Develop and manage serverless data processing using AWS Lambda
  • Design and optimize data warehouses using Amazon Redshift
  • Implement and manage NoSQL data models using Amazon DynamoDB
  • Utilize AWS DataZone for data governance, cataloging, and access management
  • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

NorthBay is looking for a Senior Data Engineer with a strong passion for databas...
Location
Location
Pakistan , Lahore; Islamabad; Karachi
Salary
Salary:
250000.00 - 350000.00 PKR / Month
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Up to 3 years of relevant experience in database deployment, management, or migration
  • Hands-on experience with PostgreSQL, MongoDB, DocumentDB, MySQL, or Oracle
  • Experience using AWS Database Migration Services (AWS DMS) for data migration projects
  • Knowledge of NoSQL databases and DocumentDB is a plus
  • Understanding of ETL/ELT pipelines, data engineering, and data flow orchestration
  • Familiarity with backup/recovery, replication, and clustering concepts
  • Strong analytical, problem-solving, and communication skills
Job Responsibility
Job Responsibility
  • Support and execute database migration initiatives across multiple database platforms and AWS environments
  • Collaborate with technical leads to ensure successful, secure, and validated database migrations
  • Develop and maintain data validation plans, migration scripts, and testing frameworks
  • Work closely with application teams to ensure business continuity, performance, and SLAs are maintained during migration
  • Perform database performance tuning, monitoring, and troubleshooting to ensure reliability and scalability
  • Contribute to database design, replication, clustering, backup/recovery, and CDC (Change Data Capture) strategies
  • Demonstrate strong understanding of OLTP and OLAP workloads and migration best practices
What we offer
What we offer
  • Fuel expense reimbursement
  • Paid holidays and vacation
  • Medical outpatient reimbursement & health insurance
  • Opportunity to work in a highly collaborative, AWS-focused environment on impactful migration projects
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

NorthBay is looking for a Senior Data Engineer with a strong passion for databas...
Location
Location
Pakistan , Lahore; Islamabad; Karachi
Salary
Salary:
250000.00 - 350000.00 PKR / Month
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Up to 3 years of relevant experience in database deployment, management, or migration
  • Hands-on experience with PostgreSQL, MongoDB, DocumentDB, MySQL, or Oracle
  • Experience using AWS Database Migration Services (AWS DMS) for data migration projects
  • Knowledge of NoSQL databases and DocumentDB is a plus
  • Understanding of ETL/ELT pipelines, data engineering, and data flow orchestration
  • Familiarity with backup/recovery, replication, and clustering concepts
  • Strong analytical, problem-solving, and communication skills
Job Responsibility
Job Responsibility
  • Support and execute database migration initiatives across multiple database platforms and AWS environments
  • Collaborate with technical leads to ensure successful, secure, and validated database migrations
  • Develop and maintain data validation plans, migration scripts, and testing frameworks
  • Work closely with application teams to ensure business continuity, performance, and SLAs are maintained during migration
  • Perform database performance tuning, monitoring, and troubleshooting to ensure reliability and scalability
  • Contribute to database design, replication, clustering, backup/recovery, and CDC (Change Data Capture) strategies
  • Demonstrate strong understanding of OLTP and OLAP workloads and migration best practices
What we offer
What we offer
  • Fuel expense reimbursement
  • Paid holidays and vacation
  • Medical outpatient reimbursement & health insurance
  • Opportunity to work in a highly collaborative, AWS-focused environment on impactful migration projects
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

NorthBay is looking for a Senior Data Engineer with a strong passion for databas...
Location
Location
Pakistan , Lahore; Islamabad; Karachi
Salary
Salary:
250000.00 - 350000.00 PKR / Month
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Up to 3 years of relevant experience in database deployment, management, or migration
  • Hands-on experience with PostgreSQL, MongoDB, DocumentDB, MySQL, or Oracle
  • Experience using AWS Database Migration Services (AWS DMS) for data migration projects
  • Knowledge of NoSQL databases and DocumentDB is a plus
  • Understanding of ETL/ELT pipelines, data engineering, and data flow orchestration
  • Familiarity with backup/recovery, replication, and clustering concepts
  • Strong analytical, problem-solving, and communication skills
Job Responsibility
Job Responsibility
  • Support and execute database migration initiatives across multiple database platforms and AWS environments
  • Collaborate with technical leads to ensure successful, secure, and validated database migrations
  • Develop and maintain data validation plans, migration scripts, and testing frameworks
  • Work closely with application teams to ensure business continuity, performance, and SLAs are maintained during migration
  • Perform database performance tuning, monitoring, and troubleshooting to ensure reliability and scalability
  • Contribute to database design, replication, clustering, backup/recovery, and CDC (Change Data Capture) strategies
  • Demonstrate strong understanding of OLTP and OLAP workloads and migration best practices
What we offer
What we offer
  • Fuel expense reimbursement
  • Paid holidays and vacation
  • Medical outpatient reimbursement & health insurance
  • Opportunity to work in a highly collaborative, AWS-focused environment on impactful migration projects
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

The mission of the business intelligence team is to create a data-driven culture...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
February 28, 2026
Flip Icon
Requirements
Requirements
  • Master’s degree in Computer Science / Information Technology or related field, highly preferred
  • Extensive knowledge of BI concepts and related technologies that help drive sustainable technical solutions
  • Extensive Experience with data lakes, ETL and data warehouses
  • Advanced experience of building data pipelines
  • Passion for building quality BI software
  • Project Management and/or process improvement experience highly preferred
  • Polyglot coder and expert level in multiple languages including, Python, R, Java, SQL, relational databases, ERP, DOMO or other data visualization tools i.e. Tableau
  • Advanced and proven experience with Google cloud platform (GCP) is preferred. But experience with Microsoft Azure / Amazon will be considered
  • Any exposure to Kafka, Spark, and Scala will be an added advantage
  • Should demonstrate a strong understanding of OOPS concepts and methodologies
Job Responsibility
Job Responsibility
  • Architect and build complex data pipelines using advanced cloud data technologies
  • Lead efforts to optimize data pipelines for performance, scalability, and cost-efficiency
  • Define industry best practices for building data pipelines
  • Ensure data security, compliance, and governance standards are met
  • Partner with leadership team to define and implement agile and DevOps methodologies
  • Serve as subject matter expert and define data architecture and infrastructure requirements
  • Partner with business analysts to plan project execution including appropriate product and technical specifications, direction, resources, and establishing realistic completion times
  • Understand data technology trends and identify opportunities to implement new technologies and provide forward-thinking recommendations
  • Proactively partner with internal stakeholders to bridge gaps, provide historical references, and design the appropriate processes
  • Design and implement a robust data observability process
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Beacon Technologies is seeking a Senior Data Engineer for our client partner. Th...
Location
Location
Salary
Salary:
Not provided
beacontechinc.com Logo
Beacon Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data engineering (SQL)
  • Scripting (Python, PowerShell, Bash)
  • Custom development (API integration, file-based integration)
  • Strategic thinker
  • Mentor juniors
  • Governance aware
Job Responsibility
Job Responsibility
  • Design integrations
  • Optimize rule structures
  • Lead analytics initiatives
  • Manage workforce identity (system access) for all corporate and field employees
What we offer
What we offer
  • Career advancement opportunities
  • Extensive training
  • Excellent benefits including paying for health and dental premiums for salaried employees
  • Fulltime
Read More
Arrow Right