Senior Data Engineer Job at Trilogy Federal (Washington, D.C.)

New

Senior Data Engineer

As a Data Engineer, you will join our Data Platform team and contribute to the d...

Location

Poland , Cracow

Salary:

18000.00 - 23000.00 PLN / Month ▼

Medius

Expiration Date

Until further notice

Requirements

Experience developing with Python, including Pandas and PySpark
Strong SQL skills and experience working with large-scale datasets
Hands-on experience designing and implementing ETL/ELT processes in Data Lakehouse environments
Practical experience with Azure cloud services
Experience working with Apache Spark and Azure Databricks
Understanding of data modeling, data integration, and modern data engineering best practices

Job Responsibility

Design, develop, and maintain scalable data processing infrastructure and ETL/ELT pipelines on Azure
Build and optimize data solutions within Azure Databricks and Data Lakehouse environments
Deliver high-quality, reliable data to support AI/ML applications, analytics, reporting, and other data consumers
Ensure data governance, security, integrity, and availability across the data platform
Monitor, troubleshoot, and improve data workflows and platform performance
Collaborate with cross-functional teams to understand data requirements and implement effective solutions
Stay current with emerging technologies and best practices in data engineering
Share knowledge and contribute to continuous learning within the team

What we offer

26 days PTO
medical, dental, and vision coverage
paid time off
retirement benefits
variable compensation (performance bonus or commission)

Fulltime

New

Senior Data Engineer

This role is categorized as hybrid. This means the successful candidate is expec...

Location

United States , Austin

Salary:

133000.00 - 188600.00 USD / Year

General Motors

Expiration Date

Until further notice

Requirements

5+ years of relevant full-time experience
or equivalent knowledge
Bachelor’s degree in Computer Science, Data Science, Engineering, or a related technical field, or equivalent practical experience.
Strong proficiency in Scala, Python, SQL, Spark, and Databricks, with production-quality software engineering practices.
Strong experience building and supporting cloud-based ETL/ELT pipelines, data platforms, and pipeline orchestration patterns for both batch and streaming operations.
Experience deploying machine learning models into production environments and supporting model development through operational release.
Strong experience with Databricks jobs, workflows, repos, Unity Catalog, and MLflow-based experimentation and model lifecycle management.
Experience building CI/CD pipelines with Git-based workflows, automated testing, and deployment of data or ML products.
Strong troubleshooting, communication, and cross-functional collaboration skills.

Job Responsibility

Design and develop batch and streaming ETL/ELT pipelines in Azure Databricks to support ingestion, transformation, curation, and delivery of manufacturing and enterprise data
Build reusable Bronze, Silver, and Gold data pipelines, data quality frameworks, and governed data products in Unity Catalog
Build and operationalize ML workflows for data preparation, feature engineering, model training, evaluation, deployment, batch scoring, retraining, and inference
Establish and maintain MLflow-based model lifecycle controls, including experiment tracking, model registration, versioning, lineage, traceability, and controlled promotion across environments
Implement CI/CD pipelines for data products, ML code, workflows, and deployment bundles using Git-based development practices, automated testing, and release automation
Build and support Databricks jobs and workflows for orchestration, scheduled execution, retraining, scoring, and downstream operational consumption
Improve reliability, observability, and production readiness through testing, monitoring, validation, alerting, documentation, and automation that reduce deployment risk and manual intervention
Partner with data scientists, data engineers, platform teams, architecture, manufacturing, and business stakeholders to productionize scalable, supportable solutions aligned to production constraints
Support modernization of legacy data and ML workflows into standardized cloud-native Databricks patterns and help bridge proof-of-concept work into repeatable production solutions

What we offer

Medical
Dental
Vision
Health Savings Account
Flexible Spending Accounts
Retirement savings plan
Sickness and accident benefits
Life insurance
Paid vacation & holidays
Tuition assistance programs

Fulltime

New

Senior Data Engineer

Ready to lead data engineering that powers critical financial decisions at scale...

Location

United Kingdom , London

Salary:

Not provided

EDF UK

Expiration Date

July 12, 2026

Requirements

Experience leading small to medium sized engineering teams within agile delivery environments
Strong expertise in at least one server-side language such as Python, Java, Kotlin or NodeJS
Knowledge of serverless, event-driven, and loosely coupled architectures
Experience designing and integrating REST APIs and third-party services
Commercial experience working with React or React Native and state management libraries
Strong experience with CI/CD tooling such as Jenkins, GitHub or Terraform
Experience applying test-driven development or behaviour-driven development practices
Proven experience working within the energy industry
Ability to communicate complex technical concepts to non-technical stakeholders

Job Responsibility

Leading the day-to-day engineering capability within the Finance Data Squad
Delivering scalable data products and software components aligned to business priorities
Driving quality through code reviews, testing practices, and engineering standards
Mentoring and developing engineers to build capability and performance
Collaborating with product owners, architects, and stakeholders to deliver value-focused solutions

What we offer

Competitive salary
Potential for an annual bonus
Market-leading pension scheme
Customisable benefits including electric vehicle leasing
Discounted gym membership
Life assurance
Tech vouchers
Experience days

Fulltime

!

New

Senior Data Engineer

Well-known technology platform company is looking for a Senior Data Engineer to ...

Location

United States , San Francisco

Salary:

155000.00 - 195000.00 USD / Year

Strategic Employment Partners

Expiration Date

Until further notice

Requirements

5+ years of data engineering experience
Strong Python development skills
Production experience with Airflow or other workflow orchestration tools
Experience building data pipelines in the public cloud (AWS, GCP, or Azure)
Strong communication (ex: push back, clarify, and manage expectations proactively)

Job Responsibility

Work directly with stakeholders to understand their data needs
Build and maintain production pipelines
Deliver high-quality data sets that drive business decisions
Be embedded within the business unit attending stakeholder meetings
Translate ambiguous requirements into technical specs
Manage your domain end to end

Fulltime

New

Senior Data Engineer

I'm working with a leading global hedge fund that is looking to hire a Data Deve...

Location

United Kingdom , London

Salary:

Not provided

Orbis Consultants

Expiration Date

Until further notice

Requirements

5+ years of software and/or data engineering experience
Strong development experience in Python or C#, ideally both
Expert-level SQL skills
Strong experience with relational databases, data modelling and schema design
Experience building ETL pipelines and data-driven applications
Strong problem-solving ability and a genuine interest in understanding systems end-to-end
Excellent communication skills and the ability to work directly with business users

Job Responsibility

Design and develop data models, reporting solutions and analytics platforms
Build and enhance ETL pipelines and data processing workflows
Develop applications and tooling using Python
Design and optimise database schemas and reporting architectures
Create and tune complex SQL queries for reporting, reconciliation and analytics
Work directly with business stakeholders to gather requirements and deliver solutions
Support and modernise existing reporting and analytics platforms

Fulltime

New

Senior Data Engineer

Randstad has partnered with a software solutions company, building innovative an...

Location

Malaysia , Kuala Lumpur

Salary:

15000.00 - 20000.00 MYR / Month

Randstad

Expiration Date

August 17, 2026

Requirements

7+ years of dedicated data engineering or distributed systems experience
Proven production experience with Apache Kafka (including ecosystem tools) and Apache Flink for real-time processing
Expert-level proficiency in Python for data processing and automation
Hands-on experience scaling modern cloud data warehouses (e.g., Snowflake, BigQuery, Redshift)
Strong grasp of distributed systems architecture, microservices, and modern data lakehouse patterns (e.g., Iceberg, Delta)
Familiarity with orchestration (e.g., Airflow), containerization (Docker, Kubernetes), and CI/CD pipelines

Job Responsibility

Architecture: Design fault-tolerant, petabyte-scale distributed data architectures and define company-wide data governance standards
Streaming: Build high-throughput, low-latency streaming pipelines using Apache Kafka and stateful Apache Flink applications
Data Warehousing: Integrate diverse data streams into a centralized Cloud Data Warehouse while optimizing query performance and storage costs
Development: Write clean, production-grade pipeline code using Python and manage end-to-end data lifecycle orchestration
Optimization: Troubleshoot bottlenecks in distributed systems, ensuring high availability, system uptime, and cost efficiency
Leadership: Provide technical mentorship to junior engineers and collaborate with cross-functional product and data science teams

What we offer

Career Growth Opportunities
Open Communication Culture
Good Incentives

New

Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer for an extensive 35-month c...

Location

Canada , Toronto

Salary:

57.46 - 67.04 USD / Hour

Randstad

Expiration Date

July 26, 2026

Requirements

5+ years of dedicated experience in Data Engineering or Database Development for enterprise-scale solutions
Hands-on expertise with Azure Synapse (SQL DW), Azure Data Factory, Azure Databricks, and SQL Server 2016+
Proficient in SQL and Python (specifically PySpark for big data processing)
Proven experience implementing CI/CD pipelines using Azure DevOps
Demonstrated experience developing reports in Power BI
University degree in Computer Science or an equivalent combination of education and experience
Expert understanding of DW/BI implementations, data lake design, and data stewardship techniques

Job Responsibility

Design, develop, and document Azure Data Factory (ADF) and SSIS packages to integrate complex data from multiple source systems
Build and maintain Databricks notebooks and jobs using Python (PySpark) and SQL for both batch and streaming workloads
Implement curated, analytics-ready datasets following the Medallion Architecture (Bronze, Silver, Gold layers) and Delta Lake best practices
Develop complex T-SQL, stored procedures, views, triggers, and indexes to optimize performance within Azure Synapse and SQL Server environments
Conduct advanced data analysis to provide meaningful, data-driven insights to business stakeholders
Develop high-quality Power BI reports and dashboards to visualize key performance indicators and operational metrics
Assist in the data modeling of the data warehouse/data lake solutions to ensure scalability and alignment with business requirements
Design and implement rigorous data quality and cleansing processes to ensure the integrity of the enterprise data assets
Manage the end-to-end development lifecycle using Azure DevOps pipelines to ensure reliable and automated deployments
Convert business requirements into detailed technical specifications, provide accurate time estimates, and conduct knowledge transfer sessions for the team

What we offer

Unmatched Stability: A 35-month contract provides rare long-term stability and the opportunity to lead a project from foundational design to mature operation
Enterprise Scale: Work on a massive transit data ecosystem, solving complex data problems that impact millions of users
Modern Cloud Stack: Deepen your expertise in the full Azure data suite, including Delta Lake, PySpark, and Synapse
Strategic Role: Move beyond simple coding to help model the enterprise data strategy and deliver actionable business intelligence

Fulltime

New

Senior Data Engineer

We are seeking Senior Data Engineers to support TCCC’s Symphony platform on a pe...

Location

India , Delhi

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

8–10 years of hands-on data engineering experience
Strong understanding of Apache Spark and its core concepts
Proficiency in Scala and/or Java — code-first approach is mandatory
Advanced SQL skills
Hands-on experience with Azure Synapse
Working knowledge of GitHub for source control
Experience with data warehousing and multi-source data integration
Ability to work in an offshore delivery model
Must be a hands-on builder — no oversight-only profiles
Must be available to mobilize immediately

Job Responsibility

Implement and configure the Symphony platform solution for assigned market(s)
Develop and maintain market-specific data pipelines using Scala and SQL on Apache Spark
Integrate market-level marketing and data sources into the Symphony platform
Identify and resolve market-specific data quality issues, discrepancies, and inconsistencies
Support ongoing maintenance and monitoring of market-level pipelines
Optimize market-specific solutions for performance and scalability
Collaborate with the core team to ensure market implementations align with global architecture standards
Work within TCCC’s metadata-driven architecture — no reinvention of existing frameworks
Ensure pipelines are used strictly for scheduling — all ETL logic must remain in code
Communicate findings and technical issues clearly to the Delivery Lead and market Business Analyst

Fulltime

Select Country

Senior Data Engineer

Requirements

Looking for more opportunities?

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Our AI answers in your language