Data Platform Engineer Job at Outsource UK (Warton)

Big Data Platform Senior Engineer

Lead Java Data Engineer to guide and mentor a talented team of engineers in buil...

Location

Bahrain , Seef, Manama

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Significant hands-on experience developing high-performance Java applications (Java 11+ preferred) with strong foundation in core Java concepts, OOP, and OOAD
Proven experience building and maintaining data pipelines using technologies like Kafka, Apache Spark, or Apache Flink
Familiarity with event-driven architectures and experience in developing real-time, low-latency applications
Deep understanding of distributed systems concepts and experience with MPP platforms such as Trino (Presto) or Snowflake
Experience deploying and managing applications on container orchestration platforms like Kubernetes, OpenShift, or ECS
Demonstrated ability to lead and mentor engineering teams, communicate complex technical concepts effectively, and collaborate across diverse teams
Excellent problem-solving skills and data-driven approach to decision-making

Job Responsibility

Provide technical leadership and mentorship to a team of data engineers
Lead the design and development of highly scalable, low-latency, fault-tolerant data pipelines and platform components
Stay abreast of emerging open-source data technologies and evaluate their suitability for integration
Continuously identify and implement performance optimizations across the data platform
Partner closely with stakeholders across engineering, data science, and business teams to understand requirements
Drive the timely and high-quality delivery of data platform projects

Fulltime

Senior Data Engineer – Data Engineering & AI Platforms

We are looking for a highly skilled Senior Data Engineer (L2) who can design, bu...

Location

India , Chennai, Madurai, Coimbatore

Salary:

Not provided

OptiSol Business Solutions

Expiration Date

Until further notice

Requirements

Strong hands-on expertise in cloud ecosystems (Azure / AWS / GCP)
Excellent Python programming skills with data engineering libraries and frameworks
Advanced SQL capabilities including window functions, CTEs, and performance tuning
Solid understanding of distributed processing using Spark/PySpark
Experience designing and implementing scalable ETL/ELT workflows
Good understanding of data modeling concepts (dimensional, star, snowflake)
Familiarity with GenAI/LLM-based integration for data workflows
Experience working with Git, CI/CD, and Agile delivery frameworks
Strong communication skills for interacting with clients, stakeholders, and internal teams

Job Responsibility

Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms
Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers
Work closely with solutioning and pre-sales teams for technical evaluations and client-facing discussions
Lead squads of L0/L1 engineers—ensuring delivery quality, mentoring, and guiding career growth
Develop cloud-native data engineering solutions using Python, SQL, PySpark, and modern data frameworks
Ensure data reliability, performance, and maintainability across the pipeline lifecycle—from development to deployment
Support long-term ODC/T&M projects by demonstrating expertise during technical discussions and interviews
Integrate emerging GenAI tools where applicable to enhance data enrichment, automation, and transformations

What we offer

Opportunity to work at the intersection of Data Engineering, Cloud, and Generative AI
Hands-on exposure to modern data stacks and emerging AI technologies
Collaboration with experts across Data, AI/ML, and cloud practices
Access to structured learning, certifications, and leadership mentoring
Competitive compensation with fast-track career growth and visibility

Fulltime

Senior Software Engineer, Data Platform

We are looking for a foundational member of the Data Team to enable Skydio to ma...

Location

United States , San Mateo

Salary:

180000.00 - 240000.00 USD / Year

Skydio

Expiration Date

Until further notice

Requirements

5+ years of professional experience
2+ years in software engineering
2+ years in data engineering with a bias towards getting your hands dirty
Deep experience with Databricks building pipelines, managing datasets, and developing dashboards or analytical applications
Proven track record of operating scalable data platforms, defining company-wide patterns that ensure reliability, performance, and cost effectiveness
Proficiency in SQL and at least one modern programming language (we use Python)
Comfort working across the full data stack — from ingestion and transformation to orchestration and visualization
Strong communication skills, with the ability to collaborate effectively across all levels and functions
Demonstrated ability to lead technical direction, mentor teammates, and promote engineering excellence and best practices across the organization
Familiarity with AI-assisted data workflows, including tools that accelerate data transformations or enable natural-language interfaces for analytics

Job Responsibility

Design and scale the data infrastructure that ingests live telemetry from tens of thousands of autonomous drones
Build and evolve our Databricks and Palantir Foundry environments to empower every Skydian to query data, define jobs, and build dashboards
Develop data systems that make our products truly data-driven — from predictive analytics that anticipate hardware failures, to 3D connectivity mapping, to in-depth flight telemetry analysis
Create and integrate AI-powered tools for data analysis, transformation, and pipeline generation
Champion a data-driven culture by defining and enforcing best practices for data quality, lineage, and governance
Collaborate with autonomy, manufacturing, and operations teams to unify how data flows across the company
Lead and mentor data engineers, analysts, and stakeholders across Skydio
Ensure platform reliability by implementing robust monitoring, observability, and contributing to the on-call rotation for critical data systems

What we offer

Equity in the form of stock options
Comprehensive benefits packages
Relocation assistance may also be provided for eligible roles
Paid vacation time
Sick leave
Holiday pay
401K savings plan

Fulltime

Senior Data Engineer - Platform Enablement

SoundCloud empowers artists and fans to connect and share through music. Founded...

Location

United States , New York; Atlanta; East Coast

Salary:

160000.00 - 210000.00 USD / Year

SoundCloud

Expiration Date

Until further notice

Requirements

7+ years of experience in data engineering, analytics engineering, or similar roles
Expert-level SQL skills, including performance tuning, advanced joins, CTEs, window functions, and analytical query design
Proven experience with Apache Airflow (designing DAGs, scheduling, task dependencies, monitoring, Python)
Familiarity with event-driven architectures and messaging systems (Pub/Sub, Kafka, etc.)
Knowledge of data governance, schema management, and versioning best practices
Understanding observability practices: logging, metrics, tracing, and incident response
Experience deploying and managing services in cloud environments, preferably GCP, AWS
Excellent communication skills and a collaborative mindset

Job Responsibility

Develop and optimize SQL data models and queries for analytics, reporting, and operational use cases
Design and maintain ETL/ELT workflows using Apache Airflow, ensuring reliability, scalability, and data integrity
Collaborate with analysts and business teams to translate data needs into efficient, automated data pipelines and datasets
Own and enhance data quality and validation processes, ensuring accuracy and completeness of business-critical metrics
Build and maintain reporting layers, supporting dashboards and analytics tools (e.g. Looker, or similar)
Troubleshoot and tune SQL performance, optimizing queries and data structures for speed and scalability
Contribute to data architecture decisions, including schema design, partitioning strategies, and workflow scheduling
Mentor junior engineers, advocate for best practices and promote a positive team culture

What we offer

Comprehensive health benefits including medical, dental, and vision plans, as well as mental health resources
Robust 401k program
Employee Equity Plan
Generous professional development allowance
Creativity and Wellness benefit
Flexible vacation and public holiday policy where you can take up to 35 days of PTO annually
16 paid weeks for all parents (birthing and non-birthing), regardless of gender, to welcome newborns, adopted and foster children
Various snacks, goodies, and 2 free lunches weekly when at the office

Fulltime