Senior Software Data Engineer Job at Nicoll Curtin (Galway)

Software Engineer / Senior Software Engineer - Data Engineering GitHub

As a Software Engineer at GitHub, you will enhance the collaboration experience ...

Location

Czech Republic , Multiple Locations

Salary:

Not provided

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND experience in Data Engineering and coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python OR equivalent experience.
Master's Degree in Computer Science or related technical field AND engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust or Python OR Bachelor's Degree in Computer Science or related technical field AND engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust or Python OR equivalent experience.

Job Responsibility

Design, develop, test and ship high-quality technical solutions that scale across multiple GitHub services.
Collaborate with cross-functional teams to define and implement innovative solutions.
Provide technical leadership, mentorship, pairing opportunities, and code reviews to encourage the growth of others.
Own and advocate for the health and quality of the systems that the team builds, including participating in on-call and first responder rotations
Write architecture briefs and proposals, carry out code experiments, and build prototypes to learn how we can achieve planetary scale with our systems.
Design and implement APIs to facilitate seamless integration between software components.
Utilize CI/CD tools to set up automated pipelines for continuous integration and delivery.
Become intimately familiar with the systems you build and take pride in writing maintainable code.

Fulltime

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...

Location

India , Bangalore

Salary:

Not provided

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR equivalent experience
Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
Experience building data lake or data engineering products, tools, or pipelines
Familiarity with container-based architectures (Docker, Kubernetes)
Ability to debug complex distributed systems on Linux and/or Windows platforms

Job Responsibility

Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
Use AI tools and coding best practices across the development lifecycle
Design data refresh, scheduling, and query optimisation features with minimal supervision
Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
Coach junior engineers through code reviews
Debug complex issues in distributed systems running on Azure, Linux, and Windows
Run live site operations on a rotational, on-call basis
Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features

Fulltime

Software Developer - Senior / Senior Data Engineer

Imagine being at the forefront of protecting financial integrity and enabling cr...

Location

United States , Southlake, TX or Austin, TX

Salary:

55.92 - 62.13 USD / Hour

Aquent

Expiration Date

Until further notice

Requirements

Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field
8+ years of hands-on experience in data management, including gathering data from diverse sources, consolidating it into centralized locations, and transforming it with business logic for consumption in visualization and data analysis
Strong expertise in BigQuery, Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, and related cloud platform services
Proficiency in Python and SQL for data processing and automation
Extensive experience with ETL processes and data pipeline design
Excellent problem-solving skills and meticulous attention to detail
Strong communication and collaboration skills, with the ability to actively listen, dialogue freely, and verbalize ideas effectively
Ability to thrive in an Agile work environment, delivering incremental value to customers by effectively managing and prioritizing tasks

Job Responsibility

Design, build, and maintain robust and scalable data pipelines using cloud platform tools such as BigQuery, Cloud Storage, Dataflow (Apache Beam), Cloud Composer (Airflow), and Pub/Sub
Develop high-performance, production-grade Python and SQL code, optimizing queries for efficient data extraction, transformation, and loading (ETL) processes
Implement complex data models in BigQuery, leveraging partitioning, clustering, and materialized views to achieve optimal performance
Collaborate closely with cross-functional teams, including business customers and Subject Matter Experts, to gather data requirements and deliver impactful solutions
Implement and uphold best practices for data quality, data governance, and data security
Proactively monitor and troubleshoot data pipeline issues, ensuring high availability and performance of critical data flows
Contribute to strategic data architecture decisions, providing recommendations for continuous improvement of data pipelines
Stay current with emerging trends and technologies in cloud-based data engineering and cyber security to drive innovation
Lead investigation and resolution efforts for identified data issues, taking ownership to resolve them in a timely manner
Document processes and procedures thoroughly for producing accurate metrics and ensuring operational clarity

What we offer

subsidized health, vision, and dental plans
paid sick leave
retirement plans with a match

Software Engineer 2 / Senior Software Engineer

We are looking for an experienced Software Engineers for our Bangalore location ...

Location

India , Bengaluru

Salary:

Not provided

Komprise, Inc.

Expiration Date

Until further notice

Requirements

Solid grasp of computer science fundamentals and especially data structures, algorithms, multi-threading
Ability to solve difficult problems with a simple elegant solution
Should have solid object-oriented programming background with impeccable design skills
Experience in developing management applications and performance management applications is ideal
Experience with object-based file systems and REST interfaces is a plus (e.g. Amazon S3, Azure, Google Cloud Service)
Should have a BE or higher in CS, EE, Math or related engineering or science field
At least 5+ years of experience in software deployment
Tech Stack: Java, Maven Virtualisation, SaaS, Github, Jira, Slack, Cloud Solutions and Hypervisors

Job Responsibility

Responsible for designing and developing features that powers Komprise data management platform to manage billions of files and petabytes of data
Responsible for designing of major components and systems of our product architecture, ensuring that Komprise data management platform is highly available and scalable
Responsible for writing performance code, evaluate feasibility, develop for quality and optimize for maintainability
Work in agile, customer focused and fast paced team with direct interaction with the customers
Responsible for analysing customer escalated issues and provide resolutions in a timely manner
Should be able to design and implement highly performant, scalable distributed systems

New

Senior Software Engineer / Principal Software Engineer - Copilot CLI

Within GitHub and Microsoft CoreAI, the Copilot CLI team builds GitHub's coding ...

Location

United States , Redmond

Salary:

119800.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years

Job Responsibility

Take ownership of critical product and platform areas of the Copilot CLI and shared agent runtime
Set a high technical and quality bar for agentic systems and developer-facing tooling
Design and ship performant, reliable terminal experiences that developers depend on for daily work
Use data, benchmarks, and direct user feedback to guide iteration and investment
Collaborate across org boundaries to enable other teams to build agentic products on top of a shared foundation
Influence architecture, technical direction, and engineering standards beyond your immediate team

What we offer

Certain roles may be eligible for benefits and other compensation

Fulltime

Software Engineer II and Senior Software Engineer

The FIO (Office Files and Identity) Team drives collaboration, identity, cloud f...

Location

United States , Redmond

Salary:

100600.00 - 199000.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, or Rust
OR equivalent experience
4+ years industry engineering experience coding in languages including, but not limited to, C, C++, C#, Java or Rust
4+ years industry experience building and shipping production quality, performant and cross-platform applications
Experience collaborating cross-team and cross-function to deliver software features or projects
Platform-specific experience building Windows, MacOS, iOS or Android applications
Experience designing and implementing efficient network communications, including network protocols, performance and reliability tooling, modeling and implementing complex customer scenarios across network services
Experience designing and implementing client-side storage stacks, with a focus on correctness, resiliency, performance, and adaptability
Understanding of client file system design and APIs, including advanced performance optimizations
Experience directly implementing large-scale data pipelines for product telemetry, with ability to evolve system as business and technical needs change

Job Responsibility

Design and write code
Work across organizations and directly with partners both in Office and across Microsoft, including other engineers and product leaders
Use data as the basis for decision making
Be a steward of products that ship to hundreds of millions of customers around the world, staying connected to customers through data and feedback and being agile and responsive to issues
Grow as an engineer in a modern and highly impactful team

Fulltime

Senior Software Engineer and Principal Software Engineer - Power Point AI Team

The PowerPoint team is embarking on an exciting new chapter - evolving a product...

Location

United States , Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
8+ years of experience in backend service engineering, including work on high-scale infrastructures
Proficiency in one or more systems programming languages such as C#, C++
1+ years of experience in software engineering, designing and developing systems (and APIs) that deploy and integrate with AI models
2+ years of experience working with rich telemetry, making data driven decisions, and carrying out rapid experimentation
2+ years of experience building software for scale, performance, and reliability
Academic or industry experience with building, finetuning, deploying or building eval-driven systems utilizing the models (any category)

Job Responsibility

Lead design and delivery of complex, scalable AI features ensuring resilience and exceptional user experience
Drive technical strategy and architecture decisions across multiple services, influencing partner teams and aligning with compliance and security requirements
Champion modern engineering practices, including AI-driven approaches, automation, and cloud-native patterns, across the full development lifecycle
Mentor and guide engineers, fostering technical excellence and continuous improvement in security, reliability, and performance
Collaborate cross-org to solve challenging technical problems, streamline processes, and reduce operational costs while improving live-site health
Design and implement scalable backend services optimized for machine learning workflows and large language model integration
Develop and maintain evaluation-driven systems that leverage text and multimodal inputs (e.g., images) to power visual-creation experiences
Build and optimize APIs and infrastructure to support high-performance model inference and experimentation at scale
Collaborate with product, ML, and design teams to integrate models into user-facing features, ensuring seamless functionality and performance
Conduct model evaluations and experiments, analyze results, and iterate on improvements to enhance accuracy and user experience

Fulltime

Senior Software Engineer, Data

We're the world's leading sports technology company, at the intersection between...

Location

Austria , Vienna

Salary:

Not provided

Sportradar

Expiration Date

Until further notice

Requirements

5+ years of data engineering experience with proven track record of leading complex data projects from conception to delivery
Exceptional communication skills and experience working in cross-functional teams with analysts, product managers, and business stakeholders
AWS & Data Engineering: Very strong hands-on experience with AWS services (S3, Lambda, Glue, Athena, Redshift, EMR, etc.) and proficiency with Apache Spark for large-scale data processing
Backend Development: Strong experience with Python for building data processing services and APIs, plus expert-level SQL for data processing and analytics
Infrastructure & DevOps: Hands-on experience with Docker, Terraform, and CI/CD pipelines with automation best practices for data systems
Clean Code Advocate: Strong commitment to writing clean, maintainable, well-documented code with comprehensive testing and deep knowledge of analytics/reporting requirements
Data Architecture: Experience designing scalable data architectures, data modeling, and optimizing data processing workflows
Dashboard Development: Experience creating and managing analytics dashboards in bi tools (Tableau, Qlik Sense, Quicksuite, Power BI) and data visualization solutions to present complex insights to stakeholders

Job Responsibility

Scale & Performance Engineering: Processing and analyzing terabytes of advertising data with sub-second query performance while building and maintaining robust ETL pipelines using Spark and AWS services to handle massive data volumes daily
Data Pipeline Architecture & Development: Designing and building scalable data processing systems, developing backend APIs and microservices (Python or Go), architecting data flows that support both batch and real-time analytics requirements, and managing user-facing dashboards that visualize complex data insights
Infrastructure & Data Quality Operations: Implementing robust monitoring and alerting systems to detect data quality issues, managing AWS infrastructure using Terraform, implementing CI/CD best practices, and maintaining high coding standards across data processing systems
Cross-Functional Leadership & Collaboration: Leading large-scale data projects from requirements gathering through delivery, bridging technical implementation with business requirements, mentoring team members, and presenting technical concepts to stakeholders while challenging requirements constructively
End-to-End Data System Ownership: Taking complete ownership of complex data engineering projects while ensuring high availability and accuracy for both internal stakeholders and external clients, championing clean code principles, and serving as a knowledge leader who supports delivering the right data solutions

What we offer

A collaborative environment with colleagues from all over the world (Engineering offices in Europe, Asia and US)
Ability to shape your own workday and career via a clearly defined professional and personal development plan
Opportunity to work with senior leadership, develop yourself and build your career within an inspiring and fast-growing company and digital sports environment
A vibrant and inclusive community, including Women in Tech and Pride groups which welcome all participants
A company culture that promotes social aspects, sports, physical exercise and fun
Innovative and cross-team challenges like ShipIt, office sports tournaments in Darts and Table Tennis and unique beer brewing competitions
Competitive salary and benefits (e.g. retirement pension and insurance plan)
Sportradar takes over the full costs of € 365.- for the Öffi-Ticket (Jahreskarte) for you

Fulltime

Select Country

Senior Software Data Engineer

Requirements

Nice to have

Looking for more opportunities?