Senior Software Engineer, Data Pipeline Job at Fullstory (Atlanta)

Software Engineer / Senior Software Engineer - Data Engineering GitHub

As a Software Engineer at GitHub, you will enhance the collaboration experience ...

Location

Czech Republic , Multiple Locations

Salary:

Not provided

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND experience in Data Engineering and coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python OR equivalent experience.
Master's Degree in Computer Science or related technical field AND engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust or Python OR Bachelor's Degree in Computer Science or related technical field AND engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust or Python OR equivalent experience.

Job Responsibility

Design, develop, test and ship high-quality technical solutions that scale across multiple GitHub services.
Collaborate with cross-functional teams to define and implement innovative solutions.
Provide technical leadership, mentorship, pairing opportunities, and code reviews to encourage the growth of others.
Own and advocate for the health and quality of the systems that the team builds, including participating in on-call and first responder rotations
Write architecture briefs and proposals, carry out code experiments, and build prototypes to learn how we can achieve planetary scale with our systems.
Design and implement APIs to facilitate seamless integration between software components.
Utilize CI/CD tools to set up automated pipelines for continuous integration and delivery.
Become intimately familiar with the systems you build and take pride in writing maintainable code.

Fulltime

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...

Location

India , Bangalore

Salary:

Not provided

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR equivalent experience
Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
Experience building data lake or data engineering products, tools, or pipelines
Familiarity with container-based architectures (Docker, Kubernetes)
Ability to debug complex distributed systems on Linux and/or Windows platforms

Job Responsibility

Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
Use AI tools and coding best practices across the development lifecycle
Design data refresh, scheduling, and query optimisation features with minimal supervision
Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
Coach junior engineers through code reviews
Debug complex issues in distributed systems running on Azure, Linux, and Windows
Run live site operations on a rotational, on-call basis
Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features

Fulltime

Software Developer - Senior / Senior Data Engineer

Imagine being at the forefront of protecting financial integrity and enabling cr...

Location

United States , Southlake, TX or Austin, TX

Salary:

55.92 - 62.13 USD / Hour

Aquent

Expiration Date

Until further notice

Requirements

Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field
8+ years of hands-on experience in data management, including gathering data from diverse sources, consolidating it into centralized locations, and transforming it with business logic for consumption in visualization and data analysis
Strong expertise in BigQuery, Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, and related cloud platform services
Proficiency in Python and SQL for data processing and automation
Extensive experience with ETL processes and data pipeline design
Excellent problem-solving skills and meticulous attention to detail
Strong communication and collaboration skills, with the ability to actively listen, dialogue freely, and verbalize ideas effectively
Ability to thrive in an Agile work environment, delivering incremental value to customers by effectively managing and prioritizing tasks

Job Responsibility

Design, build, and maintain robust and scalable data pipelines using cloud platform tools such as BigQuery, Cloud Storage, Dataflow (Apache Beam), Cloud Composer (Airflow), and Pub/Sub
Develop high-performance, production-grade Python and SQL code, optimizing queries for efficient data extraction, transformation, and loading (ETL) processes
Implement complex data models in BigQuery, leveraging partitioning, clustering, and materialized views to achieve optimal performance
Collaborate closely with cross-functional teams, including business customers and Subject Matter Experts, to gather data requirements and deliver impactful solutions
Implement and uphold best practices for data quality, data governance, and data security
Proactively monitor and troubleshoot data pipeline issues, ensuring high availability and performance of critical data flows
Contribute to strategic data architecture decisions, providing recommendations for continuous improvement of data pipelines
Stay current with emerging trends and technologies in cloud-based data engineering and cyber security to drive innovation
Lead investigation and resolution efforts for identified data issues, taking ownership to resolve them in a timely manner
Document processes and procedures thoroughly for producing accurate metrics and ensuring operational clarity

What we offer

subsidized health, vision, and dental plans
paid sick leave
retirement plans with a match

Software Engineer II and Senior Software Engineer

The FIO (Office Files and Identity) Team drives collaboration, identity, cloud f...

Location

United States , Redmond

Salary:

100600.00 - 199000.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, or Rust
OR equivalent experience
4+ years industry engineering experience coding in languages including, but not limited to, C, C++, C#, Java or Rust
4+ years industry experience building and shipping production quality, performant and cross-platform applications
Experience collaborating cross-team and cross-function to deliver software features or projects
Platform-specific experience building Windows, MacOS, iOS or Android applications
Experience designing and implementing efficient network communications, including network protocols, performance and reliability tooling, modeling and implementing complex customer scenarios across network services
Experience designing and implementing client-side storage stacks, with a focus on correctness, resiliency, performance, and adaptability
Understanding of client file system design and APIs, including advanced performance optimizations
Experience directly implementing large-scale data pipelines for product telemetry, with ability to evolve system as business and technical needs change

Job Responsibility

Design and write code
Work across organizations and directly with partners both in Office and across Microsoft, including other engineers and product leaders
Use data as the basis for decision making
Be a steward of products that ship to hundreds of millions of customers around the world, staying connected to customers through data and feedback and being agile and responsive to issues
Grow as an engineer in a modern and highly impactful team

Fulltime

New

Senior Data Software Engineer

Location

Poland , Krakow

Salary:

224000.00 - 336000.00 PLN / Year

ActiveCampaign

Expiration Date

Until further notice

Requirements

5+ years of professional software engineering experience, with a proven track record of building and maintaining production-grade data systems
Deep Data Architecture expertise, with the ability to design modern data stack components and schemas that balance immediate performance with future growth
Proficiency in Infrastructure as Code, specifically using Terraform to manage and deploy your own infrastructure
A high level of software rigor, including a strong background in automated testing, CI/CD, and general software engineering best practices
Expert-level SQL skills (particularly MySQL), with a focus on optimizing complex queries for maximum performance
Experience in a modern technical environment, ideally having worked with Python, AWS (S3, Aurora, RDS), Snowflake, Apache Spark, and DBT
Exceptional communication skills, with the talent to distill complex technical concepts into clear, actionable insights for both technical and non-technical peers

Job Responsibility

Architect and Build Pipelines by designing, developing, and maintaining high-throughput data pipelines that seamlessly transform data across our ecosystem
Execute Data Modeling and Schema Design, utilizing DDL and DML operations to optimize data structures for both performance and long-term scalability
Champion Engineering Excellence by implementing automated testing, CI/CD pipelines, and Infrastructure as Code (Terraform) to ensure system health and reliability
Collaborate Cross-Functionally with Data Science and AI teams to engineer feature stores and automated MLOps pipelines, moving cutting-edge research into live production environments
Drive System Monitoring and health checks, ensuring our containerized and orchestrated environments (Kubernetes, Docker, Airflow) run at peak efficiency
Act as a Technical Advisor to stakeholders, translating complex data architectures into clear, non-technical conversations that guide business decisions

What we offer

Medical and dental benefits paid 100% by ActiveCampaign for you and 50% for your dependents
Reimbursements on vision expenses
Complimentary access to telehealth services
Free subscription to Calm
Access to LinkedIn Learning
Professional development programs
Career growth opportunities
Generous Paid Time Off
Pension scheme with matching up to 1.5% of your contribution
MultiSport Plus card

Fulltime