Senior Data Engineer, Atlassian

Atlassian

Location:
India, Bengaluru

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Not provided

Save Job

Apply Position

Job Description:

Atlassian is looking for a Senior Data Engineer to join our Data Engineering team which is responsible for building our data lake, maintaining our big data pipelines / services and facilitating the movement of billions of messages each day. We work directly with the business stakeholders and plenty of platform and engineering teams to enable growth and retention strategies at Atlassian. We are looking for an open-minded, structured thinker who is passionate about building services that scale.

Job Responsibility:

Help our stakeholder teams ingest data faster into our data lake
Find ways to make our data pipelines more efficient
Come up with ideas to help instigate self-serve data engineering within the company
Apply your strong technical experience building highly reliable services on managing and orchestrating a multi-petabyte scale data lake
Take vague requirements and transform them into solid solutions
Solve challenging problems, where creativity is as crucial as your ability to write code and test cases

Requirements:

A BS in Computer Science or equivalent experience
At least 7+ years professional experience as a Sr. Software Engineer or Sr. Data Engineer
Strong programming skills (Python, Java or Scala preferred)
Experience writing SQL, structuring data, and data storage practices
Experience with data modeling
Knowledge of data warehousing concepts
Experience building data pipelines, platforms
Experience with Databricks, Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data
Experience in modern software development practices (Agile, TDD, CICD)
Strong focus on data quality and experience with internal/external tools/frameworks to automatically detect data issues, anomalies
A willingness to accept failure, learn and try again
An open mind to try solutions that may seem crazy at first
Experience working on Amazon Web Services (in particular using EMR, Kinesis, RDS, S3, SQS and the like)

Nice to have:

Experience building self-service tooling and platforms
Built and designed Kappa architecture platforms
Contributed to open source projects (Ex: Operators in Airflow)
Experience with Data Build Tool (DBT)

What we offer:

Health and wellbeing resources
Paid volunteer days

Additional Information:

Job Posted:
May 01, 2025

Employment Type:

Fulltime

Work Type:

Remote work

View All Jobs In This Company

Job Link Share:

Senior Data Engineer