CrawlJobs Logo

Data Engineer

https://www.atlassian.com Logo

Atlassian

Location Icon

Location:
India, Bengaluru

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

As a data engineer, you will have the opportunity to apply your strong technical experience building highly reliable data products. You enjoy working in an agile environment. You are able to translate raw requirements into solid solutions. You are motivated by solving challenging problems, where creativity is as crucial as your ability to write code and test cases.

Job Responsibility:

  • Help our partner teams ingest data faster into our data lake
  • Make our data products more efficient
  • Come up with ideas to help build self-serve data engineering within the company
  • Building micro-services, architecting, designing, and promoting self serve capabilities at scale to help Atlassian grow

Requirements:

  • At least 3+ years of professional experience as a software engineer or data engineer
  • A BS in Computer Science or equivalent experience
  • Strong programming skills (some combination of Python, Java, and Scala)
  • Experience writing SQL, structuring data, and data storage practices
  • Experience with data modeling
  • Knowledge of data warehousing concepts
  • Experienced building data pipelines and micro services
  • Experience with Spark, Airflow and other streaming technologies to process incredible volumes of streaming data
  • A willingness to accept failure, learn and try again
  • An open mind to try solutions that may seem impossible at first
  • Experience in working on Amazon Web Services (in particular using EMR, Kinesis, RDS, S3, SQS and the like), and databricks

Nice to have:

  • Experience building self-service tooling and platforms
  • Built and designed Kappa architecture platforms
  • A passion for building and running continuous integration pipelines
  • Built pipelines using Databricks and well versed with their API’s
  • Contributed to open source projects (Ex: Operators in Airflow)
What we offer:
  • Health coverage
  • Paid volunteer days
  • Wellness resources

Additional Information:

Job Posted:
May 01, 2025

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.