Data Engineer

Application Developer - Java Spark Big Data

The Applications Development Senior Programmer Analyst is an intermediate level ...

Location

India , Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Bachelor's degree in Computer Science, Engineering, or a related field
Extensive development expertise in building the high scaled and performant software platforms for data computation and processing
Experience in software development with a strong focus on Core Java and Spark
Expert level knowledge of core Java concepts and framework such as Spring Boot, Microservices and well versed with OOPs concepts and design patterns
Hands-on experience with Apache Spark (with Java)
Experience with caching solutions like Pinot, Redis etc.
Strong knowledge of Oracle DB, including schema design and query optimization
Strong problem-solving skills and the ability to work independently
Excellent communication and teamwork skills
Strong computer science fundamentals in data structures, algorithms, databases, and operating systems

Job Responsibility

Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
Ensure essential procedures are followed and help define operating standards and processes
Serve as advisor or coach to new or lower level analysts
Has the ability to operate with a limited level of direct supervision
Can exercise independence of judgement and autonomy
Acts as SME to senior stakeholders and /or other team members

Fulltime

Application Developer - Java Spark Big Data

The Applications Development Senior Programmer Analyst is an intermediate level ...

Location

India , Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Bachelor's degree in Computer Science, Engineering, or a related field
Extensive development expertise in building the high scaled and performant software platforms for data computation and processing
Experience in software development with a strong focus on Core Java and Spark
Expert level knowledge of core Java concepts and framework such as Spring Boot, Microservices and well versed with OOPs concepts and design patterns
Hands-on experience with Apache Spark (with Java)
Experience with caching solutions like Pinot, Redis etc.
Strong knowledge of Oracle DB, including schema design and query optimization
Strong problem-solving skills and the ability to work independently
Excellent communication and teamwork skills
Strong computer science fundamentals in data structures, algorithms, databases, and operating systems

Job Responsibility

Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
Ensure essential procedures are followed and help define operating standards and processes
Serve as advisor or coach to new or lower level analysts
Operate with a limited level of direct supervision
Act as SME to senior stakeholders and/or other team members
Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients, and assets.

What we offer

Equal opportunity employer
Consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran
Reasonable accommodation for persons with disability.

Fulltime

Software Engineer - Data Engineering

Akuna Capital is a leading proprietary trading firm specializing in options mark...

Location

United States , Chicago

Salary:

130000.00 USD / Year

AKUNA CAPITAL

Expiration Date

Until further notice

Requirements

BS/MS/PhD in Computer Science, Engineering, Physics, Math, or equivalent technical field
5+ years of professional experience developing software applications
Java/Scala experience required
Highly motivated and willing to take ownership of high-impact projects upon arrival
Prior hands-on experience with data platforms and technologies such as Delta Lake, Spark, Kubernetes, Kafka, ClickHouse, and/or Presto/Trino
Experience building large-scale batch and streaming pipelines with strict SLA and data quality requirements
Must possess excellent communication, analytical, and problem-solving skills
Recent hands-on experience with AWS Cloud development, deployment and monitoring necessary
Demonstrated experience working on an Agile team employing software engineering best practices, such as GitOps and CI/CD, to deliver complex software projects
The ability to react quickly and accurately to rapidly changing market conditions, including the ability to quickly and accurately respond and/or solve math and coding problems are essential functions of the role

Job Responsibility

Work within a growing Data Engineering division supporting the strategic role of data at Akuna
Drive the ongoing design and expansion of our data platform across a wide variety of data sources, supporting an array of streaming, operational and research workflows
Work closely with Trading, Quant, Technology & Business Operations teams throughout the firm to identify how data is produced and consumed, helping to define and deliver high impact projects
Build and deploy batch and streaming pipelines to collect and transform our rapidly growing Big Data set within our hybrid cloud architecture utilizing Kubernetes/EKS, Kafka/MSK and Databricks/Spark
Mentor junior engineers in software and data engineering best practices
Produce clean, well-tested, and documented code with a clear design to support mission critical applications
Build automated data validation test suites that ensure that data is processed and published in accordance with well-defined Service Level Agreements (SLA’s) pertaining to data quality, data availability and data correctness
Challenge the status quo and help push our organization forward, as we grow beyond the limits of our current tech stack

What we offer

Discretionary performance bonus
Comprehensive benefits package that may encompass employer-paid medical, dental, vision, retirement contributions, paid time off, and other benefits

Fulltime

This is a data engineer position - a programmer responsible for the design, deve...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

5-8 years of experience in working in data eco systems
4-5 years of hands-on experience in Hadoop, Scala, Java, Spark, Hive, Kafka, Impala, Unix Scripting and other Big data frameworks
3+ years of experience with relational SQL and NoSQL databases: Oracle, MongoDB, HBase
Strong proficiency in Python and Spark Java with knowledge of core spark concepts (RDDs, Dataframes, Spark Streaming, etc) and Scala and SQL
Data Integration, Migration & Large Scale ETL experience (Common ETL platforms such as PySpark/DataStage/AbInitio etc.) - ETL design & build, handling, reconciliation and normalization
Data Modeling experience (OLAP, OLTP, Logical/Physical Modeling, Normalization, knowledge on performance tuning)
Experienced in working with large and multiple datasets and data warehouses
Experience building and optimizing 'big data' data pipelines, architectures, and datasets
Strong analytic skills and experience working with unstructured datasets
Ability to effectively use complex analytical, interpretive, and problem-solving techniques

Job Responsibility

Ensuring high quality software development, with complete documentation and traceability
Develop and optimize scalable Spark Java-based data pipelines for processing and analyzing large scale financial data
Design and implement distributed computing solutions for risk modeling, pricing and regulatory compliance
Ensure efficient data storage and retrieval using Big Data
Implement best practices for spark performance tuning including partition, caching and memory management
Maintain high code quality through testing, CI/CD pipelines and version control (Git, Jenkins)
Work on batch processing frameworks for Market risk analytics
Promoting unit/functional testing and code inspection processes
Work with business stakeholders and Business Analysts to understand the requirements
Work with other data scientists to understand and interpret complex datasets

Fulltime

Lead Data Engineer

As a Lead Data Engineer at Rearc, you'll play a pivotal role in establishing and...

Location

India , Bengaluru

Salary:

Not provided

Rearc

Expiration Date

Until further notice

Requirements

10+ years of experience in data engineering, data architecture, or related fields
Extensive experience in writing and testing Java and/or Python
Proven experience with data pipeline orchestration using platforms such as Airflow, Databricks, DBT or AWS Glue
Hands-on experience with data analysis tools and libraries like Pyspark, NumPy, Pandas, or Dask
Proficiency with Spark and Databricks is highly desirable
Proven track record of leading complex data engineering projects, including designing and implementing scalable data solutions
Hands-on experience with ETL processes, data warehousing, and data modeling tools
In-depth knowledge of data integration tools and best practices
Strong understanding of cloud-based data services and technologies (e.g., AWS Redshift, Azure Synapse Analytics, Google BigQuery)
Strong strategic and analytical skills

Job Responsibility

Understand Requirements and Challenges: Collaborate with stakeholders to deeply understand their data requirements and challenges
Implement with a DataOps Mindset: Embrace a DataOps mindset and utilize modern data engineering tools and frameworks, such as Apache Airflow, Apache Spark, or similar, to build scalable and efficient data pipelines and architectures
Lead Data Engineering Projects: Take the lead in managing and executing data engineering projects, providing technical guidance and oversight to ensure successful project delivery
Mentor Data Engineers: Share your extensive knowledge and experience in data engineering with junior team members, guiding and mentoring them to foster their growth and development in the field
Promote Knowledge Sharing: Contribute to our knowledge base by writing technical blogs and articles, promoting best practices in data engineering, and contributing to a culture of continuous learning and innovation

Senior Data Engineer

A typical day may involve collaborating with partners, you will design data mode...

Location

Australia , Sydney

Salary:

Not provided

Atlassian

Expiration Date

Until further notice

Requirements

BS in Computer Science or equivalent experience with 5+ years as Data Engineer or similar role
Programming skills in Python & Java (good to have)
Design data models for storage and retrieval to meet product and requirements
Build scalable data pipelines using Spark, Airflow, AWS data services (Redshift, Athena, EMR), Apache projects (Spark, Flink, Hive, and Kafka)
Familiar with modern software development practices (Agile, TDD, CICD) applied to data engineering
Enhance data quality through internal tools/frameworks detecting DQ issues
Working knowledge of relational databases and SQL query authoring

Job Responsibility

Design data models, acquisition processes, and applications to address needs
Lead business growth and enhance product experiences
Collaborate with Product, Engineering, Research and Data Scientists across programs
Take ownership of problems from end-to-end: extracting/cleaning data, and understanding source systems
Improve the quality of data by adding sources, coding rules, and producing metrics

What we offer

Health coverage
Paid volunteer days
Wellness resources

Fulltime

Data Engineer

Atlassian is looking for a Data Engineer to join our Data Engineering Team. You ...

Location

United States , San Francisco

Salary:

186800.00 USD / Year

Atlassian

Expiration Date

Until further notice

Requirements

BS in Computer Science or equivalent experience with 3+ years as a Data Engineer or a similar role
Programming skills in Python & Java (good to have)
Design data models for storage and retrieval to meet product and requirements
Build scalable data pipelines using Spark, Airflow, AWS data services (Redshift, Athena, EMR), Apache projects (Spark, Flink, Hive, and Kafka)
Familiar with modern software development practices (Agile, TDD, CICD) applied to data engineering
Enhance data quality through internal tools/frameworks detecting DQ issues
Working knowledge of relational databases and SQL query authoring

Job Responsibility

Design data models, acquisition processes, and applications to address needs
Lead business growth and enhance product experiences
Collaborate with Technology Teams, Global Analytical Teams, and Data Scientists across programs
Extract/clean data and understand generating systems
Improve the quality of data by adding sources, coding rules, and producing metrics

What we offer

Health coverage
Paid volunteer days
Wellness resources

Fulltime

Senior Data Engineer

Atlassian is looking for a Senior Data Engineer to join our Data Engineering Tea...

Location

United States , San Francisco

Salary:

135600.00 - 217800.00 USD / Year

Atlassian

Expiration Date

Until further notice

Requirements

BS in Computer Science or equivalent experience with 5+ years as Data Engineer or similar role
Programming skills in Python & Java (good to have)
Design data models for storage and retrieval to meet product and requirements
Build scalable data pipelines using Spark, Airflow, AWS data services (Redshift, Athena, EMR), Apache projects (Spark, Flink, Hive, and Kafka)
Familiar with modern software development practices (Agile, TDD, CICD) applied to data engineering
Enhance data quality through internal tools/frameworks detecting DQ issues
Working knowledge of relational databases and SQL query authoring

Job Responsibility

Collaborating with partners, you will design data models, acquisition processes, and applications to address needs
Lead business growth and enhance product experiences
Collaborate with Technology Teams, Global Analytical Teams, and Data Scientists across programs
Extracting/cleaning data, understanding generating systems
Improve data quality by adding sources, coding rules, and producing metrics as requirements evolve

What we offer

health coverage
paid volunteer days
wellness resources

Fulltime

Data Engineer – Java & Spark

Wissen

Location:
India , Bangalore South

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
March 05, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Data Engineer – Java & Spark

Application Developer - Java Spark Big Data