CrawlJobs Logo

Data Engineer Big Data Technology

Singapore, Singapore · Job Posted March 04, 2026
Apply Position
Job Link Share

Job Description

The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Job Responsibility

  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency

Requirements

  • 4-6 years of hands-on experience in Hadoop, Scala, Java, Spark, Hive, Kafka, Impala, Unix Scripting and other Big data frameworks
  • 4+ years of experience with relational SQL and NoSQL databases: Oracle, MongoDB, HBase
  • Strong proficiency in Python and Spark Java with knowledge of core spark concepts (RDDs, Dataframes, Spark Streaming, etc) and Scala and SQL
  • Data Integration, Migration & Large Scale ETL experience (Common ETL platforms such as PySpark/DataStage/)
  • 4-6 years of relevant experience in the Financial Service industry
  • Experienced in working with large and multiple datasets and data warehouses
  • Experience building and optimizing ‘big data’ data pipelines, architectures, and datasets
  • Strong analytic skills and experience working with unstructured datasets
  • Ability to effectively use complex analytical, interpretive, and problem-solving techniques
  • Experience with Confluent Kafka, Redhat JBPM, CI/CD build pipelines and toolchain – Git, BitBucket, Jira
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer Big Data Technology

8 matching positions

Data Engineer (Big Data, Cloud - AWS, Databricks) - Assistant Vice President

Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Scala, Spark/Pyspark is must, Hadoop ( BIG Data ), + AWS,Databricks
  • 8 to 11 years’ experience implementing data-intensive solutions using agile methodologies
  • Experience of relational databases and using SQL for data querying, transformation and manipulation
  • Experience of modelling data for analytical consumers
  • Ability to automate and streamline the build, test and deployment of data pipelines
  • Experience in cloud native technologies and patterns
  • A passion for learning new technologies, and a desire for personal growth, through self-study, formal classes, or on-the-job training
  • Excellent communication and problem-solving skills
  • An inclination to mentor
  • an ability to lead and deliver medium sized components independently
Job Responsibility
Job Responsibility
  • Developing and supporting scalable, extensible, and highly available data solutions
  • Deliver on critical business priorities while ensuring alignment with the wider architectural vision
  • Identify and help address potential risks in the data supply chain
  • Follow and contribute to technical standards
  • Design and develop analytical data models
  • Fulltime
Read More
Arrow Right

Data Engineer - Big Data, Python, Databricks

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4 - 6 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Proficient in Big DataTechnologies - Cloudera, Hive, Python, Java/PySpark, Data Bricks
  • Proficient in Data analysis and data modelling
  • Good understanding of ETL concepts
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Data Engineer (Big Data, Python, Databricks) - Assistant Vice President

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Chennai, Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years of relevant handson experience in Big Data technologies like Cloudera, Python, HQL, Java/PySpark
  • Knowledge on Machine Learning, AI would be added advantage
  • Experience in systems analysis, data analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Big Data Engineer

We are seeking a talented and experienced Big Data Hadoop Developer to join our ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field
  • 3-4 years of professional experience in Big Data development
  • Proven experience with the Hadoop ecosystem, including HDFS, YARN, Hive, and other related technologies
  • Hands on experience in SQL and shell scripting
  • Strong expertise in Apache Spark for data processing and analysis
  • Proficiency in at least one of the following programming languages: Scala, Python, or PySpark
  • Experience with building and optimizing large-scale data pipelines
  • Familiarity with data warehousing concepts and ETL methodologies
  • Solid understanding of distributed computing principles
  • Excellent problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Design, develop, and maintain robust and scalable ETL processes and data pipelines using Apache Hadoop and Apache Spark
  • Write efficient, clear, and well-documented code primarily in Scala, Python, or PySpark for big data processing
  • Implement data ingestion, transformation, and loading routines from various sources into Hadoop Distributed File System (HDFS) and other big data stores
  • Optimize existing Spark jobs and Hadoop ecosystem components for performance and scalability
  • Collaborate with data architects, data scientists, and other stakeholders to understand data requirements and translate them into technical solutions
  • Ensure data quality, integrity, and security across all big data platforms
  • Participate in code reviews, testing, and deployment of big data applications
  • Troubleshoot and resolve issues in big data environments
  • Stay up-to-date with the latest trends and technologies in the big data ecosystem
  • Fulltime
Read More
Arrow Right

Lead Java Big Data Engineer Vice President

At Citi, we are at the forefront of financial technology, driven by a belief in ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of progressive experience in professional software engineering, with at least 3 years in a technical leadership or architect role
  • Proven track record of designing and building complex, high-performance, scalable server-side applications using Java
  • Deep, hands-on experience with the Big Data ecosystem, including mastery of Apache Spark, Hadoop (HDFS), and real-time data streaming with Kafka
  • Extensive experience with relational databases, data modeling, and data warehousing concepts
  • Demonstrated experience leading and mentoring technical teams and successfully delivering complex, large-scale data projects from concept to production
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field
Job Responsibility
Job Responsibility
  • Define the end-to-end architectural vision and technical roadmap for migrating from Sybase IQ to a modern Big Data platform, ensuring solutions are scalable, resilient, and secure
  • Lead the design, development, and deployment of robust, large-scale data processing pipelines using technologies like Apache Spark, Kafka, and distributed data stores
  • Develop and execute a comprehensive, phased strategy for migrating petabytes of historical and transactional data from Sybase IQ, ensuring data integrity, minimal downtime, and zero business disruption
  • Oversee the design and development of Java-based microservices that interact with the new data platform, ensuring seamless integration with the broader Oasys application ecosystem
  • Lead, inspire, and mentor a high-performing team of Java and Big Data engineers. Foster a culture of engineering excellence, innovation, and accountability
  • Partner with global business leaders, product owners, and other senior technology managers to define requirements, manage expectations, and deliver solutions that drive significant business value
  • Remain deeply technical and contribute to coding, design, and architectural decisions, leading by example
  • Fulltime
Read More
Arrow Right

Senior Software Development Engineer - Big Data

Zillow’s Comprehensive Customer Data team is part of the Data Engineering organi...
Location
Location
Mexico , Mexico City
Salary
Salary:
Not provided
Zillow
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A degree (BS+) in Computer Science or a related discipline
  • 5+ years of experience with building and maintaining data-intensive applications
  • Experience developing complex software systems scaling to millions of users with production quality deployment, monitoring and reliability
  • Experience with modern data technologies (Spark, Flink, Kafka, Airflow)
  • Strong background in Java or Python
  • Excellent interpersonal skills and passionate about collaborating across organizational boundaries
Job Responsibility
Job Responsibility
  • Design, implement, and take ownership of mission-critical data pipelines and data products
  • Collaborate with various internal teams (platform, product, other stakeholders) to scope and deliver tools ensuring ease of system use
  • Carefully review specifications, designs, pull requests and provide constructive/helpful feedback
  • Write high-quality code, refactor and optimize code for better scalability, performance, and readability
  • Integrate new frameworks, libraries, technologies, and components into codebase
  • Proactively log/collect and review metrics, monitor, alert and address issues quickly
  • Ensure the consistency and maintainability of existing applications adhering to standards/procedures for implementing technical solutions
  • Execute production/support tasks according to a documented schedule that meets or exceeds customer expectations
  • Support and mentor teams through design, implementation and deployment of solutions using relevant technologies
  • Mentor junior engineers
What we offer
What we offer
  • competitive base salary and benefits
  • equity awards based on factors such as experience, performance and location
  • Fulltime
Read More
Arrow Right

Senior Software Development Engineer, Big Data

The Zillow Group’s Housing Trends Data Engineering team brings innovative analys...
Location
Location
United States
Salary
Salary:
152900.00 - 257100.00 USD / Year
Zillow
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong proficiency in Python programming
  • Hands-on experience with big data ecosystems, architectures and modern data platforms, including AWS cloud data services and Lakehouse/Lakebase platforms
  • Hands-on experience with Databricks is a significant advantage
  • Proven ability to design, build, and orchestrate batch and real-time data pipelines, processing large-scale datasets from diverse sources
  • Practical experience with cutting-edge data engineering technologies such as SparkSQL and Spark Streaming, PostgreSQL, EKS, and Kubernetes
  • Familiarity with Agile/DevOps software development processes and tools such as GitLab and CI/CD
  • A good understanding of data science concepts, fundamental machine learning algorithms/libraries, and development lifecycle is a must-to-have
  • Familiarity with LLM and Agentic AI technologies and engineering patterns is a big advantage
  • Strong ability in performing root cause analysis to address operational issues and identify opportunities for improvement
  • Exceptional communication skills to drive effective customer engagement, collaborate with cross-functional teams, and clearly articulate technical concepts to technical and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Build data systems to link raw data and concrete Housing Trends insights
  • Build and extend our internal forecasting model development framework
  • Develop and maintain scalable data products and deliver pipelines built for speed, accuracy, and consistency that will scale as our stakeholders’ need
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability and performance, etc
  • Collaborate with data scientists to understand their data requirements and build systems/tools that enable efficient model training and experimentation
  • Implement feature stores and ETL pipelines to streamline feature engineering and model development
  • Build and maintain infrastructure for deploying machine learning models into production environments
  • Be a trusted partner for our stakeholders, such as Forecasting, Zestimates, and the ML teams within the AI organization to assist them for data investigation/publication, ML model development and infrastructure support
What we offer
What we offer
  • Eligible for equity awards based on factors such as experience, performance and location
  • Fulltime
Read More
Arrow Right

Senior Big Data Engineer

Start.io is a mobile marketing and audience platform. Start.io empowers the mobi...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
start.io Logo
Start.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • B.Sc. or M.Sc. in Computer Science, Software Engineering, or other equivalent fields.
  • 5+ years of hands-on experience in backend or ML engineering
  • Strong Python skills and experience working with distributed systems and parallel data processing frameworks such as Spark (using PySpark or Scala), Dask, or similar technologies. Familiarity with Scala is a strong advantage, especially in performance-critical environments.
  • Proven track record in designing and scaling ML infrastructure
  • Deep understanding of ML workflows and lifecycle management
  • Experience in cloud environments (AWS, GCP, OCI) and containerized deployment (Kubernetes)
  • Understanding databases and SQL for data retrieval.
  • Strong communication skills and ability to drive initiatives independently
  • A passion for clean code, elegant architecture, and measurable impact
  • Monitoring and alerting tools (e.g. Grafana, Kibana)
Job Responsibility
Job Responsibility
  • Design and implement large-scale, distributed ML training pipelines
  • Build scalable infrastructure for data preprocessing, feature engineering, and model evaluation
  • Lead the technical design and development of new ML systems: from architecture to production
  • Collaborate cross-functionally with DS, infra teams, Product, BA and Engineering teams to define and deliver impactful solutions
  • Own the full lifecycle of ML infra: tooling, versioning, monitoring, automation, measuring results and quickly responding to critical issues.
  • Continuously research and adopt best-in-class practices in MLOps, performance tuning, and distributed systems
Read More
Arrow Right