This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We're seeking a passionate and highly skilled Java Data Engineer to guide and mentor a talented team of engineers in building and maintaining Citi's next-generation data platform. If you're a natural leader with a deep understanding of Java, distributed systems, and a passion for pushing the boundaries of Big Data technology, we want to hear from you.
Job Responsibility:
Effectively interact, collaborate with development team
Work with developers onshore, offshore and matrix teams to implement a business solution
Effectively communicate development progress to the tech lead
Implement Ad-hoc changes as requested by the business or technology
Committed technologist focused on delivering high quality products on time, following TDD and meeting aggressive timelines
Requirements:
5+ years of hands-on experience developing high-performance Java applications (Java 11+ preferred) with a strong foundation in core Java concepts, OOP, and OOAD
Proven experience building and maintaining data pipelines using technologies like Kafka, Apache Spark
Familiarity with event-driven architectures and experience in developing real-time, low-latency applications
Object Oriented analysis and design using common design patterns
Profound insight of Java and JEE internals (Classloading, Memory Management, Transaction management etc)
Excellent knowledge of Relational Databases, SQL and ORM technologies (JPA2, Hibernate)
Experience in the Spring Framework
Understanding of Spark's core concepts: RDDs (Resilient Distributed Datasets), DataFrames, Datasets, transformations (map, filter, reduce), and actions (collect, count)
Proficiency in writing Spark applications using the Java API
Knowledge of Spark's execution model and cluster management
Experience with using Spark SQL for data manipulation and querying
Familiarity with Spark SQL's data types and functions
Ability to write SQL queries within Spark applications
Understanding of real-time data processing concepts
Experience with Spark Streaming API for processing data streams
Knowledge of different input sources and output sinks for streaming data
Familiarity with basic machine learning concepts
Experience with using Spark MLlib for building and deploying machine learning models
Knowledge of different machine learning algorithms available in MLlib
Understanding of data serialization formats like Kryo and Avro
Ability to optimize data serialization for performance improvements
Knowledge of Spark's performance tuning parameters
Ability to identify and address performance bottlenecks in Spark applications
Candidate should have keen interest to gain financial knowledge
Strong written, interpersonal and verbal communication skills
Nice to have:
Familiarity with other big data tools like Hadoop, Hive, Kafka, and HBase
Experience with cloud platforms like AWS, Azure, or Google Cloud Platform, especially their managed Spark services (EMR, Databricks, HDInsight)
Docker and Kubernetes for deploying and managing Spark applications
Continuous integration and continuous deployment pipelines for automated testing and deployment
While Java is perfectly suitable, learning Scala can be beneficial as many Spark libraries and examples are written in Scala
Proficiency in using the oc command-line tool to manage OpenShift resources
Strong understanding of Kubernetes concepts like pods, deployments, services, namespaces, and configmaps, as OpenShift is built on Kubernetes
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.