Big Data Engineer

• Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements
• identify and analyze issues, make recommendations, and implement solutions
• utilize knowledge of business processes, system processes, and industry standards to solve complex issues
• analyze information and make evaluative judgements to recommend solutions and improvements
• conduct testing and debugging, utilize script tools, and write basic code for design specifications
• assess applicability of similar experiences and evaluate options under circumstances not covered by procedures
• develop working knowledge of Citi’s information systems, procedures, standards, client server application development, network operations, database administration, systems administration, data center operations, and PC-based applications
• selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
• implementing data wrangling, scraping, cleaning using both Java or Python.

• 2+ years of relevant experience
• experience in programming/debugging used in business applications
• working knowledge of industry practice and standards
• comprehensive knowledge of specific business area for application development
• working knowledge of program languages
• consistently demonstrates clear and concise written and verbal communication
• proficient understanding of distributed computing principles
• proficient in Java or Python and some part of machine learning
• proficiency with Hadoop v2, MapReduce, HDFS, Pyspark, Spark
• experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
• good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
• experience with integration of data from multiple data sources
• experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• knowledge of various ETL techniques and frameworks, such as Flume
• experience with various messaging systems, such as Kafka or RabbitMQ
• experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O
• good understanding of Lambda Architecture, along with its advantages and drawbacks
• experience with Cloudera, MapR, or Hortonworks.

equal consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other protected characteristic.