Python/Pyspark Programmer Analyst - Officer

• Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
• Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
• Apply fundamental knowledge of programming languages for design specifications
• Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
• Serve as advisor or coach to new or lower-level analysts
• Identify problems, analyze information, and make evaluative judgments to recommend and implement solutions
• Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
• Has the ability to operate with a limited level of direct supervision
• Can exercise independence of judgment and autonomy
• Acts as SME to senior stakeholders and/or other team members
• Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency

• 0-3 years of relevant experience in the Financial Service industry
• Intermediate level experience in Applications Development role
• Consistently demonstrates clear and concise written and verbal communication
• Demonstrated problem-solving and decision-making skills
• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
• Bachelor's degree/University degree or equivalent experience
• Hadoop Ecosystem:In-depth understanding of HDFS architecture, data storage, and fault tolerance mechanisms, coupled with experience in HDFS commands and administration
• Solid understanding of YARN for resource management and job scheduling, and a fundamental grasp of the MapReduce programming paradigm
• Spark Expertise:Strong proficiency in Spark Core, Spark SQL, and Spark Streaming, with Spark GraphX being a beneficial addition
• Expert-level programming skills in PySpark for developing Spark applications and extensive experience with Spark performance optimization techniques (e.g., caching, partitioning, shuffle optimizations, memory management)
• Familiarity with deploying Spark applications on YARN, Mesos, or Kubernetes is also required
• Hive Proficiency:Advanced proficiency in writing complex HiveQL queries for data analysis and ETL processes
• A thorough understanding of Hive metastore, various execution engines (MapReduce, Tez, Spark), and storage formats (ORC, Parquet, Avro), along with proven experience in optimizing Hive queries and table designs for performance
• Programming & Scripting:Strong object-oriented and functional programming skills, particularly in Scala (with experience in SBT, Maven, and common Scala libraries/frameworks) and Python (specifically PySpark for data processing, and familiarity with data manipulation libraries like Pandas and NumPy)
• Proficiency in scripting for automation and data orchestration
• Data Integration & Orchestration:Experience with data ingestion tools like Apache Sqoop, Apache Flume, and Kafka
• Proficient in workflow orchestration tools such as Apache Oozie and Apache Airflow

Spark GraphX

• medical, dental & vision coverage
• 401(k)
• life, accident, and disability insurance
• wellness programs
• paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays