CrawlJobs Logo

Bigdata Java Spark And Pyspark Developer

https://www.citi.com/ Logo

Citi

Location Icon

Location:
India , Pune

Category Icon

Job Type Icon

Contract Type:
Employment contract

Salary Icon

Salary:

Not provided

Job Description:

The Digital S/W Engineer Sr Analyst role involves contributing to the development of new techniques and improving processes and workflow. It requires in-depth knowledge of application programming principles and the ability to lead design decisions, troubleshoot technical challenges, improve processes, and ensure compliance with technical requirements.

Job Responsibility:

  • Executing and driving mid-size feature application design and development efforts to completion
  • Serving as a development lead on medium-scale projects
  • Supporting the execution of larger efforts
  • Analyzing and troubleshooting coding, application performance and design challenges
  • Conducting research in root cause of development and performance concerns and resolving defects
  • Understanding engineering needs including those required to build, maintain, and operate the system through all phases of its life
  • Participating in design discussions as a Development Lead
  • Communicating progress, anticipating bottlenecks, providing escalation management, identifying, assessing, tracking, and mitigating issues/risks
  • Working across teams to optimize processes
  • Reviewing metrics and seeking improved mechanisms for visibility and alignment with objectives
  • Assessing development processes, test plans, and operations
  • Streamlining or eliminating excess process in relevant areas
  • Sharing knowledge with the team through various forums and demonstrating advanced knowledge

Requirements:

  • 5-8 years in a product development/product management environment
  • Strong analytical and quantitative skills
  • Data driven and results-oriented
  • Experience delivering with an agile methodology
  • Experience in affecting large culture change
  • Experience leading infrastructure programs
  • Skilled at working with third party service providers
  • Excellent written and oral communication skills
  • Bachelor’s/University degree or equivalent experience

Additional Information:

Job Posted:
April 24, 2025

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Bigdata Java Spark And Pyspark Developer

Big Data Engineering Lead

The Senior Big Data engineering lead will play a pivotal role in designing, impl...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master’s degree in Computer Science, Information Technology, or related field
  • Atleast 10 -12 years overall software development experience on majorly working with handling application with large scale data volumes from ingestion, persistence and retrieval
  • Deep understanding of big data technologies, including Hadoop, Spark, Kafka, Flink, NoSQL databases, etc.
  • Experience with Bigdata technologies Developer Hadoop, Apache Spark, Python, PySpark
  • Strong programming skills in languages such as Java, Scala, or Python
  • Excellent problem-solving skills with a knack for innovative solutions
  • Strong communication and leadership abilities
  • Proven ability to manage multiple projects simultaneously and deliver results
Job Responsibility
Job Responsibility
  • Lead the design and development of a robust and scalable big data architecture handling exponential data growth while maintaining high availability and resilience
  • Design complex data transformation processes using Spark and other big data technologies using Java, Pyspark or Scala
  • Design and implement data pipelines that ensure data quality, integrity, and availability
  • Collaborate with cross-functional teams to understand business needs and translate them into technical requirements
  • Evaluate and select technologies that improve data efficiency, scalability, and performance
  • Oversee the deployment and management of big data tools and frameworks such as Hadoop, Spark, Kafka, and others
  • Provide technical guidance and mentorship to the development team and junior architects
  • Continuously assess and integrate emerging technologies and methodologies to enhance data processing capabilities
  • Optimize big data frameworks, such as Hadoop, Spark, for performance improvements and reduced processing time across distributed systems
  • Implement data governance frameworks to ensure data accuracy, consistency, and privacy across the organization, leveraging metadata management and data lineage tracking
  • Fulltime
Read More
Arrow Right

Big Data Engineer

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-8 years of experience in software development, building large scale distributed data processing systems or large-scale applications
  • Designing & developing Big Data solutions with at least one end to end implementation
  • Strong Hands-on experience in following technical skills: Apache Spark, Scala/ Java, XML/ JSON/ Parquet/ Avro, SQL, Linux, Hadoop Ecosystem (HDFS, Spark, Impala, HIVE, HBASE etc.), Kafka
  • Performance analysis, troubleshooting and issue resolution and Exposure to latest Cloudera offerings like Ozone, Iceberg
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Design, development of BigData applications/ pipelines using Spark, Scala, SQL, Pyspark, Python, Java
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Bigdata Developer with PySpark

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-8 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience
  • Strong understanding of Core Java and Object-Oriented Programming (OOP) concepts
  • Proficiency in Python, specifically for PySpark development
  • Hands-on experience or familiarity with Apache Spark (PySpark), Hadoop, and related ecosystem components like Hive and Sqoop
  • Basic knowledge of SQL and relational databases
Job Responsibility
Job Responsibility
  • Develop and maintain data pipelines: Design, develop, and optimize scalable ETL (Extraction, Transformation, Loading) pipelines using PySpark to process large datasets
  • Coding and software engineering: Write clean, efficient, well-documented code primarily in Python (PySpark) and Java, often utilizing frameworks like Spring Boot
  • Collaboration and communication: Work with cross-functional teams, including senior developers, data engineers, analysts, and business partners, to understand data requirements and ensure seamless integration of solutions
  • Troubleshooting and optimization: Debug and resolve data processing issues and performance bottlenecks in Spark applications and other big data technologies
  • Full lifecycle involvement: Participate in the entire software development lifecycle (SDLC), from requirements analysis and design to testing, deployment, and operations, often using Agile/Scrum methodologies
  • Data integrity and quality: Ensure data quality and integrity throughout the data lifecycle
  • Fulltime
Read More
Arrow Right
New

Senior Java -Spark-Bigdata Engineer-Assistant Vice President

The Applications Development Senior Programmer Analyst is a senior-level positio...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-10 years of relevant experience in Data Engineering or a similar role, preferably within the Financial Services industry
  • Senior-level experience in an Applications Development or Data Engineering role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
  • Hands-on expertise in Java (8+), Spring Boot, Python, and PySpark for building high-performance data applications
  • Extensive experience with the BigData ecosystem, including Apache Spark for large-scale data processing
  • Solid understanding of Data Warehouse concepts, design principles, and best practices
  • Strong proficiency with both relational SQL databases and NoSQL databases (e.g., MongoDB, Couchbase)
Job Responsibility
Job Responsibility
  • Utilize expert knowledge of data engineering principles, big data technologies, and software development best practices to design and implement robust data solutions
  • Collaborate with business stakeholders, data scientists, and other technology teams to understand data requirements and deliver effective solutions
  • Apply deep expertise in programming languages like Python and Java for building high-performance data processing applications
  • Ensure data solutions are secure, scalable, and adhere to the firm's security and architectural standards
  • Mentor and guide junior engineers, fostering a culture of technical excellence and continuous learning
  • Lead the analysis of complex data-related issues, identify root causes, and implement sustainable solutions
  • Operate with a high degree of autonomy and independence, exercising sound judgment and decision-making
  • Act as a Subject Matter Expert (SME) in big data technologies for senior stakeholders and other team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Fullstack Big Data Developer Application Development Technical Lead Analyst Vice President

Discover your future at Citi. Working at Citi is far more than just a job. A car...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of Application development experience
  • 6+ years of experience in full stack development, with a focus on Bigdata and Python/Scala
  • 6+ years experience with big data technologies such as Python, Pyspark, Hadoop, Kafka, etc.
  • Experience with Core Java/J2EE Application with complete command over OOPs and Design Patterns
  • Commendable in Data Structures and Algorithms
  • Worked on Core Application Development of complex size encompassing all areas of Java/J2EE
  • Thorough knowledge and hands on experience in following technologies Hadoop, Map Reduce Framework, Spark, YARN, Sqoop, Pig , Hue, Unix, Java, Sqoop, Impala, Cassandra on Mesos
  • Should have implemented or part complex project execution in Big Data Spark eco system, where processing volumes of data thorough understanding of distributed processing and integrated applications
  • Exposure to ETL and BI tools
  • Work in an agile environment following through the best practices of agile Scrum
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Design, develop, and maintain scalable and robust architecture for the project using Java/Python/Scala and other full stack technologies
  • Manage big data technologies such as python, pyspark to ensure seamless data integration, storage, and analysis
  • Fulltime
Read More
Arrow Right

Receptionist

We are looking for a detail-oriented Receptionist to join our team in Miami, Flo...
Location
Location
United States , Miami
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in using a multi-line phone system for managing calls
  • Strong customer service skills with the ability to handle inquiries professionally
  • Experience in data entry with attention to detail and accuracy
  • Ability to communicate effectively through email correspondence
  • Excellent interpersonal skills to interact with staff and visitors
  • Competence in Microsoft Excel, Outlook, and Word for administrative tasks
  • Organizational skills to manage files and maintain office order
  • Capability to schedule appointments and coordinate meetings efficiently
Job Responsibility
Job Responsibility
  • Oversee access to the office, ensuring security and proper protocols are followed
  • Manage the stocking and organization of supplies in the kitchens to maintain efficiency
  • Maintain the cleanliness and orderliness of the office environment to ensure a neat appearance
  • Handle incoming phone calls using a multi-line phone system, providing courteous and efficient service
  • Assist with scheduling appointments and coordinating meetings as needed
  • Perform accurate data entry tasks to support administrative functions
  • Organize and maintain files, ensuring easy accessibility and proper documentation
  • Communicate effectively via email to address inquiries and provide information
  • Execute various ad hoc projects and tasks as assigned to support office operations
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • eligible to enroll in our company 401(k) plan
Read More
Arrow Right

Psychiatrist

Astrya Global, a San Diego–based medical staffing agency, is hiring Psychiatrist...
Location
Location
United States , San Bernardino
Salary
Salary:
Not provided
astryaglobal.com Logo
Astrya Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Active CA licensure
  • Board certification
  • Active CA DEA
  • New graduates eligible
Job Responsibility
Job Responsibility
  • Evaluate and diagnose mental health disorders
  • Develop and implement treatment plans
  • See 15+ patients per day completing initial and follow up appointments
  • Prescribe and refill medications
  • Collaborate with up to 4 NPs as needed
What we offer
What we offer
  • Malpractice Insurance
  • Weekly pay
  • Full-service credentialing and licensing department
  • Dedicated corporate travel team with airfare, car rental and hotel booking
  • Referral Bonus up to $5,000
  • Fulltime
Read More
Arrow Right

Cook

Boston Pizza Cooks are the engine of the entire restaurant! They are responsible...
Location
Location
Canada , Campbell River
Salary
Salary:
17.85 - 22.00 CAD / Hour
bostonpizza.com Logo
Boston Pizza
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Collaborative
  • Team Player
  • Multi Tasker
  • Self-Starter
  • Detail Oriented
  • Efficient
Job Responsibility
Job Responsibility
  • Creating delicious menu items perfectly every time for every guest
  • Ensuring Guests have an excellent Boston Pizza experience from start to finish
  • Championing a fun and safe work environment
  • Contributing to a thriving workplace culture
  • Works alongside their team members
  • Builds relationships by finding common ground and working cohesively with all team members
  • Committed to championing the 'Heart of Hospitality', Boston Pizza's Brand Standards and Food Safety
  • Dedicated to providing Perfect Food Every Time to our Guests
  • Maintains composure and thrives in a fast pace environment
  • Works with a sense of purpose and always prioritize Guest’s orders
What we offer
What we offer
  • Flex scheduling, days or nights
  • A discount on Canada's best gourmet pizza
  • A company entrenched in community service with opportunities to give back
  • Staff parties, pizza recipe contests etc
  • Work as part of an amazing team
  • BPI Scholarship Awards
  • Flexible scheduling that fits your lifestyle and contributes to your life-work balance
  • Exciting opportunities for career growth within the restaurant or at Boston Pizza head office
  • Build relationships and give back to your local community
  • Boston Pizza Scholarship Program
Read More
Arrow Right