CrawlJobs Logo

Senior Big Data Developer

India, Pune · Job Posted February 17, 2026
Apply Position
Job Link Share

Job Description

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities. The role encompasses end-to-end data engineering and software development, focusing on robust and scalable solutions.

Job Responsibility

  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Designing, developing, and optimizing scalable ETL pipelines using PySpark for large-scale data processing
  • Writing clean, efficient, and well-documented code primarily in Python (PySpark)
  • Working closely with senior developers, data engineers, analysts, and business partners to define requirements and ensure seamless integration of solutions
  • Debugging and optimizing Spark applications and big data technologies to resolve processing issues and performance bottlenecks
  • Participating in the entire software development lifecycle (SDLC), from requirements to operations, often leveraging Agile/Scrum methodologies
  • Maintaining high standards for data quality and integrity throughout the data lifecycle

Requirements

  • 8-14 years of relevant experience
  • Experience in systems analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience
  • Strong Object-Oriented Programming (OOP) concepts
  • proficient in Python (specifically for PySpark)
  • Extensive experience with Apache Spark (PySpark), Hadoop, and related components like Hive and Sqoop
  • skilled in writing shell scripts
  • Solid understanding of SQL and relational databases, with practical experience in writing complex queries for data validation and manipulation
  • Proficient with version control systems (Git), and development/testing tools (JIRA, Confluence)

Nice to have

  • Familiarity with distributed NoSQL databases (e.g., Elasticsearch, Cassandra, MongoDB)
  • Familiarity with DevOps practices and CI/CD pipelines

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Big Data Developer

8 matching positions

Senior Big Data Developer- Vice President

Seeking a highly motivated, Application Development Technology Lead with a passi...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficient on Spark, Data Engineering and architecture for data flows
  • Proven experience with current DevOps and engineering excellence tools like BitBucket, TeamCity, uDeploy, JIRA, etc.
  • Experience on design of cloud technology and microservice architecture
  • 10+ years of ETL technology experience and extensive experience with SQL, Analytics, Linux/ AIX Unix Shell scripting, Windows, MAVEN or ANT, Bitbucket, GIT or Source code control equivalent
  • Proven architecture experience in a complex, large organization, TOGAF certification an asset
  • Financial background in Canadian banking accounting practices an asset
  • Self-starter and a "do whatever it takes" attitude
  • Experience with the following: Hibernate, Ajax programming, IBM WebSphere MQ, C/C++, Perl, Python, Spring, Camel, Autosys, Talend or similar ETL tools, usage of Load balancer /WIP, SSL certificate configuration and deployment process
  • Bachelor’s degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • You will be responsible for many fast-changing, moving parts and get them to come together as a product
  • You will need excellent communication and collaboration skills
  • You will be responsible for identifying and managing risks, making sound judgments about quality, and speed of deliverables and deployment to production
  • You will be a key player in our Data transformation to digitize our business
  • You will be responsible for leading development on Vanguard the TTS Big Data platform
  • Fulltime
Read More
Arrow Right

Senior Big Data Developer - Vice President

The Applications Development Tech Lead Analyst is responsible for accomplishing ...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6-10 years of relevant experience in the Big Data Application Development
  • Experience as Applications Development Manager
  • Experience as senior level in an Applications Development role
  • Stakeholder and people management experience
  • Demonstrated leadership skills
  • Proven project management skills
  • Basic knowledge of industry practices and standards
  • Bachelor's degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Manage one or more Applications Development teams in an effort to accomplish established goals
  • Utilize in-depth knowledge and skills across multiple Applications Development areas to provide technical oversight across systems and applications
  • Review/analyze/develop proposed technical solutions for projects
  • Contribute to formulation of strategies for applications development and other functional areas
  • Develop comprehensive knowledge of how areas of business integrate to accomplish business goals
  • Provide evaluative judgment based on analysis of factual data in complicated and unique situations
  • Impact the Applications Development area through monitoring delivery of end results, participate in budget management, and handling day-to-day staff management issues, including resource management and allocation of work within the team/project
  • Ensure essential procedures are followed and contribute to defining standards negotiating with external parties when necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency, as well as effectively supervise the activity of others and create accountability with those who fail to maintain these standards
  • Fulltime
Read More
Arrow Right

Pyspark Big Data Senior Developer - Vice President

We are building an A-team of highly skilled and autonomous engineers, and we are...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of extensive, hands-on experience as a Senior Big Data Developer, with a strong emphasis on PySpark and the Apache Spark ecosystem, operating as a player/coach
  • Expert proficiency in Python, with a proven track record of developing robust, scalable, and high-performance PySpark applications for large-scale data processing
  • Deep understanding and extensive hands-on experience with Apache Spark (Spark Core, Spark SQL, Spark Streaming) and its ecosystem
  • Experience with distributed computing frameworks such as Hadoop (HDFS, YARN)
  • Expert proficiency in SQL and extensive experience with data warehousing concepts and technologies (e.g., Hive, Snowflake, Redshift, Databricks SQL)
  • Proven experience with various data storage formats (e.g., Parquet, ORC, Avro) and data lake solutions (e.g., Delta Lake, Iceberg)
  • Experience with NoSQL databases (e.g., MongoDB, Cassandra, HBase) is a significant plus
  • Strong experience with Apache Kafka for building real-time data pipelines and event-driven architectures
  • Demonstrated experience with big data services on major cloud platforms (e.g., AWS EMR/Glue/Redshift, Azure Databricks/Data Factory/Synapse, GCP Dataflow/Dataproc/BigQuery) is highly desirable
  • Proven effectiveness with AI coding tools (e.g., Claude Code, Codex, Antigravity) is a mandatory requirement
Job Responsibility
Job Responsibility
  • Operate end-to-end in the design, development, and implementation of robust big data solutions, ensuring optimal performance, scalability, data quality, and security
  • Collaborate closely within small, co-located squads (4-7 person teams), fostering high communication and low coordination overhead, to translate complex business requirements into technical specifications for big data processing and analytical solutions
  • Act as a player/coach within the team, mentoring junior members and leading by example in the development of efficient and innovative big data architectures
  • Design, develop, and optimize large-scale data pipelines using PySpark for data ingestion, transformation, and aggregation, always with an eye towards efficiency and domain relevance
  • Implement and manage real-time data streaming and event-driven architectures using technologies like Apache Kafka
  • Design and implement sophisticated data warehousing solutions and dimensional models for efficient data storage and retrieval, ensuring alignment with business needs
  • Work with various distributed data storage technologies, including distributed file systems (e.g., HDFS, S3) and NoSQL databases (e.g., MongoDB, Cassandra), selecting the right tool for the right problem
  • Implement efficient data processing and storage strategies to optimize the performance and scalability of big data applications, with a strong focus on the 'why' behind the technology choices
  • Champion best practices in software development, including rigorous code reviews, implementing comprehensive testing, and supporting continuous integration and continuous deployment (CI/CD) pipelines
  • Demonstrate high autonomy and agency in driving projects forward, making informed decisions, and proactively identifying areas for improvement
  • Fulltime
Read More
Arrow Right

Senior Big Data Pyspark Developer

We are looking for a skilled and motivated Full Stack Developer to join our engi...
Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-6 years of professional software development experience
  • Proficiency in Java (including modern Java features)
  • Strong experience with Node.js
  • Strong experience with Angular (versions 2+)
  • Strong experience with Spring Boot and Spring MVC for building web applications and microservices
  • Proven experience with Microservices architecture design and implementation
  • Strong experience with Hibernate
  • Solid command of Oracle Database, including SQL and PL/SQL
  • Experience with MongoDB for NoSQL data management
  • Experience with caching mechanisms and technologies like Hazelcast
Job Responsibility
Job Responsibility
  • Contribute to the design, development, and implementation of robust software solutions, ensuring performance, scalability, and security
  • Collaborate with product managers, architects, and senior developers to translate business requirements into technical specifications and develop innovative solutions
  • Develop and maintain back-end services using Java, Spring Boot, Spring MVC, Node.js, and Microservices architecture
  • Build responsive and intuitive user interfaces using Angular
  • Design and manage databases, working with both relational (Oracle) and NoSQL (MongoDB) data stores, leveraging Hibernate for ORM
  • Implement caching strategies using technologies like Hazelcast to improve application performance
  • Implement event-driven architectures and data streaming solutions using Kafka
  • Develop and consume GraphQL APIs, ensuring efficient data exchange between front-end and back-end systems
  • Adhere to best practices in software development, including participating in code reviews, testing, continuous integration, and continuous deployment (CI/CD)
  • Actively learn from and contribute to the team, sharing knowledge and helping to maintain high technical standards
  • Fulltime
Read More
Arrow Right

Senior Data Engineer, Big Data

This role is essential for designing and developing data architectures across on...
Location
Location
United States , New York; Philadelphia
Salary
Salary:
105100.00 - 189600.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree plus 5 years of related work experience OR Advanced degree with 3 years of related experience
  • 4-7 years Developing cloud solutions using data series
  • experience with cloud platforms (Amazon Web Services, Azure, or Google Cloud)
  • 4-7 years Hands-on development using and migrating data to cloud platforms
  • 4-7 years Experience in SQL, NoSQL, and/or relational database design and development
  • 4-7 years Advanced knowledge and experience in building complex data pipelines with Python, Experience in languages such as SQL, DAX Python, Java, Scala, and/or Go
  • At least 18 years of age
  • Legally authorized to work in the United States
Job Responsibility
Job Responsibility
  • Develop data engineering solutions that enable data pipelines, visualization, and analytical tools to support business requirements
  • Design and develop data architectures across on-premise, cloud, and hybrid platforms to ensure scalable data infrastructure
  • Perform data wrangling, exploration, and discovery of heterogeneous data to generate new business insights
  • Contribute to team knowledge sharing and drive the advancement of new data engineering capabilities
  • Mentor team members to build and enhance their data engineering skillsets and professional growth
  • Assist management in project definition, including estimating, planning, and scoping work to meet objectives
  • Also responsible for other duties/projects as assigned by business management as needed
What we offer
What we offer
  • annual stock grant
  • employee stock purchase plan
  • 401(k)
  • free, year-round money coaches
  • medical insurance
  • dental insurance
  • vision insurance
  • flexible spending account
  • paid time off
  • up to 12 paid holidays
  • Fulltime
Read More
Arrow Right

Banamex Senior Auditor Data (Programador / Big Data)

The Senior Data Auditor is an intermediate level role responsible for performing...
Location
Location
Mexico , Ciudad De Mexico
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years of relevant experience
  • Database management
  • Audit and/or compliance areas
  • Effective verbal and written communication and negotiation skills
  • Subject matter expertise regarding audit technology’s application
  • Effective project management skills
  • Effective influencing and relationship management skills
  • Demonstrated ability to remain unbiased in a diverse working environment
  • SAS, SQL, Phyton
  • English: Hold conversations and be able to read and write documentation
Job Responsibility
Job Responsibility
  • Perform moderately complex audits including drafting audit reports, presenting issues to the business, and discussing practical solutions
  • Draft audit reports and present issues to the business while discussing practical cross-functional solutions
  • Complete assigned audits within budgeted timeframes, and budgeted costs
  • Monitor, assess, and recommend solutions to emerging risks
  • Contribute to the development of audit processes improvements, including the development of automated routines
  • Apply internal audit standards, policies, and regulations to provide timely audit assurance and influence audit scope
  • Develop effective line management relationships to ensure strong understanding of the business
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Senior Big Data Engineer

Citi is looking for a Senior Big Data Engineer to design, build, and optimize la...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on expertise in PySpark and Big Data processing
  • Practical knowledge of the Hadoop ecosystem, including Hive, HDFS, Sqoop, Spark, Impala, and Scala
  • Proficiency in complex SQL query development
  • Solid understanding of distributed systems architecture
  • Demonstrated knowledge of data modelling and data design
  • Competence in shell scripting and job scheduling using Autosys
  • Strong analytical and problem-solving ability
  • Clear and effective communication skills
Job Responsibility
Job Responsibility
  • Build and maintain scalable data pipelines using PySpark
  • Design and develop solutions across the Hadoop ecosystem
  • Develop and manage real-time and batch data workflows using streaming data platforms
  • Write complex SQL queries
  • Design and implement data models and data architecture patterns
  • Automate pipeline scheduling and orchestration using shell scripting and Autosys
  • Independently identify, assess, and resolve technical risks and data issues
What we offer
What we offer
  • Hybrid working model
  • Access to continuous learning and development programmes
  • Exposure to large-scale, complex data systems
  • A collaborative and inclusive team environment
  • Competitive compensation and a comprehensive benefits package
  • Wellbeing and work-life balance support
  • Global connectivity
  • Fulltime
Read More
Arrow Right

PySpark Big Data Developer

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2-5 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
  • 4-8 years of experience in developing and managing Enterprise Applications
  • Expertise in PySpark, HDFS, Hive, Sqoop, and Hadoop
  • Good exposure to SQL Server and ORACLE databases
  • Proficient in Shell Scripting
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right