CrawlJobs Logo

Python and Spark Developer

India, Pune · Job Posted May 16, 2026
Apply Position
Job Link Share

Job Description

The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Job Responsibility

  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency

Requirements

  • 4+ years of relevant experience in the Financial Service industry
  • Must have skills – Python and Spark
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Python and Spark Developer

8 matching positions

Python and PySpark Developer

We are seeking a motivated and detail‑oriented Python / PySpark Developer to sup...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Basic to intermediate proficiency in Python
  • 4 -7 years of experience
  • Exposure to Apache Spark / PySpark (internship or project experience is acceptable)
  • Understanding of fundamental programming and data structures
  • Basic knowledge of SQL and relational databases
  • Familiarity with data processing concepts and ETL fundamentals
  • Awareness of Linux/Unix command line is a plus
  • Understanding of coding best practices and version control (Git)
  • Basic debugging and problem‑solving skills
  • Exposure to unit testing concepts is a plus
Job Responsibility
Job Responsibility
  • Assist in developing and maintaining data pipelines using Python and PySpark
  • Support ETL/ELT workflows for batch data processing
  • Write clean, readable, and well‑structured Python code following best practices
  • Perform basic data transformations, aggregations, and validations
  • Debug and troubleshoot pipeline issues with guidance from senior developers
  • Work with structured and semi‑structured data formats (CSV, JSON, Parquet, etc.)
  • Assist in integrating data from databases, APIs, and cloud storage systems
  • Help ensure data quality and consistency within pipelines
  • Support migration of legacy scripts to modern data platforms
  • Collaborate with team members on development tasks and code reviews
  • Fulltime
Read More
Arrow Right

Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg

The Data Engineer will play a crucial role in migrating data from on-prem DataLa...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
  • Minimum of 3-5 years of professional hands-on-keyboard coding experience in a collaborative, team-based environment
  • Ability to troubleshoot SQL and basic scripting experience
  • Professional proficiency in Python or Java
  • Deep familiarity with the full Software Development Life Cycle (SDLC) and CI/CD best practices
  • K8s deployment experience
  • Sophisticated understanding of Temporal Data Modeling, Schema Management, Performance Optimization, and Architectural Theory
  • Experience with Kafka, ANSI SQL, FTP, Apache Spark
  • Experience with JSON, Avro, Parquet
  • Experience with Hadoop (HDFS/Hive), Snowflake, Apache Iceberg, Sybase IQ
Job Responsibility
Job Responsibility
  • Perform end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse
  • Pipeline Migration - Refactoring and migrating extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment
  • Data Transfer - Executing the physical migration of underlying datasets while ensuring data integrity
  • Stakeholder Engagement - Acting as a technical liaison to internal clients, facilitating handoff and sign-off conversations with data owners to ensure migrated assets meet business requirements
  • Consumption Pattern Migration - Translating and optimizing legacy SQL and Spark-based consumption patterns for compatibility with Snowflake and Iceberg
  • Usage analysis to understand usage patterns and deliver required data products
  • Data Reconciliation and Quality - Work with reconciliation frameworks to build confidence that migrated data is functionally equivalent to that already used within production flows
  • Fulltime
Read More
Arrow Right
New

Lead Software Engineer, Back End (Python, Spark)

Lead Software Engineer, Back End (Python, Spark). Do you love building and pione...
Location
Location
United States , New York; San Francisco
Salary
Salary:
215200.00 - 245600.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree
  • At least 4 years of professional software engineering experience (Internship experience does not apply)
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Lead a portfolio of diverse technology projects and a team of developers with deep experience in distributed microservices, and full stack systems to create solutions that help meet regulatory needs for the company
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, mentoring other members of the engineering community, and from time to time, be asked to code or evaluate code
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Utilize programming languages like Java, Python, SQL, Node, Go, and Scala, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services
What we offer
What we offer
  • Eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Python Developer

My client is a well-established and successful tech house working in the finance...
Location
Location
United Kingdom , London
Salary
Salary:
140000.00 GBP / Year
hunterbond.com Logo
Hunter Bond
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience with Python (2+ Years)
  • Experience working with REST Microservices
  • Strong SQL skills
  • Experience working with very large data sets
  • Knowledge of big data tools (Spark, Kafka etc)
  • Experience working in finance (Preferred)
  • Strong formal education - ideally in Computer Science
Job Responsibility
Job Responsibility
  • Building one of the world's most scalable and performant data platforms
  • Contributing to the end-to-end SDLC of mission-critical financial software
  • Collaborating with elite technologists from top-tier tech houses and trading firms
  • Developing and maintaining high-performance REST microservices
  • Making a genuine impact on system architecture and business growth
What we offer
What we offer
  • Market-leading salary of £140,000 + a generous bonus and benefits package
  • The opportunity to work with some of the smartest software engineers in London
  • Exposure to one of the most innovative and modern tech stacks in the finance sector
  • A highly collaborative environment with a true say in technical direction
  • Rapidly growing business with clear paths for career progression
  • Fulltime
Read More
Arrow Right

Applications Development Sr Programmer Analyst - Python Spark

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years of relevant experience
  • Experience in systems analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Strong expertise in Python (8+ years preferred)
  • Hands-on experience with Apache Spark / PySpark (4+ years)
  • Solid understanding of distributed computing concepts
  • Strong SQL skills and experience with relational databases
  • Experience with big data ecosystems (Hive, HDFS, Delta Lake, or similar)
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Sr. Data Engineer - Python Developer

Seeking a hands-on Senior Data Engineer (ETL / Python Developer) to support the ...
Location
Location
United States , Springfield
Salary
Salary:
52.00 - 54.00 USD / Hour
myticas.com Logo
Myticas Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience with a focus on enterprise data warehousing
  • 5+ years of hands-on ETL development using Informatica PowerCenter, Azure Data Factory, or similar tools
  • 5+ years of Python development for data engineering and automation
  • 3+ years of experience with Spark-based processing frameworks (Databricks or equivalent)
  • Strong SQL expertise and experience with relational databases (such as Teradata, Snowflake, Oracle, SQL Server)
  • Experience with source control and DevOps practices (Azure DevOps, GitHub, CI/CD)
  • Bachelor's degree or higher in Computer Science, Engineering, Analytics, or a related field
  • Strong analytical, problem-solving, and troubleshooting skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain enterprise ETL pipelines using Azure Data Factory (ADF), Informatica PowerCenter, and Python-based frameworks
  • Build and optimize scalable data processing solutions using Python, Spark, and Databricks
  • Support Medicaid analytics and federal reporting initiatives (e.g., T-MSIS, PERM, MARS, Quality of Care)
  • Develop robust data validation, reconciliation, and audit-traceable data pipelines
  • Write and optimize SQL and stored procedures across relational platforms such as Snowflake, Oracle, and SQL Server
  • Participate in cloud migration and modernization initiatives within Azure-based architectures
  • Collaborate with analysts, QA, and reporting teams to ensure data quality, accuracy, and timeliness
  • Follow data engineering best practices for performance, reliability, reusability, and security
  • Support production operations, incident resolution, and root-cause analysis
  • Participate in code reviews, source control, and CI/CD processes using Azure DevOps and GitHub
  • Fulltime
Read More
Arrow Right

Sql And Python Engineers

We are currently seeking a SQL and Python Engineers to join our team in Remote, ...
Location
Location
India , Remote
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Data Science, Machine Learning, Software Engineering, or a related quantitative field
  • 3–5 years of professional experience in AI/ML engineering
  • Hands-on experience building and deploying LLM-powered applications using frameworks such as LangChain, LlamaIndex, or Semantic Kernel
  • Proven experience implementing MLOps pipelines in cloud environments (Azure preferred)
  • Experience developing AI agents or automation workflows using agentic frameworks
  • Prior experience in financial services, insurance, or regulated industries is strongly preferred
  • Technical skills: Generative AI & LLMs (OpenAI / Azure OpenAI, Claude, Mistral, or open-source LLMs
  • RAG architectures, vector search, embeddings
  • LangChain, LlamaIndex, Semantic Kernel
  • Prompt engineering, few-shot learning, instruction tuning, RLHF concepts)
Job Responsibility
Job Responsibility
  • Design, fine-tune, and deploy Large Language Models (LLMs) for insurance-specific use cases including document intelligence, claims summarization, policy interpretation, and underwriting Q&A
  • Build Retrieval-Augmented Generation (RAG) pipelines using vector databases to ground LLM outputs in enterprise knowledge bases
  • Develop prompt engineering frameworks and systematic evaluation pipelines to ensure LLM output quality, consistency, and safety in regulated insurance contexts
  • Integrate LLM capabilities with internal data platforms via LangChain, LlamaIndex, or Semantic Kernel
  • Evaluate and benchmark foundational models against insurance-specific tasks
  • Architect and implement autonomous AI agents capable of multi-step reasoning, tool use, and decision-making for workflows such as FNOL triage, claims routing, policy lookup, and compliance checks
  • Build agentic frameworks using patterns such as ReAct, Chain-of-Thought, and Tool-Augmented Agents
  • Design human-in-the-loop checkpoints and escalation logic
  • Integrate agents with internal APIs, data platforms, and enterprise systems using orchestration tools
  • Develop guardrails, monitoring, and audit logging for all deployed agents
Read More
Arrow Right

Python Developer

My client is a well-established and successful tech house working in the finance...
Location
Location
United Kingdom , London
Salary
Salary:
140000.00 GBP / Year
hunterbond.com Logo
Hunter Bond
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience with Python (2+ years)
  • Experience working with REST microservices
  • Strong SQL skills
  • Experience working with very large data sets
  • Knowledge of tools such as Spark and Kafka
  • Experience working in finance (preferred)
  • Strong formal education, ideally in Computer Science
Job Responsibility
Job Responsibility
  • Python Development: Building high-performance systems using Python
  • Microservices: Developing and working with REST microservices
  • Data Engineering: Handling and processing very large data sets
  • Platform Development: Contributing to the design and build of scalable data platforms
  • Full SDLC: Participating across the full software development lifecycle
  • Backend Development: Designing and implementing robust backend systems
  • Database Work: Writing and optimising SQL queries
  • Big Data: Working with big data tools such as Spark and Kafka
  • Collaboration: Working closely with highly skilled engineers in a fast-paced fintech environment
What we offer
What we offer
  • Bonus
  • Fulltime
Read More
Arrow Right