Senior Python Pyspark Engineer Job at Citi (Pune)

Senior Data Engineer

Senior Data Engineer position at Checkr, building the data platform to power saf...

Location

United States , San Francisco

Salary:

162000.00 - 190000.00 USD / Year

Checkr

Expiration Date

Until further notice

Requirements

7+ years of development experience in the field of data engineering
5+ years writing PySpark
Experience building large-scale (100s of Terabytes and Petabytes) data processing pipelines - batch and stream
Experience with ETL/ELT, stream and batch processing of data at scale
Strong proficiency in PySpark and Python
Expertise in understanding of database systems, data modeling, relational databases, NoSQL (such as MongoDB)
Experience with big data technologies such as Kafka, Spark, Iceberg, Datalake and AWS stack (EKS, EMR, Serverless, Glue, Athena, S3, etc.)
Knowledge of security best practices and data privacy concerns
Strong problem-solving skills and attention to detail

Job Responsibility

Create and maintain data pipelines and foundational datasets to support product/business needs
Design and build database architectures with massive and complex data, balancing with computational load and cost
Develop audits for data quality at scale, implementing alerting as necessary
Create scalable dashboards and reports to support business objectives and enable data-driven decision-making
Troubleshoot and resolve complex issues in production environments
Work closely with product managers and other stakeholders to define and implement new features

What we offer

Learning and development reimbursement allowance
Competitive compensation and opportunity for professional and personal advancement
100% medical, dental, and vision coverage for employees and dependents
Additional vacation benefits of 5 extra days and flexibility to take time off
Reimbursement for work from home equipment
Lunch four times a week
Commuter stipend
Abundance of snacks and beverages

Fulltime

Senior Data Engineer

Join a leading energy sector analytics company as we expand our innovative data ...

Location

Poland

Salary:

Not provided

Edvantis

Expiration Date

Until further notice

Requirements

At least 5 years of experience as a Data Engineer, with a proven track record of successful projects
Solid experience with relational database systems, particularly SQL Server
Advanced proficiency in Python and PySpark – the languages of data manipulation and analysis
Expertise in Databricks as a distributed data engineering platform
Expertise with Airflow and Grafana
Ability to collaborate effectively within a team environment and meet project deadlines
Strong communication skills and fluency in English

Job Responsibility

Develop and maintain scalable data pipelines using Python, SQL, AWS services(Amazon Bedrock, S3), and Databricks
Build and optimize ETL jobs in Databricks using PySpark, ensuring efficient processing of large-scale distributed datasets
Play a pivotal role in enhancing the breadth and depth of our courthouse data products
Utilize your Python expertise to parse complex datasets, manipulate intricate image data, and craft innovative data products that meet our customers’ evolving needs
Champion data quality, consistency, and reliability throughout our product lifecycle
Contribute to the development of new features and the continuous improvement of existing data systems
Design and implement distributed data engineering solutions in Databricks, leveraging PySpark for optimized workflows

What we offer

Remote-first work model with flexible working hours (we provide all equipment)
Comfortable and fully equipped offices in Lviv and Rzeszów
Competitive compensation with regular performance reviews
18 paid vacation days per year + all state holidays
12 days of paid sick leave per year without a medical certificate + extra paid leave for blood donation
Medical insurance with an affordable family coverage option
Mental health program which includes free and confidential consultations with a psychologist
English, German, and Polish language courses
Corporate subscription to learning platforms, regular meetups and webinars
Friendly team that values accountability, innovation, teamwork, and customer satisfaction

Fulltime

Senior Data Engineer

At Rearc, we're committed to empowering engineers to build awesome products and ...

Location

India , Bangalore

Salary:

Not provided

Rearc

Expiration Date

Until further notice

Requirements

8+ years of experience in data engineering, showcasing expertise in diverse architectures, technology stacks, and use cases
Strong expertise in designing and implementing data warehouse and data lake architectures, particularly in AWS environments
Extensive experience with Python for data engineering tasks, including familiarity with libraries and frameworks commonly used in Python-based data engineering workflows
Proven experience with data pipeline orchestration using platforms such as Airflow, Databricks, DBT or AWS Glue
Hands-on experience with data analysis tools and libraries like Pyspark, NumPy, Pandas, or Dask
Proficiency with Spark and Databricks is highly desirable
Experience with SQL and NoSQL databases, including PostgreSQL, Amazon Redshift, Delta Lake, Iceberg and DynamoDB
In-depth knowledge of data architecture principles and best practices, especially in cloud environments
Proven experience with AWS services, including expertise in using AWS CLI, SDK, and Infrastructure as Code (IaC) tools such as Terraform, CloudFormation, or AWS CDK
Exceptional communication skills, capable of clearly articulating complex technical concepts to both technical and non-technical stakeholders

Job Responsibility

Strategic Data Engineering Leadership: Provide strategic vision and technical leadership in data engineering, guiding the development and execution of advanced data strategies that align with business objectives
Architect Data Solutions: Design and architect complex data pipelines and scalable architectures, leveraging advanced tools and frameworks (e.g., Apache Kafka, Kubernetes) to ensure optimal performance and reliability
Drive Innovation: Lead the exploration and adoption of new technologies and methodologies in data engineering, driving innovation and continuous improvement across data processes
Technical Expertise: Apply deep expertise in ETL processes, data modelling, and data warehousing to optimize data workflows and ensure data integrity and quality
Collaboration and Mentorship: Collaborate closely with cross-functional teams to understand requirements and deliver impactful data solutions—mentor and coach junior team members, fostering their growth and development in data engineering practices
Thought Leadership: Contribute to thought leadership in the data engineering domain through technical articles, conference presentations, and participation in industry forums

Senior Data Engineer

At Blue Margin, we are on a mission to build the go-to data platform for PE-back...

Location

United States , Fort Collins

Salary:

110000.00 - 140000.00 USD / Year

Blue Margin

Expiration Date

Until further notice

Requirements

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
5+ years of professional experience in data engineering, with emphasis on Python & PySpark/Apache Spark
Proven ability to manage large datasets and optimize for speed, scalability, and reliability
Strong SQL skills and understanding of relational and distributed data systems
Experience with Azure Data Factory, Synapse Pipelines, Fivetran, Delta Lake, Microsoft Fabric, or Snowflake
Knowledge of data modeling, orchestration, and Delta/Parquet file management best practices
Familiarity with CI/CD, version control, and DevOps practices for data pipelines
Experience leveraging AI-assisted tools to accelerate engineering workflows
Strong communication skills
ability to convey complex technical details to both engineers and business stakeholders

Job Responsibility

Architect, design, and optimize large-scale data pipelines using tools like PySpark, SparkSQL, Delta Lake, and cloud-native tools
Drive efficiency in incremental/delta data loading, partitioning, and performance tuning
Lead implementations across Azure Synapse, Microsoft Fabric, and/or Snowflake environments
Collaborate with stakeholders and analysts to translate business needs into scalable data solutions
Evaluate and incorporate AI/automation to improve development speed, testing, and data quality
Oversee and mentor junior data engineers, establishing coding standards and best practices
Ensure high standards for data quality, security, and governance
Participate in solution design for client engagements, balancing technical depth with practical outcomes

What we offer

Competitive pay
strong benefits
flexible hybrid work setup

Fulltime

Senior Data Engineer – Data Engineering & AI Platforms

We are looking for a highly skilled Senior Data Engineer (L2) who can design, bu...

Location

India , Chennai, Madurai, Coimbatore

Salary:

Not provided

OptiSol Business Solutions

Expiration Date

Until further notice

Requirements

Strong hands-on expertise in cloud ecosystems (Azure / AWS / GCP)
Excellent Python programming skills with data engineering libraries and frameworks
Advanced SQL capabilities including window functions, CTEs, and performance tuning
Solid understanding of distributed processing using Spark/PySpark
Experience designing and implementing scalable ETL/ELT workflows
Good understanding of data modeling concepts (dimensional, star, snowflake)
Familiarity with GenAI/LLM-based integration for data workflows
Experience working with Git, CI/CD, and Agile delivery frameworks
Strong communication skills for interacting with clients, stakeholders, and internal teams

Job Responsibility

Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms
Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers
Work closely with solutioning and pre-sales teams for technical evaluations and client-facing discussions
Lead squads of L0/L1 engineers—ensuring delivery quality, mentoring, and guiding career growth
Develop cloud-native data engineering solutions using Python, SQL, PySpark, and modern data frameworks
Ensure data reliability, performance, and maintainability across the pipeline lifecycle—from development to deployment
Support long-term ODC/T&M projects by demonstrating expertise during technical discussions and interviews
Integrate emerging GenAI tools where applicable to enhance data enrichment, automation, and transformations

What we offer

Opportunity to work at the intersection of Data Engineering, Cloud, and Generative AI
Hands-on exposure to modern data stacks and emerging AI technologies
Collaboration with experts across Data, AI/ML, and cloud practices
Access to structured learning, certifications, and leadership mentoring
Competitive compensation with fast-track career growth and visibility

Fulltime

Senior Data Engineering Architect

Location

Poland

Salary:

Not provided

Lingaro

Expiration Date

Until further notice

Requirements

Proven work experience as a Data Engineering Architect or a similar role and strong experience in in the Data & Analytics area
Strong understanding of data engineering concepts, including data modeling, ETL processes, data pipelines, and data governance
Expertise in designing and implementing scalable and efficient data processing frameworks
In-depth knowledge of various data technologies and tools, such as relational databases, NoSQL databases, data lakes, data warehouses, and big data frameworks (e.g., Hadoop, Spark)
Experience in selecting and integrating appropriate technologies to meet business requirements and long-term data strategy
Ability to work closely with stakeholders to understand business needs and translate them into data engineering solutions
Strong analytical and problem-solving skills, with the ability to identify and address complex data engineering challenges
Proficiency in Python, PySpark, SQL
Familiarity with cloud platforms and services, such as AWS, GCP, or Azure, and experience in designing and implementing data solutions in a cloud environment
Knowledge of data governance principles and best practices, including data privacy and security regulations

Job Responsibility

Collaborate with stakeholders to understand business requirements and translate them into data engineering solutions
Design and oversee the overall data architecture and infrastructure, ensuring scalability, performance, security, maintainability, and adherence to industry best practices
Define data models and data schemas to meet business needs, considering factors such as data volume, velocity, variety, and veracity
Select and integrate appropriate data technologies and tools, such as databases, data lakes, data warehouses, and big data frameworks, to support data processing and analysis
Create scalable and efficient data processing frameworks, including ETL (Extract, Transform, Load) processes, data pipelines, and data integration solutions
Ensure that data engineering solutions align with the organization's long-term data strategy and goals
Evaluate and recommend data governance strategies and practices, including data privacy, security, and compliance measures
Collaborate with data scientists, analysts, and other stakeholders to define data requirements and enable effective data analysis and reporting
Provide technical guidance and expertise to data engineering teams, promoting best practices and ensuring high-quality deliverables. Support to team throughout the implementation process, answering questions and addressing issues as they arise
Oversee the implementation of the solution, ensuring that it is implemented according to the design documents and technical specifications

What we offer

Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites
Workation. Enjoy working from inspiring locations in line with our workation policy
Great Place to Work® certified employer
Flexibility regarding working hours and your preferred form of contract
Comprehensive online onboarding program with a “Buddy” from day 1
Cooperation with top-tier engineers and experts
Unlimited access to the Udemy learning platform from day 1
Certificate training programs. Lingarians earn 500+ technology certificates yearly
Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly
Grow as we grow as a company. 76% of our managers are internal promotions

Senior Palantir Foundry Engineer

We are seeking an experienced Palantir Foundry Engineer to join our Corporate Te...

Location

United States , San Jose

Salary:

133400.00 - 200000.00 USD / Year

Archer Aviation

Expiration Date

Until further notice

Requirements

Bachelor’s degree in Computer Science, Engineering, Data Science, or equivalent experience
6–8 years of experience in data engineering, analytics engineering, or application development
2–4 years hands-on experience with Palantir Foundry in an enterprise setting
Strong proficiency in Python, PySpark, and SQL for data transformations
Experience designing and maintaining Foundry Ontology models and object relationships
Hands-on experience with Workshop, Code Repositories, Pipeline Builder, and transformation frameworks
Understanding of data engineering fundamentals: data quality, governance, testing, logging, monitoring
Experience with Git-based version control and modern CI/CD practices
Ability to explain architectural decisions clearly to both technical and non-technical stakeholders
Strong problem-solving and system design skills

Job Responsibility

Design and develop data pipelines using Foundry’s Code Repositories, Pipeline Builder, and Transformations
Create scalable and well-structured Ontologies, including upstream object modeling, relationships, and governance patterns
Build user-facing applications and workflows using Workshop, Slate/UI tooling, and Foundry’s Action Framework
Drive architectural decisions around ontology design, feature pipelines, data lineage, permissioning, and semantic modeling
Collaborate with business teams to translate requirements into Foundry-native solutions
Optimize existing pipelines for performance, reliability, and operational maintainability
Implement data quality rules, monitoring frameworks, and operational alerting within Foundry
Participate in code reviews and establish engineering standards for Foundry development
Mentor team members and help establish best practices for Foundry development across the organization
Partner with platform engineering teams (as needed) on access controls, repository strategy, and workspace organization

Fulltime

Senior Bigdata Engineer

The Applications Development Senior Programmer Analyst is an intermediate level ...

Location

India , Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

8 - 10 years of relevant experience
Experience in systems analysis and programming of software applications
Experience in managing and implementing successful projects
Working knowledge of consulting/project management techniques/methods
Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Programming Languages: Python, PySpark
Data Lake Table Format: Apache Iceberg
Data Orchestration: Apache Airflow
Data Visualization: Tableau
Big Data Processing: Apache Spark

Job Responsibility

Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
Ensure essential procedures are followed and help define operating standards and processes
Serve as advisor or coach to new or lower level analysts
Has the ability to operate with a limited level of direct supervision
Can exercise independence of judgement and autonomy
Acts as SME to senior stakeholders and /or other team members

What we offer

Equal employment opportunity

Fulltime

Senior Python Pyspark Engineer

Citi

Location:
India , Pune

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Additional Information:

Job Posted:
February 07, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Senior Python Pyspark Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer – Data Engineering & AI Platforms

Senior Data Engineering Architect

Senior Palantir Foundry Engineer

Senior Bigdata Engineer

Senior Python Pyspark Engineer

Citi

Location:India , Pune

Category:IT - Software Development

Contract Type:Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Additional Information:

Job Posted:February 07, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Senior Python Pyspark Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer – Data Engineering & AI Platforms

Senior Data Engineering Architect

Senior Palantir Foundry Engineer

Senior Bigdata Engineer

Location:
India , Pune

Category:
IT - Software Development

Contract Type:
Not provided

Job Posted:
February 07, 2026