CrawlJobs Logo

Pyspark/Python ETL Developer

https://www.citi.com/ Logo

Citi

Location Icon

Location:
India , Chennai

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your community and make a real impact.

Job Responsibility:

  • Design, develop, and implement efficient and scalable data pipelines and ETL processes using Pyspark and Python
  • Develop, optimize, and maintain complex SQL queries and stored procedures within Oracle database environments
  • Collaborate with data architects, data scientists, and other stakeholders to understand data requirements and translate them into technical solutions
  • Perform data analysis, profiling, and quality checks to ensure data accuracy and integrity
  • Optimize Pyspark and Python code for performance and efficiency on large datasets
  • Troubleshoot and resolve data-related issues, ensuring data availability and reliability
  • Participate in code reviews, testing, and deployment processes
  • Stay up-to-date with emerging technologies and best practices in data engineering and big data
  • Document technical designs, data flows, and code

Requirements:

  • Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field
  • 3+ years of experience in data engineering or software development with a focus on Pyspark/Python
  • Proven expertise in developing data processing applications using Pyspark and Python
  • Strong proficiency in writing complex SQL queries, stored procedures, and understanding database schema in Oracle
  • Experience with Apache Spark and its ecosystem for big data processing
  • Solid understanding and experience with ETL methodologies and tools
  • Experience with job scheduling and automation tools, such as Autosys
  • Proficiency in Unix/Linux shell scripting for automation and system tasks
  • Experience with Git or similar version control systems
  • Excellent analytical and problem-solving skills with attention to detail

Nice to have:

  • Experience with other database systems (e.g., PostgreSQL, SQL Server)
  • Knowledge of cloud platforms (AWS, Azure, GCP) and their data services (e.g., AWS S3, EMR, Glue)
  • Familiarity with data orchestration tools (e.g., Apache Airflow)
  • Experience with data visualization tools (e.g., Tableau, Power BI)
  • Understanding of data warehousing concepts (e.g., Kimball, Inmon)

Additional Information:

Job Posted:
March 01, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
Citi - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Pyspark/Python ETL Developer

Optimization Data Analyst

We are looking for a Data Analyst to join our Optimization Data Analytics team. ...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
adyen.com Logo
Adyen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 4 years of relevant working experience in the Data & Analytics field
  • Excellent analytical and data wrangling skills, with advanced proficiency in PySpark/Python
  • Experience using descriptive and inferential statistics (e.g., distributions, correlations, hypothesis testing, regressions)
  • Expertise in leveraging data to uncover meaningful and actionable insights, paired with the ability to craft compelling data stories that effectively present findings and recommendations to executives
  • Experience with data visualization platforms (e.g., Looker, Tableau)
  • Familiarity with Big Data tools and platforms such as Spark and Airflow, and proficiency in version control using Git
  • Ability to design and develop efficient and scalable ETL and data pipelines for datasets, including the use of automated data validation to ensure reliability
  • Ability to manage multiple priorities and deliver results in a fast-paced environment
  • Excellent communication and collaboration skills, with a global perspective and ability to interface seamlessly with a global, multicultural team
Job Responsibility
Job Responsibility
  • Framework Development: Collaborate with cross-functional data teams to develop scalable and reusable frameworks for evaluating large datasets on pressing business questions
  • Data Analysis: Determine the necessary data required to solve a wide variety of business problems
  • extract required data, draw conclusions, and provide recommendations
  • Be a Subject Matter Expert: Act as Adyen’s SME for both merchants and internal stakeholders on payment optimization
  • Data Strategy: Shape the next generation of BI and data infrastructure
  • Build self-service tools to enable business users and contribute to automation and scaling projects
  • Storytelling: Turn your findings into effective communication and concise, actionable advice by connecting the data to a story
  • present to internal customers and merchants
  • Stakeholder Management: Collaborate with Account Managers, Product teams, and other Optimization Data Analysts to align on data best practices and priorities
  • Gather requirements, provide data insights, and address inquiries
Read More
Arrow Right
New

Cook

This is a great opportunity in Narooma for quality and talented Cooks to join th...
Location
Location
Australia , Narooma
Salary
Salary:
75000.00 - 80000.00 AUD / Year
merivale.com Logo
Merivale
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of relevant experience in the industry
  • Food preparation, cooking and seasoning knowledge
  • Worked in a quality restaurant, pub, cafe, or hotel
  • Good knife skills and a desire to learn
  • An understanding of HACCP and hygiene practices
What we offer
What we offer
  • Paid parental leave and flexible return to work support for new parents
  • Amazing discounts at 90+ venues
  • Career and development opportunities through the Merivale Academy
  • Employee Assistance Program
  • Employee Referral Program
  • Fulltime
Read More
Arrow Right
New

Principal Product Manager - Data Engineering

Microsoft’s Azure Data engineering team is leading the transformation of analyti...
Location
Location
Canada , Vancouver
Salary
Salary:
142400.00 - 257500.00 CAD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience
  • 4+ years experience with Data Engineering in Cloud
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Own the end‑to‑end developer experience across notebooks, APIs, and AI‑assisted tooling (including MCP and CI/CD), enabling data engineers and professional developers to reliably build, scale, and operate Apache Spark workloads on Microsoft Fabric in the age of AI
  • Translate customer, partner, and field insights into clear product priorities that measurably improve usability, productivity, and operational readiness
  • Partner closely with engineering and partner teams to shape production‑grade Spark capabilities, including performance, reliability, security, and deep integration across the Microsoft Fabric ecosystem
  • Advance AI‑assisted developer workflows for data engineering, including Copilot‑powered experiences, that reduce friction and eliminate operational complexity in real‑world Spark workloads
  • Represent the Spark developer experience in cross‑team and platform‑level decision making, aligning stakeholders across Azure Data, Fabric, and Real‑Time Intelligence to deliver cohesive outcomes at scale
  • Embody Microsoft’s culture and values by operating with a growth mindset, customer obsession, accountability, and inclusive collaboration—driving impact through influence rather than people management
  • Fulltime
Read More
Arrow Right
New

Auto Body Technician

Every day, over 20,000 car accidents disrupt lives. When our customers face one,...
Location
Location
United States of America , Asheville
Salary
Salary:
Not provided
caliber.com Logo
Caliber Collision
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least two years of turning wrecks into road-ready rides
  • Frame and structural know-how—If you can pull, straighten, and square it up
  • No-shortcuts mentality—Blueprint it, fix it right the first time
  • Sharp eye for detail—You’re committed to tightened bolts, perfected welds, and no excuses
  • Physically fit for the job—You can lift up to 50lbs
  • Team-first attitude—You collaborate with the painters, estimators, and front office staff in the business
  • Must be eligible to work in the U.S. with no restrictions
Job Responsibility
Job Responsibility
  • Blueprint and execute—No guesswork, no shortcuts—just clean, precise repairs
  • Full collision repair—From fender benders to frame rebuilds, you handle it all
  • Panel and structural work—If it’s bent, twisted or torn, you bring it back to factory specs
  • Quality reassembly—Fit and finish matter—your final touches make all the difference
  • Work as a team—Trust and teamwork move cars through
  • Keep it clean—A pro always puts work location safety and tidiness first
What we offer
What we offer
  • Competitive pay—Unlimited work paired with a flag rate of up to $20–$30 paid weekly
  • XTREME Benefits Discount—Enjoy an extra $60.70 weekly toward healthcare premiums for your first six months
  • Career growth—Opportunities to create a career that works for you
  • Training that levels you up—I-CAR, ASE certifications—we invest in you
  • Paid time off and holidays—Start accruing time off on day one and enjoy six company-wide holidays each year
  • Day-one benefits—Medical, dental, vision, 401k match—no waiting
  • Best equipment and tech in the business—3M products, industry-leading gear
  • Fulltime
Read More
Arrow Right
New

Logistics Administrator

We are looking for a skilled Logistics Administrator to join our team in Inver G...
Location
Location
United States , Inver Grove Heights
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in logistics, transportation, or supply chain management
  • Strong negotiation skills with the ability to secure competitive rates and contracts
  • Proficiency in managing databases, spreadsheets, and transportation-related systems
  • Excellent communication skills for collaboration with internal teams and external vendors
  • Ability to analyze operations and identify opportunities for improvement
  • Knowledge of freight markets and transportation trends
  • Familiarity with KPI reporting and carrier performance monitoring
  • Flexibility to work overtime during peak seasons, such as harvest periods
Job Responsibility
Job Responsibility
  • Coordinate and manage truck transportation of materials and products, ensuring timely and cost-effective delivery
  • Negotiate competitive freight rates with carriers and oversee rate loading in internal rating systems
  • Analyze transportation operations to identify and implement process and cost improvements
  • Build and maintain strong relationships with third-party truck carriers, ensuring profitable partnerships
  • Monitor carrier performance using key performance indicators (KPIs) and take corrective actions to address service issues
  • Update and maintain internal systems and databases for contracts, freight rates, and customer information
  • Communicate transportation market trends to internal sales, purchasing teams, and external stakeholders
  • Collaborate with cross-functional teams to align transportation strategies with operational and financial goals
  • Provide accurate and market-based freight pricing to stakeholders within multiple product lines
  • Ensure compliance with shipping requirements and effectively manage customer-specific needs
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • company 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Casual Chef

Award winning modern Cantonese restaurant Queen Chow located on the busy bustlin...
Location
Location
Australia
Salary
Salary:
Not provided
merivale.com Logo
Merivale
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years cooking in high-end restaurants
  • Experience in Asian kitchens or a passion for Asian cooking ideal
  • Able to work in a fast-paced team and environment
  • Calm under pressure with good communication and attention to detail
  • Experience on wok ideally but not essential
What we offer
What we offer
  • Competitive salary and award rates
  • Paid parental leave and flexible return to work support for new parents
  • Amazing discounts at 90+ venues
  • Career and development opportunities through the Merivale Academy
  • Employee Assistance Program
  • Employee Referral Program
Read More
Arrow Right
New

Assistant Head Sommelier

In this role you’ll be given the opportunity to use your creativity, introduce n...
Location
Location
Australia , Sydney
Salary
Salary:
Not provided
merivale.com Logo
Merivale
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • previous Sommelier experience within a similar high-end restaurant environment
  • enjoy working with extensive wine lists
  • be an inspirational team leader with a proven track record of developing and mentoring the other Sommeliers within your team
  • have a thirst for knowledge and growth
  • a passion for providing the customer with an outstanding experience
Job Responsibility
Job Responsibility
  • use your creativity, introduce new and unique offerings to the wine list and take charge of the wine program
  • lead and inspire our floor staff
  • play a key role in ensuring the delivery of exceptional guest service as well as driving revenue and cost results
  • set the standard for world-class service and share your wine knowledge with esteemed guests
What we offer
What we offer
  • Competitive salary
  • Paid parental leave and flexible return to work support for new parents
  • Amazing discounts at 90+ venues
  • Career and development opportunities, learning from the best
  • Employee Assistance Program
  • Employee Referral Program
  • Fulltime
Read More
Arrow Right
New

E-Commerce Specialist

In this role, you will play a key part in managing and enhancing digital shelf c...
Location
Location
United States , St Louis Park
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in e-commerce and digital content management
  • Proficiency in working with Content Management Systems (CMS)
  • Strong analytical skills and ability to translate data insights into actionable strategies
  • Advanced knowledge of Microsoft Excel, including formula-based automation
  • Excellent communication and collaboration skills to work effectively across teams
  • Attention to detail and strong organizational abilities
  • Familiarity with digital shelf optimization and product syndication processes
  • Ability to adapt to evolving e-commerce trends and technologies
Job Responsibility
Job Responsibility
  • Develop and implement digital shelf content strategies to improve visibility and conversion rates for products across multiple online retail platforms
  • Coordinate with the eCommerce analyst to ensure approved content updates are accurately executed
  • Work alongside the Master Data Management team to maintain and validate the accuracy of digital shelf content
  • Collaborate with brand management teams to align digital content with brand messaging priorities and guidelines
  • Partner with platforms and retailers to syndicate product content efficiently and ensure consistency across channels
  • Document and refine processes to incorporate digital shelf requirements into commercialization workflows
  • Provide insights and analysis to identify future digital shelf needs and support long-term planning activities
  • Review and validate content readiness, including product specifications, marketing copy, and retailer-specific requirements
  • Manage digital assets such as images and renders, ensuring compliance with retailer specifications and formatting guidelines
  • Utilize advanced Excel skills to automate recurring data tasks and support import/export templates
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • company 401(k) plan
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy