CrawlJobs Logo

Python Pyspark

overturerede.in Logo

Overture Rede

Location Icon

Location:

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

This is a remote position.

Requirements:

  • Design and develop on Hadoop applications
  • Hands-on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALA
  • Experience on Core Java
  • Experience on Map Reduce programs, Hive programming, Hive queries performance concepts
  • Experience on source code management with Git repositories

Nice to have:

  • Exposure to AWS Ecosystem with hands-on knowledge of ec2, S3 and services
  • Basic SQL programming
  • Knowledge of agile methodology for delivering software solutions
  • Build scripting with Maven / Cradle
  • Exposure to Jenkins

Additional Information:

Job Posted:
January 07, 2026

Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Python Pyspark

Pyspark Module Lead

Sopra Steria is seeking a PySpark Module Lead based in Bengaluru, India. The pos...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Python
  • PySpark
  • SQL
  • JavaScript
  • Proficient with Skywise platform and tools e.g. Contour, Code-Workbook, Code, Slate and Ontology
Job Responsibility
Job Responsibility
  • Designing and building solutions for Airbus on foundry
  • Data engineering and integration
  • Data analysis and visualization
  • Application development within Skywise Framework
  • Working closely with Product Owners and core Airbus business functions to understand processes, capture requirements, and solve business problems
  • Full delivery lifecycle for designing, implementing, testing, documenting, and supporting applications
  • CI/CD pipeline development and automated deployments
  • Troubleshooting application issues
  • Providing support on developed tools
What we offer
What we offer
  • Inclusive and respectful work environment
  • Open to people with disabilities
  • Fulltime
Read More
Arrow Right

Python Developer

Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
January 26, 2026
Flip Icon
Requirements
Requirements
  • Hands on experience with numpy, pandas, pyspark, py4j using python
  • Making db connection, fetching resultset, processing resultset
  • Working with data type- date, number, text
  • File IO, csv file processing, sending mail
  • Exception management
  • Good understanding of schell scripting, ETL concepts
  • Understanding of batch jobs, autosys
  • Good hands on exp with basic to medium complex SQL queries
  • Basic understanding of Unix shell script and Unix OS platform
  • Excellent problem solving and analytical skill
Read More
Arrow Right

Pyspark Developer

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Tableau and Python Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience
  • 5-8 years of experience in Python
  • 3 year experience using PySpark
  • 3 year experience in developing Kafka data pipelines
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Software Developer

Sopra Steria, a major Tech player in Europe, is hiring a Software Developer skil...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Python
  • PySpark
  • AWS (Lambda, RDS)
  • Spark SQL
  • Experience with Foundry (Slate, Workbook, etc.)
  • Schedulers (like Airflow)
  • Proficiency in Python, SQL, and/or Spark with minimum of 3 years working experience
  • Solid understanding of data modeling and data warehousing concepts
  • Experience working with data integration, transformation, and visualization tools
  • Full stack knowledge experience in Python & PySpark
Job Responsibility
Job Responsibility
  • To deliver all activities assigned within agreed KPIs
  • Develop and maintain adequate competences needed to meet expected deliveries
  • Build and maintain healthy relationship with all stakeholders including customers
  • Continuously look for opportunities to increase/optimize efficiency of operations
  • Capture learnings and share knowledge within the team
  • Launch initiatives and ensure meaningful closure
  • Regular reporting on the status to required Stakeholders
  • Adequate and timely communication to stakeholders
  • Exchange feedback with team members
  • Abide by company policies
What we offer
What we offer
  • Inclusive and respectful work environment
  • Open to people with disabilities
  • Fulltime
Read More
Arrow Right

Gen AI/Data Engineer

Job Title: Gen AI/Data Engineer. Duration: 12 Months. Location: Addison TX. Pay ...
Location
Location
United States , Addison
Salary
Salary:
65.00 - 68.26 USD / Hour
apexsystems.com Logo
Apex Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expert Python development skills
  • Python, PySpark, Scala - heavy data engineer skills
  • RAG LLM, (Chat GPT – Copilot) –need a someone who has experience developing these technologies. NOT a User
  • Hands-on experience in application development in one or more areas MongoDB, Redis, Angular/React Frameworks, Containerization.
  • Experience with AI/ML/GenAI Lifecycle Management and Development and its Ecosystem. Hands on experience building frameworks using MLFlow, KubeFlow, Fine – Tuning techniques, Inference Frameworks
  • Building API based application leveraging FAST API services, JWT Integration, API Gateway
  • Working in large sized teams that collaboratively develop on a shared multi-repo codebase using IDEs (e.g. VS Code rather than Jupyter Notebooks), Continuous Integration (CI), Continuous Deployment (CD) and Continuous Testing
  • Hands-on DevOps experience with one or more of the following enterprise development tools: Version Control (GIT/Bitbucket), Build Orchestration (Jenkins), Code Quality (SonarQube and pytest Unit Testing), Artifact Management (Artifactory) and Deployment (Ansible)
Job Responsibility
Job Responsibility
  • Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements.
  • Utilizes multiple architectural components (across data, application, business) in design and development of client requirements.
  • Performs Continuous Integration and Continuous Development (CI-CD) activities.
  • Contributes to story refinement and definition of requirements.
  • Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle.
What we offer
What we offer
  • medical, dental, vision, life, disability, and other insurance plans
  • ESPP (employee stock purchase program)
  • 401K program with a company match after 12 months of tenure
  • HSA (Health Savings Account on the HDHP plan)
  • SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions
  • corporate discount savings program
  • on-demand training program
  • access to certification prep and a library of technical and leadership courses/books/seminars after 6+ months of tenure
  • certification discounts
  • dedicated customer service team
  • Fulltime
Read More
Arrow Right

Pyspark Data Engineer

The Data Analytics Intmd Analyst is a developing professional role. Deals with m...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-8 years relevant experience in Data Analytics and Big Data
  • SQL, Python, Pyspark, with Spark components
  • Minimum 4 years of experience as a python developer with expertise in automation testing to design, develop, and automate robust software solutions and testing frameworks like Pytest, Behave
  • 2-4 years of experience as Big Data Engineer to develop, optimize, and manage large-scale data processing systems and analytics platforms
  • 4 years of experience in distributed data processing & near real-time data analytics using PySpark
  • Strong understanding of PySpark execution plans, partitioning & optimization techniques
Job Responsibility
Job Responsibility
  • Integrates in-depth data analysis knowledge with a solid understanding of industry standards and practices
  • Demonstrates a Good understanding of how data analytics teams and area integrate with others in accomplishing objectives
  • Applies project management skills
  • Applies analytical thinking and knowledge of data analysis tools and methodologies
  • Analyzes factual information to make accurate judgments and recommendations focused on local operations and broader impacts
  • Applies professional judgment when interpreting data and results breaking down information in a systematic and communicable manner
  • Employs developed communication and diplomacy skills to exchange potentially complex/sensitive information
  • Demonstrates attention to quality and timeliness of service to ensure the effectiveness of the team and group
  • Provides informal guidance or on-the-job-training to new team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Data Governance Application Architect

Location
Location
India , Miracle Heights
Salary
Salary:
Not provided
miraclesoft.com Logo
Miracle Software Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Python
  • Pyspark
  • SQL
  • Databricks
  • Powerbi
  • Exp 5-10 Years
  • Certifications in Azure Fundamentals, Azure Data Fundamentals, Databricks, or Data Governance are an added advantage
Job Responsibility
Job Responsibility
  • Implement and manage data governance frameworks using Databricks, PySpark, and SQL to support standardized data lineage, cataloging, and quality validation across domains
  • Develop and automate governance processes to support compliance, data quality, and lifecycle management across multiple domains
  • Collaborate with enterprise data, analytics, and business teams to define governance policies, business rules, and metadata standards aligned with strategic objectives
  • Design Power BI dashboards and reporting solutions to monitor governance KPIs, data quality metrics, and data stewardship activities
  • Enhance metadata visibility and traceability by integrating data catalogs and lineage tools across cloud and on-premises environments
  • Contribute to data stewardship and policy enforcement initiatives, ensuring adherence to regulatory and internal data standards
  • Participate in architecture and governance discussions to support data strategy, platform selection, and implementation best practices
Read More
Arrow Right

Skywise Developer

The Skywise Developer will work with technologies like Python, PySpark, Spark SQ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Python
  • PySpark
  • Spark SQL
  • Experience with Skywise & Foundry (Slate, Workshop, Object Explorer)
  • JavaScript
  • Development experience using JavaScript or TypeScript
  • Understanding of how to ensure robust, reusable server-side applications
  • Knowledge of SQL and relational databases
  • Experience working in an agile team (Scrum, Kanban, or XP)
  • Practical experience delivering good quality code in enterprise-scale development
Job Responsibility
Job Responsibility
  • Understand business processes and technical architecture of Airbus application portfolio
  • Design and develop high quality scalable and reliable solutions
  • Perform deep technology root cause analysis and performance improvement
  • Define/suggest best practices and Golden rules
  • Excellent communication skills as required to engage customers on requirements and delivery
What we offer
What we offer
  • Inclusive and respectful work environment
  • Open to people with disabilities
  • Fulltime
Read More
Arrow Right