CrawlJobs Logo

Pyspark Module Lead

https://www.soprasteria.com Logo

Sopra Steria

Location Icon

Location:
India , Bengaluru

Category Icon

Job Type Icon

Contract Type:
Employment contract

Salary Icon

Salary:

Not provided

Job Description:

Sopra Steria is seeking a PySpark Module Lead based in Bengaluru, India. The position involves designing and building data solutions for Airbus, leveraging the Skywise platform and tools, and working along Product Owners and business functions. The role requires a strong understanding of Python, PySpark, SQL, and JavaScript, and proficiency with Skywise tools such as Contour, Code-Workbook, and Ontology.

Job Responsibility:

  • Designing and building solutions for Airbus on foundry
  • Data engineering and integration
  • Data analysis and visualization
  • Application development within Skywise Framework
  • Working closely with Product Owners and core Airbus business functions to understand processes, capture requirements, and solve business problems
  • Full delivery lifecycle for designing, implementing, testing, documenting, and supporting applications
  • CI/CD pipeline development and automated deployments
  • Troubleshooting application issues
  • Providing support on developed tools

Requirements:

  • Python
  • PySpark
  • SQL
  • JavaScript
  • Proficient with Skywise platform and tools e.g. Contour, Code-Workbook, Code, Slate and Ontology

Nice to have:

  • Knowledge of airline and MRO operations
  • AWS Cloud Services like EC2, RDS and Redshift
  • Agile/Scrum
  • SAFe
  • Palantir tools like Slate, Workshop
What we offer:
  • Inclusive and respectful work environment
  • Open to people with disabilities

Additional Information:

Job Posted:
May 05, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Pyspark Module Lead

Pyspark Module Lead

We are seeking a highly skilled and motivated Data Engineer to join our dynamic ...
Location
Location
India , Noida
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Advanced SQL (Window functions), Spark Architecture, Pyspark or Scala with Spark, Hadoop
  • Proven expertise in designing and deploying data pipelines
  • Strong problem-solving skills and ability to work effectively in a collaborative team environment
  • Excellent communication skills and ability to translate technical concepts to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Work in tandem with Data Scientists to design, develop, and implement machine learning pipelines
  • Utilize PySpark for data processing, transformation, and preparation for model training
  • Leverage AWS EMR and S3 for scalable and efficient data storage and processing
  • Implement and manage ETL workflows using Streamsets for data ingestion and transformation
  • Design and construct pipelines to deliver high-quality training and inference datasets
  • Collaborate with cross-functional teams to ensure smooth deployment and real-time/near real-time inferencing capabilities
  • Optimize and fine-tune pipelines for performance, scalability, and reliability
  • Ensure IAM policies and permissions are appropriately configured for secure data access and management
  • Implement Spark architecture and optimize Spark jobs for scalable data processing
What we offer
What we offer
  • All positions are open to people with disabilities
  • Commitment to fighting against all forms of discrimination
  • Inclusive and respectful work environment
Read More
Arrow Right

PySpark Module Lead

PySpark Module Lead position at Sopra Steria, a major Tech player in Europe. The...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Good experience in applying best coding practices
  • Good understanding and ability to develop simple to medium applications
  • Strong learnability and analytical skills
  • Strong team player with excellent communication skills
  • Mandatory skills: AWS, PySpark, PL SQL, Java
  • AWS Skills are on S3, Lambda, Cloudwatch, Dynamo DB, SQS, SNS, CloudFormation, Stack, Serverless
  • Total Experience Expected: 04-06 years
  • B.Tech, MCA or equivalent degree
What we offer
What we offer
  • Committed to fighting against all forms of discrimination
  • Fosters a work environment that is inclusive and respectful of all differences
  • All positions are open to people with disabilities
Read More
Arrow Right

Senior Software Engineer

The Senior Software Engineer will lead a team of data engineers to design, build...
Location
Location
United States , San Diego
Salary
Salary:
Not provided
gomillenniumsoft.com Logo
MillenniumSoft Inc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in developing data solutions
  • Proven experience in designing and implementing large-scale data pipelines
  • Hands-on expertise with AWS cloud technologies and distributed systems
  • Strong programming skills in PySpark, Python, and SQL
  • Data pipeline development using AWS tools (Step Functions, Airflow, etc.)
  • Distributed systems (S3, ADLS), and modern file/table formats (Parquet, Hudi)
  • ETL tools, orchestration technologies, and database design
  • Knowledge of regulatory standards like SOX, PCI, and HIPAA
  • Bachelor’s or Master’s in Computer Science, Information Systems, or related fields
  • AWS certification preferred
Job Responsibility
Job Responsibility
  • Design and implement scalable data pipelines for structured and unstructured data
  • Lead module architecture design for optimal performance, reliability, and maintainability
  • Mentor team members and ensure alignment with business goals
  • Collaborate with cross-functional teams to enable real-time and batch data processing
  • Ensure adherence to data security, privacy, and governance standards
  • Create and maintain technical documentation for architectures and decisions
  • Conduct code reviews and establish best practices
  • Develop monitoring systems for data pipeline reliability
  • Drive adoption of new technologies and workflows
  • Fulltime
Read More
Arrow Right
New

AI Lead, Client Technology - SVP

We are seeking a highly skilled and pragmatic AI Lead to design, develop, deploy...
Location
Location
United States , New York
Salary
Salary:
176720.00 - 265080.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
February 19, 2026
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field
  • 10+ years software engineering experience with recent hands-on coding, with a track record of rapid delivery and launching multiple AI features in production
  • Minimum 3+ years of professional experience in software development with a focus on AI, prompt engineering, machine learning and/or agentic AI systems
  • Strong proficiency in Python (FastAPI, Django, Flask, PySpark) or Java (Spring Boot, Spring Cloud, Spring Security), and SQL
  • JavaScript (React, Next.js, Node.js, TypeScript)
  • Full-stack development with a focus on rapid prototyping
  • Solid understanding of core AI concepts, including knowledge representation, automated planning, decision-making under uncertainty, and multi-agent systems
  • Experience with machine learning frameworks (e.g., TensorFlow, PyTorch) and relevant libraries (e.g., Scikit-Learn, NumPy, Pandas)
  • Familiarity with large language models (LLMs) like ChatGPT, LaMDA/Gemini, Llama, etc., and their application in agentic systems
  • Familiarity with specific agent frameworks (e.g., LangChain, AutoGen, CrewAI, RAG) or research in multi-agent reinforcement learning
Job Responsibility
Job Responsibility
  • Design, implement, and deploy intelligent agents, including perception, reasoning, planning, and action execution modules
  • Contribute to the development and implementation of generative AI solutions, ensuring they meet technical requirements and business objectives
  • Develop scalable and robust architectures for agentic systems and generative AI applications, ensuring high performance, reliability, and security
  • Integrate various machine learning models (e.g., LLMs, reinforcement learning, predictive models) to enhance agent capabilities and decision-making
  • Implement LLM integration using platforms like OpenAI, Anthropic, and Bedrock APIs
  • Develop agents that can automate complex tasks, optimize workflows, and solve real-world problems across various domains
  • MVP first approach, iterative improvement approach with a focus on 'time to value' (quick iterations, hypothesis testing, A/B experiments)
  • Utilize and contribute to agentic AI frameworks and development tools
  • Build full-stack applications that integrate existing ML/LLM tools and services
  • Design and implement metrics and evaluation strategies for agent performance, continuously optimizing and improving agent behavior
What we offer
What we offer
  • medical, dental & vision coverage
  • 401(k)
  • life, accident, and disability insurance
  • wellness programs
  • paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays
  • discretionary and formulaic incentive and retention awards
  • Fulltime
!
Read More
Arrow Right
New

Teller

Wells Fargo is seeking a Teller in our Consumer, Small & Business Banking divisi...
Location
Location
United States , Kalispell
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
February 28, 2026
Flip Icon
Requirements
Requirements
  • 6+ months of interacting with customers experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
Job Responsibility
Job Responsibility
  • Support customer engagement by processing teller transactions, sharing digital solutions, and making appropriate introductions to bankers
  • Complete operational activities while minimizing risks under established policies
  • Perform routine transactional, operational, and customer support tasks efficiently through knowledge of bank procedures and products, as well as partners across the organization
  • Receive direction from managers and exercises judgment within defined policies and procedures
  • Escalate questions and issues to more experienced roles
  • Interact with customers and individuals to demonstrate care, build relationships, and complete requested transactions
  • Identify information and services to meet customers financial needs
  • Fulltime
Read More
Arrow Right
New

Senior Manager, Consulting

The role of a Senior Manager, Consulting is to support customer engagements, con...
Location
Location
United States , New York
Salary
Salary:
110000.00 - 145000.00 USD / Year
flywheeldigital.com Logo
Flywheel Digital
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years working within CPG/Retail, analytics or consulting
  • 5 years professional experience in ecommerce
  • Experience working with or for brands/manufacturers and/or experience working with retailers
  • Knowledge of the digital retail industry, retail media, retailers' strategies and manufacturer/retailer ways of working
  • Strong understanding of eCommerce performance drivers / dynamics / fundamentals – i.e. SEO, Taxonomy, Enhanced content
  • Easily establish strong rapport with clients, able to address client feedback, drive retention and repeat engagements
  • Experienced in people management, supporting individuals’ career development & growth on your team
  • Effective communication skills (written & verbal), you can work with a variety of internal and external stakeholders and customers
  • Experience presenting using Microsoft PowerPoint to individuals and groups
  • Flexibility to travel as and when required
Job Responsibility
Job Responsibility
  • Lead client projects & engagements from the initial client question to ideation, planning, scheduling, research and final delivery
  • Working with our most strategic partners to deliver actionable recommendations and thought leadership
  • Lead project teams - guiding the team via clear planning and delivery processes, coaching on research, creating engaging presentations and delivering best-in-class client deliverables
  • Provide actionable insight for clients on future strategies, tied to client's core business objectives, structure and measurements, and identify potential growth opportunities and necessary capabilities for growth
  • Manage people (as needed) with a focus on supporting their growth and a feedback first culture
  • Deliver Actionable Insight - on commerce strategies, and implications tied to client's core business objectives, roles, responsibilities, structure and measurements, and identifies potential growth opportunities and necessary capabilities for growth
  • Present Analysis & Findings - to clients virtually and at in-person events
  • Collaboration - Partner with other team members to execute projects on a right-first-time basis
  • develops a successful relationship with key stakeholders
What we offer
What we offer
  • Flexible vacation time
  • Great learning and development opportunities
  • Benefits that help you live your best life
  • Parental leave and benefits
  • Volunteering opportunities
  • Employee Resource Groups (ERGs)
  • Fulltime
Read More
Arrow Right
New

Rcm manager

Finni Health empowers autism care providers to start, run, and grow their own pr...
Location
Location
United States
Salary
Salary:
65000.00 - 80000.00 USD / Year
finnihealth.com Logo
Finni Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant experience in revenue cycle management, RCM operations, or related roles, preferably in an early-stage startup, behavioral or mental health, or healthcare tech
  • Strong understanding of RCM processes, including billing, claim denials, collections, and accounts receivable management
  • Proven ability to work effectively within a team environment, contributing to collective success, and independently driving RCM initiatives
  • Deep understanding of the full revenue cycle, including billing, claims processing, collections, accounts receivable management, payer contracting, and compliance
  • Strong ability to analyze complex RCM data, identify trends, root causes of issues, and implement effective, data-driven solutions to optimize financial performance
  • Demonstrated expertise in identifying inefficiencies and driving process improvements for RCM efficiency and effectiveness
  • Excellent written and verbal communication skills, with proven ability to effectively collaborate with internal teams and external stakeholders (payers, vendors, providers)
  • Exceptional organizational and time management skills, with the ability to manage multiple priorities and projects in a fast-paced environment
  • Proficient in Google Suite, Slack, CRM/support software, and EHR/RCM management tools
  • Passion for Finni’s mission to democratize autism care and empower providers through robust RCM
Job Responsibility
Job Responsibility
  • Appeal Denials: Work with payers to understand the cause of denials and recover lost revenue. Partner with other stakeholders to obtain the corrections/information needed to successfully appeal denials
  • Denial Trend Analysis: Determine the root cause of denials and determine what is needed for denial prevention in terms of product enhancements or workflows
  • Operational Efficiency and Project Management: Lead workflow optimization initiatives within RCM, manage specific projects, and drive continuous process improvements to maximize reimbursement and minimize denials
  • RCM Strategy & Execution: Contribute to the development and implementation of effective processes for billing, claims processing, revenue collections, and cash posting, ensuring accuracy and timeliness
  • Cross-Functional Collaboration: Collaborate extensively with product, provider success, compliance, HR, finance, and other teams to align RCM efforts with overall business objectives and drive strategic goals
  • Additional Responsibilities: Adapt and take on evolving responsibilities and projects as Finni Health grows and the RCM landscape changes
  • Fulltime
Read More
Arrow Right
New

Maid

Everlight Solar is seeking a dedicated maid, also known as the Property Cleaning...
Location
Location
United States , St. Paul
Salary
Salary:
19.00 - 24.00 USD / Hour
everlightsolar.com Logo
Everlight Solar
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • No Experience Required
  • Good interpersonal skills
  • Friendly nature
  • Reliable and efficient
  • Organized
Job Responsibility
Job Responsibility
  • Making sure that all the work areas assigned are clean and well kept
  • Informing supervisor if there’s any damages
  • Ensuring that inventory is well stocked
  • Showing a high level of professionalism
  • Familiar with the health and safety practices
What we offer
What we offer
  • Health Insurance
  • Dental Insurance
  • Vision Insurance
  • Life Insurance
  • PTO
  • Sick and Safe Time
  • Paid Holidays Off
  • Fulltime
Read More
Arrow Right