CrawlJobs Logo

Pyspark Module Lead

https://www.soprasteria.com Logo

Sopra Steria

Location Icon

Location:
India , Bengaluru

Category Icon

Job Type Icon

Contract Type:
Employment contract

Salary Icon

Salary:

Not provided

Job Description:

Sopra Steria is seeking a PySpark Module Lead based in Bengaluru, India. The position involves designing and building data solutions for Airbus, leveraging the Skywise platform and tools, and working along Product Owners and business functions. The role requires a strong understanding of Python, PySpark, SQL, and JavaScript, and proficiency with Skywise tools such as Contour, Code-Workbook, and Ontology.

Job Responsibility:

  • Designing and building solutions for Airbus on foundry
  • Data engineering and integration
  • Data analysis and visualization
  • Application development within Skywise Framework
  • Working closely with Product Owners and core Airbus business functions to understand processes, capture requirements, and solve business problems
  • Full delivery lifecycle for designing, implementing, testing, documenting, and supporting applications
  • CI/CD pipeline development and automated deployments
  • Troubleshooting application issues
  • Providing support on developed tools

Requirements:

  • Python
  • PySpark
  • SQL
  • JavaScript
  • Proficient with Skywise platform and tools e.g. Contour, Code-Workbook, Code, Slate and Ontology

Nice to have:

  • Knowledge of airline and MRO operations
  • AWS Cloud Services like EC2, RDS and Redshift
  • Agile/Scrum
  • SAFe
  • Palantir tools like Slate, Workshop
What we offer:
  • Inclusive and respectful work environment
  • Open to people with disabilities

Additional Information:

Job Posted:
May 05, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Pyspark Module Lead

Pyspark Module Lead

We are seeking a highly skilled and motivated Data Engineer to join our dynamic ...
Location
Location
India , Noida
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Advanced SQL (Window functions), Spark Architecture, Pyspark or Scala with Spark, Hadoop
  • Proven expertise in designing and deploying data pipelines
  • Strong problem-solving skills and ability to work effectively in a collaborative team environment
  • Excellent communication skills and ability to translate technical concepts to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Work in tandem with Data Scientists to design, develop, and implement machine learning pipelines
  • Utilize PySpark for data processing, transformation, and preparation for model training
  • Leverage AWS EMR and S3 for scalable and efficient data storage and processing
  • Implement and manage ETL workflows using Streamsets for data ingestion and transformation
  • Design and construct pipelines to deliver high-quality training and inference datasets
  • Collaborate with cross-functional teams to ensure smooth deployment and real-time/near real-time inferencing capabilities
  • Optimize and fine-tune pipelines for performance, scalability, and reliability
  • Ensure IAM policies and permissions are appropriately configured for secure data access and management
  • Implement Spark architecture and optimize Spark jobs for scalable data processing
What we offer
What we offer
  • All positions are open to people with disabilities
  • Commitment to fighting against all forms of discrimination
  • Inclusive and respectful work environment
Read More
Arrow Right

PySpark Module Lead

PySpark Module Lead position at Sopra Steria, a major Tech player in Europe. The...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Good experience in applying best coding practices
  • Good understanding and ability to develop simple to medium applications
  • Strong learnability and analytical skills
  • Strong team player with excellent communication skills
  • Mandatory skills: AWS, PySpark, PL SQL, Java
  • AWS Skills are on S3, Lambda, Cloudwatch, Dynamo DB, SQS, SNS, CloudFormation, Stack, Serverless
  • Total Experience Expected: 04-06 years
  • B.Tech, MCA or equivalent degree
What we offer
What we offer
  • Committed to fighting against all forms of discrimination
  • Fosters a work environment that is inclusive and respectful of all differences
  • All positions are open to people with disabilities
Read More
Arrow Right

Senior Software Engineer

The Senior Software Engineer will lead a team of data engineers to design, build...
Location
Location
United States , San Diego
Salary
Salary:
Not provided
gomillenniumsoft.com Logo
MillenniumSoft Inc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in developing data solutions
  • Proven experience in designing and implementing large-scale data pipelines
  • Hands-on expertise with AWS cloud technologies and distributed systems
  • Strong programming skills in PySpark, Python, and SQL
  • Data pipeline development using AWS tools (Step Functions, Airflow, etc.)
  • Distributed systems (S3, ADLS), and modern file/table formats (Parquet, Hudi)
  • ETL tools, orchestration technologies, and database design
  • Knowledge of regulatory standards like SOX, PCI, and HIPAA
  • Bachelor’s or Master’s in Computer Science, Information Systems, or related fields
  • AWS certification preferred
Job Responsibility
Job Responsibility
  • Design and implement scalable data pipelines for structured and unstructured data
  • Lead module architecture design for optimal performance, reliability, and maintainability
  • Mentor team members and ensure alignment with business goals
  • Collaborate with cross-functional teams to enable real-time and batch data processing
  • Ensure adherence to data security, privacy, and governance standards
  • Create and maintain technical documentation for architectures and decisions
  • Conduct code reviews and establish best practices
  • Develop monitoring systems for data pipeline reliability
  • Drive adoption of new technologies and workflows
  • Fulltime
Read More
Arrow Right

General Manager

General Manager for Roxy Ball Room Birmingham Victoria Square, the home of booze...
Location
Location
United Kingdom , Birmingham
Salary
Salary:
44000.00 - 48000.00 GBP / Year
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Leader that drives the business forward
  • Real team player with a passion for hospitality
  • Winning personality and fun-loving spirit
  • Enthusiasm and own character
  • Passionate attitude
  • Loves to be professional playful
  • Always gives good energy
  • Your team. Every time
  • Can motivate and lead a team
  • Display a good work ethic and share knowledge
Job Responsibility
Job Responsibility
  • Ensure we are delivering the best gaming experience for our guests on every visit
  • Creating and delivering quarterly business plans
  • Leading by example through Training, coaching and developing a winning team
  • Managing a P&L to meet financial targets and expectations
  • Ensuring the business is managed correctly to achieve Quarterly and Yearly Bonus
  • Managing the Safety, Security and licensing aspects of the business
  • Managing our guest experience platform to improve service and standards
  • Maintain a fun and engaging culture using our Brand Standards and Company Ethos
  • Monthly reviews with all your team members encouraging their growth and development
  • Ensuring service standards and duty management are upheld throughout operating hours
What we offer
What we offer
  • Quarterly Bonus Scheme
  • Tips
  • Service Charge
  • 50% off food and drink & free gaming
  • Regular team incentives- with rewards including paid trips abroad
  • 2 Staff Socials throughout the year
  • Employee Assistance Program that includes access to free counselling services
  • Further development opportunities within the company growth
  • Development courses including leadership, mental health awareness, first aid and personal licences
  • Access to Rewards Gateway, offering discounts at 100s of retailers
  • Fulltime
Read More
Arrow Right

Casual Kitchen Assistant

We are looking for flexible and enthusiastic Kitchen Assistants to join our cate...
Location
Location
United Kingdom
Salary
Salary:
12.25 GBP / Hour
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
April 26, 2026
Flip Icon
Requirements
Requirements
  • Good organisational skills and attention to detail
  • Committed to maintaining high standards of cleanliness and food quality
  • Able to work flexibly and adapt to changing demands
  • Team player with a positive, can-do attitude
  • Basic food hygiene knowledge (Level 2 Food Safety desirable)
  • Experience working in a similar professional kitchen environment (desirable)
Job Responsibility
Job Responsibility
  • Assisting with basic food preparation under the guidance of the Head Chef/Sous Chef
  • Supporting with plating and presentation during busy service periods, following instructions and set standards
  • Ensuring all food hygiene and health and safety standards are consistently met
  • Ensuring all kitchen areas, utensils and equipment are cleaned and maintained to a high standard
  • Carrying out pot wash and general cleaning duties as required
  • Supporting the wider catering team with ad hoc tasks to ensure smooth kitchen operations
  • Parttime
Read More
Arrow Right

Nursery Assistant

Join the Kindred Family – A Place to Grow, Thrive, and Make a Difference. Are yo...
Location
Location
United Kingdom , Teddington
Salary
Salary:
25724.00 - 26640.16 GBP / Year
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong written and verbal communication skills
  • Excellent organisational ability and attention to detail
  • Provide outstanding customer service
  • Have good time management, meeting deadlines
  • A commitment to working within Early Years Childcare
Job Responsibility
Job Responsibility
  • Use a friendly approach with parents and carers, children, and colleagues
  • Provide a safe, stimulating, and educational environment for the children to learn, play, explore and develop
  • Maintain a homely environment for all children, which is clean and organised
  • Implement interesting and inspiring activities for children to learn through play
  • Build relationships with Key Children, record their interests and achievements through observations
  • Ensure that you understand and follow company Policies and Procedures
  • Safeguarding is a shared responsibility to protect children, parents, and staff from harm
  • Maintain strictly professional relationships and report any complaints or concerns to management in accordance with company policy and procedures
  • Attend and actively participate in staff meetings and training, parent information sessions and functions as appropriate
  • including marketing events and activities that may run during the evening or at the weekend
What we offer
What we offer
  • Birthday Off
  • 6 fully paid sick days
  • Cashback Healthcare Plan
  • Retail Discounts
  • Recognition & Reward
  • 50 % Childcare Discount
  • 24/7 Virtual GP Access
  • 24/7 Counselling Support
  • Discounted gym Membership
  • Personal Financial Advisor Access
  • Fulltime
Read More
Arrow Right

Lecturer in Digital Computing

Join Colchester Institute – Where Your Career Makes a Difference. At Colchester ...
Location
Location
United Kingdom , Colchester
Salary
Salary:
35228.44 - 43290.00 GBP / Year
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Education to level 5 or above and/or a professional qualification in relevant subject area or equivalent
  • Minimum of Level 2 qualification in English Language and Mathematics GCSE 4+ or C and above or equivalent
  • Level 5 Teaching Qualification / completing within 2 years of employment or 2 years of the first available course
  • Experience of delivering Digital Computing related subjects reflecting recent changes in industry and including the use of modern technology including AI
  • Experience of managing and motivating young learners (Secondary/16-19yr olds)
  • Experience of undertaking a pastoral role and effectively using individual learning planning to raise achievement
Job Responsibility
Job Responsibility
  • Deliver high-quality teaching across a range of Further Education Digital Computing courses
  • Plan and prepare engaging schemes of work, lesson plans, resources, and assessments
  • Support student recruitment, interviews, and guidance
  • Design and carry out effective assessment activities, including setting and marking work
  • Monitor learner progress and maintain high standards in line with awarding body guidelines
  • Set, promote, and review aspirational targets to support strong learner achievement and progression
  • Provide outstanding personal and academic support through tutorials and Individual Learning Plans
  • Ensure efficient course administration and that all programme and unit requirements are met across multiple learner groups
  • Support the Area Head and Assistant Managers in the coordination and development of Digital programmes
What we offer
What we offer
  • £5,000 Golden Hello
  • Fulltime
Read More
Arrow Right

Kitchen Assistant

Join Kindred as a Kitchen Assistant and be part of a friendly, family-like team ...
Location
Location
United Kingdom , Rayleigh
Salary
Salary:
12.71 - 12.75 GBP / Hour
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong written and verbal communication skills
  • Excellent organisational ability and attention to detail
  • Outstanding customer service
  • Level 2 Food Hygiene Certificate (or willingness to complete on induction)
  • Previous experience as a Kitchen Assistant is desirable but not essential
Job Responsibility
Job Responsibility
  • Work with the team to maintain a safe, clean, and tidy kitchen environment
  • Complete daily cleaning checks and record them on the appropriate checklists
  • Step up to cover all aspects of the nursery chef’s role in their absence
  • Keep the kitchen clean and organised in line with Safer Food Better Business and COSHH guidelines
  • Assist the chef to ensure all children’s dietary needs are met
  • Support meal and snack preparation safely according to food policies
  • Maintain allergy and dietary records
  • Assist the chef in safely serving meals to children
  • Cover lunch breaks for practitioners working in the rooms
  • Act as a positive role model and advocate healthy eating for children
What we offer
What we offer
  • Birthday Off
  • 6 Fully Paid Sick Days
  • Cashback Healthcare Plan
  • Retail Discounts
  • Recognition & Reward Scheme
  • 50% Childcare Discount
  • 24/7 Virtual GP Access
  • 24/7 Counselling Support
  • Discounted Gym Membership
  • Personal Financial Advisor Access
  • Parttime
Read More
Arrow Right