CrawlJobs Logo

Pyspark Module Lead

https://www.soprasteria.com Logo

Sopra Steria

Location Icon

Location:
India , Bengaluru

Category Icon

Job Type Icon

Contract Type:
Employment contract

Salary Icon

Salary:

Not provided

Job Description:

Sopra Steria is seeking a PySpark Module Lead based in Bengaluru, India. The position involves designing and building data solutions for Airbus, leveraging the Skywise platform and tools, and working along Product Owners and business functions. The role requires a strong understanding of Python, PySpark, SQL, and JavaScript, and proficiency with Skywise tools such as Contour, Code-Workbook, and Ontology.

Job Responsibility:

  • Designing and building solutions for Airbus on foundry
  • Data engineering and integration
  • Data analysis and visualization
  • Application development within Skywise Framework
  • Working closely with Product Owners and core Airbus business functions to understand processes, capture requirements, and solve business problems
  • Full delivery lifecycle for designing, implementing, testing, documenting, and supporting applications
  • CI/CD pipeline development and automated deployments
  • Troubleshooting application issues
  • Providing support on developed tools

Requirements:

  • Python
  • PySpark
  • SQL
  • JavaScript
  • Proficient with Skywise platform and tools e.g. Contour, Code-Workbook, Code, Slate and Ontology

Nice to have:

  • Knowledge of airline and MRO operations
  • AWS Cloud Services like EC2, RDS and Redshift
  • Agile/Scrum
  • SAFe
  • Palantir tools like Slate, Workshop
What we offer:
  • Inclusive and respectful work environment
  • Open to people with disabilities

Additional Information:

Job Posted:
May 05, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Pyspark Module Lead

Pyspark Module Lead

We are seeking a highly skilled and motivated Data Engineer to join our dynamic ...
Location
Location
India , Noida
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Advanced SQL (Window functions), Spark Architecture, Pyspark or Scala with Spark, Hadoop
  • Proven expertise in designing and deploying data pipelines
  • Strong problem-solving skills and ability to work effectively in a collaborative team environment
  • Excellent communication skills and ability to translate technical concepts to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Work in tandem with Data Scientists to design, develop, and implement machine learning pipelines
  • Utilize PySpark for data processing, transformation, and preparation for model training
  • Leverage AWS EMR and S3 for scalable and efficient data storage and processing
  • Implement and manage ETL workflows using Streamsets for data ingestion and transformation
  • Design and construct pipelines to deliver high-quality training and inference datasets
  • Collaborate with cross-functional teams to ensure smooth deployment and real-time/near real-time inferencing capabilities
  • Optimize and fine-tune pipelines for performance, scalability, and reliability
  • Ensure IAM policies and permissions are appropriately configured for secure data access and management
  • Implement Spark architecture and optimize Spark jobs for scalable data processing
What we offer
What we offer
  • All positions are open to people with disabilities
  • Commitment to fighting against all forms of discrimination
  • Inclusive and respectful work environment
Read More
Arrow Right
New

It specialist - sap material flow systems

As a successful family-owned company on the road to global growth, the Brose Gro...
Location
Location
Czechia , Ostrava
Salary
Salary:
Not provided
brose.com Logo
Brose Fahrzeugteile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Completed studies preferably in the field of business informatics, industrial engineering or comparable training with corresponding professional experience
  • Several years of professional experience in the SAP environment, in the automotive sector
  • In-depth knowledge of at least one of the following SAP modules (MM-IM, LE-WM, EWM) including customizing, ABAP debugging
  • Process knowledge in the areas of goods receiving, inventory management, warehouse management, production supply and internal transport.
  • Practical experience in international project work
  • Fluent English Language Proficiency
  • Willingness to travel international
  • Ability to work in a team as well as flexibility and independence
Job Responsibility
Job Responsibility
  • Advising logistics departments in the areas of information flow, digitalization and automation
  • Integration of new solutions and technologies (such as cloud applications) into existing architectures
  • Development of concepts for innovative material flow processes in IT systems (e.g. automatic warehouses, AGV systems, ...)
  • Preparation and conversion of Brose Logistic to the SAP S/4HANA platform
  • Implementation and continuous optimization of standardized solutions through customizing including specification, testing and release of in-house developments
  • Management of agile, international projects with worldwide on-site assignments
  • Execution of 1st, 2nd and 3rd level support and key user training
  • Administration and worldwide operation of productive IT applications and processes
What we offer
What we offer
  • Meal allowance of CZK 2,000/month, discounts in OC Nová Karolina restaurants
  • Contribution to life and pension insurance
  • Transport allowance
  • Electronic benefits - Benefit Plus
  • Reward before holidays and Christmas, or a share of the company's profit
  • Parking in underground garages
  • Modern and newly equipped offices
  • Flexible working hours (core time between 9.00 - 14.00h) of 7.5h/day
  • Good transport accessibility by tram, bus, train, bicycle and scooter thanks to the location in the centre of Ostrava
  • Language training and other courses
  • Fulltime
Read More
Arrow Right
New

Personal Assistant

Our education client has an an exciting opportunity for a PA/Administrative Assi...
Location
Location
United Kingdom , Cardiff
Salary
Salary:
13.27 GBP / Hour
brookstreet.co.uk Logo
Brook-St Hiredonline
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a PA or in a similar role within a complex organisation
  • Highly IT literate, confident in using MS Office and Outlook
  • Experienced in setting up and improving administrative systems
  • Discretion and the ability to handle sensitive information
  • Excellent written and verbal communication skills
  • Ability to build positive working relationships
  • Strong organisational and problem-solving skills
  • Attention to detail
  • Ability to prioritise a busy workload
  • Proactive, adaptable, and committed to delivering excellent customer service
Job Responsibility
Job Responsibility
  • Deliver high-quality, confidential PA and executive support
  • Ensure the smooth running of the office and its priorities
  • Take ownership of a wide range of administrative tasks
  • Help to meet operational needs and deliver excellent service to colleagues and external partners
  • Manage diaries
  • Handle correspondence
  • Organise meetings, events, and travel
  • Maintain efficient systems
  • Build strong professional relationships
  • Support committees
What we offer
What we offer
  • Guaranteed interview for veterans or spouses/partners of military personnel who meet essential criteria
  • Guaranteed interview with a PSR Sourcer for candidates with a disability and/or as a veteran or spouse/partner of military personnel who meet essential criteria
  • Fulltime
Read More
Arrow Right
New

Head of Testing Department

As a successful family-owned company on a path to global growth, the Brose Group...
Location
Location
Slovakia , Prievidza
Salary
Salary:
2500.00 EUR / Month
brose.com Logo
Brose Fahrzeugteile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience and proficient skills in validation/testing and prototyping environment
  • Proven experience in managing people
  • Experience in the automotive industry would be an advantage
  • Ability to demonstrate excellent communication and decision-making skills
  • Independent, assertive working style and an ability to cope with pressure - stress resistance
  • Team management skills
  • Intercultural competency and a willingness to support and motivate the team
  • Business fluency in English
Job Responsibility
Job Responsibility
  • Disciplinary and job-related leadership of all employees within the test and prototype team
  • Independent planning and control of costs and timeframes for all test and prototype activities
  • Ensuring to observe the standard test and prototype procedures and usage of equipment
  • Responsibilty for Calculation of test and prototype-related costs and plan data for the elaboration of the offers to customer
  • Assessment and interpretation of tests results, issue of test reports and, as a result, of test releases for the system including presentation to customers
  • Develoment of the Validaiton Team with an international focus
What we offer
What we offer
  • Summer and winter bonus up to 700 EUR
  • Bonus 500 € - working anniversary after 5 years in Brose
  • Relocation contribution according to internal regulations
  • Bring a friend contribution
  • Financial reward for improvement proposals
  • Annual reward for reaching goals
  • Transport allowance (up to maximum of 80 €/month depending on distance between place of residence and workplace)
  • Child birth allowance in the amount of 150 € after working for 2 years
  • Contribution to supplementary pension saving - III. pillar
  • Full flexible working time - healthy work-life balance
  • Fulltime
Read More
Arrow Right
New

Business Support Coordinator

Our supportive and values-driven national public sector client are seeking a Bus...
Location
Location
United Kingdom , Cardiff
Salary
Salary:
16.42 GBP / Hour
brookstreet.co.uk Logo
Brook-St Hiredonline
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Knowledge of the public sector and an understanding of Welsh Government's role in supporting national improvement work
  • Experience in providing administrative support at meetings, including taking minutes
  • Strong organisational and time management skills, with the ability to manage priorities and meet deadlines
  • Developed IT skills, including proficiency in Microsoft Office, Zoom, and Teams
  • Excellent written and verbal communication skills
  • Attention to detail and accuracy in all work
  • Proven ability to work both independently and collaboratively as part of a team
  • Strong emotional intelligence, discretion, and ability to maintain confidentiality
  • Proactive and innovative problem solver with a flexible and positive approach
  • Ability to build and maintain effective relationships with a wide range of stakeholders, including senior staff
Job Responsibility
Job Responsibility
  • Provide efficient and effective project support across a range of improvement and development projects, groups, and partnerships
  • Coordinate internal and external meetings - including scheduling, preparing agendas and papers, taking minutes, and ensuring follow-up actions
  • Collate and analyse data to inform recommendations and future work priorities
  • Maintain clear administrative systems, procedures, and databases in line with organisational policies
  • Support project planning, implementation, and monitoring to ensure agreed outcomes are achieved
  • Assist in creating and coordinating resources - proofreading, branding, translation, and dissemination
  • Advise on best practice in relation to GDPR, Welsh language standards, and virtual meeting platforms (Zoom, Teams)
  • Organise and support events, representing the organisation and facilitating workshops as required
  • Maintain up-to-date project content on internal systems and websites
  • Provide high-quality administrative and project support in both Welsh and English
What we offer
What we offer
  • Guaranteed interview for veterans or spouses/partners of military personnel who meet all the essential criteria
  • Guaranteed interview with a PSR Sourcer for candidates with a disability and/or as a veteran or spouse/partner of military personnel who meet all the essential criteria
Read More
Arrow Right
New

Data Center Technician

Location
Location
United States , New Carlisle
Salary
Salary:
20.00 - 23.00 USD / Hour
Collabera
Expiration Date
January 25, 2026
Flip Icon
Requirements
Requirements
  • Basic Networking knowledge
  • Basic Cabling (Fiber Optic) Knowledge
  • Basic hardware and IT system understanding
  • Understand setting up servers (rack installation, wiring computers, cable installation)
  • Understand TCP/IP networks
  • Can lift and rack equipment up to 40 pounds
  • Reliable transportation
  • Bachelor’s degree in a related type field
What we offer
What we offer
  • medical insurance
  • dental insurance
  • vision insurance
  • 401(k) retirement plan
  • life insurance
  • long-term disability insurance
  • short-term disability insurance
  • paid parking/public transportation
  • paid time
  • paid sick and safe time
Read More
Arrow Right
New

Head of Test Validation

Change perspective. Shape the future. Brose invests in new technologies and busi...
Location
Location
Mexico , Aeropuerto
Salary
Salary:
Not provided
brose.com Logo
Brose Fahrzeugteile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in the same position or similar (with leadership)
  • 5 years of experience in simulation, validation testing, continuous conformance
  • Knowledge in prototype construction
  • Fluent English (required)
  • Experience with German OEMS
  • Personnel management & leadership
Job Responsibility
Job Responsibility
  • Plan the test/prototype activities, supporting the business plan, including capacity planning, investments and budget
  • Engage in customer and supplier visits as appropriate
  • Maintain good open communication channels with direct supervisor, peers and direct interface at headquarters
  • Ensure quality, effectiveness, cleanliness, and keep your responsible area in order
  • Develop business methods to improve interaction with other departments
  • Manage the prototype deliveries regarding to cost and Quality goals
What we offer
What we offer
  • modern working environment with our Brose working world
  • Fulltime
Read More
Arrow Right
New

Maintenance Co-ordinator

Join a dynamic and customer-focused property management team that takes pride in...
Location
Location
United Kingdom , Cardiff
Salary
Salary:
26000.00 GBP / Year
brookstreet.co.uk Logo
Brook-St Hiredonline
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Highly organised
  • Approachable
  • Confident in managing multiple tasks
  • Strong communication
  • Problem-solving
  • Attention to detail
  • Prior experience in property management, maintenance coordination, or facilities administration is desirable
  • Strong customer service skills
  • Ability to building good relationships
Job Responsibility
Job Responsibility
  • Act as the first point of contact for maintenance queries from tenants
  • Communicate with landlords regarding repairs, approvals, and property updates
  • Coordinate internal staff and external contractors, including emergency call-outs
  • Monitor job progress, ensuring quality completion and timely delivery
  • Maintain full compliance with all property safety regulations and certification requirements
  • Handle maintenance complaints professionally and effectively
  • Keep detailed records of works, contractor hours, costs, and materials
  • Support lettings and accounts teams with administrative tasks as needed
  • Assist with property inspections, move-ins/outs, and general lettings support
  • Help manage lettings enquiries, arrange viewings, and ensure a smooth process for prospective tenants
  • Fulltime
Read More
Arrow Right
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.