CrawlJobs Logo
Sopra Steria Logo Sopra Steria · IT - Software Development

PySpark Module Lead

India, Bengaluru · Job Posted January 31, 2026
Apply Position
Job Link Share

Job Description

PySpark Module Lead position at Sopra Steria, a major Tech player in Europe. The role is within the Engineering, Development, Applications department.

Requirements

  • Good experience in applying best coding practices
  • Good understanding and ability to develop simple to medium applications
  • Strong learnability and analytical skills
  • Strong team player with excellent communication skills
  • Mandatory skills: AWS, PySpark, PL SQL, Java
  • AWS Skills are on S3, Lambda, Cloudwatch, Dynamo DB, SQS, SNS, CloudFormation, Stack, Serverless
  • Total Experience Expected: 04-06 years
  • B.Tech, MCA or equivalent degree

Nice to have

Desirable skills: Pytest, Junit, Maven, Basic understanding of DevOps concepts

What we offer

  • Committed to fighting against all forms of discrimination
  • Fosters a work environment that is inclusive and respectful of all differences
  • All positions are open to people with disabilities
Sopra Steria - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

PySpark Module Lead

8 matching positions

Senior Technical Lead - Data & AI (Oil & Gas)

At Codvo, we are committed to building scalable, future-ready data platforms tha...
Location
Location
India , Pune
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience: 12+ years in technical roles, with at least 4+ years in a technical leadership or principal engineer capacity, managing cross-functional engineering teams
  • Cloud Expertise: Expert-level, hands-on knowledge of Microsoft Azure as a primary platform
  • Data & AI Expertise: Proven mastery of Databricks and Apache Spark (PySpark)
  • Extensive experience designing and building large-scale ETL/ELT data pipelines
  • Strong understanding of AI/ML workflows and data requirements for industrial AI use cases
  • DevOps & IaC Expertise: Deep proficiency with Infrastructure as Code (Terraform, ARM templates)
  • Hands-on mastery of Kubernetes and containerization (Docker)
  • Proven experience building and managing complex CI/CD pipelines (Azure DevOps, Jenkins)
  • Cloud Security: Strong, practical knowledge of cloud network security (VNETs, NSGs, Firewalls) and identity management (Azure Key Vault, IAM)
  • Industry Knowledge: Experience in the Oil & Gas sector or a similar heavy-industry/critical infrastructure environment
Job Responsibility
Job Responsibility
  • Technical Leadership & Mentorship: Lead, mentor, and provide technical direction to a multi-disciplinary team of engineers (Data, DevOps, Security). Foster a culture of high technical standards, collaboration, and continuous improvement
  • Detailed Solution Design: Partner with the Solutions Architect and Project Manager to decompose high-level architecture into detailed technical designs, actionable tasks, and implementation plans for the engineering team
  • Hands-on Development: Act as the lead engineer, personally designing and building the most complex components of the solution, including data pipelines, IaC modules, and CI/CD frameworks
  • Cross-Functional Integration: Drive the seamless integration of diverse systems, including OT data from historians (OSIsoft PI), data platforms (Databricks), cloud infrastructure (Azure), and CI/CD pipelines (Azure DevOps)
  • Technical Governance & Quality: Enforce technical best practices across all domains. Conduct rigorous code reviews, design reviews, and security assessments. Ensure all solutions adhere to security-by-design principles, CI/CD automation standards, and data governance policies
  • Stakeholder Collaboration: Translate complex technical concepts and risks to the Project Manager and business stakeholders. Manage technical dependencies and help the PM with accurate effort estimation and milestone tracking
  • Problem Solving: Serve as the primary escalation point for the team's most complex technical challenges, leading root cause analysis and implementing robust, long-term solutions
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

The Senior Software Engineer will lead a team of data engineers to design, build...
Location
Location
United States , San Diego
Salary
Salary:
Not provided
gomillenniumsoft.com Logo
MillenniumSoft Inc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in developing data solutions
  • Proven experience in designing and implementing large-scale data pipelines
  • Hands-on expertise with AWS cloud technologies and distributed systems
  • Strong programming skills in PySpark, Python, and SQL
  • Data pipeline development using AWS tools (Step Functions, Airflow, etc.)
  • Distributed systems (S3, ADLS), and modern file/table formats (Parquet, Hudi)
  • ETL tools, orchestration technologies, and database design
  • Knowledge of regulatory standards like SOX, PCI, and HIPAA
  • Bachelor’s or Master’s in Computer Science, Information Systems, or related fields
  • AWS certification preferred
Job Responsibility
Job Responsibility
  • Design and implement scalable data pipelines for structured and unstructured data
  • Lead module architecture design for optimal performance, reliability, and maintainability
  • Mentor team members and ensure alignment with business goals
  • Collaborate with cross-functional teams to enable real-time and batch data processing
  • Ensure adherence to data security, privacy, and governance standards
  • Create and maintain technical documentation for architectures and decisions
  • Conduct code reviews and establish best practices
  • Develop monitoring systems for data pipeline reliability
  • Drive adoption of new technologies and workflows
  • Fulltime
Read More
Arrow Right

Purchase & Sales Specialist

We are looking for a detail-oriented Purchase & Sales Specialist to support day-...
Location
Location
United States , Lititz
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Prior experience supporting purchasing, order administration, inventory control, or a related operational function
  • Ability to manage purchase orders accurately and maintain strong attention to detail in a fast-paced environment
  • Experience working within an ERP or similar business system
  • Epicor experience is preferred
  • Strong communication skills for interacting professionally with vendors and internal teams
  • Ability to track multiple purchases at once and follow orders through to final delivery
  • Comfortable stepping into a tactical purchasing role with minimal training and immediate day-to-day contribution
  • Working knowledge of general purchasing functions and department workflows
Job Responsibility
Job Responsibility
  • Maintain accurate inventory records by updating item details, quantities, and purchasing information in the system
  • Coordinate with vendors to issue purchase orders, confirm order details, and address routine follow-up questions
  • Check purchasing documents carefully to ensure order information, pricing, and quantities are correct before submission
  • Monitor open orders from initial placement through delivery to help ensure requested materials arrive on time
  • Provide day-to-day support for purchasing activities by handling tactical order processing and related administrative tasks
  • Use Epicor to enter, review, and manage purchasing transactions with a high level of accuracy
  • Work closely with internal stakeholders to clarify order needs and provide status updates on active purchases
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • 401(k) plan
Read More
Arrow Right

Product Recovery Team Leader

As a Product Recovery Team Leader, working to prevent the occurrence of unnecess...
Location
Location
United States , Stoughton
Salary
Salary:
27.51 - 38.00 USD / Hour
https://www.ikea.com Logo
IKEA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in managing, leading, and developing people preferably in customer-centric service or retail environment
  • Understanding of business processes and working methods within IKEA retailing
  • Knowledge of applicable policies, laws, and regulations
  • Knowledge of business and management principles, budgeting, and resource allocation
Job Responsibility
Job Responsibility
  • Lead, recruit, develop, and schedule a team of recovery co-workers to secure department routines and succession
  • Ensure all recovery processes are completed in a consistent manner
  • Identify business opportunities and implement business plan tactics to improve performance
  • Create a commercial recovery sales floor
  • Monitor the sales floor to secure the highest return while ensuring a timely sell-through of products
  • Implement and continuously ensure optimal use of common working methods relating to recovery process
  • Cooperates across functions and leads interdependently to ensure everyone understands and contributes to the recovery process
  • Works with Imonitor recovery related questions on a consistent basis and champions all necessary changes to ensure compliance
  • Monitor and ensure the proper coding of relevant transfers
  • Contribute to an environment where IKEA culture is a strong and living reality that embraces the diversity of co-workers and customers
What we offer
What we offer
  • Generous paid time off, holiday and sick time
  • WiselyPay – get earned wages up to two days early
  • Paid parental leave (up to 16 weeks)
  • KinderCare tuition discount
  • Retirement and bonus plans
  • Co-worker discount, meal deal, and referral bonus
  • Pet insurance program
  • Education assistance and learning programs
  • Safety shoe reimbursement
  • 24/7 telehealth visits
  • Fulltime
Read More
Arrow Right

Retail Sales Planner- Key Holder

As a Retail Sales Planning keyholder, responsible for optimizing the shopping ex...
Location
Location
United States , Redmond
Salary
Salary:
26.20 - 35.68 USD / Hour
https://www.ikea.com Logo
IKEA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Previous retail selling experience
  • Experience in a consultative sales environment
  • Experience leading change initiatives and building new programs in a retail space environment
  • Experience in designing kitchen and bath preferred
Job Responsibility
Job Responsibility
  • Use your knowledge of interior design to provide guidance on layout, color, style and accessories for residential and business customers who need advice on how to decorate their homes, offices, or businesses
  • Utilize specialized knowledge and training to sell specialized home furnishing solutions, such as kitchens, bath, storage systems, and services
  • Create relationships with customers to identify customer needs and provide support before, during and after the sales
  • Apply basic measurement techniques and understanding of planning, design, and construction to ensure customer orders are correct and to specification
  • Drive repeat visitation to the IKEA stores by ensuring the sales team is customer-centric and is focused on providing a great shopping and branding experience
  • Overseeing day-to-day operations when assigned, including opening and/or closing duties for the store
  • Responsible for a safe and secure work environment, including but not limited to escalated customer issues, customer and co-worker injuries, first aid/CPR/AED, and emergency protocols
  • Partner with Safety & Security to ensure adherence to policies, procedures, and audits regarding inventory integrity, safety, cash, credit, and check handling procedures, internal controls and internal audit standards
  • Ensure implementation of working routines, competence development and follow-up of Commercial Review and Compliance (ASR) related to the role and functions
  • Performs CMP goods flow and customer handout operations efficiently using available systems and tools to ensure smooth processes and data accuracy
What we offer
What we offer
  • Generous paid time off, holiday and sick time
  • WiselyPay – get earned wages up to two days early
  • Paid parental leave (up to 16 weeks)
  • KinderCare tuition discount
  • Retirement and bonus plans
  • Co-worker discount, meal deal, and referral bonus
  • Pet insurance program
  • Education assistance and learning programs
  • Safety shoe reimbursement
  • 24/7 telehealth visits
  • Parttime
Read More
Arrow Right

Retail Sales Associate

You care about making a positive impact in the world. You understand greatness r...
Location
Location
United States , Renton
Salary
Salary:
22.00 - 28.65 USD / Hour
https://www.ikea.com Logo
IKEA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 1 year experience in retail sales, preferably in the home furnishing sector.
Job Responsibility
Job Responsibility
  • Assisting customers and providing advice on the best solutions for their homes
  • Keeping your sales floor tidy, priced and fully stocked to give customers a positive shopping experience
  • Acting as an expert and consultant on a broad range of home furnishing solutions, products and services to inspire and inform customers
  • Guiding customers toward top-selling and prioritized products
  • Assembling display products for the introduction of new products.
What we offer
What we offer
  • Generous paid time off, holiday and sick time
  • WiselyPay – get earned wages up to two days early
  • Paid parental leave (up to 16 weeks)
  • KinderCare tuition discount
  • Retirement and bonus plans
  • Co-worker discount, meal deal, and referral bonus
  • Pet insurance program
  • Education assistance and learning programs
  • Safety shoe reimbursement
  • 24/7 telehealth visits
  • Parttime
Read More
Arrow Right

Senior Assistant Manager, Sales - ITT

As a member of Baxter’s sales team, you’ll be aligned to one of our global busin...
Location
Location
India , Gurgaon
Salary
Salary:
Not provided
https://www.baxter.com/ Logo
Baxter
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Stakeholder insight and influence
  • Sales solution identification and development
  • Negotiation skills
  • Strategic planning
  • Managing and coaching
  • Ownership of the business
Job Responsibility
Job Responsibility
  • Driving secondary sales through product promotion in defined territory by meeting HCPs and paramedical staff
  • Coordinating with commercial/purchase authorities and channel partners for ensuring supply and liquidation of products
  • Driving awareness and adoption through activations in territory/accounts
  • Monthly account wise planning and execution of secondary sales leading to primary sales
  • Weekly planning for coverage and calls
  • Monthly/quarterly sales forecast for defined territory
  • Driving adherence to SFE processes: call average, customer coverage, working days, prescription tracker, secondary sales and product sampling/demonstrations
  • Tracking all product and service quality related complaints and coordinating with National/Sales Manager/quality to ensure formal response and closure
  • Driving demand/prescription generation of the product
  • Ensuring liquidation of products from stockists and distributors through regular monitoring and coordination with product users
What we offer
What we offer
  • Support for parents
  • Continuing education/professional development
  • Employee health and well-being benefits
  • Paid time off
  • 2 days a year to volunteer
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

We are seeking an exceptional Data Scientist to join our dynamic Data Science te...
Location
Location
India , Gurgaon
Salary
Salary:
Not provided
https://www.baxter.com/ Logo
Baxter
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 8+ years of progressive experience in AI/Data Science
  • At least 5+ years of hands-on experience in building AI/ML models for Financial domain
  • Proven track record of design and delivering production-grade AI/ML projects in enterprise environments for finance
  • Experience working with large-scale financial transactional datasets and ERP systems (SAP, Oracle, Workday etc)
  • Demonstrated success in cross-functional collaboration with Finance, IT, and Business teams
  • Hands-on experience in designing and deploying forecasting (Statistical and ML based) applied to financial metrics
  • Proven experience in designing and deploying production-ready solutions powered by Large Language Models (LLMs)
  • Experience in enterprise grade implementation of cutting edge Agentic AI solution
  • Programming Languages: Python (NumPy, Pandas, Scikit-learn), SQL (advanced proficiency required)
  • Machine Learning: Regression, Classification, Forecasting, Clustering, Ensemble Methods
Job Responsibility
Job Responsibility
  • Design, develop, and deploy advanced machine learning models to forecast key business KPIs including expense allocation and cash flow management
  • Build automated business process optimization model and reporting systems using AI
  • Design variance analysis frameworks to identify key drivers of financial performance
  • Conduct scenario analysis and sensitivity modelling for strategic initiatives
  • Present findings and recommendations to senior leadership and stakeholders
  • Establish data quality standards and governance frameworks for financial analytics
  • Drive innovation by evaluating and implementing emerging AI/data science technologies
What we offer
What we offer
  • Paid Time Off
  • Employee Heath & Well-Being Benefits
  • Continuing Education/ Professional Development
  • Support for Parents
  • Employee Assistance Program
  • Competitive salary package commensurate with experience and market standards
  • Comprehensive health insurance coverage for self and dependents
  • Clear career progression path with regular performance reviews
  • Mentorship from senior leaders and exposure to global projects
  • Collaborative and inclusive culture that values innovation and diversity
  • Fulltime
Read More
Arrow Right