Apache Spark Senior Technical Lead Job at Sopra Steria (Chennai)

Java / Spark Senior Lead Developer

The Applications Development Technology Lead Analyst is a senior level position ...

Location

India , Pune/Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

10+ years of relevant experience in Apps Development or systems analysis role
Extensive experience system analysis and in programming of software applications
Experience in managing and implementing successful projects
Subject Matter Expert (SME) in at least one area of Applications Development
Ability to adjust priorities quickly as circumstances dictate
Demonstrated leadership and project management skills
Consistently demonstrates clear and concise written and verbal communication
Highly experienced and skilled Java technical lead with 10+years of experience with software building and platform engineering
Extensive development expertise in building the high scaled and performant software platforms for data computation and processing
Expert level knowledge of core Java concepts and framework such as Spring Boot, Microservices and well versed with OOPs concepts and design patterns

Job Responsibility

Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

What we offer

Global Benefits
We bring the best to our people. We put our employees first and provide the best-in-class benefits they need to be well, live well and save well.

Fulltime

Tech Lead - Ab Initio / Spark ETL

The Applications Development Senior Programmer Analyst is an intermediate level ...

Location

India , Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

BS or MS Degree in Computer Science, Information Technology, or equivalent
Minimum 10 years of Ab Initio application design and development experience
Minimum 6 years of experience in leading globally distributed teams successfully
Demonstrated people and technical management skills
Strong understanding of ETL analysis and design, frameworks on Ab Initio
Experience in developing and managing big data solutions using Apache Spark
Strong programming skills in Scala, Java, or Python
Hands on experience on Technologies like Apache Hive, Apache Kafka, HBase, Couchbase, Sqoop, Flume etc.
Demonstrated excellent software development skills
Experience in building enterprise ETL based system with focus on recovery, stability, reliability, scalability and performance

Job Responsibility

Responsible for providing technical leadership of multiple large scale/complex global software solutions
Experience of developing teams of permanent employees and vendors from 5 – 20 developers in size
Build and sustain strong relationships with the senior business leaders associated with the platform
Design, code, test, document and implement application release projects as part of development team
Work with onsite development partners to ensure design and coding best practices
Work closely with Program Management and Quality Control teams to deliver quality software to agreed project schedules
Proactively notify Development Project Manager of risks, bottlenecks, problems, issues, and concerns
Compliance with Citi's System Development Lifecycle and Information Security requirements
Oversee development scope, budgets, time line documents
Monitor, update and communicate project timelines and milestones

Fulltime

Senior Data Engineer

Inetum Polska is part of the global Inetum Group and plays a key role in driving...

Location

Poland , Warsaw

Salary:

Not provided

Inetum

Expiration Date

Until further notice

Requirements

Expert-level proficiency in Databricks, Apache Spark, SQL, and Python/Scala
Extensive experience with cloud data platforms (AWS, Azure, or GCP) and big data technologies
Strong understanding of data architecture, data warehousing, and lakehouse concepts
Experience with real-time data processing and streaming technologies (Kafka, Delta Live Tables, Event Hubs)
Proficiency in automation, CI/CD, and Infrastructure as Code (Terraform, Bicep)
Leadership skills with the ability to drive strategic technical decisions
6+ years of experience in data engineering, with a track record of designing and implementing complex data solutions

Job Responsibility

Architect and implement enterprise-grade data solutions using Databricks, Apache Spark, and cloud services
Lead data engineering initiatives, setting best practices and guiding technical decisions
Design, optimize, and scale data pipelines for performance, reliability, and cost efficiency
Define data governance policies and implement security best practices
Evaluate emerging technologies and recommend improvements to existing data infrastructure
Mentor junior and mid-level engineers, fostering a culture of continuous learning
Collaborate with cross-functional teams to align data strategy with business objectives

What we offer

Flexible working hours
Hybrid work model
Cafeteria system
Generous referral bonuses
Additional revenue sharing opportunities
Ongoing guidance from a dedicated Team Manager
Tailored technical mentoring
Dedicated team-building budget
Opportunities to participate in charitable initiatives and local sports programs
Supportive and inclusive work culture

Fulltime

Tech Lead – Scala/Spark

We are seeking a Spark, Big Data - ETL Tech Lead for Commercial Card’s Global Da...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Bachelor’s or master’s degree in computer science, Information Technology, or equivalent
Minimum 10 years of Proven experience in developing and managing big data solutions using Apache Spark. Having strong hold on Spark-core, Spark-SQL & Spark Streaming
Minimum 6 years of experience in leading globally distributed teams successfully
Strong programming skills in Scala, Java, or Python
Hands on experience on Technologies like Apache Hive, Apache Kafka, HBase, Couchbase, Sqoop, Flume etc.
Proficiency in SQL and experience with relational (Oracle/PL-SQL) and NoSQL databases like mongoDB
Demonstrated people and technical management skills
Demonstrated excellent software development skills. Strong experiences in implementation of complex file transformations like positional, xmls
Experience in building enterprise system with focus on recovery, stability, reliability, scalability and performance
Experience in working on Kafka, JMS / MQ applications

Job Responsibility

Lead the design and implementation of large-scale data processing pipelines using Apache Spark on BigData Hadoop Platform
Develop and optimize Spark applications for performance and scalability
Responsible for providing technical leadership of multiple large scale/complex global software solutions
Integrate data from various sources, including Couchbase, Snowflake, and HBase, ensuring data quality and consistency
Experience of developing teams of permanent employees and vendors from 5 – 15 developers in size
Build and sustain strong relationships with the senior business leaders associated with the platform
Design, code, test, document and implement application release projects as part of development team
Work with onsite development partners to ensure design and coding best practices
Work closely with Program Management and Quality Control teams to deliver quality software to agreed project schedules
Proactively notify Development Project Manager of risks, bottlenecks, problems, issues, and concerns

Fulltime

Senior Analytics Engineer, Corporate Strategy

Join us in building the future of finance. Our mission is to democratize finance...

Location

United States , Menlo Park

Salary:

179000.00 - 210000.00 USD / Year

Robinhood

Expiration Date

Until further notice

Requirements

5+ years of experience in Analytics Engineering, Data Engineering, Data Science, or similar field
Strong expertise in advanced SQL, Python scripting, and Apache Spark (PySpark, Spark SQL) for data processing and transformation
Proficiency in building, maintaining, and optimizing ETL pipelines, using modern tools like Airflow or similar
Experience in building polished and performant dashboards using tools like Superset, Looker, Tableau
Strong familiarity with version control (GitHub), CI/CD, and modern development workflows
A strong business acumen around business strategy and competitive landscape
Ability to work in a fast-paced, and highly multi-functional environment

Job Responsibility

Partner cross-functionally with product, engineering, and business teams to scope and deliver high-impact analytics initiatives, from metric definitions to fully automated reporting solutions
Design and maintain reliable, scalable pipelines and data models using modern data tools (e.g., Airflow, Spark), ensuring performance and accuracy at scale
Lead end-to-end development of analytics products—from ingestion to visualization—that meet critically important business, product, and regulatory needs
Build internal frameworks and tooling to make high-quality data more accessible and actionable across the organization
Support competitive benchmarking efforts, providing technical expertise for competitive intelligence and contextualizing Robinhood’s performance relative to peers
Advocate for customers by helping establish best practices in how we measure, interpret, and act on customer feedback

What we offer

Performance driven compensation with multipliers for outsized impact, bonus programs, equity ownership, and 401(k) matching
100% paid health insurance for employees with 90% coverage for dependents
Lifestyle wallet - a highly flexible benefits spending account for wellness, learning, and more
Employer-paid life & disability insurance, fertility benefits, and mental health benefits
Time off to recharge including company holidays, paid time off, sick time, parental leave, and more
Exceptional office experience with catered meals, events, and comfortable workspaces

Fulltime

Senior Principal Data Platform Software Engineer

We’re looking for a Sr Principal Data Platform Software Engineer (P70) to be a k...

Location

Salary:

239400.00 - 312550.00 USD / Year

Atlassian

Expiration Date

Until further notice

Requirements

15+ years in Data Engineering, Software Engineering, or related roles, with substantial exposure to big data ecosystems
Demonstrated experience building and operating data platforms or large‑scale data services in production
Proven track record of building services from the ground up (requirements → design → implementation → deployment → ongoing ownership)
Hands‑on experience with AWS, GCP (e.g., compute, storage, data, and streaming services) and cloud‑native architectures
Practical experience with big data technologies, such as Databricks, Apache Spark, AWS EMR, Apache Flink, or StarRocks
Strong programming skills in one or more of: Kotlin, Scala, Java, Python
Experience leading cross‑team technical initiatives and influencing senior stakeholders
Experience mentoring Staff/Principal engineers and lifting the technical bar for a team or org
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience

Job Responsibility

Design, develop and own delivery of high quality big data and analytical platform solutions aiming to solve Atlassian’s needs to support millions of users with optimal cost, minimal latency and maximum reliability
Improve and operate large‑scale distributed data systems in the cloud (primarily AWS, with increasing integration with GCP and Kubernetes‑based microservices)
Drive the evolution of our high-performance analytical databases and its integrations with products, cloud infrastructures (AWS and GCP) and isolated cloud environments
Help define and uplift engineering and operational standards for petabyte scale data platforms, with sub‑second analytic queries and multi‑region availability (coding guidelines, code review practices, observability, incident response, SLIs/SLOs)
Partner across multiple product and platform teams (including Analytics, Marketplace/Ecosystem, Core Data Platform, ML Platform, Search, and Oasis/FedRAMP) to deliver company‑wide initiatives that depend on reliable, high‑quality data
Act as a technical mentor and multiplier, raising the bar on design quality, code quality, and operational excellence across the broader team
Design and implement self‑healing, resilient data platforms with strong observability, fault tolerance, and recovery characteristics
Own the long‑term architecture and technical direction of Atlassian’s product data platform with projects that are directly tied to Atlassian’s company-level OKRs
Be accountable for the reliability, cost efficiency, and strategic direction of Atlassian’s product analytical data platform
Partner with executives and influence senior leaders to align engineering efforts with Atlassian’s long-term business objectives

What we offer

health and wellbeing resources
paid volunteer days

Fulltime

Senior Principal Data Engineer

Atlassian is looking for a Senior Principal Data Engineer to join the Go-To Mark...

Location

United States , San Francisco

Salary:

Not provided

Atlassian

Expiration Date

Until further notice

Requirements

18+ years of experience in a Data Engineer role as an individual contributor
at least 7 years of experience as a tech lead for Data Engineering teams, and delivered complex, cross-team initiatives
built durable relationships with executives/senior leaders across Sales, Marketing, Finance, Commerce and related organizations, and understand complexities of data in these organizations
a track record of driving and delivering large complex, multi-team efforts
a great communicator and maintain many of the essential cross-team and cross-functional relationships necessary for the team's success
experience with building streaming pipelines with a micro-services architecture for low-latency analytics
experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, dbt, and column stores (e.g. Redshift)
experience building scalable data pipelines using Spark using Airflow scheduler/executor framework or similar scheduling tools
experience working in a technical environment with the latest technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, or Kafka)
understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team

Job Responsibility

Help stakeholder teams ingest data faster into our data lake
find ways to make data pipelines more efficient
come up with ideas to help instigate self-serve data engineering within the company
building micro-services, architecting, designing, and enabling self-serve capabilities at scale to help Atlassian grow

What we offer

health coverage
paid volunteer days
wellness resources

Fulltime

Big Data Scala Engineer

We are seeking an experienced and highly skilled Vice President, Big Data Scala ...

Location

India , Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Bachelor's or Master's degree in Computer Science, Engineering, or a related field
12+ years of progressive experience in software development, with at least 5+ years focusing on big data technologies
3+ years of experience in a leadership or senior architectural role
Extensive hands-on experience with Scala for big data processing
Demonstrated expertise with Apache Spark (Spark Core, Spark SQL, Spark Streaming)
Strong experience with distributed systems and big data ecosystems (e.g., Hadoop, Kafka, Cassandra, HBase, Delta Lake, Snowflake, Databricks)
Proficiency with cloud platforms (AWS, Azure, GCP) and their big data services (e.g., EMR, Redshift, Glue, DataProc, BigQuery)
Experience with containerization technologies (Docker, Kubernetes) and CI/CD pipelines
Solid understanding of data warehousing concepts, ETL/ELT processes, and data modeling
Familiarity with functional programming paradigms in Scala

Job Responsibility

Lead the architecture, design, and development of high-performance, scalable, and reliable big data processing systems using Scala and Apache Spark
Drive technical vision and strategy for big data initiatives
Evaluate and recommend new technologies and tools
Design, develop, and optimize data pipelines for ingestion, transformation, and storage of massive datasets
Implement robust and efficient data processing jobs using Scala and Spark (batch and streaming)
Ensure data quality, integrity, and security
Promote and enforce best practices in coding, testing, and deployment
Mentor and guide a team of talented big data engineers
Conduct code reviews, provide constructive feedback
Participate in the recruitment and hiring of top engineering talent

What we offer

Opportunity to work on cutting-edge big data technologies and impactful projects
A collaborative and innovative work environment
Competitive compensation and benefits package
Opportunities for professional growth and career advancement

Fulltime

Apache Spark Senior Technical Lead

Sopra Steria

Location:
India , Chennai

Category:
IT - Software Development

Contract Type:
Employment contract

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
August 14, 2025

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Apache Spark Senior Technical Lead

Java / Spark Senior Lead Developer

Tech Lead - Ab Initio / Spark ETL

Senior Data Engineer

Tech Lead – Scala/Spark

Senior Analytics Engineer, Corporate Strategy

Senior Principal Data Platform Software Engineer

Senior Principal Data Engineer

Big Data Scala Engineer

Apache Spark Senior Technical Lead

Sopra Steria

Location:India , Chennai

Category:IT - Software Development

Contract Type:Employment contract

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:August 14, 2025

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Apache Spark Senior Technical Lead

Java / Spark Senior Lead Developer

Tech Lead - Ab Initio / Spark ETL

Senior Data Engineer

Tech Lead – Scala/Spark

Senior Analytics Engineer, Corporate Strategy

Senior Principal Data Platform Software Engineer

Senior Principal Data Engineer

Big Data Scala Engineer

Location:
India , Chennai

Category:
IT - Software Development

Contract Type:
Employment contract

Job Posted:
August 14, 2025