CrawlJobs Logo
Arcesium Logo Arcesium · IT - Software Development

Senior Software Engineer - Data Engineering

India, Hyderabad · Job Posted February 13, 2026
Apply Position
Job Link Share

Job Description

We are looking for a bright and exceptional Data Engineer to join our Technology team. In this role, you will be part of our Data Engineering team, working with product managers and subject matter experts to design, build, and optimize scalable data pipelines for our Data Platform. The ideal candidate has strong hands-on experience in distributed data processing and operational skills to drive efficiency and speed.

Job Responsibility

  • Build and support connectors and data pipelines for data ingestion and processing on the in-house data platform to meet business requirements
  • Demonstrate strong SQL skills to write complex transformations
  • Demonstrate deep knowledge in Python and PySpark to code ETL blocks for the data pipelines
  • Troubleshoot and optimize ETL pipelines to minimize execution overheads
  • Drive improvements in performance, reliability, and scalability of data pipelines
  • Mentor other team members

Requirements

  • Bachelor's degree in computer science, math, or other technical fields
  • 2-4 years of relevant experience
  • Experience building pipelines and ingesting data from APIs, SFTP, Databases, etc.
  • Strong proficiency in Python and PySpark for data engineering tasks
  • Ability to write complex queries for data transformations and analysis
  • Basic understanding of data modeling and data warehousing
  • Solid understanding of CI/CD, version control, and DevOps practices
  • Excellent problem-solving and troubleshooting skills
  • Proven track record for working in an agile and collaborative environment

Nice to have

  • Fintech domain experience is a plus
  • Experience with the AWS stack, especially with AWS Glue, Athena, and AWS Lambda, is a plus
  • Familiarity with Airflow, ADF, Glue Workflow, etc.
  • Demonstrated contribution to end-to-end delivery of enterprise-grade software
Arcesium - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Software Engineer - Data Engineering

8 matching positions

Software Engineer / Senior Software Engineer - Data Engineering GitHub

As a Software Engineer at GitHub, you will enhance the collaboration experience ...
Location
Location
Czech Republic , Multiple Locations
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND experience in Data Engineering and coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python OR equivalent experience.
  • Master's Degree in Computer Science or related technical field AND engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust or Python OR Bachelor's Degree in Computer Science or related technical field AND engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust or Python OR equivalent experience.
Job Responsibility
Job Responsibility
  • Design, develop, test and ship high-quality technical solutions that scale across multiple GitHub services.
  • Collaborate with cross-functional teams to define and implement innovative solutions.
  • Provide technical leadership, mentorship, pairing opportunities, and code reviews to encourage the growth of others.
  • Own and advocate for the health and quality of the systems that the team builds, including participating in on-call and first responder rotations
  • Write architecture briefs and proposals, carry out code experiments, and build prototypes to learn how we can achieve planetary scale with our systems.
  • Design and implement APIs to facilitate seamless integration between software components.
  • Utilize CI/CD tools to set up automated pipelines for continuous integration and delivery.
  • Become intimately familiar with the systems you build and take pride in writing maintainable code.
  • Fulltime
Read More
Arrow Right

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
  • Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
  • Experience building data lake or data engineering products, tools, or pipelines
  • Familiarity with container-based architectures (Docker, Kubernetes)
  • Ability to debug complex distributed systems on Linux and/or Windows platforms
Job Responsibility
Job Responsibility
  • Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
  • Use AI tools and coding best practices across the development lifecycle
  • Design data refresh, scheduling, and query optimisation features with minimal supervision
  • Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
  • Coach junior engineers through code reviews
  • Debug complex issues in distributed systems running on Azure, Linux, and Windows
  • Run live site operations on a rotational, on-call basis
  • Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
  • Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data Engineering

Join us in building the future of finance. Our mission is to democratize finance...
Location
Location
United States , Menlo Park
Salary
Salary:
196000.00 - 230000.00 USD / Year
robinhood.com Logo
Robinhood
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional experience building end-to-end data pipelines
  • Hands-on software engineering experience, with the ability to write production-level code in Python for user-facing applications, services, or systems (not just data scripting or automation)
  • Expert at building and maintaining large-scale data pipelines using open source frameworks (Spark, Flink, etc)
  • Strong SQL (Presto, Spark SQL, etc) skills
  • Experience solving problems across the data stack (Data Infrastructure, Analytics and Visualization platforms)
  • Expert collaborator with the ability to democratize data through actionable insights and solutions
Job Responsibility
Job Responsibility
  • Help define and build key datasets across all Robinhood product areas. Lead the evolution of these datasets as use cases grow
  • Build scalable data pipelines using Python, Spark and Airflow to move data from different applications into our data lake
  • Partner with upstream engineering teams to enhance data generation patterns
  • Partner with data consumers across Robinhood to understand consumption patterns and design intuitive data models
  • Ideate and contribute to shared data engineering tooling and standards
  • Define and promote data engineering best practices across the company
What we offer
What we offer
  • Market competitive and pay equity-focused compensation structure
  • 100% paid health insurance for employees with 90% coverage for dependents
  • Annual lifestyle wallet for personal wellness, learning and development, and more
  • Lifetime maximum benefit for family forming and fertility benefits
  • Dedicated mental health support for employees and eligible dependents
  • Generous time away including company holidays, paid time off, sick time, parental leave, and more
  • Lively office environment with catered meals, fully stocked kitchens, and geo-specific commuter benefits
  • Fulltime
Read More
Arrow Right

Senior Software Engineer- Data Engineering

At Cloudera, our Data Services Pillar is the heart of data innovation. We don’t ...
Location
Location
Hungary
Salary
Salary:
Not provided
cloudera.com Logo
Cloudera
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years experience as a Software Engineer in infrastructure space
  • Strong understanding of at least one of the following languages: Java or Python
  • Strong understanding of distributed systems and building systems at scale
  • Experience with containerization (Kubernetes, Docker)
  • Passionate about programming, clean coding habits, attention to detail, and focus on quality
  • Experience with public cloud (AWS/Azure/GCP) and/or private cloud (OpenShift/Rancher)
  • Open-minded attitude, desire to learn new things and build great products
  • Excellent communication and collaboration skills
  • Relevant studies / BS or MS in Computer Science or related field
Job Responsibility
Job Responsibility
  • Gain deep technical knowledge across the Cloudera Data Engineering technical stack, with a focus on the runtimes of the stack like Apache Spark and Apache Iceberg, and apply this expertise in your daily work
  • Work with a team of talented infrastructure engineers. Help hire and mentor engineers while supporting their career growth
  • Drive architecture and design discussions, providing strong technical direction for the team
  • Collaborate with product, engineering, and cross-functional partners, leading the delivery of several large, critical features in Cloudera’s data engineering experience
  • Work on large-scale distributed systems, ranging from hundreds to thousands of nodes in production clusters
  • Bring passion for programming, clean coding practices, attention to detail, and a strong focus on quality
What we offer
What we offer
  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data Engineering

Senior Software Engineer (Contract) – Market Data. A leading global investment m...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
rmgdigital.io Logo
rmg digital
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong commercial experience in Java (essential)
  • Solid Python development experience
  • Background in market data, trading systems, or low-latency / high-performance platforms (highly desirable)
  • Experience working with large-scale, real-time data systems
  • Comfortable operating in fast-paced, high-stakes environments
Job Responsibility
Job Responsibility
  • Design, build and optimise components of a high-throughput market data platform
  • Work across Java (primary) and Python in a performance-critical environment
  • Improve and modernise older parts of the stack with a focus on scalability and latency
  • Partner closely with Data Management teams and Quant Traders within the systematic trading business
  • Contribute to the ongoing expansion of a specialist market data engineering function
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data Engineering

Join us in building the future of finance. Our mission is to democratize finance...
Location
Location
United States , Menlo Park
Salary
Salary:
146000.00 - 198000.00 USD / Year
robinhood.com Logo
Robinhood
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional experience building end-to-end data pipelines
  • Hands-on software engineering experience, with the ability to write production-level code in Python for user-facing applications, services, or systems (not just data scripting or automation)
  • Expert at building and maintaining large-scale data pipelines using open source frameworks (Spark, Flink, etc)
  • Strong SQL (Presto, Spark SQL, etc) skills
  • Experience solving problems across the data stack (Data Infrastructure, Analytics and Visualization platforms)
  • Expert collaborator with the ability to democratize data through actionable insights and solutions
Job Responsibility
Job Responsibility
  • Help define and build key datasets across all Robinhood product areas. Lead the evolution of these datasets as use cases grow
  • Build scalable data pipelines using Python, Spark and Airflow to move data from different applications into our data lake
  • Partner with upstream engineering teams to enhance data generation patterns
  • Partner with data consumers across Robinhood to understand consumption patterns and design intuitive data models
  • Ideate and contribute to shared data engineering tooling and standards
  • Define and promote data engineering best practices across the company
What we offer
What we offer
  • Market competitive and pay equity-focused compensation structure
  • 100% paid health insurance for employees with 90% coverage for dependents
  • Annual lifestyle wallet for personal wellness, learning and development, and more
  • Lifetime maximum benefit for family forming and fertility benefits
  • Dedicated mental health support for employees and eligible dependents
  • Generous time away including company holidays, paid time off, sick time, parental leave, and more
  • Lively office environment with catered meals, fully stocked kitchens, and geo-specific commuter benefits
  • Bonus opportunities
  • Equity
  • Fulltime
Read More
Arrow Right
New

Senior Software Engineer - Azure Data Engineering Team

Microsoft is a company where passionate innovators come to collaborate, envision...
Location
Location
Canada , Vancouver
Salary
Salary:
114400.00 - 203900.00 CAD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Drive the design and implementation of complex, large-scale distributed systems by producing technical designs, proof-of-concepts, and prototype solutions from ambiguous or high-level requirements
  • Own end-to-end delivery of key system components, including design tradeoffs, implementation, testing strategy, deployment, and long-term operability
  • Continuously improve system performance, scalability, and resilience by identifying architectural gaps, leading refactoring efforts, and addressing systemic technical debt
  • Define and apply metrics, best practices, and quality bars to ensure long-term service stability, operational excellence, and strong return on engineering investment
  • Lead code reviews and design discussions, setting technical direction and mentoring engineers to improve overall code quality and system design maturity
  • Collaborate across teams and organizations to align designs, influence dependencies, and deliver solutions that scale across Azure
  • Build and evolve the core messaging infrastructure that underpins hundreds of thousands of Azure applications, supporting critical platform capabilities such as eventing, asynchronous workflows, telemetry, and diagnostics
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Software Senior Principal Engineer, Data Path Engineering

Join us as a SoftwareSenior Principal Engineer on our Data Path Engineering team...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
dell.com Logo
Dell
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • University Degree and 10+ years of extensive experience with high-performing software quality teams
  • Knowledge of software development methods, design and implementation
  • Proficiency with programming languages
  • operating systems
  • firmware
  • BIOS
  • device drivers
  • databases
  • system, network, operating system, and application administration
  • embedded software/firmware
Job Responsibility
Job Responsibility
  • Contribute to the design and architecture of high-quality, complex systems and software/storage environments
  • Prepare, review, and evaluate software/storage specifications for products and systems
  • Contribute to the development and implementation of test strategies for complex software products and systems/for storage products and systems
  • Develop core software primarily using C/C++ and Python
What we offer
What we offer
  • Private medical care
  • Group life insurance
  • Global Travel Medical Insurance
  • Emergency Travel Assistance
  • Employee Assistance Program
  • Lunch card
  • Benefit Systems vouchers or Multisport card
  • Languages’ classes
  • Discounts for Dell Products
  • Wellness Program
Read More
Arrow Right