CrawlJobs Logo
InXiteOut Logo InXiteOut · IT - Software Development

Senior Data Engineer II

India, Bangalore · Job Posted April 19, 2026
Apply Position
Job Link Share

Job Description

We are seeking a highly skilled Senior Data Engineer with 5+ years of experience in building scalable data solutions. The ideal candidate will have strong expertise in SQL, PySpark, ETL processes, Data Lakes, and the Azure data ecosystem.

Job Responsibility

  • Design, develop, and maintain robust data pipelines using Python/PySpark
  • Build and optimize ETL workflows for large-scale data processing
  • Work with Azure services such as: Azure Blob Storage
  • Azure Data Lake
  • Azure Data Factory
  • Azure Synapse Analytics
  • Ensure high performance and reliability of data systems
  • Collaborate with cross-functional teams to understand data requirements
  • Implement best practices for data governance, security, and quality
  • Use version control tools like Git and manage tasks via Azure DevOps or Jira
  • Provide technical guidance and mentorship to junior team members.
  • Drive design decisions and contribute to data architecture planning.

Requirements

  • 5+ years of experience with SQL
  • 4+ years of hands-on experience in building data pipelines using Python/PySpark
  • 4+ years of experience with the Azure ETL stack
  • Strong understanding of: Data modeling
  • Distributed computing
  • Data warehousing concepts
  • Experience with code versioning tools (Git)
  • Familiarity with Agile tools such as Azure DevOps or Jira
  • Bachelor’s degree in: B.Sc / BCA / B.Tech / B.E (any specialization)
  • Strong verbal and written communication skills
  • Reliable internet connection (for remote/hybrid roles)
  • Lead and Drive Outcomes
  • Creative Problem Solving
  • Accountability and Ownership
  • Communicates Effectively

Nice to have

  • Azure certifications are a plus
  • Experience with real-time data processing
  • Knowledge of CI/CD pipelines for data engineering
  • Exposure to big data technologies beyond Azure ecosystem
InXiteOut - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Data Engineer II

8 matching positions

Software Engineer II and Senior Software Engineer

The FIO (Office Files and Identity) Team drives collaboration, identity, cloud f...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, or Rust
  • OR equivalent experience
  • 4+ years industry engineering experience coding in languages including, but not limited to, C, C++, C#, Java or Rust
  • 4+ years industry experience building and shipping production quality, performant and cross-platform applications
  • Experience collaborating cross-team and cross-function to deliver software features or projects
  • Platform-specific experience building Windows, MacOS, iOS or Android applications
  • Experience designing and implementing efficient network communications, including network protocols, performance and reliability tooling, modeling and implementing complex customer scenarios across network services
  • Experience designing and implementing client-side storage stacks, with a focus on correctness, resiliency, performance, and adaptability
  • Understanding of client file system design and APIs, including advanced performance optimizations
  • Experience directly implementing large-scale data pipelines for product telemetry, with ability to evolve system as business and technical needs change
Job Responsibility
Job Responsibility
  • Design and write code
  • Work across organizations and directly with partners both in Office and across Microsoft, including other engineers and product leaders
  • Use data as the basis for decision making
  • Be a steward of products that ship to hundreds of millions of customers around the world, staying connected to customers through data and feedback and being agile and responsive to issues
  • Grow as an engineer in a modern and highly impactful team
  • Fulltime
Read More
Arrow Right

Senior Engineer II, Applied Technologies

This high-impact individual contributor role will lead the strategy and deployme...
Location
Location
United States , Norwood
Salary
Salary:
145900.00 - 234200.00 USD / Year
modernatx.com Logo
Moderna
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ph.D. in Chemical/Biomedical Engineering, Analytical Chemistry, or related discipline with 2+ years, OR M.S. with 8+ years, OR B.S. with 10+ years of relevant industrial experience
  • Hands‑on experience developing and implementing PAT tools in biopharmaceutical or advanced ‑therapy manufacturing environments, including sensor specification, installation, and data ‑modelling, and technology transfer
  • Proficient in multivariate data analysis/chemometrics tools (SIMCA, Unscrambler, Python, R) and integration with process automation systems, manufacturing data platforms, and communication protocols (e.g. DeltaV, SynTQ, PI AF, OPC UA)
  • Strong understanding of Design of Experiment (DoE), cGMP, Quality by Design principles, and process validation fundamentals
Job Responsibility
Job Responsibility
  • Lead the end-to-end PAT and control strategy, ensuring cross-platform consistency and alignment with Moderna’s digital and automation roadmaps
  • Design, deploy, and maintain a diverse suite of spectroscopic, chromatographic, and sensor technologies (e.g., Raman, FTIR, UPLC, rapid sterility, pH/DO micro sensors)
  • Develop chemometric models and real-time dashboards linking process parameters with critical quality attributes
  • Serve as a technical lead on integration of PAT tools into Moderna’s digital ecosystem — including data lakes, electronic batch records (eBR), and advanced process control layers
  • Author and lead technology transfer packages to internal GMP sites and external partners, ensuring seamless comparability and calibration approaches
  • Collaborate closely with analytical development, MS&T, process automation, digital, engineering, quality, and regulatory teams to ensure PAT solutions are seamlessly manufacturable and inspection-ready
  • Drive continuous improvement initiatives that reduce cycle times, enhance right-first-time metrics, and improve overall process robustness
  • Mentor staff and champion a scientific culture of curiosity, innovation, and excellence
  • Translate complex analytical and regulatory requirements into integrated solutions aligned with Moderna’s next-gen manufacturing platforms
  • Travel up to 10%, supporting deployment at domestic and international manufacturing sites
What we offer
What we offer
  • Best-in-class healthcare coverage, plus voluntary benefit programs to support your unique needs
  • A holistic approach to well-being, with access to fitness, mindfulness, and mental health support
  • Family planning benefits, including fertility, adoption, and surrogacy support
  • Generous paid time off, including vacation, volunteer days, sabbatical, global recharge days, and a discretionary year-end shutdown
  • Savings and investment opportunities to help you plan for the future
  • Location-specific perks and extras
  • Annual discretionary bonus, other incentive compensation, or equity award
  • Fulltime
Read More
Arrow Right

Network Planning Engineer-Senior II

Air Network Design; Air Network Planning & Implementation; ULD Planning & Manage...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
fedex.com Logo
Fedex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Relevant at least 7 years of experience in air freight planning, logistics, or a related field
  • A bachelor's degree in logistics, supply chain management, engineering, or a related field
  • Strong analytical and problem-solving skills
  • Effective communication skills
  • Familiarity with relevant software and technology tools used in air freight planning and logistics
  • Understanding of international air freight regulations, customs procedures, and compliance requirements
  • Attention to detail
  • The ability to adapt to changing circumstances
  • Project & Resource Management
Job Responsibility
Job Responsibility
  • Air Network Design, Air Network Planning & Implementation
  • Develop and implement short-term and long-term air network roadmaps
  • Create network design artifacts
  • Run scenario modeling
  • Analyze and optimize air freight networks
  • Plan and manage cargo capacity
  • Standardize planning templates and SOPs
  • Stakeholder engagement
  • Work closely with airlines, ground handlers, customs authorities, and other stakeholders
  • Liaise with airlines, ground handlers, and strategic network partners
  • Fulltime
Read More
Arrow Right

Data Engineer II

As a Data Engineer II on our Core Engineering Data Team, you will focus on build...
Location
Location
United States , Boston
Salary
Salary:
93200.00 - 136600.00 USD / Year
simplisafe.com Logo
SimpliSafe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field or equivalent practical experience
  • 2+ years of experience in software engineering, data engineering, or a related field
  • Foundational knowledge of AWS or other public cloud platforms (e.g., Azure, GCP)
  • Strong SQL knowledge and experience optimizing for data warehousing technologies like AWS Athena
  • Strong knowledge of Python for use in data transformation
  • Experience with ETL/ELT, schema design, and datalake technologies
  • Familiarity with various data and table formats (JSON, Avro, Parquet, Iceberg)
  • Love of data and a passion for building reliable data products
Job Responsibility
Job Responsibility
  • Develop and maintain efficient and reliable ETL/ELT data pipelines from product and service data sources to our centralized analytical platforms
  • Implement and monitor data pipeline orchestration using tools like Airflow or Dagster to ensure timely and accurate data delivery
  • Collaborate with senior engineers and analysts to understand requirements and implement technical solutions for data workflows
  • Perform routine monitoring of pipeline performance and reliability, assisting with troubleshooting and optimizing for efficiency
  • Contribute to the optimization of table structures and data storage to support various query and usage patterns
  • Support and maintain data discovery, catalog, and analytics tooling for internal teams
  • Assist in implementing data security measures and ensuring compliance with data governance policies
  • Write and maintain data quality validation checks and unit tests to ensure the integrity and reliability of data pipelines
  • Participate in team-wide discussions to help develop and refine team norms and engineering best practices
What we offer
What we offer
  • A mission- and values-driven culture and a safe, inclusive environment where you can build, grow and thrive
  • A comprehensive total rewards package that supports your wellness and provides security for SimpliSafers and their families
  • Free SimpliSafe system and professional monitoring for your home
  • Employee Resource Groups (ERGs) that bring people together, give opportunities to network, mentor and develop, and advocate for change
  • Participation in our annual bonus program, equity, and other forms of compensation, in addition to a full range of medical, retirement, and lifestyle benefits
  • Fulltime
Read More
Arrow Right

Senior Software Engineer II

We’re not just building better tech. We’re rewriting how data moves and what the...
Location
Location
United States , New York
Salary
Salary:
197400.00 - 232000.00 USD / Year
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of industry experience designing, building, scaling, and operating backend systems in production
  • Deep proficiency in at least one major backend programming language (e.g., Java, Go, C/C++, or Python) and strong fundamentals in data structures, algorithms, and system design
  • Hands-on experience with distributed systems, such as event-driven architectures, high-throughput services, or large-scale data pipelines
  • Strong experience running production services in a public cloud (AWS, GCP, or Azure), including containerized workloads (e.g., Docker, Kubernetes)
  • Expertise in cloud-native technology, including networking & security, and experience being part of an on-call rotation
  • Proven experience in leading and mentoring technical teams
  • A track record of technical leadership: driving projects, influencing architecture, and coordinating work across multiple engineers or teams
  • Strong communication and collaboration skills, with the ability to align stakeholders, explain complex ideas clearly, and drive decisions
  • BS, MS, or PhD in computer science, engineering, or a related field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Develop and architect the cloud-native Stream Governance platform - a multi-tenant, highly available, and scalable service for Kafka and real-time data
  • Own and lead the end-to-end design and implementation of complex backend services within a cloud-native, microservices-based environment
  • Drive projects from requirements and design through implementation, rollout, and ongoing operation in production
  • Make architecture and technical decisions that thoughtfully balance reliability, scalability, performance, and operability
  • Solve complicated technical projects with high quality, provide specialized technical guidance to the team, and mentor/support other engineers through code reviews and design reviews
  • Evaluate and enhance the efficiency of our platform's technology stack, ensuring we keep pace with industry trends and adopt state-of-the-art solutions
  • Take responsibility for developing, managing, and maintaining a mission-critical service with a 99.99 SLA running across 100+ AWS, GCP, and Azure regions
  • Partner across engineering and with other key stakeholders to create and execute the overall roadmap for delivering a top-notch Data Streaming Platform
  • Contribute to a culture of continuous improvement, inclusive collaboration, and high technical standards
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
  • Offers Equity
  • Fulltime
Read More
Arrow Right

Senior Data Scientist II

Role: Senior Data Scientist – Conversational AI, LLM Location: Bangalore Experie...
Location
Location
India , Bangalore, Kolkata
Salary
Salary:
Not provided
inxiteout.ai Logo
InXiteOut
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ Years
  • Large Language Models (LLMs) & NLP
  • RAG, agents, and multi-agent orchestration
  • Prompt engineering & LLM evaluation frameworks
  • Vector databases
  • Python (advanced proficiency)
  • FastAPI / Flask
  • Asynchronous & modular application design
  • Databricks & PySpark
  • MongoDB (schema design, indexing, optimization)
Job Responsibility
Job Responsibility
  • Design, develop, and maintain enterprise-grade Conversational AI systems using modern architectural patterns
  • Build context-aware AI applications leveraging LLMs, vector databases, and multi-agent orchestration frameworks
  • Develop and optimize prompt engineering strategies for reliability, evaluation, and performance tuning
  • Implement LLM interaction workflows including RAG, tool usage, and agent-to-agent communication
  • Design and integrate Knowledge Graphs to enhance contextual intelligence and reasoning
  • Develop graph-based solutions using enterprise Neo4j with strong proficiency in Cypher query language and graph algorithms
  • Implement graph traversal, inference, and graph analytics for AI use cases
  • Build modular, scalable, and maintainable Python-based AI applications
  • Develop high-performance REST APIs using Fast / Flask framework
  • Implement asynchronous processing and orchestration workflows
  • Fulltime
Read More
Arrow Right

Senior Software Engineer II

As a Senior Software Engineer II at Confluent, you will take ownership of critic...
Location
Location
Salary
Salary:
197400.00 - 232000.00 USD / Year
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of industry experience designing, building, scaling, and operating backend systems in production
  • Deep proficiency in at least one major backend programming language (e.g., Java, Go, C/C++, or Python) and strong fundamentals in data structures, algorithms, and system design
  • Hands-on experience with distributed systems, such as event-driven architectures, high-throughput services, or large-scale data pipelines. A strong understanding of consistency, fault tolerance, and performance tradeoffs
  • Strong experience running production services in a public cloud (AWS, GCP, or Azure), including containerized workloads (e.g., Docker, Kubernetes)
  • Expertise in cloud-native technology, including networking & security, and experience being part of an oncall rotation
  • Proven experience in leading and mentoring technical teams
  • A track record of technical leadership: driving projects, influencing architecture, and coordinating work across multiple engineers or teams
  • Strong communication and collaboration skills, with the ability to align stakeholders, explain complex ideas clearly, and drive decisions
  • BS, MS, or PhD in computer science, engineering, or a related field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Develop and architect the cloud-native Stream Governance platform - a multi-tenant, highly available, and scalable service for Kafka and real-time data
  • Own and lead the end-to-end design and implementation of complex backend services within a cloud-native, microservices-based environment
  • Drive projects from requirements and design through implementation, rollout, and ongoing operation in production
  • Make architecture and technical decisions that thoughtfully balance reliability, scalability, performance, and operability
  • Solve complicated technical projects with high quality, provide specialized technical guidance to the team, and mentor/support other engineers through code reviews and design reviews
  • Evaluate and enhance the efficiency of our platform's technology stack, ensuring we keep pace with industry trends and adopt state-of-the-art solutions
  • Take responsibility for developing, managing, and maintaining a mission-critical service with a 99.99 SLA running across 100+ AWS, GCP, and Azure regions
  • Partner across engineering and with other key stakeholders to create and execute the overall roadmap for delivering a top-notch Data Streaming Platform
  • Contribute to a culture of continuous improvement, inclusive collaboration, and high technical standards
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
  • Offers Equity
  • Fulltime
Read More
Arrow Right

Senior Software Engineer II - Frontend - AI Search

Join us at Seismic, a cutting-edge technology company leading the way in the Saa...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
seismic.com Logo
Seismic
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in software engineering, with experience contributing to frontend or UI-focused web applications
  • Experience with HTML, CSS, and modern JavaScript (ES6+)
  • Experience building user interfaces using React, including functional components, hooks, and state management patterns
  • Experience with TypeScript, including writing strongly typed components and APIs
  • Familiarity with modern CSS techniques such as CSS Modules, styled-components, Tailwind, or similar approaches
  • Experience integrating frontend applications with REST or GraphQL APIs
  • Working knowledge of automated frontend testing practices (e.g., Jest, React Testing Library, Cypress, Playwright)
  • Experience using Git for source control and collaborating through pull requests
  • Familiarity with CI/CD concepts and modern frontend pipelines, including GitHub Actions
  • Exposure to frontend performance optimization techniques (code splitting, lazy loading, memoization)
Job Responsibility
Job Responsibility
  • Contribute to the development and maintenance of backend systems that power our web application, including search, content discovery, and AI capabilities
  • Contribute to the design, development, and maintenance of backend systems and services supporting search functionality, ensuring performance, scalability, and reliability
  • Assist in implementing search and/or AI-related features, including indexing, retrieval, and ranking logic, to improve search accuracy and efficiency
  • Collaborate with engineers, AI partners, and product teams to integrate search and AI-driven capabilities across the Seismic platform
  • Participate in monitoring and performance tuning efforts, identifying routine bottlenecks and applying guided improvements to ensure acceptable query latency
  • Work closely with cross-functional and geographically distributed teams, including product managers, frontend engineers, and UX designers, to support seamless search experiences
  • Learn and apply new tools, technologies, and best practices related to search, backend development, and AI systems
  • Fulltime
Read More
Arrow Right