CrawlJobs Logo

Principal Engineer, Storage Data Science and Analytics

India, Bengaluru · Job Posted July 13, 2026
Apply Position
Job Link Share

Job Description

In the HPE Hybrid Cloud, we lead the innovation agenda and technology roadmap for all of HPE. This includes managing the design, development, and product portfolio of our next-generation cloud platform, Green Lake. Working with customers, we help them reimagine their information technology needs to deliver a simple, consumable solution that helps them drive their business results. Join us redefine what's next for you.

Job Responsibility

  • Serve as the premier technical authority bridging advanced machine learning, GenAI, and big data analytics with HPE's next-generation cloud and storage ecosystem (HPE GreenLake and hybrid cloud)
  • Lead the architectural strategy to extract, analyze, and operationalize intelligence from vast telemetry data pipelines generated by enterprise file, block, and object storage systems
  • Define the organization-wide data architecture strategy and analytical roadmaps for software systems running across HPE's hybrid cloud platform
  • Develop predictive, prescriptive, and generative AI models to map data paths, enhance memory/space management, and predict capacity or hardware failure across global enterprise clusters
  • Validate highly complex, distributed telemetry data from customer storage networks to uncover structured insights that drive automated mitigation and system reliability
  • Design, deploy, and scale machine learning and deep learning code to run reliably in worldwide production edge-to-cloud environments
  • Collaborate with data engineering to establish standardized ELT patterns, big data storage views, and high-throughput, low-latency streaming pipelines (supporting Kafka, Spark, etc.)
  • Integrate advanced LLM workflows, Retrieval-Augmented Generation (RAG), and agentic systems into storage customer support analytics and digital products to automate troubleshooting
  • Partner with product management, storage hardware engineers, and business executives to translate abstract business challenges into production-ready analytical solutions
  • Provide career guidance, conduct design reviews, and actively mentor senior engineers and data scientists across multiple Scrum teams to foster an innovative technical community

Requirements

  • 10+ years of proven industry experience in software product development or enterprise data science, with a heavy emphasis on distributed systems, storage, or cloud infrastructure architectures
  • Bachelor's or Master's degree in Computer Science, Data Science, Engineering, Mathematics, or a highly technical, data-oriented discipline
  • Advanced mastery of machine learning algorithms (time-series forecasting, clustering, anomaly detection, random forests) and deep learning frameworks
  • Expert Python/Go-lang programmer
  • Strong working knowledge of data structures, algorithmic complexity, and multi-threaded programming
  • Experience with C/C++ or system internals is a strong differentiator
  • Concrete experience building and fine-tuning LLMs, prompt engineering, and leveraging vector databases
  • Exceptional ability to explain highly technical architectural trade-offs, algorithms, and AI solutions clearly to non-technical business leaders and executive management
  • A proven track record of industry innovation, backed by whitepapers, industry conference contributions, or patents in software and analytical design
  • Cloud Architectures
  • Cross Domain Knowledge
  • Design Thinking
  • Development Fundamentals
  • DevOps
  • Distributed Computing
  • Microservices Fluency
  • Full Stack Development
  • Release Management
  • Security-First Mindset
  • User Experience (UX)

What we offer

  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Principal Engineer, Storage Data Science and Analytics

8 matching positions

Principal Engineer - Data path - HPE Alletra Storage MP X10000 (Object Storage product development)

Develops organization-wide architectures and methodologies for software systems ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Information Systems, or equivalent
  • 15+ years of experience in a product development environment on storage/system engineering
  • Track record of delivering V1 products (or early-stage product development) in modern storage technologies (Object/File storage for modern AI use-cases, Object storage, cloud storage)
  • A track record of establishing and assuring adherence to performance requirements, work plans, and schedules for significant engineering initiatives
  • Experience designing and developing software systems design tools and languages
  • Experience in storage product development either file, block or object storage
  • Excellent analytical and problem-solving skills
  • Experience in overall architecture of software systems for products and solutions
  • Designing and integrating software systems running on multiple platform types into overall architecture
  • Evaluating and selecting forms and processes for software systems testing and methodology, including writing and execution of test plans, debugging, and testing scripts and tools
Job Responsibility
Job Responsibility
  • Develops organization-wide architectures and methodologies for software systems design and development across multiple platforms and organizations within the Global Business Unit
  • End-to-End Ownership and Technical Leadership
  • Identifies and evaluates new technologies, innovations, and outsourced development partner relationships for alignment with technology roadmap and business value
  • creates plans for integration and update into architecture
  • Anticipate bottlenecks and architect innovative solutions
  • Reviews and evaluates designs and project activities for compliance with development guidelines and standards
  • provides tangible feedback to improve product quality and mitigate failure risk
  • Drive best practices and operational excellence both at the team and organizational level
  • Coach and mentor junior and mid-level developers to help them grow technically and understand best practices
  • Leverages recognized domain expertise, business acumen, and experience to influence decisions of executive business leadership, outsourced development partners, and industry standards groups
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

Senior Principal Engineer – Storage Data path - HPE Alletra MP X10000

Senior Principal Engineer – Storage Data path - HPE Alletra MP X10000 (Object St...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Information Systems, or equivalent
  • 15+ years of experience in a product development environment on storage/system engineering
  • Track record of delivering V1 products (or early-stage product development) in modern storage technologies (Object/File storage for modern AI use-cases, Object storage, cloud storage)
  • Evidence of advancing storage technologies – new segment, industry standards/conference contributions
  • Experience concurrently driving technology development/delivery of multiple scrum teams
  • A track record of establishing and assuring adherence to performance requirements, work plans, and schedules for significant engineering initiatives
  • Excellent communications and interpersonal skills
  • Experience architecting, designing, and developing innovative software system design tools and languages
  • Excellent analytical and problem-solving skills
  • Experience in leading overall architecture of software systems for products and solutions
Job Responsibility
Job Responsibility
  • Develops organization-wide architectures, strategies, and methodologies for software systems design and development across multiple platforms and organizations within the Global Business Unit
  • Identifies and makes informed recommendations regarding new technologies, innovations, and outsourced development partner relationships for alignment with technology roadmap and business value
  • creates plans for integration and update into architecture
  • End-to-End Ownership and Technical Leadership
  • Anticipate bottlenecks and architect innovative solutions
  • Drive best practices and operational excellence both at the team and organizational level
  • Reviews, evaluates, and influences designs and project activities for compliance with development guidelines and standards
  • Provides tangible solutions that improve product quality and mitigate failure risk
  • Contributes to domain expertise, business acumen, and experience to influence decisions of executive business leadership, outsourced development partners, and industry standards groups
  • Brings creativity and innovation to the organization
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
Read More
Arrow Right

Principal Data Engineer

Microsoft’s Path team helps customers along their journey from the initial idea ...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Design, implement, monitor, and optimize large-scale, robust data pipelines and architectures that support Microsoft Path products data analytics initiatives.
  • Develop scalable ETL/ELT workflows, ensure reliable ingestion, transformation, and storage of high-volume, high-velocity data from diverse sources with different schemas.
  • Enforce best practices for data quality, lineage, security, and compliance.
  • Collaborate with stakeholders to define trustworthy data sets and implement rigorous data validation protocols, ensuring analytics are accurate and auditable.
  • Work closely with product managers, software engineers, AI researchers, and business stakeholders to build data solutions that accomplish business goals.
  • Enable self-service analytics and empower teams by building data models, semantic layers, and tools that streamline access to trusted information.
  • Translate ambitious vision into actionable roadmaps and measurable outcomes.
  • Mentor senior data engineers and technical leads, guide complex design decisions, and foster a culture of engineering excellence, operational rigor, and continuous learning across the organization.
  • Fulltime
Read More
Arrow Right

Principal Data Infrastructure Engineer

As Microsoft continues to push the boundaries of AI, we are on the lookout for p...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR equivalent experience
  • 4+ years in Big Data Infrastructure, DevOps, SRE, or Platform Engineering
  • 3+ years of hands-on experience managing and scaling distributed systems—from bare-metal to cloud-native environments
  • 2+ years deploying containerized applications using Kubernetes and Helm/Kustomize
  • Solid scripting and automation skills using Python, Bash, or PowerShell
  • Proven success in CI/CD pipeline management, release automation, and production troubleshooting
  • Experience working with Databricks for scalable data processing and analytics
  • Familiarity with security practices in infrastructure environments, including IAM, OAuth, and Kerberos administration
Job Responsibility
Job Responsibility
  • Architect and maintain scalable, reliable, and observable Big Data Infrastructure for mission-critical AI applications
  • Champion DevOps and SRE best practices—automated deployments, service monitoring, and incident response
  • Build a self-service big data platform that empowers data and platform engineers and researchers
  • Develop robust CI/CD pipelines and automate infrastructure provisioning using Infrastructure as Code tools (Bicep, Terraform, ARM)
  • Collaborate with Data Engineers, Data Scientists, AI Researchers, and Developers to deliver secure, seamless big data workflows
  • Lead technical design reviews and uphold a clean, secure, and well-documented codebase
  • Proactively identify and resolve bottlenecks in data pipelines and infrastructure
  • Optimize system performance across storage, compute, and analytics layers
  • Partner with Security teams to enhance system security (IAM, OAuth, Kerberos)
  • Embody and promote Microsoft’s values: Respect, Integrity, Accountability, and Inclusion
  • Fulltime
Read More
Arrow Right

Principal Software Engineer Manager - Azure Storage

Are you interested in solving the challenges of cloud-scale storage that support...
Location
Location
United States , Multiple Locations
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C#, Powershell, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Lead the team shaping technical strategy, delivering scalable, safe, reliable, high-performance systems
  • Partner across product and platform teams to align priorities and deliver customer impacting outcomes, while ensuring operational excellence in reliability, livesite health, efficiency, cost, and latency
  • Drive strategic clarity and customer focused decision making, leveraging deep technical expertise to identify opportunities
  • Grow and empower a high performing team, hiring and developing talent while fostering a culture of collaboration, innovation, and accountability
  • Oversee analytics and data driven insights using AI, integrating key metrics, KPIs, and operational signals to identify trends in quality & velocity in Azure Storage Deployment
  • Drive strategies to close measurement gaps, prioritize findings effectively, and ensure timely resolution of high impact problems
  • Evaluate emerging analytical tools and technologies, sharing insights across teams to drive adoption and improve effectiveness
  • Provide high quality code reviews for engineers, guiding the team to ensure code meets high standards for maintainability, quality, and correctness
  • Participate in DevOps to provide operational support and to identify pain points and improvements in tooling and automation
  • Fulltime
Read More
Arrow Right

Principal Data Consultant

10Pearls is seeking a Senior Principal Data Engineer with strong expertise in mo...
Location
Location
Pakistan , Islamabad; Lahore; Karachi
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field
  • Minimum 7+ years of experience in Data Engineering and large-scale data platforms
  • Strong expertise in Big Data technologies including Hadoop, Spark (including Spark Streaming), Kafka, Hive, Airflow, and Apache NiFi
  • Advanced proficiency in Python and SQL
  • Hands-on experience with Azure Data Platform services including Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Azure Functions, and Logic Apps
  • or equivalent data stack knowledge within Google Cloud or AWS Cloud
  • Hands-on experience with Google BigQuery, Google Analytics, and Clickstream data modelling
  • Strong experience in building and maintaining ETL/ELT pipelines
  • Proficiency in relational SQL, Graph, NoSQL, and distributed database technologies
  • Proficiency in Elasticsearch and Couchbase databases
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable batch and real-time data pipelines to support growing data volume and complexity
  • Build and optimize data solutions on cloud-based and on-premises data platforms (Azure, AWS, Google Cloud)
  • Develop data models, data marts, and data domains including laying the foundation for Data Mesh architecture
  • Implement and maintain ETL/ELT processes for efficient data integration and transformation
  • Collaborate with data analysts, data scientists, and business stakeholders to deliver reliable data solutions
  • Ensure data quality, governance, security, and compliance across the full data ecosystem including access controls, data masking, and encryption
  • Automate deployment, scheduling, monitoring, and management of data pipelines and datasets
  • Monitor platform performance and troubleshoot data-related issues while providing L2/L3 production support
  • Develop and maintain data orchestration frameworks and DataOps best practices
  • Optimize existing data infrastructure and recommend improvements for scalability and performance
  • Fulltime
Read More
Arrow Right

Principal Data Architect

At Comcast advertising, we're building a data-driven future, and we need a Princ...
Location
Location
United States
Salary
Salary:
107020.26 - 250828.74 USD / Year
comcastadvertising.com Logo
Comcast Advertising
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Implementing cloud data architecture and data integration patterns (AWS Glue, Azure Data Factory, Event Hub, Databricks, etc.), storage and processing (Redshift, Azure Synapse,BigQuery, Snowflake)
  • Infrastructure as code (CloudFormation, Terraform)
  • 3rd Party Integration (Salesforce, D365)
  • Understanding and experience with modern cloud data architectures and engineering for one or more of the following cloud providers - AWS, Azure, GCP
  • Experience building data models and semantic layers
  • Design and Implementing enterprise reporting solutions using Tableau / Looker
  • Experience in integrating pipeline with REST API / GRAPHQL
  • Exposure to Mulesoft API and Clean Rooms will be desired
  • Experience in defining Master Data Management strategy and exposing data securely as a through data sharing architecture and APIs
  • Leading and supporting data architecture team and leads in creation of cloud data migration/integration/warehouse plans, roadmap, success metrics, and assessment of client’s enterprise (on-premise and on-cloud) data systems
Job Responsibility
Job Responsibility
  • Collaborate across application and data teams to orchestrate data solutions that meet needs from transactional, analytics and data science needs
  • Propose solutions focusing on tenants such as cost optimization, reducing data hops, ensuring high availability, performance and Effectv’s strategic needs and future growth goals as it relates to becoming a ‘data driven’ organization
  • Ensure solutions adhere to policies outlined at Comcast level such as data privacy and security
  • Design and manage robust, scalable data models and semantic layer
  • Build prototypes, publish design patterns for use by the organization
  • Provide guidance on getting started in cloud and cloud migration techniques
  • Work with the data governance team to ensure critical data elements are identified and monitored
  • Work with partners like AWS, Databricks, Snowflake to ensure services meet the growing needs of Effectv
  • Facilitate in-depth architectural discussions and design exercises to create world-class cloud solutions
  • Work with internal and external stakeholders to gather requirements
What we offer
What we offer
  • Paid Time off
  • Physical Wellbeing
  • Financial Wellbeing
  • Emotional Wellbeing
  • Life Events + Family Support
  • Base pay
  • Bonus/Commission eligibility
  • Fulltime
Read More
Arrow Right

Principal Data Scientist - Rentals Marketplace Ads Team

Location
Location
United States
Salary
Salary:
169300.00 - 284700.00 USD / Year
Zillow
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A Ph.D or Master's degree in a quantitative field
  • 8+ years of work experience involving quantitative data analysis, experimentation and complex problem-solving
  • A strong understanding of statistical concepts, measurement methods, A/B testing and causal inference techniques
  • A proven track record of building and operating value-based pricing systems
  • Mastery of SQL, Excel, Python, along with some experience with Tableau, Databricks, or other visualization software
  • Superb verbal and written communication skills with the ability to distill sophisticated issues and detailed analysis into simple, structured frameworks with concrete action plans
  • Able to work cross-functionally and influence business partners to set realistic goals and focus on data-driven solutions
  • Keen understanding and experience with online products
Job Responsibility
Job Responsibility
  • Analyze and interpret large, complex datasets to identify trends, patterns, and insights that support Zillow’s burgeoning rentals ecosystem
  • Collaborate with product stakeholders to define key metrics, goals, and objectives, and develop data-driven strategies to achieve them
  • Utilize causal inference techniques and novel experimental designs to evaluate and iterate on our pricing program
  • Mentor and coach junior team members on executing analytic requests and help unblocking through code reviews & best practice sharing
  • Work closely with cross-functional teams, such as product, marketing, engineering, and corporate strategy, to ensure relevant insights are surfaced for decision making
  • Collaborate with data engineering teams to design and optimize data pipelines and workflows to support efficient data collection, storage, and processing
  • Provide insights and recommendations based on data analysis to drive product decisions and roadmap
  • Effectively communicate complex analytical findings to diverse stakeholders, translating technical concepts into actionable insights and recommendations
  • Dive into Zillow's internal and third party data (think Hive, Presto, SQL Server, Databricks) to develop solutions that will help move the business forward and enable better decisions at a rapid speed
What we offer
What we offer
  • Equity awards
  • Fulltime
Read More
Arrow Right