CrawlJobs Logo

Ml - Principal Software Engineer

India, Hyderabad · Job Posted May 03, 2026
Apply Position
Job Link Share

Job Description

Imagine shaping the future of AI on Windows where your work directly impacts how millions of people experience intelligent computing every day. On the Windows AI Platform & Tools Team, you’ll collaborate across Microsoft and with hardware ecosystem partners to build the next generation of AI-infused experiences. You’ll be part of a team that thrives on solving complex challenges and delivering scalable solutions at the edge. As a Principal Software Engineer in our team, you will help lead the design and development of high-performance software that powers AI capabilities across Windows & Devices. You’ll architect and build code that enables developers to deploy machine learning models at scale, optimize edge execution, and guide system-level decisions around scheduling, memory orchestration, and power-aware execution and secure execution. This opportunity will accelerate your career growth through strategic leadership and technical innovation, deepen your expertise in machine learning and edge computing, and position you to influence the future of AI integration across Microsoft platforms. The role offers flexible work options, including partial remote work. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Job Responsibility

  • Partners with appropriate stakeholders to determine user requirements for one or more complex scenarios
  • Provides technical leadership for the identification of dependencies and the development of design documents for a product, application, service, or platform
  • Leads by example and mentors others to produce extensible and maintainable code used across the company
  • Leverages deep subject-matter expertise of cross-product features with appropriate stakeholders (e.g., project managers) to lead multiple product's project plans, release plans, and work items
  • Holds accountability as a Designated Responsible Individual (DRI), mentoring engineers across products/solutions, working on call to monitor system/product/service for degradation, downtime, or interruptions
  • Proactively seeks new knowledge and adapts to new trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale and shares knowledge with other engineers

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Proven ability to define long-term ML infrastructure strategy and drive cross-org alignment across engineering, product, and research
  • Hands-on experience working or building robust, ML systems with high reliability, low latency, and seamless platform integration
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Nice to have

  • Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript or Python OR Master's Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Experience architecting ML inference pipelines for LLMs
  • Experience building local model integrations in system or app level components
  • Demonstrated mastery in ML compiler design, hardware-aware optimizations, and scalable infrastructure across heterogeneous platforms

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Ml - Principal Software Engineer

8 matching positions

Senior Software Engineer and Principal Software Engineer - Power Point AI Team

The PowerPoint team is embarking on an exciting new chapter - evolving a product...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 8+ years of experience in backend service engineering, including work on high-scale infrastructures
  • Proficiency in one or more systems programming languages such as C#, C++
  • 1+ years of experience in software engineering, designing and developing systems (and APIs) that deploy and integrate with AI models
  • 2+ years of experience working with rich telemetry, making data driven decisions, and carrying out rapid experimentation
  • 2+ years of experience building software for scale, performance, and reliability
  • Academic or industry experience with building, finetuning, deploying or building eval-driven systems utilizing the models (any category)
Job Responsibility
Job Responsibility
  • Lead design and delivery of complex, scalable AI features ensuring resilience and exceptional user experience
  • Drive technical strategy and architecture decisions across multiple services, influencing partner teams and aligning with compliance and security requirements
  • Champion modern engineering practices, including AI-driven approaches, automation, and cloud-native patterns, across the full development lifecycle
  • Mentor and guide engineers, fostering technical excellence and continuous improvement in security, reliability, and performance
  • Collaborate cross-org to solve challenging technical problems, streamline processes, and reduce operational costs while improving live-site health
  • Design and implement scalable backend services optimized for machine learning workflows and large language model integration
  • Develop and maintain evaluation-driven systems that leverage text and multimodal inputs (e.g., images) to power visual-creation experiences
  • Build and optimize APIs and infrastructure to support high-performance model inference and experimentation at scale
  • Collaborate with product, ML, and design teams to integrate models into user-facing features, ensuring seamless functionality and performance
  • Conduct model evaluations and experiments, analyze results, and iterate on improvements to enhance accuracy and user experience
  • Fulltime
Read More
Arrow Right

Principal ML Engineer, ML Platform Engineering

Xometry is seeking a Principal Machine Learning Engineer to join our core machin...
Location
Location
United States , North Bethesda
Salary
Salary:
140000.00 - 182000.00 USD / Year
cherry.vc Logo
Cherry Ventures
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 7 years of experience in machine learning engineering, software engineering, data science, or similar technical role
  • A bachelor’s degree is required, but an advanced degree (M.S. or PhD) in computer science, machine learning, AI, or a related field is preferred and may substitute for some years of experience
  • Demonstrated experience designing and deploying cloud infrastructure (AWS preferred) to support machine learning, and machine learning models, with considerations for scale, reliability and security
  • Deep understanding of the machine learning lifecycle and related infrastructure needs - feature stores, a/b testing, model registration, drift detection, automated retraining, etc
  • Strong technical expertise. You will need to either have or demonstrate the ability ability to quickly build technical expertise in the following: Software engineering principles, including parallel and distributed computing, version control, reproducibility, and continuous integration
  • Machine learning techniques and algorithms, with emphasis on their impact to infrastructure implementation Including large-scale language and vision models (Transformers, GPT, VLMs, LLMs), deep learning (PyTorch, Tensorflow)
  • Infrastructure as Code (IaC), especially Terraform
  • REST API design and implementation
  • Object oriented and functional programming in Python
  • Multimodal data processing (e.g., combining text, image, and 3D data)
Job Responsibility
Job Responsibility
  • Hands-On Technical Leadership: Adopt a 'lead by example' approach by actively coding and troubleshooting, as well as creating documentation and technical diagrams
  • Teaching & Mentorship: You will serve as a mentor and guide to engineers across the organization, teaching and mentoring them to grow their skills
  • Code Review: You will do code review and mentor others within the organization regarding best practices in ML Engineering
  • Operational Excellence: Guarantee the delivery of superior infrastructure and software that not only meets but exceeds customer expectations, while aligning with the strategic business timelines
  • Collaborative Strategy: Forge strong partnerships with product managers, data scientists, and company leadership to promote a culture of open communication and integrated team dynamics
  • Guide Innovation: Champion the adoption of cutting-edge technologies, methodologies, and practices to enhance problem-solving efficiency and effectiveness across the AI/ML organization.
What we offer
What we offer
  • 401(k) match
  • medical, dental and vision insurance
  • life and disability insurance
  • generous paid time off including vacation, sick leave, floating and fixed holidays, maternity and bonding leave
  • EAP, other wellbeing resources
  • Fulltime
Read More
Arrow Right

Principal Software Engineer

Modern ads platforms run on always-on, real-time data: streaming events, feature...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Electrical/Computer Engineering, or a related field, with 8+ years of related experience
  • Strong programming skills in language C++, C# or Python (at least one required)
  • Hands-on experience in one or more: Building and operating streaming data pipelines in production (Flink or Spark Structured Streaming), Distributed systems engineering with strong reliability and operational rigor, Messaging systems such as Kafka/Pulsar
  • Experience operating services with Kubernetes/containers and production readiness practices (deployments, scaling, rollbacks)
  • Experience with observability stacks such as OpenTelemetry, Prometheus, Grafana
  • Ability to debug complex production issues using logs/metrics/traces and performance profiling
  • Strong communication and collaboration skills, with experience working across engineering, applied science/ML, and product/business stakeholders
Job Responsibility
Job Responsibility
  • Design and implement real-time streaming ETL / feature pipelines (e.g., Flink or Spark Structured Streaming) that meet strict freshness and correctness constraints
  • Build and operate reliable messaging and ingestion with Kafka/Pulsar (partitioning strategy, retries, ordering guarantees, DLQs, backpressure handling)
  • Own data contracts between producers, pipelines, and consumers: schema evolution, versioning, compatibility, validation, and safe rollout
  • Implement production-grade backfill/replay workflows
  • Define and meet SLOs using OpenTelemetry/Prometheus/Grafana for metrics, tracing, dashboards, alerting, and incident response readiness
  • Integrate pipelines with online stores/caches and ML consumers (feature stores, embedding pipelines, LLM API calls, online/offline consistency patterns)
  • Partner with applied scientists on feature/embedding definitions, validation, and end-to-end quality measurement
  • Optimize end-to-end performance and efficiency: CPU/memory/I/O, serialization, caching, network overhead, concurrency, and pipeline compute cost
  • Contribute to serving/inference integrations where needed (e.g., Triton/ONNX Runtime/TensorRT) including batching and latency/cost tradeoffs
  • Ship safely with CI/CD, automated testing (unit/integration/data quality), and operational playbooks/runbooks
  • Fulltime
Read More
Arrow Right

Principal Software Engineer

The Industry Solutions Engineering (ISE) team is a global engineering organizati...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, or related technical discipline AND technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • Experience building or integrating AI/ML or LLM-based solutions, prompt engineering, RAG, fine-tuning
  • Familiarity with deploying and operating AI systems in production environments
  • Understanding of model evaluation, data quality, and performance monitoring
  • Experience using cloud AI platforms (Azure ML, OpenAI, or similar)
  • OR equivalent experience.
Job Responsibility
Job Responsibility
  • Put security first: Build and ship solutions that meet enterprise security standards (threat modeling, secure coding, privacy, and compliance) from design through production
  • Translate business needs into technical solutions: Partner with stakeholders to define problem statements, success metrics, and architectural approaches that deliver measurable outcomes
  • Design and lead architecture: Own end-to-end system design for cloud and AI workloads, making sound tradeoffs across reliability, performance, cost, and maintainability
  • Deliver quickly without sacrificing quality: Use modern engineering practices (CI/CD, automated testing, observability, and progressive delivery) to iterate fast and reduce operational risk
  • Drive customer success and adoption: Work directly with customer engineering teams to deliver production-ready solutions, unblock delivery, and ensure outcomes are adopted at scale
  • Build reusable, scalable assets: Create solution accelerators, reference architectures, and code that can be reused across customers and scenarios to maximize impact
  • Operate effectively in ambiguity: Continuously learn and adapt as technologies and customer priorities evolve
  • bring clarity, structure, and momentum to complex engagements
  • Lead and mentor across disciplines: Provide technical direction, coach engineers, and collaborate with product, data, and security partners to deliver as one team
  • Lead complex delivery end-to-end: Coordinate multiple workstreams, manage dependencies, and raise the bar on reliability and operational excellence for services running in production
What we offer
What we offer
  • Health, wellness, and financial future benefits
  • Fulltime
Read More
Arrow Right

Principal Engineer Software - Developer Experience, Backend (Chronosphere)

Chronosphere, a Palo Alto Networks company, is the observability platform built ...
Location
Location
United States , New York
Salary
Salary:
147000.00 - 237500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience in one or more backend languages (e.g., Go, Java, Python, Rust)
  • Experience using AI coding assistants (e.g., Cursor, Claude) as part of day-to-day software development
  • Experience building and operating highly available systems in production
  • Experience working with cloud infrastructure (AWS, GCP, Azure)
  • Experience designing APIs (REST, gRPC, GraphQL) for scale
  • Experience working effectively with cross functional partners
  • Experience owning and executing projects from inception to delivery
  • Experience working with a high degree of autonomy with good judgement on when to push forward and when to ask for help
  • An effective collaborative working style and willingness to build and maintain a positive and supportive environment
  • An ability to operate effectively in a remote first environment
Job Responsibility
Job Responsibility
  • Directly impact how customers leverage observability for their infrastructure and services architecture
  • Leverage AI infrastructure like LLMs, ML to build innovative capabilities for our customers
  • Design experiences and systems for contextualizing large amounts of telemetry data
  • Help shape the architecture of a rapidly scaling platform
  • Collaborate with deeply technical teammates and customers
  • Improve our own system observability (we use our own product heavily)
  • Improve performance, reliability, and cost efficiency of distributed systems
  • Mentor engineers and help maintain our engineering standards
What we offer
What we offer
  • restricted stock units
  • bonus
  • Fulltime
Read More
Arrow Right

Staff / Principal Software Engineer, Product

TL;DR: We're seeking exceptional senior engineers and technical leaders for our ...
Location
Location
Sweden , Stockholm
Salary
Salary:
Not provided
lovable.dev Logo
Lovable
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience designing, building, and shipping production products, with a track record operating at senior engineering levels
  • Deep experience across the full stack, or strong backend depth - fluent in modern frontend (React/TypeScript) and/or backend (Golang, Rust) development
  • Solid understanding of systems design, performance tradeoffs, and scalable architecture for products serving millions of users
  • Strong product sense and the ability to make well-reasoned technical decisions - knowing when to prioritise speed and when to invest in foundational work
  • You own systems end-to-end: architecture, implementation, deployment, monitoring, and iteration
  • You're comfortable navigating ambiguity and driving clarity at an organisational level, not just technically
  • You're based in Stockholm or ready to relocate — this is an on-site, 5-days-a-week role
Job Responsibility
Job Responsibility
  • Build and scale the systems that power Lovable products, ensuring they're fast, reliable, and ready to support millions of users
  • Implement and maintain features across the stack - frontend, backend, and infrastructure - owning them from architecture through to production
  • Design, implement, and maintain backend services, APIs, and infrastructure components built for scale
  • Collaborate closely with ML, design, and product teams to translate capabilities into intuitive, mind-blowing user experiences
  • Drive the full development lifecycle, from technical planning to production launch and post-release iteration
  • Contribute to shaping our technical direction, engineering culture, and product strategy
  • Fulltime
Read More
Arrow Right

Principal, Software Engineer – GenAI Initiative

Walmart Global Tech is at the forefront of AI innovation, leveraging cutting-edg...
Location
Location
United States , Sunnyvale
Salary
Salary:
143000.00 - 286000.00 USD / Year
walmart.com Logo
Walmart
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Overall 12+ years of experience in machine learning / software engineering, with 2+ years in Generative AI or LLMs
  • Strong experience with RAG frameworks, vector search technologies and knowledge grounding techniques
  • Expertise in Python, ML frameworks (PyTorch, TensorFlow), and libraries like Hugging Face Transformers
  • Proficiency in distributed computing, cloud platforms (GCP, Azure), and scalable architectures
  • Familiarity with disaster recovery principles and building resilient, fault-tolerant systems
  • Experience with multi-modal models (text, image, video) and advanced optimization techniques (e.g., quantization, distillation)
  • Experience with Generative AI models (e.g., GPT, Gemini) and their fine-tuning
  • Contributions to open-source projects or publications in Generative AI, RAG, or agentic frameworks
  • Strong understanding of system design, non-functional requirements, and design patterns
  • Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 5 years' experience in software engineering or related area
Job Responsibility
Job Responsibility
  • Design, fine-tune, and deploy Generative AI models with a focus on RAG frameworks to enhance information retrieval and generation
  • Develop and optimize LLM-based agents for tasks like knowledge grounding, multi-step reasoning, and decision-making
  • Integrate external data sources (e.g., vector databases) with LLMs to build dynamic, context-aware systems
  • Architect scalable, distributed AI systems with a focus on performance, fault tolerance, and disaster recovery
  • Develop detailed design specifications, including modular, extensible, and functional components
  • Build MVPs to validate requirements and refine designs iteratively
  • Partner with product teams to integrate AI into customer-facing applications
  • Work cross-functionally to design solutions that address both functional and non-functional requirements
  • Drive technical direction for large-scale AI initiatives and mentor junior engineers
  • Establish best practices for building and maintaining AI-driven systems
What we offer
What we offer
  • Performance-based bonus awards
  • Medical, vision and dental coverage
  • 401(k), stock purchase and company-paid life insurance
  • PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting
  • Short-term and long-term disability
  • Company discounts
  • Military Leave Pay
  • Adoption and surrogacy expense reimbursement
  • Live Better U education benefit program
  • Annual or quarterly performance bonuses
  • Fulltime
Read More
Arrow Right

Principal Software Engineer

The Windows team is building a Centre of Excellence in Microsoft India, with a b...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.
  • Master's Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python. OR equivalent experience.
  • 6+ years of total experience designing, building and shipping distributed software services for Web applications and cloud services at scale.
  • Experience building products across the full stack using distributed services with modern tech stacks like React, Redis, Kubernetes, Azure or similar.
  • Solid design, coding, debugging, teamwork, partnership, and communication skills.
  • Excellent Technical skills in Driving Design, Architecture with cross product and services dependencies.
  • Ability to Drive Innovation with customer obsession.
  • Expertise in ML concepts and algorithms, along with a deep understanding of LLM usage patterns and agentic frameworks, is required.
  • You must be self-driven, curious to learn, proactive, and result oriented.
Job Responsibility
Job Responsibility
  • Lead teams of high-caliber Software Engineers, ensuring project and development excellence and technical leadership.
  • Influence and align the product vision by collaborating with customers, partners, product management, and engineering teams.
  • Drive the adoption and practical application of AI across both product features and engineering productivity.
  • Deliver high quality results with full ownership and take the product to the next level.
  • Foster a solid culture of engineering excellence, customer focus, collaboration, and diversity and inclusion.
  • Hire and develop the best.
  • Fulltime
Read More
Arrow Right