CrawlJobs Logo

Principal Edge AI Engineer

United States, Newark · Job Posted June 29, 2026
Apply Position
Job Link Share

Job Responsibility

  • Lead the design and development of AI/ML-enabled telemetry pipelines across GPU-enabled embedded and edge systems, enabling real-time analytics and performance optimization
  • Develop software, algorithms, and C++-driven firmware components for AI systems running on embedded GPUs, ARM MCUs, DSPs, and FPGAs
  • Build and deploy deterministic Edge AI pipelines on NVIDIA platforms to support low-latency inference and system-level decisioning
  • Develop and optimize Edge AI applications across Apple (Core ML + Metal) and Android devices (TensorFlow Lite GPU runtime, OpenCL/OpenGL ES)
  • Design and implement end-to-end data pipelines transforming low-level system telemetry (via C++/firmware interfaces) into structured datasets for analytics, ML, and performance tuning
  • Translate GPU, thermal, and workload telemetry into actionable insights, optimization strategies, and automated control mechanisms
  • Partner with firmware, hardware, and platform engineering teams to ensure scalable, high-quality data capture and integration across system layers
  • Define data models, schemas, and interface contracts to enable reliable data ingestion, observability, and AI-driven system intelligence

Requirements

  • 10+ years of experience in AI/ML engineering, data engineering, telemetry systems, or embedded/edge computing environments
  • Strong experience developing AI software, algorithms, and C++-based systems/firmware for embedded platforms (GPUs, ARM MCUs, DSPs, FPGAs)
  • Proven expertise building and optimizing Edge AI solutions across devices (Core ML, Metal, TensorFlow Lite, GPU runtimes)
  • Proficiency in Python for data modeling, pipeline development, and ML-related data processing
  • Strong working expertise in C++ for low-level system integration, firmware interfacing, and performance-sensitive components
  • Experience designing and implementing telemetry pipelines and transforming hardware/firmware signals into structured datasets for analytics or ML
  • Strong understanding of time-series data, signal processing, and real-time system constraints in AI/edge environments
  • Experience analyzing system-level telemetry (GPU utilization, thermals, workload behavior) to drive performance optimization and AI-driven decisioning

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Principal Edge AI Engineer

8 matching positions

Principal Software Engineer - Edge AI

The Edge AI group drives play a major role in Microsoft specialized clouds strat...
Location
Location
Israel , Herzliya
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 10 years of professional software engineering experience, with demonstrated ownership of complex systems
  • Proven expertise in software architecture, system design, and distributed systems
  • Proven ability to lead complex technical initiatives across teams without direct authority
  • 3-5 years of experience with K8S
  • B.Sc. in Computer Science or equivalent
  • High profession level of technical judgment and ability to operate effectively in high-ambiguity environments
  • Ability to write professional, comprehensive technical documents
  • Proven understanding of the AI stack from Hardware to software
  • Relevant experience in corporates
  • Skills to leverage AI in coding, testing, building automation, and day-to-day work
Job Responsibility
Job Responsibility
  • Serves as a senior technical leader and architect within the organization
  • Driving architecture and system design across one or more major product areas or multiple teams
  • Tackling highly ambiguous technical problems and raising the engineering bar through technical leadership and mentorship
  • Leading critical architectural decisions
  • Partnering closely with engineering and product leadership
  • Delivering sustained, high impact technical outcomes
  • Act as AI Thought Leadership and Technical Foresight
  • Serve as a trusted source of technical insight into AI trends, technologies, and architectural patterns relevant to Edge AI
  • Actively track and evaluate developments in AI systems, model architectures, tooling, hardware acceleration, and industry direction
  • Synthesize external and internal signals into clear technical perspectives
  • Fulltime
Read More
Arrow Right

Principal Ai Engineer - Enterprise Ai Solutions

Our Mission: At Palo Alto Networks®, we’re united by a shared mission—to protect...
Location
Location
United States , Santa Clara
Salary
Salary:
185200.00 - 299475.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in a related field or equivalent military experience required
  • 12+ years of related experience, or a Master's degree with 8 years of experience, or a PhD with 5 years of experience
  • Proven expertise in designing and building complex, enterprise-grade AI/ML platforms and applications
  • Direct hands-on experience with Generative AI technologies, including Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and agentic AI systems
  • Strong programming skills in languages such as Python, Java, or Go and proficiency in modern AI/ML frameworks (e.g., TensorFlow, PyTorch)
  • Extensive hands-on experience with distributed systems architecture, streaming data platforms, and cloud AI/ML platforms (e.g., GCP Vertex AI, AWS SageMaker)
Job Responsibility
Job Responsibility
  • Lead the applied AI solution design and architecture, breaking down ambiguous business problems into concrete, actionable AI solution designs
  • Drive the hands-on development and implementation of key AI components, supporting both traditional and Generative AI model development and deployment
  • Contribute significantly to the detailed design of large-scale, distributed AI/ML systems, ensuring performance, reliability, and security
  • Proactively collaborate with executive leadership, data science, engineering, and product stakeholders to translate business use-cases into scalable AI solutions
  • Provide technical leadership and mentorship to other AI/ML engineers, fostering a culture of engineering excellence and hands-on experimentation
  • Lead the implementation and continuous improvement of MLOps pipelines, including automated model training, versioning, deployment, and monitoring
  • Champion and enforce design standards, patterns, and best practices for scalable and secure development of AI applications across various teams
  • Actively research and evaluate cutting-edge AI/ML techniques, algorithms, and models to identify opportunities for platform enhancement and new solution development
What we offer
What we offer
  • Restricted stock units
  • Bonus
  • Fulltime
Read More
Arrow Right

Senior / Principal AI / ML Engineer

Are you passionate about shaping the future of AI-powered products? We are looki...
Location
Location
Salary
Salary:
Not provided
sigma.software Logo
Sigma Software Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • AWS / expert
  • SQL / expert
  • Machine Learning / expert
  • Agentic Programming / expert
  • Spec-driven Development / expert
Job Responsibility
Job Responsibility
  • Lead the standardization and scaling of AI implementation across a cutting-edge platform
What we offer
What we offer
  • Diversity of Domains & Businesses
  • Variety of technology
  • Health & Legal support
  • Active professional community
  • Continuous education and growing
  • Flexible schedule
  • Remote work
  • Outstanding offices (if you choose it)
  • Sports and community activities
Read More
Arrow Right

Principal AI Tooling Engineer

Design and develop testing frameworks for AI/ML models and LLM applications. Bui...
Location
Location
United States , Santa Clara
Salary
Salary:
147000.00 - 237500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, AI, Machine Learning, or related field
  • 8+ years of experience in software engineering, QA automation, or ML engineering
  • Strong programming skills in Python (preferred) or similar languages
  • Experience with testing frameworks (e.g., PyTest, unittest)
  • Familiarity with machine learning concepts and model evaluation techniques
  • Experience working with APIs, distributed systems, and CI/CD pipelines
  • Knowledge of data structures, algorithms, and software design principles
Job Responsibility
Job Responsibility
  • Design and develop testing frameworks for AI/ML models and LLM applications
  • Build automated pipelines for model validation, regression testing, and benchmarking
  • Create evaluation datasets, synthetic data, and test scenarios for edge cases
  • Implement metrics to assess accuracy, robustness, latency, and safety
  • Develop tools for prompt testing, output validation, and hallucination detection
  • Collaborate with engineers, and product teams to define test strategies
  • Monitor model performance in production and build alerting systems
  • Ensure compliance with ethical AI standards, fairness, and bias testing
  • Debug model behavior and identify root causes of failures
What we offer
What we offer
  • restricted stock units
  • bonus
  • employee benefits
  • Fulltime
Read More
Arrow Right

Principal AI Software Engineer, Senior Vice President

Are you looking for a career move that will put you at the heart of a global fin...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Exceptional Python Expertise: Demonstrated mastery of core Python, including advanced features, performance optimization, and a deep understanding of the FastAPI framework
  • Prior hands-on experience with Generative AI, Large Language Model (LLM) frameworks (e.g. LangChain, LlamaIndex), and their application in enterprise environments is a must. This must be underpinned by a profound understanding of core machine learning principles, algorithms, and data science methodologies
  • Full Lifecycle Ownership: Extensive hands-on experience and technical authority throughout the entire software development lifecycle, from conceptualization and design to implementation, deployment, and operational ownership of enterprise software solutions, involving significant cross-functional collaboration
  • Strategic System Design: Significant hands-on experience in architecting and designing (architecture, design patterns, reliability, scaling) highly complex new and current systems with broad technical impact
  • Hands-on expertise with containerized deployment technologies (e.g. Kubernetes, OpenShift, Docker) and orchestration strategies
  • Hands-on experience and in-depth understanding of C++ is a significant bonus, particularly for complex code analysis, parsing, and integration into knowledge graph structures
Job Responsibility
Job Responsibility
  • Architect and implement cutting-edge software systems, defining the technical design for our AI solutions to ensure scalability, performance, and reliability
  • Drive the hands-on design, implementation, and deployment of sophisticated systems that automate the analysis of data, code, and documentation
  • Apply deep expertise to structure extracted knowledge within a Credit Risk Domain-aware knowledge graph, including advanced strategies for effectively modelling complex codebases, particularly C++, within this graph
  • Act as a critical technical partner with data scientists, business analysts, and other engineering teams to translate challenging business requirements into robust technical solutions and ensure successful, high-quality project delivery
  • Tackle the most complex technical challenges within our AI initiatives, providing solutions that set the standard for engineering excellence
What we offer
What we offer
  • Generous holiday allowance starting at 27 days plus bank holidays
  • increasing with tenure
  • A discretional annual performance related bonus
  • Private medical insurance packages to suit your personal circumstances
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right

Principal Generative AI Engineer

We are seeking an exceptional Principal Generative AI Engineer to join our team ...
Location
Location
Canada , Mississauga
Salary
Salary:
145100.00 - 217700.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of progressive professional software engineering experience, with a significant portion dedicated to designing, building, and delivering highly scalable and impactful enterprise-grade solutions in commercial production environments, tackling complex, ambiguous challenges
  • Mastery in Python is non-negotiable, with a profound understanding of its ecosystem for advanced AI/ML development, complex data engineering, and robust backend services
  • Expert-level, hands-on experience with Generative AI concepts, Large Language Models (LLMs), transformer architectures, RAG, and advanced agentic frameworks (e.g., LangChain, LangGraph, Google ADK, Optionally AutoGen, CrewAI, LlamaIndex, Semantic Kernel)
  • Deep and strategic expertise with containerization and orchestration technologies, specifically OpenShift, including leading deployment strategies and troubleshooting complex production issues
  • Demonstrated ability to architect, lead development, and deploy highly performant, large-scale AI/ML systems, defining their long-term technical strategy and ensuring operational excellence
  • Exceptional understanding of modern software development principles, clean code practices, distributed systems, advanced data structures, and algorithms, with the ability to apply them to novel problems
  • Proficiency with Relational (preferably, PostgreSQL) and Vector (preferably, pgvector) databases
  • Bachelor’s degree in Computer Science, Information Technology or Engineering is required
  • a Master's degree is preferred
Job Responsibility
Job Responsibility
  • Define & Lead Architecture: Set the technical vision and architect sophisticated Generative AI applications, LLM-powered solutions, and intricate agentic frameworks
  • Strategize & Pioneer Automation with Agents: Drive the strategic direction for intelligent agent-based automation
  • Establish Containerization Best Practices: Possess expert-level comfort and leadership in container technologies, specifically defining and implementing best practices for deploying and managing mission-critical applications within OpenShift environments
  • Drive Strategic Technical Direction & Ownership: Own and drive critical technical initiatives from conception to production, influencing broad technical strategy and standards across multiple teams and product lines
  • Elevate Engineering Excellence: Act as a key driver for engineering excellence, establishing and upholding rigorous software development best practices
  • Innovate & Shape the Future: Stay at the absolute forefront of Generative AI, actively identifying strategic opportunities, exploring bleeding-edge models, techniques, and frameworks
  • Technical Thought Leadership: Act as a go-to technical expert, providing deep technical leadership, guidance, and mentorship across the organization
  • Overcome Ambiguity & Deliver: Thrive in an agile, fast-paced environment, taking ownership of highly ambiguous and complex problems
  • Lead Responsible AI Implementation: Architect and champion the implementation of robust guardrails, ethical considerations, and responsible AI governance into all solutions
What we offer
What we offer
  • Define the Future & Impact at Scale: Lead critical, high-visibility projects that are transforming a global enterprise
  • Pioneer Cutting-Edge Technology: Drive the adoption and implementation of the latest Generative AI models, advanced agentic frameworks, and cloud-native technologies, amplified by state-of-the-art AI-assisted development tools like Devin and Copilot
  • Exceptional Growth & Technical Leadership: A culture of continuous learning, technical thought leadership, and opportunities to drive significant technical innovation
  • Benefit from extensive learning resources including Udemy for Business and Pluralsight
  • Highly Collaborative & Influential Environment: Join a highly skilled, passionate team where your technical expertise and strategic vision will be highly valued
  • Flexible Work Environment: Embrace a hybrid working model, balancing productive in-office collaboration (3 days) with the flexibility of working from home (up to 2 days)
  • Global Scale & Challenge: Tackle the most complex problems at a massive global scale
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, AI

We are seeking a visionary and hands-on Principal AI Engineer to be the foundati...
Location
Location
India , Delhi
Salary
Salary:
Not provided
alpha-sense.com Logo
AlphaSense
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of professional software engineering experience, with a proven track record of building complex, data-intensive, backend systems
  • Deep expertise (5+ years) in building and scaling production-grade services using modern backend frameworks such as FastAPI, Django, Sanic, Spring Boot or similar
  • Significant, hands-on experience (3+ years) in the complete lifecycle of AI/ML models: from experimentation and prototyping to deploying, monitoring, and iterating on them in a high-volume cloud environment
  • Mastery in designing large-scale distributed systems, demonstrating strong knowledge of asynchronous patterns, streaming/queuing/caching strategies, and robust observability (logging, metrics, tracing)
  • Exceptional communication and leadership skills. You can articulate complex technical concepts to diverse audiences and have the ability to influence engineering direction across multiple teams without direct authority
Job Responsibility
Job Responsibility
  • Spearhead AI Innovation: Act as the chief technical authority on AI, you will research, evaluate, and prototype cutting-edge solutions using Large Language Models (LLMs), Computer Vision, and other machine learning techniques to solve our most complex data extraction challenges
  • Architect for Scale: Design and build robust, highly scalable, and cost-effective AI services and data processing pipelines. Your architecture will be the backbone for processing millions of documents daily with high reliability and throughput
  • Tackle Real-World AI Challenges: Go beyond theory to systematically solve the practical problems of production AI. This includes managing LLM latency and variance, developing sophisticated prompt engineering strategies, and building fault-tolerant, defensive systems that perform consistently
  • Be a Force Multiplier: Act as the key technical mentor and thought leader for our large engineering team and drive some mission-critical initiatives to production
Read More
Arrow Right

Principal Software Engineer, AI

We are seeking a visionary and hands-on Principal AI Engineer to be the foundati...
Location
Location
India , Pune
Salary
Salary:
Not provided
alpha-sense.com Logo
AlphaSense
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of professional software engineering experience, with a proven track record of building complex, data-intensive, backend systems
  • Deep expertise (5+ years) in building and scaling production-grade services using modern backend frameworks such as FastAPI, Django, Sanic, Spring Boot or similar
  • Significant, hands-on experience (3+ years) in the complete lifecycle of AI/ML models: from experimentation and prototyping to deploying, monitoring, and iterating on them in a high-volume cloud environment
  • Mastery in designing large-scale distributed systems, demonstrating strong knowledge of asynchronous patterns, streaming/queuing/caching strategies, and robust observability (logging, metrics, tracing)
  • Exceptional communication and leadership skills. You can articulate complex technical concepts to diverse audiences and have the ability to influence engineering direction across multiple teams without direct authority
Job Responsibility
Job Responsibility
  • Spearhead AI Innovation: Act as the chief technical authority on AI, you will research, evaluate, and prototype cutting-edge solutions using Large Language Models (LLMs), Computer Vision, and other machine learning techniques to solve our most complex data extraction challenges
  • Architect for Scale: Design and build robust, highly scalable, and cost-effective AI services and data processing pipelines. Your architecture will be the backbone for processing millions of documents daily with high reliability and throughput
  • Tackle Real-World AI Challenges: Go beyond theory to systematically solve the practical problems of production AI. This includes managing LLM latency and variance, developing sophisticated prompt engineering strategies, and building fault-tolerant, defensive systems that perform consistently
  • Be a Force Multiplier: Act as the key technical mentor and thought leader for our large engineering team and drive some mission-critical initiatives to production
Read More
Arrow Right