CrawlJobs Logo

Principal Engineer - Machine Learning & Inference Engineering

https://www.wellsfargo.com/ Logo

Wells Fargo

Location Icon

Location:
United States , Concord ▼

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Employment contract

Salary Icon

Salary:

159000.00 - 305000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

Wells Fargo is seeking a Principal Engineer in the Digital Technology and Innovation group which supports evolving digital platforms and enhances integration of the innovation pipeline into our customer-facing capabilities. The Principal Engineer for Tachyon AI Engineering will lead the design, development, and operationalization of enterprise-scale AI/ML solutions across hybrid environments. This role requires deep technical expertise, strategic vision, and leadership to accelerate predictive and generative AI adoption. The ideal candidate will have experience with AI Compute Environment, Data Engineering, Generative AI, RAG pipelines, and agentic AI systems, and will drive innovation and modernization initiatives, including model migration from on-prem platforms to cloud-native environments

Job Responsibility:

  • Act as an advisor to leadership to develop or influence applications, network, information security, database, operating systems, or web technologies for highly complex business and technical needs across multiple groups
  • Lead the strategy and resolution of highly complex and unique challenges requiring in-depth evaluation across multiple areas or the enterprise, delivering solutions that are long-term, large-scale and require vision, creativity, innovation, advanced analytical and inductive thinking
  • Translate advanced technology experience, an in-depth knowledge of the organizations tactical and strategic business objectives, the enterprise technological environment, the organization structure, and strategic technological opportunities and requirements into technical engineering solutions
  • Provide vision, direction and expertise to leadership on implementing innovative and significant business solutions
  • Maintain knowledge of industry best practices and new technologies and recommends innovations that enhance operations or provide a competitive advantage to the organization
  • Strategically engage with all levels of professionals and managers across the enterprise and serve as an expert advisor to leadership
  • Drive the evolution of the Tachyon Predictive AI Platform on GCP Vertex AI, Azure ML, and On-Prem AIML Platform
  • Architect scalable, secure, and compliant AI/ML infrastructure across hybrid environments
  • Oversee end-to-end ML lifecycle: feature engineering, model development, validation, deployment, and monitoring
  • Implement proactive, event-driven model monitoring and drift detection
  • Lead model migration initiatives from legacy and on-prem systems to cloud-native platforms
  • Ensure smooth transitions with minimal downtime and compliance adherence
  • Drive initiatives for Generative AI and agentic AI integration into workflows
  • Automate governance processes and optimize operational SLAs
  • Partner with data scientists, MLOps engineers, and application teams to deliver AI solutions
  • Act as a trusted advisor to senior leadership on AI strategy and technical decisions
  • Provide technical guidance and mentorship to engineering teams
  • Represent the organization in AI forums and contribute to enterprise AI strategy

Requirements:

  • 7+ years of Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 5+ years of hands-on programming and/or scripting experience in one or more of the following: Python, Java, Shell scripting etc.
  • 5+ years of experience with Infrastructure as code (IaC) implementation using Terraform, Crossplane or any other industry equivalent solutions
  • 5+ years of experience with OpenShift Container Platform and/or Google Cloud Platform, and/or Microsoft Azure hands on experience
  • 5+ years of experience with enterprise-grade automation solutions design and implementation experience using tools such as Ansible, Harness CD, GitHub Actions, Playwright etc.
  • 2+ years of experience with AI, Gen AI, Agentic automation solutions design and development

Nice to have:

  • Excellent communication and stakeholder management skills
  • Demonstrated ability to lead complex projects with limited supervision and high accountability
  • Experience with Generative AI, RAG pipelines, and agentic AI systems
  • Exposure to Google Cloud Platform: Vertex AI / Gemini Enterprise Agent Platform, Agentspace, MCP, A2A exposure
  • Cloud certification
  • AWS, GCP, Azure or Generative AI Leader
  • Deep understanding of LLMs, prompt engineering, vector databases, and orchestration tools
  • Expertise in cloud AI platforms (GCP Vertex AI, Azure ML), On-Prem AIML systems, and MLOps frameworks
  • Strong programming skills (Python, SQL/NoSQL) and experience with ML frameworks (TensorFlow, PyTorch)
  • Proven track record in enterprise-scale AI deployments, model migration projects, and innovation initiatives
  • 2+ years of experience building full stack Agentic AI Automations (from chat experiences to muti-agent systems) using Agentic AI Frameworks like LangGraph, Crew AI, Microsoft AutoGen, LangChain, Chainlit
What we offer:
  • Health benefits
  • 401(k) Plan
  • Paid time off
  • Disability benefits
  • Life insurance, critical illness insurance, and accident insurance
  • Parental leave
  • Critical caregiving leave
  • Discounts and savings
  • Commuter benefits
  • Tuition reimbursement
  • Scholarships for dependent children
  • Adoption reimbursement

Additional Information:

Job Posted:
May 05, 2026

Expiration:
May 12, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Icon
Wells Fargo - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Principal Engineer - Machine Learning & Inference Engineering

Senior / Principal Machine Learning Scientist

Our mission is to restore cell health and resilience through cell rejuvenation t...
Location
Location
United Kingdom , Cambridge
Salary
Salary:
136000.00 - 261050.00 GBP / Year
altoslabs.com Logo
Altos Labs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ph.D. in Machine Learning, Computer Science, Artificial Intelligence, Statistics, or a related quantitative field
  • 6+ years of relevant post-PhD work experience in either an academic or industry setting
  • Proven experience developing and applying complex machine learning models
  • A strong track record of leading and publishing innovative, peer-reviewed research in top-tier ML conferences or high-impact scientific journals
  • Excellent scientific communication skills
  • Expertise in several of the following: deep learning, reinforcement learning, generative models, language models, computer vision, Bayesian inference, causal reasoning & inference, transfer & multi-task learning, graph neural networks, active learning, hybrid mechanistic/ML models
  • Proven experience applying sophisticated ML techniques to molecular and cell biological data sets
Job Responsibility
Job Responsibility
  • Pioneer novel machine learning methodologies and statistical frameworks
  • Contribute to setting the long-term technical vision and research strategy for a core domain within the Institute of Computation
  • Translate your deep understanding of the mathematical and theoretical underpinnings of cutting-edge AI research into high-impact applications
  • Design, implement, and optimize large-scale machine learning systems using modern frameworks and agile practices
  • Develop and manage efficient distributed training strategies across multiple GPUs and compute clusters
  • Develop robust approaches for multi-modal data integration and cross-domain mapping to extract actionable biological insights
  • Apply computational thinking to solve problems in drug target identification, compound assessment, and prediction of cellular perturbation responses
  • Lead the full ML development lifecycle from theoretical conception and data strategy through model development, training, and evaluation
  • Act as a key technical mentor to Machine Learning Scientists and Engineers
  • Fulltime
Read More
Arrow Right

Senior / Principal Machine Learning Scientist

Our mission is to restore cell health and resilience through cell rejuvenation t...
Location
Location
United States , Redwood City; San Diego
Salary
Salary:
260950.00 - 509450.00 USD / Year
altoslabs.com Logo
Altos Labs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ph.D. in Machine Learning, Computer Science, Artificial Intelligence, Statistics, or a related quantitative field
  • 6+ years of relevant post-PhD work experience in either an academic or industry setting
  • Proven experience developing and applying complex machine learning models
  • A strong track record of leading and publishing innovative, peer-reviewed research in top-tier ML conferences or high-impact scientific journals
  • Excellent scientific communication skills
  • Expertise in several of the following: deep learning, reinforcement learning, generative models, language models, computer vision, Bayesian inference, causal reasoning & inference, transfer & multi-task learning, graph neural networks, active learning, hybrid mechanistic/ML models
  • Proven experience applying sophisticated ML techniques to molecular and cell biological data sets
Job Responsibility
Job Responsibility
  • Pioneer novel machine learning methodologies and statistical frameworks
  • Contribute to setting the long-term technical vision and research strategy for a core domain
  • Translate your deep understanding of the mathematical and theoretical underpinnings of cutting-edge AI research into high-impact applications
  • Design, implement, and optimize large-scale machine learning systems
  • Develop and manage efficient distributed training strategies across multiple GPUs and compute clusters
  • Develop robust approaches for multi-modal data integration and cross-domain mapping
  • Apply computational thinking to solve problems in drug target identification, compound assessment, and prediction of cellular perturbation responses
  • Lead the full ML development lifecycle
  • Act as a key technical mentor to Machine Learning Scientists and Engineers
Read More
Arrow Right

Principal Engineer

The Principal AI/ML Operations Engineer leads the architecture, automation, and ...
Location
Location
United States , Pleasanton, California
Salary
Salary:
251000.00 - 314500.00 USD / Year
blackline.com Logo
BlackLine
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field
  • 10+ years in ML infrastructure, DevOps, and software system architecture
  • 4+ years in leading MLOps or AI Ops platforms
  • Strong programming skills in languages such as Python, Java, or Scala
  • Expertise in ML frameworks (TensorFlow, PyTorch, scikit-learn) and orchestration tools (Airflow, Kubeflow, Vertex AI, MLflow)
  • Proven experience operating production pipelines for ML and LLM-based systems across cloud ecosystems (GCP, AWS, Azure)
  • Deep familiarity with LangChain, LangGraph, ADK or similar agentic system runtime management
  • Strong competencies in CI/CD, IaC, and DevSecOps pipelines integrating testing, compliance, and deployment automation
  • Hands-on with observability stacks (Prometheus, Grafana, Newrelic) for model and agent performance tracking
  • Understanding of governance frameworks for Responsible AI, auditability, and cost metering across training and inference workloads
Job Responsibility
Job Responsibility
  • Define enterprise-level standards and reference architectures for ML-Ops and AIOps systems
  • Partner with data science, security, and product teams to set evaluation and governance standards (Guardrails, Bias, Drift, Latency SLAs)
  • Mentor senior engineers and drive design reviews for ML pipelines, model registries, and agentic runtime environments
  • Lead incident response and reliability strategies for ML/AI systems
  • Lead the deployment of AI models and systems in various environments
  • Collaborate with development teams to integrate AI solutions into existing workflows and applications
  • Ensure seamless integration with different platforms and technologies
  • Define and manage MCP Registry for agentic component onboarding, lifecycle versioning, and dependency governance
  • Build CI/CD pipelines automating LLM agent deployment, policy validation, and prompt evaluation of workflows
  • Develop and operationalize experimentation frameworks for agent evaluations, scenario regression, and performance analytics
What we offer
What we offer
  • short-term and long-term incentive programs
  • robust offering of benefit and wellness plans
  • Fulltime
Read More
Arrow Right

Principal AI Engineer

We are looking for a Principal AI Engineer to lead the design and deployment of ...
Location
Location
United States
Salary
Salary:
200000.00 - 300000.00 USD / Year
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of software engineering experience
  • at least 3 years in applied LLM or agentic AI systems (2023–present)
  • proven success in deploying LLM-powered products used by real users at scale
  • deep backend & systems engineering expertise with Python, distributed systems, and scalable APIs
  • familiarity with LangChain, LlamaIndex, or similar orchestration frameworks
  • experience with RAG pipelines, vector DBs, embedding models, and semantic search tuning
  • experience managing performance across cloud providers (e.g., AWS Bedrock, OpenAI, Anthropic, etc.)
  • demonstrated experience building multi-step agents, planning workflows, chaining reasoning steps, and integrating APIs with agent memory/state
  • comfort with advanced prompting strategies, few-shot and chain-of-thought reasoning, and embedding retrieval setups
  • strong understanding of AI system evaluation, human ratings, A/B experimentation, and feedback loop pipelines
Job Responsibility
Job Responsibility
  • Architect and lead the development of multi-agent systems capable of long-horizon planning, reasoning, and API orchestration
  • build reusable agentic components that integrate deeply into sales and marketing processes
  • own and evolve our in-house platform for scalable, low-latency, and cost-efficient LLM and agent deployments
  • lead design of interfaces powered by natural language understanding and retrieval-augmented generation (RAG)
  • build embedding-based, intent-aware search and personalization systems tuned to business user needs
  • drive innovation in personalized outreach generation using context-aware generation pipelines
  • tune inference pipelines, caching layers, and model selection logic for high-scale, cost-aware performance
  • define and drive robust offline and online testing methodologies (A/B, sandboxing, human evals) across agents and LLM flows
  • architect human-in-the-loop systems and telemetry to improve accuracy, UX, and explainability over time
What we offer
What we offer
  • equity
  • company bonus or sales commissions/bonuses
  • 401(k) plan
  • at least 10 paid holidays per year
  • flex PTO
  • parental leave
  • employee assistance program
  • wellbeing benefits
  • global travel coverage
  • life/AD&D/STD/LTD insurance
  • Fulltime
Read More
Arrow Right

Principal Data Scientist

T-Mobile’s Strategy and Corporate Development (S&CD) team is looking for a Princ...
Location
Location
United States , Bellevue; Overland Park
Salary
Salary:
127400.00 - 229800.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Quantitative Discipline (math, statistics, economics, computer science, physics, engineering)
  • Master's/Advanced Degree Quantitative Discipline (math, statistics, economics, computer science, physics, engineering)
  • 7-10 years of industry experience in predictive modeling, data science, and analysis in an ML engineer or data scientist role building and deploying ML models or hands on experience developing deep learning models
  • 7-10 years of Experience articulating and translating business questions and using statistical techniques to arrive at an answer using available data
  • 7-10 years of Experience with data scripting languages (e.g., SQL, Python, R) and Extended experience working with relational database using SQL
  • 4-7 years of Experience writing and speaking about technical concepts to business, technical, and lay audiences and giving data-driven presentations
  • 4-7 years of Experience with statistical methods and advanced modeling techniques. For example- SVM, Random Forest, graph models, Bayesian inference, NLP, Computer Vision, neural networks
  • 4-7 years of Experience with big data architecture and pipeline, Hadoop, Hive, Spark, Kafka, etc
  • 4-7 years of Experience in data visualization
  • 2-4 years Management consulting, investment banking, or corporate strategy
Job Responsibility
Job Responsibility
  • Extract, prepare, and model large, complex data sets using a combination of skills, including machine learning theory, mathematics, statistics, and programming
  • Identify critical and emerging technologies that will support and extend our consumer data, data integration, and quantitative analytic capabilities
  • Lead the implementation, assessment and standardization of advanced analytics and modeling toolkits for our data science team
  • Partner with data engineering teams to shape data management strategies, architecture, governance, pipelines, and infrastructure enabling effective modeling environments for data science teams
  • Provide senior level guidance to the data science and measurement science teams on approach and methodologies
  • Communicate important information and insights to business leaders using verbal, written, and data visualization skills
What we offer
What we offer
  • competitive base salary and compensation package
  • annual stock grant
  • employee stock purchase plan
  • 401(k)
  • access to free, year-round money coaches
  • medical, dental and vision insurance
  • flexible spending account
  • employee stock grants
  • paid time off
  • up to 12 paid holidays
  • Fulltime
Read More
Arrow Right

Principal Data Scientist

The Principal Data Scientist – Media Attribution will lead the development of cu...
Location
Location
United States , Bellevue
Salary
Salary:
127400.00 - 229800.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in marketing and media analytics, with a focus on attribution modeling, causal inference, and media mix optimization
  • Strong background in machine learning, econometrics, and statistical modeling with applications in marketing measurement
  • Expertise in Python, R, SQL, and cloud platforms (AWS, GCP, or Azure) for scalable modeling and data processing
  • Experience with experimental design and incrementality testing in digital and traditional media channels
  • Ability to communicate complex data science concepts to both technical and non-technical stakeholders, influencing business decisions
  • Ph.D. or Master’s degree in a quantitative field (e.g., Statistics, Economics, Computer Science, Applied Mathematics)
Job Responsibility
Job Responsibility
  • Lead the development and refinement of attribution models (MTA, MMM) to quantify the impact of media investments across channels (digital, social, TV, search, etc.)
  • Advance causal inference techniques to improve media measurement, including uplift modeling, propensity scoring, and Bayesian methods
  • Develop forecasting models to predict marketing performance, budget allocation impacts, and long-term customer acquisition trends
  • Enhance ad testing methodologies, including A/B testing, synthetic control experiments, and incrementality testing, to measure media effectiveness accurately
  • Collaborate with marketing, finance, and analytics teams to translate model insights into business strategies that drive ROI improvements
  • Optimize media spend through AI-driven decisioning, leveraging reinforcement learning, Bayesian optimization, and econometric modeling
  • Stay at the forefront of AI & ML innovations in marketing measurement, driving technical advancements and thought leadership within the team
  • Work closely with data engineers to scale and automate model deployment, integrating ML solutions into production environments
What we offer
What we offer
  • medical, dental and vision insurance
  • flexible spending account
  • 401(k)
  • employee stock grants
  • employee stock purchase plan
  • paid time off
  • up to 12 paid holidays
  • paid parental and family leave
  • family building benefits
  • back-up care
  • Fulltime
Read More
Arrow Right

Principal AI Architect

We are seeking an experienced AI Architect to lead the design, implementation, a...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
evoluteiq.com Logo
EvoluteIQ
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of experience in data science, ML engineering and AI system architecture
  • Hands-on experience with Python, TensorFlow, PyTorch, Scikit-learn, spaCy and related AI/ML frameworks
  • Expertise in MLOps tools such as MLflow, Kubeflow, Vertex AI, or SageMaker
  • Proficiency in data processing technologies (Spark, Kafka, Airflow) and data modeling
  • Strong background in deploying models such as APIs or services using Docker, Kubernetes, and REST/gRPC
  • Experience designing data pipelines and integrating AI with production systems
  • Should have an understanding of prompt engineering, LLM fine-tuning, and vector stores (e.g. Pinecone, FAISS, Weaviate)
  • Knowledge of cloud AI services (AWS, GCP, Azure) and distributed computing architectures
  • Proven experience implementing observability for models (drift, accuracy, bias, and performance)
Job Responsibility
Job Responsibility
  • Architect and oversee AI/ML pipelines covering data collection, preparation, training, validation, and inference
  • Define and implement scalable AI infrastructure for training, deployment, and continuous integration (MLOps)
  • Collaborate with data scientists, ML engineers, product manager, and product teams to translate business problems into AI-driven solutions
  • Establish frameworks for model governance, versioning, reproducibility, and explainability
  • Integrate models into production systems ensuring low latency, scalability, and reliability
  • Define data strategy, storage, and access patterns to support AI workloads
  • Build solutions to monitor model performance, drift, and data quality, implementing continuous retraining strategies
  • Ensure compliance with ethical AI, data privacy, and security best practices
  • Mentor AI/ML engineers and contribute to architectural decisions across the AI platform stack
What we offer
What we offer
  • Opportunity to shape the strategy of a next-gen hyper-automation platform
  • Work with a cross-disciplinary team in a fast-growing, innovation-driven environment
  • Competitive compensation and growth opportunities
  • A culture of innovation, ownership, and continuous learning
  • Fulltime
Read More
Arrow Right

Principal Data Scientist

We are seeking a Principal Data Scientist with deep expertise in forecasting and...
Location
Location
United States
Salary
Salary:
Not provided
duettocloud.com Logo
Duetto
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • MS or PhD in Statistics, Econometrics, Computer Science, Operations Research, or a related quantitative field
  • 10+ years of experience delivering impactful data science solutions in production environments
  • Expertise in time series forecasting, including classical methods (e.g., ARIMA, Exponential Smoothing, State Space Models) and deep learning (e.g., RNNs, Temporal Fusion Transformers)
  • Practical experience with Bayesian modeling, including hierarchical models and probabilistic programming (e.g., PyMC3, Stan)
  • Proficiency with ML/DL frameworks (e.g., PyTorch, TensorFlow, scikit-learn, DARTS) and programming languages (Python, R, SQL)
  • Familiarity with cloud platforms and MLOps tools (e.g., AWS SageMaker, MLflow) for scalable model development and deployment
  • Strong communication and presentation skills, capable of conveying complex analytical concepts to non-technical stakeholders
  • Experience designing model evaluation and impact measurement frameworks, including causal inference
Job Responsibility
Job Responsibility
  • Lead the design, development, and deployment of forecasting and pricing models using a blend of classical time series, deep learning and Bayesian statistical techniques
  • Develop hierarchical forecasting frameworks, including multi-level Bayesian models, that scale across thousands of hotel properties
  • Build uncertainty quantification frameworks to increase trust and robustness in forecasts
  • Guide model architecture choices—balancing complexity, interpretability, and operational feasibility
  • Collaborate closely with engineering to deploy and monitor models in production (e.g., using AWS SageMaker)
  • Translate model outputs into actionable insights in partnership with product and business stakeholders
  • Define and execute model performance measurement strategies, including causal inference and uplift modeling
  • Present findings, experimental results, and strategic recommendations to senior leadership
Read More
Arrow Right