CrawlJobs Logo
Etched Logo Etched · IT - Software Development

Architecture Intern - Inference

United States, San Jose · Job Posted February 18, 2026
Apply Position
Job Link Share

Job Description

We are seeking a talented Architecture intern to join our team and contribute to the design of next-generation AI accelerators. This role focuses on developing and optimizing compute architectures that deliver exceptional performance and efficiency for transformer workloads. You will work on cutting-edge architectural problems and performance modeling over the course of your internship.

Job Responsibility

  • Support porting state-of-the-art models to our architecture
  • Help build programming abstractions and testing capabilities to rapidly iterate on model porting
  • Assist in building, enhancing, and scaling Sohu’s runtime, including multi-node inference, intra-node execution, state management, and robust error handling
  • Contribute to optimizing routing and communication layers using Sohu’s collectives
  • Utilize performance profiling and debugging tools to identify bottlenecks and correctness issues
  • Develop and leverage a deep understanding of Sohu to co-design both HW instructions and model architecture operations to maximize model performance
  • Implement high-performance software components for the Model Toolkit

Requirements

  • Progress towards a Bachelor’s, Master’s, or PhD degree in computer science, computer engineering, or a related field
  • Proficiency in C++ or Rust
  • Understanding of performance-sensitive or complex distributed software systems, e.g. Linux internals, accelerator architectures (e.g. GPUs, TPUs), Compilers, or high-speed interconnects (e.g. NVLink, InfiniBand)
  • Familiarity with PyTorch or JAX
  • Ported applications to non-standard accelerator hardware or hardware platforms
  • Deep knowledge of transformer model architectures and/or inference serving stacks (vLLM, SGLang, etc.)

Nice to have

  • Low-latency, high-performance applications using both kernel-level and user-space networking stacks
  • Deep understanding of distributed systems concepts, algorithms, and challenges, including consensus protocols, consistency models, and communication patterns
  • Solid grasp of Transformer architectures, particularly Mixture-of-Experts (MoE)
  • Built applications with extensive SIMD (Single Instruction, Multiple Data) optimizations for performance-critical paths

What we offer

  • 12-week paid internship
  • Generous housing support for those relocating
  • Daily lunch and dinner in our office
  • Direct mentorship from industry leaders and world-class engineers
  • Opportunity to work on one of the most important problems of our time
Etched - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Architecture Intern - Inference

8 matching positions

Research Intern - AI Inference Architecture

Research Internships at Microsoft provide a dynamic environment for research car...
Location
Location
United States , Redmond
Salary
Salary:
6710.00 - 13270.00 USD / Month
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Currently enrolled in a PhD program in Computer Science, Computer Engineering or a related STEM field
  • At least 1 year of experience working with LLM inference software stack and systems
  • Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship
  • submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples
Job Responsibility
Job Responsibility
  • Research Interns put inquiry and theory into practice
  • learn, collaborate, and network for life
  • contribute to exciting research and development strides
  • paired with mentors and expected to collaborate with other Research Interns and researchers, present findings, and contribute to the vibrant life of the community
  • Fulltime
Read More
Arrow Right

Research Intern - AI Systems & Architecture

Research Internships at Microsoft provide a dynamic environment for research car...
Location
Location
United States , Mountain View
Salary
Salary:
6710.00 - 13270.00 USD / Month
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Currently enrolled in a PhD program in Computer Science, Electrical/Computer Engineering, or a related field
  • Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship
  • submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples
Job Responsibility
Job Responsibility
  • Investigate emerging AI system architectures and analyze how hardware, software, and model behavior interact across large-scale inference workloads
  • Develop and evaluate analytical or simulation-based performance models to identify system bottlenecks, scalability limits, and optimization opportunities
  • Prototype or assess new inference mechanisms, including disaggregated execution, sparse/expert model scaling, and hierarchical attention techniques
  • Explore next-generation accelerator, memory-architecture, and interconnect technologies, assessing their architectural trade-offs and cost implications
  • Conduct experiments, synthesize research findings, and communicate results to mentors and collaborating researchers
  • Collaborate with fellow interns and researchers to advance new ideas in AI systems and architectural design
  • Fulltime
Read More
Arrow Right

Machine Learning Engineer

We are looking for a Machine Learning Engineer to build and support production-r...
Location
Location
United States , Los Angeles
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in machine learning engineering, MLOps, or a closely related technical role
  • Strong proficiency in Python and practical experience building machine learning solutions in production environments
  • Hands-on expertise with Databricks and familiarity with capabilities such as experiment tracking, model governance, workflows, and feature management
  • Experience deploying and maintaining generative AI or large language model applications, including retrieval-based architectures and vector databases
  • Solid understanding of automation, CI/CD practices, and workflow orchestration for data and model pipelines
  • Background working with machine learning frameworks such as TensorFlow and applying AI techniques in real-world business settings
  • Knowledge of model evaluation, monitoring, and governance practices with attention to reliability, compliance, and traceability
Job Responsibility
Job Responsibility
  • Build and maintain scalable machine learning infrastructure in Databricks, including experiment tracking, model management, and serving capabilities for production use
  • Create and improve MLOps frameworks and automated deployment pipelines that support model release, monitoring, and lifecycle management
  • Establish disciplined processes for model version control, retraining, and artifact governance using tools such as Unity Catalog
  • Develop and administer a feature store strategy that keeps training and inference data consistent across machine learning workflows
  • Design retrieval-augmented generation solutions that allow internal teams to search and interact with documents such as fund materials, investor communications, and research content
  • Implement and manage vector search platforms to support semantic retrieval across large collections of enterprise documents
  • Customize and fine-tune large language models using proprietary datasets while protecting data privacy and meeting compliance expectations
  • Build document ingestion and transformation pipelines that handle parsing, segmentation, and embedding creation for generative AI applications
  • Introduce prompt design standards, evaluation methods, and application safeguards to improve response quality, reduce hallucinations, and provide source-backed outputs
  • Automate training, testing, orchestration, and deployment workflows through CI/CD pipelines and tools such as Databricks Workflows, GitHub Actions, Azure DevOps, Airflow, or Prefect
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • Company 401(k) plan
Read More
Arrow Right

Senior Project Engineer

CEC is a privately held engineering firm, serving both public entities and priva...
Location
Location
United States , Norman; Oklahoma City; Tulsa
Salary
Salary:
Not provided
connectcec.com Logo
CEC
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree (B.A. or B.S.) in Structural Engineering, Architectural Engineering (with Structural emphasis), or Civil Engineering (with Structural emphasis) from ABET accredited university
  • Eight or more years of progressive experience in structural engineering
  • Professional Engineer (P.E.) or Structural Engineer (S.E.) license (preferred) required
  • If not licensed in Oklahoma, Texas, and/or Arkansas, must be able to obtain licenses within six months of start date
  • Previous experience with designing and detailing structural systems for building-type structures with demonstrable familiarity the following Structural systems: Reinforced Concrete
  • Structural Steel
  • Concrete Masonry Units (CMU)
  • Demonstrable familiarity with Autodesk Revit
  • Valid driver's license, clean driving record, and ability to drive to meetings and project sites
  • English language skills: ability to read, analyze, and interpret general business periodicals, professional journals, technical procedures, or governmental regulations
Job Responsibility
Job Responsibility
  • Serves as project engineer with autonomy for project-related tasks and as a designated client contact
  • May have project management responsibilities on multiple projects, particularly those with high complexity and/or risk
  • Responsible for successful completion of projects, including schedule, budget, and profitability
  • Develops estimates, pricing, scoping, and marketing strategies for proposed projects
  • Develops feasible engineering design alternatives to meet project requirements
  • Prepares or directs preparation of structural calculations, modeling, analysis, and design
  • Utilizes or oversees use of Revit and other structural-specific design and calculation software to create or assist in the creation of detailed designs for construction documents
  • Prepares or directs preparation of contract documents, including technical reports, studies, plan specifications, construction cost estimates, and permitting for projects
  • Selects and utilizes structural materials appropriate for the project based on coordination with architects, engineers, plans, specifications, and code requirements
  • Reviews construction shop drawings, responds to RFIs, performs site visits, and other Construction Administration activities
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

We are looking for experienced, skilled and innovative Senior Software Engineer ...
Location
Location
India , Pune
Salary
Salary:
Not provided
bentley.com Logo
Bentley Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BE/MS/ME/MTech (Preferably Computer Science & Engineering)
  • 8+ years strong development experience with at least 3 years .Net web frameworks and React coding experience and about 3-4 years in AI/ML based solutions development
  • Must have worked as Developer for web and cloud applications and possess strong knowledge of Software Development Framework
  • Experience and expertise in Generative AI & LLM Systems with good knowledge of LLM tools like OpenAI / Azure OpenAI / Anthropic / open-source LLMs, Lang Chain and Lang Graph, Vector databases: FAISS, Pinecone, Chroma
  • Expert in python with data engineering libraries like NumPy, Pandas
  • Good knowledge of typescript
  • Excellent Problem solving and analytical skills
  • Excellent verbal and written communication skills are required
  • Ability to learn and adapt quickly to maximize productivity
  • Self-motivated person with the ability to work individually and as part of a team
Job Responsibility
Job Responsibility
  • Develop and deploy full stack machine learning, deep learning, and generative AI solutions
  • Apply advanced methods such as ensemble models, representation learning, transfer learning, and retrieval-augmented generation (RAG)
  • Design, build, and optimize LLM-based systems, including assistants, copilots, and automation workflows
  • Understand and apply AI/ML architecture patterns, model selection strategies, and technical standards in coordination with architect/platform team
  • Lead prompt engineering, fine-tuning strategies, embedding pipelines, and retrieval systems
  • Build components of agentic ai solutions like MCP servers, skills, agents
  • Integrate the AI solutions in web applications using nodejs, Reactjs and .Net
  • Collaborate on deployment and monitoring of solutions in cloud environments with performance, security, and cost considerations
  • Should be able to own end-to-end design and implementation of AI enabled cloud systems from problem definition to production deployment
  • Contribute to evaluation of trade-offs across model accuracy, latency, scalability, cost, and maintainability
What we offer
What we offer
  • A great Team and culture
  • An exciting career as an integral part of a world-leading software company
  • An attractive salary and benefits package
  • A commitment to inclusion, belonging and colleague wellbeing through global initiatives and resource groups
  • A company committed to making a real difference by advancing the world’s infrastructure for better quality of life
  • Fulltime
Read More
Arrow Right
New

Senior Applied Scientist

Frontier Tuning is Microsoft’s AI customization platform that enables enterprise...
Location
Location
United Kingdom , Multiple Locations
Salary
Salary:
74700.00 - 122600.00 GBP / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND advanced related experience (e.g., statistics predictive analytics, research)
  • OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND solid related experience (e.g., statistics, predictive analytics, research)
  • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND some related experience (e.g., statistics, predictive analytics, research)
  • OR equivalent experience
  • Experience contributing to research, open‑source systems, or production deployments involving model training or adaptation
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND extensive related experience (e.g., statistics, predictive analytics, research)
  • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND advanced related experience (e.g., statistics, predictive analytics, research)
  • OR equivalent experience
Job Responsibility
Job Responsibility
  • Design and develop methods to adapt foundation models (e.g., language, diffusion, or multimodal models) for enterprise‑specific tasks such as document understanding, workflow automation, or content generation
  • Contribute to one or more aspects of the post-training stack, including: Reinforcement learning or fine-tuning methods
  • Architectural or parameter‑efficient adaptation techniques
  • Inference‑time steering or controllability approaches
  • Tooling for evaluation, debugging, or model development
  • Privacy- or security‑preserving training techniques (e.g., differential privacy)
  • Harnesses
  • Implement and evaluate adaptation approaches under real‑world enterprise deployment constraints such as latency, safety, privacy, policy compliance, and compute efficiency
  • Partner with research and engineering teams to translate product or customer requirements into scalable model adaptation solutions
  • Explore post‑training techniques that improve domain specialization, tool use, planning, or agentic behaviors in enterprise environments
  • Fulltime
Read More
Arrow Right
New

Principal Machine Learning Engineer - Forecasting

We are seeking a Principal Machine Learning Engineer to join the Forecasting tea...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Degree and 12+ years of experience in machine learning engineering, software engineering, data science engineering, or a related quantitative discipline.
  • 10+ years of professional experience building, deploying, and operating production ML, AI, data, or software systems, including significant experience as a technical lead on complex, cross-functional initiatives.
  • Demonstrated track record of designing or architecting new and existing systems with emphasis on reliability, scale, security, maintainability, and operational excellence.
  • Deep hands-on experience with the full ML engineering lifecycle, including data pipelines, feature engineering, experimentation, model training, model integration, testing, deployment, monitoring, evaluation, observability, and continuous improvement.
  • Strong experience deploying forecasting, probabilistic, Bayesian, predictive, NLP, deep learning, or LLM-based systems in production environments.
  • Experience building or integrating AI systems, including LLM-powered applications, agentic workflows, retrieval or information-retrieval systems, evaluation frameworks, and human-in-the-loop review patterns.
  • Strong object-oriented programming skills in Python and SQL, with experience using modern ML and software development frameworks such as scikit-learn, PyTorch, TensorFlow/JAX, Spark, Ray, MLflow, Airflow/Prefect/Dagster, FastAPI, or equivalent technologies.
  • Experience with cloud platforms and distributed systems, including containerization, CI/CD, infrastructure-as-code, model serving, workflow orchestration, batch and streaming data processing, and production support.
  • Strong software engineering fundamentals, including system design, architecture trade-off analysis, testing strategies, code reviews, source control, build and release processes, performance optimization, and maintainability.
  • Demonstrated ability to communicate technical strategy, system tradeoffs, and delivery risks to technical and non-technical stakeholders, including senior leaders, product/program owners, scientists, and business partners.
Job Responsibility
Job Responsibility
  • Define and drive the technical strategy for enterprise forecasting and AI decision systems, aligning architecture, reusable platforms, and delivery roadmaps to Amgen's planning, supply, commercial, manufacturing, operations, and patient-focused priorities.
  • Partner with data scientists, product and program leaders, operations, commercial, manufacturing, supply chain, finance, and other business stakeholders to translate ambiguous requirements into shipped software and measurable business outcomes.
  • Architect, build, and scale production ML, LLM, and agentic AI systems that combine forecasting, predictive analytics, simulation, optimization, and autonomous or semi-autonomous workflow automation.
  • Productionize advanced statistical, Bayesian, deep learning, and machine learning models, including training, validation, inference, serving, evaluation, lifecycle management, and governed deployment.
  • Lead development of AI agent components that automate complex forecasting and operational workflows across multiple systems, decision points, datasets, and user groups while preserving appropriate human-in-the-loop review and escalation patterns.
  • Design secure integrations across enterprise APIs, databases, analytics platforms, workflow systems, cloud services, and AI orchestration patterns to enable multi-system decision support and scalable automation.
  • Establish robust MLOps and AI engineering capabilities, including model versioning, CI/CD, automated retraining, performance monitoring, observability, drift detection, service-level reliability, rollback strategies, and operational runbooks.
  • Implement guardrails, model and agent evaluation frameworks, auditability, explainability, responsible AI controls, and human-in-the-loop operating models for production AI systems in high-impact and regulated business contexts.
  • Research and evaluate state-of-the-art open-source, vendor, and internal tools related to forecasting, LLMs, AI agents, MLOps, model optimization, model serving, and scalable AI infrastructure for potential application to Amgen business problems.
  • Provide principal-level technical mentorship, design review leadership, and engineering standard-setting across teams, promoting code quality, documentation, reproducibility, testing, security, privacy, maintainability, and operational excellence.
  • Fulltime
Read More
Arrow Right

FX STIRT Technology - Senior Software Engineer (SVP)

The STIRT Engineering Lead is a London-based Senior Vice President responsible f...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience in software engineering within capital markets or financial services, with significant hands-on development experience in high-performance, distributed systems
  • Proven hands-on expertise in building low-latency, high-throughput trading systems — capable of writing, reviewing, and debugging production code alongside the team
  • Deep domain knowledge of markets businesses — including Short-Term Interest Rates, FX, or broader FX and Rates/Credit markets — with a strong understanding of curve construction, RFQ/pricing workflows, and electronic trading
  • Proven track record of defining and delivering strategic architecture for large-scale, mission-critical financial platforms, including system modernisation and legacy decommissioning programmes
  • Experience managing and mentoring global engineering teams across multiple time zones
  • Strong background in stakeholder management and trader engagement, with the ability to translate complex technical concepts into business-relevant language
  • Demonstrable experience evaluating, adopting, or delivering AI/ML capabilities within a financial services or trading technology context, including familiarity with model governance and responsible AI practices
  • Strong proficiency in Java — including core Java (JVM internals, concurrency, memory management), modern frameworks (Spring Boot), and experience building low-latency, high-throughput applications
  • Proven system design and architecture skills — including large-scale distributed systems, microservices, event-driven architectures, and real-time data pipelines (e.g., Solace, KDB, in-memory data grids such as Couchbase)
  • Market data and pricing systems — experience with real-time market data feeds, curve construction engines, and pricing libraries
Job Responsibility
Job Responsibility
  • Serve as the primary technology partner for STIRT traders, building trusted relationships and acting as the first point of contact for all technology needs across FX and Rates desks
  • Conduct regular structured engagement sessions with traders to capture workflow pain points, prioritise enhancements, and translate business requirements into actionable engineering deliverables
  • Partner with Desk Heads, Quants, Sales, Operations, and Risk to ensure technology solutions are aligned with front-to-back business objectives
  • Communicate technical strategy, delivery progress, and risk in clear, business-relevant terms to senior stakeholders including Trading Management and Technology leadership
  • Represent STIRT Technology in cross-functional forums, governance committees, and strategic planning sessions
  • Develop and maintain a comprehensive understanding of the full STIRT front-to-back workflow
  • Define and own the target-state technical architecture for the STIRT platform, covering all components from market data ingestion through to trade booking and risk reporting
  • Lead architectural decisions on system decomposition, data flow design, API contracts, event-driven patterns, and integration with upstream/downstream systems
  • Drive the modernisation and consolidation of legacy STIRT systems, establishing a clear migration roadmap that minimises disruption to live trading
  • Evaluate and govern technical trade-offs across build vs. buy, latency vs. throughput, consistency vs. availability, and monolith vs. microservices dimensions
What we offer
What we offer
  • 27 days annual leave (plus bank holidays)
  • A discretional annual performance related bonus
  • Private Medical Care & Life Insurance
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right