Tag: 大模型推理

All the articles with the tag "大模型推理".

• OSDI 2022 - Orca: A Distributed Serving System for Transformer-Based Generative Models

  12 Apr, 2026

  OSDI 2022 Orca 论文阅读笔记，梳理迭代级调度、选择性批处理与生成式模型分布式推理服务的系统设计。

• ICCV 2025 - AdaLLaVA: Learning to Inference Adaptively for Multimodal Large Language Models

  31 Mar, 2026

  由威斯康星大学麦迪逊分校（University of Wisconsin-Madison）、普渡大学（Purdue University）、香港大学（The …

• OSDI 2024 - ServerlessLLM: Low-Latency Serverless Inference for Large Language Models

  9 Sep, 2025

  OSDI 2024 论文阅读笔记：ServerlessLLM — 面向大语言模型的低延迟 Serverless 推理系统。