Tag: OSDI
All the articles with the tag "OSDI".
-
OSDI 2022 - Orca: A Distributed Serving System for Transformer-Based Generative Models
OSDI 2022 Orca 论文阅读笔记,梳理迭代级调度、选择性批处理与生成式模型分布式推理服务的系统设计。
-
OSDI 2018 - Ray: A Distributed Framework for Emerging AI Applications
OSDI 2018 论文阅读笔记:Ray — 面向新兴 AI 应用的分布式计算框架。
-
OSDI 2024 - ServerlessLLM: Low-Latency Serverless Inference for Large Language Models
OSDI 2024 论文阅读笔记:ServerlessLLM — 面向大语言模型的低延迟 Serverless 推理系统。