[BE] Setup HF cache for vLLM benchmark #140

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

huydhn merged 2 commits into main from huydhn/enable-hf-cache

Jan 31, 2026

+15 −0

Contributor

huydhn commented Jan 28, 2026 •

edited

Loading

The local cache directory is created in https://github.com/meta-pytorch/pytorch-gha-infra/pull/920

Testing


          [BE] Setup HF cache for vLLM benchmark

dbf0ae5

Signed-off-by: Huy Do <huydhn@gmail.com>

meta-cla bot added the cla signed label

huydhn had a problem deploying to pytorch-x-vllm

January 28, 2026 02:33

— with

GitHub Actions Failure

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 09:54

— with

GitHub Actions Inactive

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 11:28

— with

GitHub Actions Inactive

huydhn requested a review from yangw-dev

January 28, 2026 19:31

huydhn had a problem deploying to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Failure

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn had a problem deploying to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Failure

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn had a problem deploying to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Failure

huydhn had a problem deploying to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Failure

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn had a problem deploying to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Failure

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn had a problem deploying to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Failure

huydhn had a problem deploying to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Failure

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn had a problem deploying to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Failure

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn had a problem deploying to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Failure

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn had a problem deploying to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Failure

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn had a problem deploying to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Failure

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn had a problem deploying to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Failure

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn had a problem deploying to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Failure

huydhn temporarily deployed to pytorch-x-vllm

January 28, 2026 21:57

— with

GitHub Actions Inactive

huydhn had a problem deploying to pytorch-x-vllm

January 30, 2026 00:02

— with

GitHub Actions Failure

huydhn had a problem deploying to pytorch-x-vllm

January 30, 2026 00:02

— with

GitHub Actions Failure

huydhn had a problem deploying to pytorch-x-vllm

January 30, 2026 00:02

— with

GitHub Actions Failure

huydhn had a problem deploying to pytorch-x-vllm

January 30, 2026 00:02

— with

GitHub Actions Failure

huydhn had a problem deploying to pytorch-x-vllm

January 30, 2026 00:02

— with

GitHub Actions Failure

huydhn had a problem deploying to pytorch-x-vllm

January 30, 2026 00:02

— with

GitHub Actions Failure

huydhn had a problem deploying to pytorch-x-vllm

January 30, 2026 00:02

— with

GitHub Actions Failure

huydhn had a problem deploying to pytorch-x-vllm

January 30, 2026 00:02

— with

GitHub Actions Failure

huydhn had a problem deploying to pytorch-x-vllm

January 30, 2026 00:02

— with

GitHub Actions Failure

huydhn had a problem deploying to pytorch-x-vllm

January 30, 2026 00:02

— with

GitHub Actions Failure

huydhn had a problem deploying to pytorch-x-vllm

January 30, 2026 00:02

— with

GitHub Actions Failure

huydhn had a problem deploying to pytorch-x-vllm

January 30, 2026 00:02

— with

GitHub Actions Failure

huydhn had a problem deploying to pytorch-x-vllm

January 30, 2026 00:02

— with

GitHub Actions Failure

huydhn temporarily deployed to pytorch-x-vllm

January 30, 2026 02:40

— with

GitHub Actions Inactive

huydhn requested a review from georgehong

January 30, 2026 10:19

huydhn mentioned this pull request

[BE] Add a script to download models from HF and warm up the cache #146

Merged

georgehong approved these changes

View reviewed changes


          Enable offline mode

867b16b

huydhn merged commit 8164ca5 into main

1 check passed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels