Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

GitHub discussion is not used anymore, please use the forum for discussion. #15229

Discussion options

Please enjoy the discussion forum at https://discuss.vllm.ai . See you there!

You must be logged in to vote

Replies: 3 comments 2 replies

Comment options

why the change?

You must be logged in to vote
3 replies
Comment options

hmellor Mar 21, 2025
Collaborator

GitHub discussions are not often looked at by users and maintainers.

The hope is that a community will build on the forum, similar to the PyTorch forum, where users can go to ask questions and seek advice about building with vLLM. Then, the GitHub issues will become more focused on building vLLM.

If this goes well, then users will be able to ask and find answers more easily via the forum, and the devs will be able to focus more easily on building vLLM via GitHub. I hope this explanation helps!

Comment options

How is a forum even better? That requires an extra account.

I'm a maintainer in another project, you get notifications when discussions are created.

Comment options

Exactly! I hate people making my life difficult for no sensible reason.

You're not that important in Apr 2025 for me, I'll just use something else that works especially if it's better, is faster and has bigger context length that actually is respected, not some fake extension bs.

Comment options

请教下,nv 的orin 平台能vllm支持吗?

You must be logged in to vote
0 replies
Comment options

One problem with the forum is that RunLLM responds there without a way to switch it off:
https://discuss.vllm.ai/t/vllm-serve-to-use-all-gpus-of-a-single-node-multi-use/1264/4

It does not even listen when explicitly tell it to not respond. And there is no way to downvote its imperfect responses. At least it would be good to have some way to mention in the post, so that RunLLM would abstain from posting in certain threads.

I'd like to have a place for technical discussion with actual humans (as I'm a human myself).

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

AltStyle によって変換されたページ (->オリジナル) /