Skip to content

[All Reduce] Change default backend of Flashinfer All Reduce to trtllm - #35793

Merged
robertgshaw2-redhat merged 2 commits into
vllm-project:mainfrom
CentML:ar-default
Mar 2, 2026
Merged

robertgshaw2-redhat merged 2 commits into
vllm-project:mainfrom
CentML:ar-default

Conversation

@hjjq

@hjjq hjjq commented Mar 2, 2026 •

Copy link
Copy Markdown
Contributor

#34109 introduced mnnvl backend and it is the default choice for 'auto' backend.
But it seems to have issues like #35772.
Forcing default backend to 'trtllm' for stability.

Signed-off-by: hjjq <hanjieq@nvidia.com>
@hjjq
hjjq marked this pull request as ready for review March 2, 2026 19:52

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request changes the default backend for Flashinfer All Reduce from 'auto' to 'trtllm' to address stability issues associated with the 'mnnvl' backend. The update is reflected in the default value of the VLLM_FLASHINFER_ALLREDUCE_BACKEND environment variable. The change is straightforward and aligns with the goal of improving system stability. I have reviewed the code and have no further feedback.

@ProExpertProg ProExpertProg left a comment •

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you add a TODO & issue link?

Signed-off-by: hjjq <hanjieq@nvidia.com>
@ProExpertProg
ProExpertProg enabled auto-merge (squash) March 2, 2026 20:05
@github-actions github-actions Bot added the ready ONLY add when PR is ready to merge/full CI is needed label Mar 2, 2026
@robertgshaw2-redhat
robertgshaw2-redhat merged commit 96fc095 into vllm-project:main Mar 2, 2026
48 of 51 checks passed
@hjjq
hjjq deleted the ar-default branch March 3, 2026 14:45
Copilot AI pushed a commit to machov/vllm that referenced this pull request Mar 10, 2026
avinashsingh77 pushed a commit to avinashsingh77/vllm that referenced this pull request Mar 12, 2026
wendyliu235 pushed a commit to wendyliu235/vllm-public that referenced this pull request Mar 18, 2026
mystous pushed a commit to mystous/vllm_hybrid that referenced this pull request May 10, 2026
my-other-github-account pushed a commit to my-other-github-account/vllm that referenced this pull request May 15, 2026
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request May 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants