Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Is "Hierarchical All-to-all" feat available in current version? #6957

Open
GalanPei opened this issue Jan 16, 2025 · 0 comments
Open

Is "Hierarchical All-to-all" feat available in current version? #6957

GalanPei opened this issue Jan 16, 2025 · 0 comments

Comments

@GalanPei
Copy link

GalanPei commented Jan 16, 2025 •
edited
Loading

According to https://arxiv.org/pdf/2201.05596, we are very interested on "Hierarchical All-to-all" and think this is an amazing feature. But after reading source code, we could not find any part related to this. I found that team said that they did not have a ETA for this in #2039, will this be supported in the future?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@GalanPei