Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PyTorch checkpointing with Tin #4

Open
ifsheldon opened this issue Dec 30, 2021 · 0 comments
Open

PyTorch checkpointing with Tin #4

ifsheldon opened this issue Dec 30, 2021 · 0 comments
Labels
enhancement New feature or request hard hard to implement PyTorch-related Taichi-related welcome_contribution contributions are welcome

Comments

@ifsheldon
Copy link
Owner

Now although Tin is subclass of torch.nn.Module, we cannot actually save parameters and "model structures" in Tin because parameters are values in Taichi fields and "model structures" are actually Taichi kernels and Taichi functions.

To totally serialize a Tin, we need to serialize parameters, which may be achieved by a proxy torch.nn.Parameter (see issue #3 ), but we also need to serialize Taichi kernels and Taichi functions.

If anyone comes up with a better solution, discussions and PRs are always welcomed.

@ifsheldon ifsheldon added enhancement New feature or request Taichi-related PyTorch-related hard hard to implement welcome_contribution contributions are welcome labels Dec 30, 2021
@ifsheldon ifsheldon moved this to Todo in stannum 1.0 Sep 27, 2022
@ifsheldon ifsheldon modified the milestone: v1.0 Sep 27, 2022
@ifsheldon ifsheldon removed this from stannum 1.0 Sep 27, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request hard hard to implement PyTorch-related Taichi-related welcome_contribution contributions are welcome
Projects
None yet
Development

No branches or pull requests

1 participant