New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Pass over full dataset #5

Open

DenisVorotyntsev opened this issue May 25, 2023 · 1 comment

DenisVorotyntsev commented May 25, 2023 •

edited by polar-sh bot

Loading

In the code the pass over full dataset is required:

Sophia/Sophia/Sophiav2.py

Line 64 in a0ac675

logits = [self.model(xb) for xb in self.input_data]

while in the paper estimation is computed using a mini-batch.

Screenshot 2023-05-25 at 10 25 39

Upvote & Fund

We're using Polar.sh so you can upvote and help fund this issue.
We receive the funding once the issue is completed & confirmed by you.
Thank you in advance for helping prioritize & fund our backlog.

Fund with Polar

Owner

kyegomez commented May 25, 2023

Oh I missed that thanks for letting me know! I've upgraded it now, try upgrading with pip and it should work

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment