Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TPU Instance Creation #237

Open
zzj0402 opened this issue Aug 22, 2022 · 2 comments
Open

TPU Instance Creation #237

zzj0402 opened this issue Aug 22, 2022 · 2 comments

Comments

@zzj0402
Copy link

zzj0402 commented Aug 22, 2022

Please elaborate on the TPU creation process. Which TPU to use? Which version of the software to use? I am getting not enough space error.

@umm-maybe
Copy link

Is the error you are getting something like this:
"jaxlib.xla_extension.XlaRuntimeError: RESOURCE_EXHAUSTED: Failed to allocate request for 32.00MiB (33554432B) on device ordinal 0: while running replica 0 and partition 0 of a replicated computation (other replicas may have failed as well)."
If so, I have the same problem. It doesn't seem to matter what size dataset I use...

@zzj0402
Copy link
Author

zzj0402 commented Oct 1, 2022

Is the error you are getting something like this: "jaxlib.xla_extension.XlaRuntimeError: RESOURCE_EXHAUSTED: Failed to allocate request for 32.00MiB (33554432B) on device ordinal 0: while running replica 0 and partition 0 of a replicated computation (other replicas may have failed as well)." If so, I have the same problem. It doesn't seem to matter what size dataset I use...

No. I get a dependency installation error. The Google TPU VM cannot install the requirements. I haven't gone that far just yet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants