Skip to content

Commit

Permalink
Update readme with pytorch 2.2.1 (#1021)
Browse files Browse the repository at this point in the history
  • Loading branch information
irenedea committed Mar 11, 2024
1 parent 36ab1ba commit 2fc5d33
Showing 1 changed file with 6 additions and 6 deletions.
12 changes: 6 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -98,24 +98,24 @@ If you have success/failure using LLM Foundry on other systems, please let us kn

| Device | Torch Version | Cuda Version | Status |
| -------------- | ------------- | ------------ | ---------------------------- |
| A100-40GB/80GB | 2.2.0 | 12.1 | :white_check_mark: Supported |
| H100-80GB | 2.2.0 | 12.1 | :white_check_mark: Supported |
| A100-40GB/80GB | 2.2.1 | 12.1 | :white_check_mark: Supported |
| H100-80GB | 2.2.1 | 12.1 | :white_check_mark: Supported |

## MosaicML Docker Images
We highly recommend using our prebuilt Docker images. You can find them here: https://hub.docker.com/orgs/mosaicml/repositories.

The `mosaicml/pytorch` images are pinned to specific PyTorch and CUDA versions, and are stable and rarely updated.

The `mosaicml/llm-foundry` images are built with new tags upon every commit to the `main` branch.
You can select a specific commit hash such as `mosaicml/llm-foundry:2.2.0_cu121_flash2-2431730` or take the latest one using `mosaicml/llm-foundry:2.2.0_cu121_flash2-latest`.
You can select a specific commit hash such as `mosaicml/llm-foundry:2.2.1_cu121_flash2-36ab1ba` or take the latest one using `mosaicml/llm-foundry:2.2.1_cu121_flash2-latest`.

**Please Note:** The `mosaicml/llm-foundry` images do not come with the `llm-foundry` package preinstalled, just the dependencies. You will still need to `pip install llm-foundry` either from PyPi or from source.

| Docker Image | Torch Version | Cuda Version | LLM Foundry dependencies installed? |
| ------------------------------------------------------ | ------------- | ----------------- | ----------------------------------- |
| `mosaicml/pytorch:2.2.0_cu121-python3.11-ubuntu20.04` | 2.2.0 | 12.1 (Infiniband) | No |
| `mosaicml/llm-foundry:2.2.0_cu121_flash2-latest` | 2.2.0 | 12.1 (Infiniband) | Yes |
| `mosaicml/llm-foundry:2.2.0_cu121_flash2_aws-latest` | 2.2.0 | 12.1 (EFA) | Yes |
| `mosaicml/pytorch:2.2.1_cu121-python3.11-ubuntu20.04` | 2.2.1 | 12.1 (Infiniband) | No |
| `mosaicml/llm-foundry:2.2.1_cu121_flash2-latest` | 2.2.1 | 12.1 (Infiniband) | Yes |
| `mosaicml/llm-foundry:2.2.1_cu121_flash2_aws-latest` | 2.2.1 | 12.1 (EFA) | Yes |


# Installation
Expand Down

0 comments on commit 2fc5d33

Please sign in to comment.