Skip to content

Conversation

@rraminen
Copy link

@rraminen rraminen commented Mar 1, 2022

To include scripts to run Megatron-LM GPT2 ZeRO2 model on 16 GPUs from ROCm/DeepSpeedExamples#20

@jithunnair-amd jithunnair-amd merged commit 09f8f1f into ROCm:master Mar 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants