Train 70B Language Model on 2 24GB GPUs

You can now train a 70b language model at home https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html


Posted

in

by

Tags:

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *