AIcrowd Forum
Did somebody try deploy three llama3-8b on four T4?
Meta Comprehensive RAG Benchmark: KDD Cup 2-9d1937
liberifatali
June 17, 2024, 2:51pm
2
How large is each llama3-8b model? If it is 16GB each, it’s possible.
show post in topic