AIcrowd Forum
Did somebody try deploy three llama3-8b on four T4?
Meta Comprehensive RAG Benchmark: KDD Cup 2-9d1937
liberifatali
June 18, 2024, 2:04pm
4
There are 4 T4 cards. But I see that the total GPU memory is < 60GB.
show post in topic