Update llama.py
update n_batch default to 512 to match upstream llama.cpp
E
eiery committed
aa12d8a81f5b2cf6d9b7a037fa69bdec6ca036b1
Parent: e99caed
Committed by GitHub <noreply@github.com>
on 4/24/2023, 12:56:40 AM