SonicBoom – llama.cpp's own kernels, 14% faster decode via a graph compiler

 (github.com)

2 points | by nalaginrut 2 hours ago

0 comments