Q1_0_g128 CPU kernel fix + AVX2 SIMD (fork of PrismML-Eng/llama.cpp)

03ba2cd verified 10 days ago

113 Bytes

This is a swift clone of examples/batched.

$ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]