ggml : AVX2 support for Q4_0_8_8 (#8713)
* Add AVX2 based implementations for quantize_q8_0_4x8, ggml_gemv_q4_0_8x8_q8_0 and ggml_gemm_q4_0_8x8_q8_0 functions * Update code to fix issues occuring due to non alignment of elements to be processed as multiple of 16 in MSVC * Update comments and indentation * Make updates to reduce number of load instructions
S
Srihari-mcw committed
581c305186a0ff93f360346c57e21fe16e967bb7
Parent: 5910ea9
Committed by GitHub <noreply@github.com>
on 9/4/2024, 4:51:22 PM