Skip to content
Back to pull request #6183

Add ability to use Q5_0, Q5_1, and IQ4_NL for quantized K cache #9850

Sign in to view logs

Add ability to use Q5_0, Q5_1, and IQ4_NL for quantized K cache

Add ability to use Q5_0, Q5_1, and IQ4_NL for quantized K cache #9850

ubuntu-focal-make-curl

ubuntu-focal-make-curl
succeeded Mar 20, 2024 in 1m 16s