Search results

quik.matmul.int8SpMatmul Question

Status: Open.

#15 In IST-DASLab/QUIK;

·yeliang2258 openedon Aug 12, 2024

int8FusedDequantizeCUDA Inference Results are Incorrect

Status: Open.

#14 In IST-DASLab/QUIK;

·zkf331 openedon May 29, 2024

how to build cutlass library only with kernels that used in QUIK?

Status: Open.

#12 In IST-DASLab/QUIK;

·ThisisBillhe openedon Jan 5, 2024

[Question] Does QUIK support muiti-batch inference?

Status: Open.

#11 In IST-DASLab/QUIK;

·hanrui1sensetime openedon Dec 20, 2023

[Question] How to get act_scales of custom llama-like model? How much calibration data items do we need? Need act_zeros simultaneously?

Status: Open.

#10 In IST-DASLab/QUIK;

·hanrui1sensetime openedon Dec 7, 2023