Great job, starred! I do have a few questions:

1. Did you test the e2e generation speed, specifically in terms of tokens/second or the latency of the first token?
2. For the W4A4, the speedup is about 1. Could you share the reason behind this, and is there any potential for improvement?
3. For the W4A4, did you compare it with fp16 or bf16?