Enhancing GPTQv2 Format Support in vLLM: Analysis and Implementation
An analysis of GPTQv2 format limitations in vLLM and the CUDA kernel changes needed for low-bit asymmetric quantization inference.
Tagged
Development
All writing filed under this topic.
Cheatsheet for Setting up Android Smartphones
A practical checklist for setting up Android smartphones for development.
Cheatsheet for Setting up Termux on Android Smartphones
A practical checklist for setting up Termux as an Android development environment.
Cheatsheet for Setting up Pi Devices
A practical setup checklist for Raspberry Pi and similar single-board computers.