Gemma 3 4B IT Quantized

Google has dropped quantization-aware trained versions of Gemma, a technique to bring the performance of the int4 quantized models close to the original model. The 27B version of Gemma only needs 14GB of VRAM instead of the 54GB of the original model.