r/deeplearning•4 mo. agoFront-University4363Running Gemma 4 QAT 12B on an 8GB GPU at 16k context — measured the KV-cache tradeoffsPosted Jun 11, 2026, 2:41 AM UTC10ShareSave