#RAG

My Local AI Model: 8 GB of VRAM, 9 Billion Parameters, Zero Insecurity

How far can you go with a local 9-billion-parameter AI model and just 8 GB of VRAM? Tests, reasoning, RAG, Home Assistant, quantization, and a few surprises.