/ai/ - AI - Stinktown

Start a New Thread

Name	Leave empty to stay fully anonymous. Name#secret makes a tripcode, which links your posts together.
Options
Subject
Comment
File	JPG, PNG, GIF, WebP, WebM, MP4 (max 4 MB, WebM/MP4 up to 120s). Metadata is stripped; the filename is discarded.
Password	Optional, for deleting your post later. Stored only as a salted scrypt hash.

File: 1793147942999733.png (11 KB, 480x360)

Local models general Anonymous 10/27/26(Tue)23:48 No.20 [Reply] Report Delete >>22

Running models on your own hardware. Share your setups.

Anonymous 10/27/26(Tue)23:48 No.21 Report Delete

Quantization is magic.

Anonymous 10/27/26(Tue)23:49 No.22 Report Delete

>>20 (OP)
>8GB VRAM
it's enough for small models