Explore AI
Private search over your own files
Ask questions of a folder of PDFs or notes, with nothing leaving your machine.
Ask questions of a folder of PDFs or notes, with nothing leaving your machine.
What we would try first
- BGE-M3 2 GB at Q4 Multilingual, long-context embeddings — the retrieval half of any private document search. Tiny, and does most of the work in a RAG setup.
- Qwen3 8B 8 GB at Q4 The default answer for most people with 16 GB or a 12 GB card. Start here, and only look elsewhere if it fails at something specific.
- Nomic Embed Text v1.5 1 GB at Q4 The lightweight option. Runs alongside your chat model without competing for memory.