LLMs as local offline tools like grep? llamafile combines model + binaries into one single file and it is easy to run as part of your bash script as grep or sed is. https://github.com/mozilla-Ocho/llamafile
Interesting thing is that the same binary runs natively on Linux + Mac + Windows + FreeBSD + OpenBSD + NetBSD + BIOS on AMD64 and ARM64 with the best possible performance. Because of this project: https://justine.lol/cosmopolitan/index.html
#llm #llama #llava #genai #cosmopolitanlibc #cosmopolitan #libc