minus-squarehyperhypervisor@programming.devtoSelfhosted@lemmy.world•Getting Started with Self Hosted LLMlinkfedilinkEnglisharrow-up4·1 year agoOk. I haven’t tried it so I’ll take your word for it. I’m just offering an easier alternative since the topic was “getting started” linkfedilink
minus-squarehyperhypervisor@programming.devtoSelfhosted@lemmy.world•Getting Started with Self Hosted LLMlinkfedilinkEnglisharrow-up5·1 year agoIirc it can run anything llama.cpp can because it just uses that under the hood. linkfedilink
minus-squarehyperhypervisor@programming.devtoSelfhosted@lemmy.world•Getting Started with Self Hosted LLMlinkfedilinkEnglisharrow-up8·1 year agoThere’s also llamafile, super simple: download and run it. linkfedilink
Ok. I haven’t tried it so I’ll take your word for it. I’m just offering an easier alternative since the topic was “getting started”