Mmojo Server v2 Repo

[BradHutchings]

I originally got started with llama.cpp through llamafile. Well, Mozilla dropped the ball and I needed up-to-date model support, so I rolled my own as a cloned repo of llama.cpp. It was renamed Mmojo Server last spring and kept the spirit of llamafile around for awhile.

I recently did a ground-up rewrite, focusing on providing a great build and deploy instruction framework for llama.cpp. I don't know how else to describe it, but people close to me have been telling me it's just what llama.cpp needs, especially for casual developers. On a fastish Windows machine with WSL, you ought to be able to build an Actual Portable Executable (APE) that runs on x86_64 / aarch64 (arm64) and across all the popular operating systems in a couple hours. The instructions are that good.

There are a couple paths through the instructions. One builds Mmojo Server, which has a completion UI since I strongly believe that chat is an abomination. The other path is called Dogpile and it's not quite so opinionated. Either way, work with the instructions in Github, and clone or download as it instructs you.

I'm a dictator with my repo right now. I don't need help and probably don't need suggestions — for now. Pats on the back and questions are welcome though!

I hope you'll give it a look!

https://github.com/BradHutchings/Mmojo-Server

-Brad