A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

AI

Svelte

Serge image

Yo, check it out! Serge is making waves in the AI chat game, and it's doing it with style. This open-source project is bringing the heat with a slick web interface that lets you chat it up with Alpaca using llama.cpp. And get this - it's all wrapped up in a neat little Docker package with an API that's a breeze to use. Let's break it down, shall we? Serge is rocking a SvelteKit frontend that's smooth as butter. For data storage, they've got Redis in the mix, keeping all your chat history and parameters on lock. And when it comes to the backend, they're not messing around. FastAPI and LangChain are teaming up to handle the API, wrapping those llama.cpp calls like a pro. Now, here's where it gets really sweet. Serge supports a whole bunch of models, from the big guns like LLaMA 2 and Mistral, to some niche players like Meditron and PsyMedRP. They've even got Gemma and LLaMA 3 in there. Talk about options! Setting up Serge is a piece of cake. If you're rolling with Docker, it's as simple as running a single command. For the Kubernetes crowd, they've got you covered with setup instructions in the wiki. And if you're on Windows? No sweat, just make sure you've got Docker Desktop and WSL2 good to go. But hold up, there's more! Serge is customizable with environment variables, letting you tweak things like the database URL and session expiry. And for all you devs out there, they've made it super easy to contribute. Just clone the repo, fire up Docker Compose in dev mode, and you're off to the races. So whether you're looking to chat with an AI, experiment with different models, or contribute to a cool open-source project, Serge has got your back. It's free, it's open-source, and it's licensed under MIT and Apache-2.0. What's not to love? Just remember, these language models can be pretty hungry when it comes to memory. Make sure your rig can handle it, or Serge might throw a fit. Ready to dive in? Head over to their GitHub, join their Discord if you need a hand, and let's see what you can do with Serge. It's time to get chatty with some seriously smart AI!

Check out site
Back to all products