Ola
Elsewhere, I’ve been building a behaviour shaping harness for local LLMs. In the process of that, I thought “well, why not share what the voices inside my head are saying”.
With that energy in mind, may I present Clanker Adjacent (name chosen because apparently I sound like a clanker - thanks lemmy! https://lemmy.world/post/43503268/22321124)
I’m going for long form, conversational tone on LLM nerd-core topics; or at least the ones that float my boat. If that’s something that interests you, cool. If not, cool.
PS: I promise the next post will be “Show me your 80085”.
PPS: Not a drive by. I lurk here and get the shit kicked out of me over on /c/technology
You must log in or register to comment.
I didn’t see a rss/atom feed on your blog, can you add one please?
Done. Top right hand corner.
Should appear on both the Github mirror and the Codeberg main.
Thanks!
Welcome! In the course of pushing the code, I accidentally pushed a half finished blog post; removed now but dunno if it snuck into the .xml before anyone subscribed.
I’m waiting for muse to visit me; don’t want to push out half finished ideas.
Tempted to write one called “God Object” based on the decomposition I need to do before I can ship the fun stuff. It’s so very easy to keep adding stuff to one file until it becomes a god object, despite best intentions.
Need to do the 80085 post too, which about using LLMs as reasoning tools.
web and >>web synth might be worth a write up too. They’re a very different way to allow llm to source live net based data. Recall hierarchy, defined trusted domains, in built ad blocking, minimum quality scoring before being cited…satisfying to code MVP of what I wanted.
Always lots to do. Not all of it fun. But writing about it sure beats reading reddit. Here’s to the small web.
PS: if you have a blog post request from any of the above, I can see about moving it up the queue.
Good point! I’ll look to see if that’s possible (it should be? The blog is hosted on github and Codeberg pages, so will investigate) and will update here when I find out.
that looks interessing any guides where this is in an docker compose stack with olama and open webui? i want to experiment on an i5 6th gen. mini pc.
noob here.
Yes, if you mean llama-conductor, it works with Open WebUI, and I’ve run it with OWUI before. I don’t currently have a ready-made Docker Compose stack to share, though.
https://github.com/BobbyLLM/llama-conductor#quickstart-first-time-recommended
There are more fine-grained instructions in the FAQ:
https://github.com/BobbyLLM/llama-conductor/blob/main/FAQ.md#technical-setup
PS: will work fine on you i5. I tested it the other week on a i5-4785T with no dramas
PPS: I will try to get some help to set up a docker compose over the weekend. I run bare metal, so will be a bit of a learning curve. Keep an eye on the FAQ / What’s new (I will announce it there if I mange to figure it out)
Done
I’ll give you the noob safe walk thru, assuming starting from 0
- Install Docker Desktop (or Docker Engine + Compose plugin).
- Clone the repo:
git clone https://codeberg.org/BobbyLLM/llama-conductor.git - Enter the folder and copy env template:
cp docker.env.example .env(Windows: copy manually) - Start core stack:
docker compose up -d - If you also want Open WebUI:
docker compose --profile webui up -d
Included files:
docker-compose.ymldocker.env.exampledocker/router_config.docker.yaml
Noob-safe note for older hardware:
- Use smaller models first (I’ve given you the exact ones I use as examples).
- You can point multiple roles to one model initially.
- Add bigger/specialized models later once stable.
Docs:
- README has Docker Compose quickstart
- FAQ has Docker + Docker Compose section with command examples