Show HN: Foreman, a self-hosted LLM gateway for cost aware model routing
Comments
midtake
TurdF3rguson
Not to mention the George Foreman grill
AndrewLiu96
That was actually one of my naming inspirations, the george foreman grill is a s tier invention
TurdF3rguson
Lol. It's an objectively bad grill.
GuestFAUniverse
Slop(py) coders don't care.
I would vote for the alternative: "Sloppy McSlopGate"
AndrewLiu96
Could you point out where you see the slop in the codebase? I'm more than happy to address it and make the tool better and more useful :)
dilushin
I have something simmilar brewed in my multi-agent system, showing and saving cost data on every agent flow run.
AndrewLiu96
That's awesome! I'd love to check it out and give it a try
anirudhak47
how does it compare to sakana?
AndrewLiu96
I assume you're referencing Sakana Fugu? Similar in the sense that there's multiple models involved, but from what I understand Fugu is kind of a black box in terms of what model is used for what. This project is more deterministic, you can pick and choose which model to assign/use for certain tasks, plus this project is open source which Fugu isn't.
bigtechisajoke
Foreman is too well known imo
AndrewLiu96
Noted!
jsabess24
Nice
AndrewLiu96
Thanks for checking it out!
Name collision with Foreman, the provisioning/patching tool.
https://en.wikipedia.org/wiki/Foreman_(software)