Caveman Mode Save Token?

16 points
1/21/1970
a day ago
by brightball

Comments


rdevilla

Only two or three weeks from incepting the idea of a token efficient LLM English dialect to seeing it in practice. I just never imagined it to take.... this particular form.....

https://news.ycombinator.com/item?id=47434846

a day ago

gavinray

I've had the thought that English is an efficiency barrier for a while now. Surely there are more information-dense representations of semantic concepts.

Some languages for example have single characters that represent entire ideas/phrases.

https://news.ycombinator.com/item?id=47442478

21 hours ago

downboots

https://en.wikipedia.org/wiki/Le_Taureau

"Everything should be made simple as possible but not simpler"

21 hours ago

[deleted]
21 hours ago

schmorptron

I used a system prompt similar to this, where I just dumped the entirety of https://grugbrain.dev/ into it and prefaced it with the assistant having to emulate grug.

Didn't find it particularly useful, but is is funny!

a day ago

brightball

Can this actually work?

a day ago

illwrks

It does. I've been tinkering with Copilot Studio Agents and you can hit a 8k character limit quickly. By taking your instructions and asking Copilot to compress the information down, while ensuring they are still human readable, you can cut it back to about 5k characters. The information is more dense and functionally the same and the agent is just as consistent as before.

a day ago

pixel_popping

Anything that reduce input/output works to an extent logically.

a day ago

JaceDev

[flagged]

a day ago