Show HN: I built a web tool to see and edit what an AI thinks before it answers

33 points
1/21/1970
2 days ago
by ada1981

Comments


krackers

>J-lens beats a plain logit lens on some architectures and does nothing on others, and it isn't about size

The paper talked about this, the jacobian matrix corrects for the shift in basis from initial to final layer compared to logit lens which assumes that the residual remains in the same basis across layers. Maybe the latter is in fact true for some models/architectures so the J-lens doesn't do anything extra?

2 days ago

Planktonne

I think this code be an interesting project, but the generated nature of the site and copy suggests that little thought has been put into it.

a day ago

ada1981

Sorry to disapoint!

I suppose it's relative.

It was essentially 2 days of work using AI to help us get it all together and we were able to release it within 48 hours of the research dropping. It wouldn't have been possible at all without using AI.

a day ago

mune2gu-chan

I love the focus on the pre-answer thinking phase. It feels way more practical than just trying to steer the output with a generic system prompt.

2 days ago

ada1981

Yes I am curious if we will start to see tools that expose this surface more directly or built into the models.

2 days ago

great_psy

At least link the one made by anthropic. Can’t say if this is better or worse since I’m on mobile.

2 days ago

ada1981

I actually just saw the paper not the one they made. Just googled and found it.

There’s is likely better!

https://www.neuronpedia.org/qwen3.6-27b/jlens?shareId=cmr2kx...

2 days ago

ada1981

also from our lab is Personality Bench: https://persona.earthpilot.ai/ which runs every frontier model through personality tests.

2 days ago