Implementation of GPT-2 in pure CMake
Comments
voxelghost
ahartmetz
FWIW, this is most likely not even fast enough to laugh at how slow it is - for that, you need to see something happening in less than an hour or so.
It can only use one core at a time, but that is not the worst thing: CMake is interpreted and stringly typed, so every number will have to be converted string -> number and usually back on every use.
voxelghost
We just need to find a way to extend Moores law into the 4th dimension, and hardware will catch up to this.
ahartmetz
Btw, I just realized that "cannot use all cores" has become a similar performance handicap to "is interpreted". So many cores now!
avilay
Why? Just...why?
I get that sometimes we like to build useless things because they are elegant, or beautiful, or "cool" in some sense of the word. But CMake is not cool in any sense of the word! I can barely use it to write build files, and that too I have gladly offloaded to AI. Sometimes when looking at CMake files in a large project, I become nostalgic about Makefiles, but then I think about what the rewrite would entail, and I resign myself to my fate.
voxelghost
Sometimes these little endevors, are like art, they don't have to mean something, they just has to make you feel something.
Feeling Queasy, is still a feeling, mind you.
Bluestein
This is the best definition of so many things (from "enragement"/engagement) to the entire Drump presidency to, oh, so many things. So, thanks.-
(Also, in a good way, mind: Art for art's sake.-)
OJFord
An exercise in understanding gpt2, flexing the author's cmake skills, while demonstrating the absurd complexity of what it allows similarly to 'c++ templates are turing complete' or 'doom on my calculator'.
da-x
These kind of things have used to be more impressive in the past, when you knew that humans made them.
inoffensivename
To quote April Ludgate: Gross. I love it.
_menelaus
AI is gonna keep us around because it would never think to do this kinda stuff
varun_ch
It might not think to do this but it’ll certainly help do it. The code is full of suspiciously AI code comments and file headers!
https://github.com/AlpinDale/gpt2.cmake/blob/main/cmake/mode...
edg5000
It's surprisingly tiny when you exclude the data
sirsinsalot
A hellscape.
zombot
I wonder when Doom will finally be implemented in pure CMake.
paaloeye
Somebody has more time than sense
pkilgore
disgusting (complementary)
vivzkestrel
good now build GPT 2 using brainfuck
Using python as a build tool, and Cmake as the programming language, now all that is missing is a bit of config in ASM