2024-12-21 at 21:14
December 24, 2024•25 words
if we want ai to make serendipitously great discoveries we need it to play
and that means we need “useless” ai agents that “waste” compute
More from corbinAll posts
2024-12-21 at 20:55
December 24, 2024•129 words
remember the thing shane said about adding more params just allows us to gradient descent even more instead of hitting a minima and it seems to work rly rly rly well
its rly interesting bc once i was talking w jason and i thought more params = harder to find gradient and less params = rly easy to find gradient
we were comparing Life Happiness vs Tennis, and we made that analogy ... happiness is very hard to make progress on, tennis is very easy to make progress on.. (or at least it seems like ...
Read post2024-12-22 at 00:03
December 24, 2024•260 words
for things like tennis n rock climbing, perhaps the partial derivatives are approximately only dependent on that variable
like, at any point, you can improve any part of your technique and expect a reasonable gain in performance, and it doesn't rly matter what order you do this in, because the improvement from URGH im gonna stop explaining it in english i already understand it . whatever.
a little more formally, let's say you have a cost function C which depends on factors x, y, ...
let's say ...
Read post