2024-12-09 at 1312
December 24, 2024•1 words
tokenization
More from corbinAll posts
2024-12-05 at 2018 Untitledaksdjfhdas
December 24, 2024•63 words
i swear AI research is like a profitable tweaker's hobby.. like sure it's Valuable and you are contributing value to ppl. but like . ppl do it moreso for the prestige and the thrill (or at least me) . and i would feel more of the Contribution Feeling if i was doing smth like . actually personal . at least i think .
...
Read post2024-12-08 at 2220 mimi import
December 24, 2024•517 words
train type 1 w type 2 (as in at the same time, just like how we train the word embedding matrix with the rest of the model), but type 2 is constructed from type 1 tho
one new sorta reason ive thought of that it’s good to train type 1 and type 2 together is . this combined training will also determine how type 2 is constructed from type 1, and otherwise youre setting a sort of demarcation that is probably rly naive, but if u allow the demarcation to happen on its own then it follows how humans l...
Read post