2024-12-05 at 2018 Untitledaksdjfhdas

do we only interpolate? how do we interpolate on ideas how limited are LLMs? bc they do not interpolate on ideas wait but what if they Do interpolate on ideas . like what if with 170B params it actually interpolates on ideas in a similar way as us bc like . we are only trained on our output not our hidden layers (ideas) right ...? i mean sorta but also no. okay but with next word prediction it obviously does not interpolate on an Entire idea (or maybe it is?? and maybe our sentence generation...