Z2H Video 2, round 2 [Post #14, Day 30]
February 4, 2025•93 words
PyTorch is a deep learning neural network framework.
Part 1: bigram language modeling, explicit (statistical) approach
- Intro to makemore, "makemore takes one text file as input, where each line is assumed to be one training thing, and generates more things like it"
- Names data set, quick analysis of data set
- Divide up all the bigrams in the names data set and keep counts of them in a dictionary
PyTorch tensor to store bigram counts instead (27 x 27 tensor)
Summary
Part 2: bigram language modeling, neural net approach