Skip to content

Commit

Permalink
update comments
Browse files Browse the repository at this point in the history
  • Loading branch information
tomogwen committed Feb 29, 2024
1 parent 924e05a commit 07a7068
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion src/litgpt/model.py
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,6 @@
from torch.nn import functional as F

# global hyperparams
# TODO: add these to an args/hparam object
VOCAB_SIZE = 65
N_EMBD = 384 # dimension of token embeddings
N_HEADS = 6 # number of self-attention heads
Expand Down

0 comments on commit 07a7068

Please sign in to comment.