Truncating TI embeddings #6849
guaneec
started this conversation in
Show and tell
Truncating TI embeddings
#6849
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I had a hypothesis that with wide TI embeddings, only a small part of it recognized by the model. To test this, I made modified copies of an embedding I made that imitates Twitter user kaamin's art style. Here,
kmn-xis an embedding the only keeps the firstxtokens of the original 16-wide embedding. Here are some results:Beta Was this translation helpful? Give feedback.
All reactions