- Notifications
You must be signed in to change notification settings - Fork11.9k
Intuition about project input embedding tokens to queries, keys and values#919
krishnan-duraisamy started this conversation inGeneral
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
-
In Section 3.4.1 we have this definition - These weight matrices are then initialized later to random tensors like so:
|
BetaWas this translation helpful?Give feedback.
All reactions
Replies: 0 comments
Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment