Commita11965f

authored

Remove persistent flag from cache buffers (#916)

1 parentc195338 commita11965fCopy full SHA for a11965f

File tree

-3

lines changed

-3

lines changed

Lines changed: 3 additions & 3 deletions

Original file line number	Diff line number	Diff line change
`@@ -55,11 +55,11 @@ To summarize the implementation details, here's a short walkthrough.`
`55`	`55`
`56`	`56`	`###1. Registering the cache buffers`
`57`	`57`
`58`		-Inside the`MultiHeadAttention` constructor we add twonon-persistentbuffers,`cache_k` and`cache_v`, which will hold concatenated keys and values across steps:
	`58`	+Inside the`MultiHeadAttention` constructor we add two buffers,`cache_k` and`cache_v`, which will hold concatenated keys and values across steps:
`59`	`59`
`60`	`60`	```python
`61`		`-self.register_buffer("cache_k",None,persistent=False)`
`62`		`-self.register_buffer("cache_v",None,persistent=False)`
	`61`	`+self.register_buffer("cache_k",None)`
	`62`	`+self.register_buffer("cache_v",None)`
`63`	`63`	```
`64`	`64`
`65`	`65`	` `

Comments

(0)