Commitc18c080

committed

fix for use with larger openai clip models by extracting dimension of last layernorm in clip

1 parentb39653c commitc18c080Copy full SHA for c18c080

File tree

-2

lines changed

-2

lines changed

Lines changed: 4 additions & 1 deletion

Original file line number	Diff line number	Diff line change
`@@ -314,7 +314,10 @@ def __init__(`
`314`	`314`	`self.eos_id=49407# for handling 0 being also '!'`
`315`	`315`
`316`	`316`	`text_attention_final=self.find_layer('ln_final')`
	`317`	`+`
	`318`	`+self.dim_latent_=text_attention_final.weight.shape[0]`
`317`	`319`	`self.handle=text_attention_final.register_forward_hook(self._hook)`
	`320`	`+`
`318`	`321`	`self.clip_normalize=preprocess.transforms[-1]`
`319`	`322`	`self.cleared=False`
`320`	`323`
`@@ -333,7 +336,7 @@ def _hook(self, _, inputs, outputs):`
`333`	`336`
`334`	`337`	`@property`
`335`	`338`	`defdim_latent(self):`
`336`		`-return512`
	`339`	`+returnself.dim_latent_`
`337`	`340`
`338`	`341`	`@property`
`339`	`342`	`defimage_size(self):`

Lines changed: 1 addition & 1 deletion

Comments

(0)