Commit7166ad6

authored

add open clip to train_config (lucidrains#260)

add the ability to use open_clip in the train configs (useful for the new SOTA h/14 model)

1 parentfbba0f9 commit7166ad6Copy full SHA for 7166ad6

File tree

-0

lines changed

-0

lines changed

Lines changed: 6 additions & 0 deletions

Original file line number	Diff line number	Diff line change
`@@ -4,11 +4,13 @@`
`4`	`4`	`fromtypingimportList,Optional,Union,Tuple,Dict,Any,TypeVar`
`5`	`5`
`6`	`6`	`fromx_clipimportCLIPasXCLIP`
	`7`	`+fromopen_clipimportlist_pretrained`
`7`	`8`	`fromcoca_pytorchimportCoCa`
`8`	`9`
`9`	`10`	`fromdalle2_pytorch.dalle2_pytorchimport (`
`10`	`11`	`CoCaAdapter,`
`11`	`12`	`OpenAIClipAdapter,`
	`13`	`+OpenClipAdapter,`
`12`	`14`	`Unet,`
`13`	`15`	`Decoder,`
`14`	`16`	`DiffusionPrior,`
`@@ -117,6 +119,10 @@ class AdapterConfig(BaseModel):`
`117`	`119`	`defcreate(self):`
`118`	`120`	`ifself.make=="openai":`
`119`	`121`	`returnOpenAIClipAdapter(self.model)`
	`122`	`+elifself.make=="open_clip":`
	`123`	`+pretrained=dict(list_pretrained())`
	`124`	`+checkpoint=pretrained[self.model]`
	`125`	`+returnOpenClipAdapter(name=self.model,pretrained=checkpoint)`
`120`	`126`	`elifself.make=="x-clip":`
`121`	`127`	`returnXClipAdapter(XCLIP(**self.base_model_kwargs))`
`122`	`128`	`elifself.make=="coca":`

Comments

(0)