Commit9f6b81b

committed

Sample config for training a pokemon LoRA.

1 parent4e2116f commit9f6b81bCopy full SHA for 9f6b81b

File tree

+16

-6

lines changed

+16

-6

lines changed

Lines changed: 16 additions & 6 deletions

Original file line number	Diff line number	Diff line change
`@@ -1,14 +1,24 @@`
	`1`	`+# This is a sample config for training a Pokemon LoRA model.`
	`2`	`+`
`1`	`3`	`# General`
`2`	`4`	`seed:1`
`3`		`-gradient_accumulation_steps:4`
	`5`	`+gradient_accumulation_steps:1`
`4`	`6`	`mixed_precision:fp16`
`5`	`7`	`xformers:True`
`6`	`8`	`gradient_checkpointing:True`
`7`		`-max_train_steps:100`
`8`		`-save_every_n_epochs:null`
`9`		`-save_every_n_steps:5`
`10`		`-max_checkpoints:3`
	`9`	`+max_train_steps:10000`
	`10`	`+save_every_n_epochs:1`
	`11`	`+save_every_n_steps:null`
	`12`	`+max_checkpoints:100`
	`13`	`+validation_prompts:`
	`14`	`+ -yoda`
	`15`	`+ -astronaut`
	`16`	`+ -yoda in a space suit`
	`17`	`+validate_every_n_epochs:1`
`11`	`18`
`12`	`19`	`# Dataset`
`13`	`20`	`dataset_name:lambdalabs/pokemon-blip-captions`
`14`		`-train_batch_size:1`
	`21`	`+train_batch_size:4`
	`22`	`+`
	`23`	`+# Optimizer`
	`24`	`+learning_rate:5.0e-4`

Comments

(0)