Commit683dd98

committed

extra insurance in case eos id is not there

1 parent067ac32 commit683dd98Copy full SHA for 683dd98

File tree

-1

lines changed

-1

lines changed

Lines changed: 2 additions & 0 deletions

Original file line number	Diff line number	Diff line change
`@@ -360,6 +360,7 @@ def embed_text(self, text):`
`360`	`360`	`is_eos_id= (text==self.eos_id)`
`361`	`361`	`text_mask_excluding_eos=is_eos_id.cumsum(dim=-1)==0`
`362`	`362`	`text_mask=F.pad(text_mask_excluding_eos, (1,-1),value=True)`
	`363`	`+text_mask=text_mask& (text!=0)`
`363`	`364`	`assertnotself.cleared`
`364`	`365`
`365`	`366`	`text_embed=self.clip.encode_text(text)`
`@@ -434,6 +435,7 @@ def embed_text(self, text):`
`434`	`435`	`is_eos_id= (text==self.eos_id)`
`435`	`436`	`text_mask_excluding_eos=is_eos_id.cumsum(dim=-1)==0`
`436`	`437`	`text_mask=F.pad(text_mask_excluding_eos, (1,-1),value=True)`
	`438`	`+text_mask=text_mask& (text!=0)`
`437`	`439`	`assertnotself.cleared`
`438`	`440`
`439`	`441`	`text_embed=self.clip.encode_text(text)`

Lines changed: 1 addition & 1 deletion

Comments

(0)