Commitc2d69ad

authored

Update extension for cloud streaming use (#1163)

1 parenta3a7a95 commitc2d69adCopy full SHA for c2d69ad

File tree

-1

lines changed

-1

lines changed

Lines changed: 3 additions & 1 deletion

Original file line number	Diff line number	Diff line change
`@@ -312,14 +312,16 @@ def create_pipeline(task):`
`312`	`312`	`returnpipe`
`313`	`313`
`314`	`314`
`315`		`-deftransform_using(pipeline,args,inputs):`
	`315`	`+deftransform_using(pipeline,args,inputs,stream=False):`
`316`	`316`	`args=orjson.loads(args)`
`317`	`317`	`inputs=orjson.loads(inputs)`
`318`	`318`
`319`	`319`	`ifpipeline.task=="question-answering":`
`320`	`320`	`inputs= [orjson.loads(input)forinputininputs]`
`321`	`321`	`convert_eos_token(pipeline.tokenizer,args)`
`322`	`322`
	`323`	`+ifstream:`
	`324`	`+returnpipeline.stream(inputs,**args)`
`323`	`325`	`returnorjson.dumps(pipeline(inputs,**args),default=orjson_default).decode()`
`324`	`326`
`325`	`327`

Comments

(0)