Commitd5ccf13

committed

account for empty table in arrow table filter

Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>

1 parent89de17a commitd5ccf13Copy full SHA for d5ccf13

File tree

-0

lines changed

-0

lines changed

Lines changed: 3 additions & 0 deletions

Original file line number	Diff line number	Diff line change
`@@ -116,6 +116,9 @@ def _filter_arrow_table(`
`116`	`116`	`ifnotpyarrow:`
`117`	`117`	`raiseImportError("PyArrow is required for Arrow table filtering")`
`118`	`118`
	`119`	`+iftable.num_rows==0:`
	`120`	`+returntable`
	`121`	`+`
`119`	`122`	`# Convert allowed_values to PyArrow Array for better performance`
`120`	`123`	`allowed_array=pyarrow.array(allowed_values)`
`121`	`124`

Comments

(0)