- Notifications
You must be signed in to change notification settings - Fork126
Fix potential resource leak inCloudFetchQueue#624
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.
Already on GitHub?Sign in to your account
Uh oh!
There was an error while loading.Please reload this page.
Conversation
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
…gardless of server side stateSigned-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
samikshya-db left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
Good catch! Thanks for this 🚢
Uh oh!
There was an error while loading.Please reload this page.
jprakash-db left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
LGTM, Thanks for making the changes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
ac4713e tof172f3bCompareUh oh!
There was an error while loading.Please reload this page.
576eafc intomainUh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
What type of PR is this?
Description
The
ResultFileDownloadManagerin theCloudFetchQueueis not shut down alongside theResultSet.The
ResultFileDownloadManageron being requested for a file ensures that the "download queue is always full", i.e. it adds uptomax_download_threadsFutures into_download_tasks. In caseResultSet.close()is invoked after this,_shutdown_manager(defined forResultFileDownloadManager) is NOT called, so these Futures keep executing in the background and the files keep being downloaded.We define a
closefor theCloudFetchQueuethat invokes_shutdown_manager.How is this tested?
Related Tickets & Documents
N/A