Which OpenObserve functionalities are relevant/related to the feature request?

No response

Description

Today we have a case:

User search for last 15mins, but it took a lot. we foundwal->parquet->search: get file list files: 0, took 8000 ms

there is no file but took 8 secs?

we found there are over 130k files in local, just there is no file match last 15mins.

Proposed solution

Maybe we can scan files by hour, we know we store the files by hour, if we can simple check files by hours, we don't care how many files in local. just check the latest hour is enough for this case.

Alternatives considered

--