You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
tustvold
changed the title
bug: executor does not understand the remote storage cost and reads the whole file instead of a chunk
Support CSV Limit Pushdown to Object Storage
Jul 17, 2022
Describe the bug
If you will take a 10 GB file from a S3 remote storage the following request:
will try to read the WHOLE file (10GB) instead of just a first row (chunk).
To Reproduce
Steps to reproduce the behavior:
Expected behavior
It must read only a small chunk that is enough to execute the LIMIT 1 query.
Additional context
The contrib module is fine... It's an engine that requests this epic lenght.
The text was updated successfully, but these errors were encountered: