New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support continuation-token for ListObjectsV2 #112

Closed

roman-khimov opened this issue Jun 28, 2021 · 0 comments · Fixed by #175

Assignees

Member

roman-khimov commented Jun 28, 2021

IIUC continutation-token requires us to save some stable object list on the gateway and return results from it in subsequent requests. Refs. #111.

The text was updated successfully, but these errors were encountered:

roman-khimov mentioned this issue

[#97] List object paging #111

Merged

masterSplinter01 self-assigned this

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: refactor allObjectsParams struct

199c922

Replaced Bucket (means name) by BucketInfo struct

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: refactor allObjectsParams struct

5c02c42

Replaced Bucket (means name) by BucketInfo struct

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: refactor allObjectsParams struct

70250c2

Replaced Bucket (means name) by BucketInfo struct

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: Add cache for ListObjectsV2

4e3025a

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: Add cache for ListObjectsV2

44cdb0e

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api:Add usages of cache in ListObjectsV2

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api,app: Timers for caches

3c4c91f

Add stopTimer and startTimer for caches for ListObjecsV2 to
s3-gw and layer

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: Refactor allObjectsParams struct

f975dbb

Replaced Bucket (means name) by BucketInfo struct

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: Add cache for ListObjectsV2

59f3589

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api:Add usages of cache in ListObjectsV2

9fee36d

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api,app: Timers for caches

c10ab0d

Add stopTimer and startTimer for caches for ListObjecsV2 to
s3-gw and layer

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 mentioned this issue

ListObjectsV2 cache #175

Merged

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] Fix comments from PR

660bffe

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: Refactor allObjectsParams struct

97a7d16

Replaced Bucket (means name) by BucketInfo struct

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: Add cache for ListObjectsV2

c8ffeb6

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api:Add usages of cache in ListObjectsV2

6a163a9

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api,app: Timers for caches

936997c

Add stopTimer and startTimer for caches for ListObjecsV2 to
s3-gw and layer

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] Fix comments from PR

346ae36

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: fix calls of deprecated BoxData

28734cb

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] Fix tests

a7e1b6a

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] Fix comments from PR

016a2f1

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: fix calls of deprecated BoxData

d927c0c

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] Fix tests

da4a2a1

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] Fix comments from PR

93516ae

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: fix calls of deprecated BoxData

0e159a4

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] Fix tests

2b8b94c

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] Fix comments from PR

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: fix calls of deprecated BoxData

9ac39eb

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] Fix tests

a95687e

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: Add start-after to ListObjectsV2

bd39eff

In case when we send a response from a cache

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: Add start-after to ListObjectsV2 cache

d09b399

In case when we send a response from a cache

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: Add start-after to ListObjectsV2 cache

a6500eb

In case when we send a response from a cache

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: Change a way to clean cache

Replaced background Worker by time.StartAfter

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] api: Change a way to clean cache

17b49f7

Replaced background Worker by time.StartAfter

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] Fix comments from PR

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] Fix comments from PR

8702d1e

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] Fix comments from PR

8fde302

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] Fix comments from PR

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] Move getBoxData from handler to layer

c24fe5c

And made it exported

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

masterSplinter01 added a commit to masterSplinter01/neofs-s3-gw that referenced this issue


          [nspcc-dev#112] Add cache to ListObjects and layer

0ceea95

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment