Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor clients and add support for FirecREST v2 #148

Merged
merged 21 commits into from
Jan 22, 2025
Merged

Refactor clients and add support for FirecREST v2 #148

merged 21 commits into from
Jan 22, 2025

Conversation

ekouts
Copy link
Collaborator

@ekouts ekouts commented Jan 20, 2025

No description provided.

ekouts and others added 19 commits October 4, 2024 13:56
Add documentation for API v2
* Async client for FirecREST v2

* Fix log level

* Add status endpoints
* Run unittests for all PRs, not only the ones to main (#131)

* Update AsyncExternalStorage.py

---------

Co-authored-by: rsarm <rafael.sarmiento@cscs.ch>
* Run unittests for all PRs, not only the ones to main (#131)

* add fs endpoints

* fix bugs

* Fix small typos

* Add responses for ls

* Add responses for ls options

* Add tests for /head

* Small fixes and test files in tail

* Small fixes in tail and test file

* Small fixes in async client and checksum test file

* Add file test output

* Add test files for stat

* add more endpoints

* add responses

* Fix rm

* Add rm test

* Fix typo

* Fix simple upload and download

* Rename param

* Update _json_response

* Fix simple upload

---------

Co-authored-by: Eirini Koutsaniti <eirini.koutsaniti@cscs.ch>
Co-authored-by: Eirini Koutsaniti <ekoutsaniti@gmail.com>
* Add submit endpoint

* Fix typo

* Add job info and metadata

* Add job submissions output

* Add cancel and attach to v2 client

* Fix type
* Add better support for transfer jobs in mv/cp/rm

* Fix type

* Add upload method

* Add download method

* Add aiofiles dep

* Pin aiofiles to 23.2.1 to maintain support for python 3.7

* Fix mypy errors

* Fix aiofiles version

* Fix types-aiofiles version
* Add better support for transfer jobs in mv/cp/rm

* Fix type

* Add upload method

* Add download method

* Add aiofiles dep

* Pin aiofiles to 23.2.1 to maintain support for python 3.7

* Fix mypy errors

* Fix aiofiles version

* Fix types-aiofiles version

* Add sync client

* Fix mypy errors

* Add docs for sync client
* Run unittests for all PRs, not only the ones to main (#131)

* add user info endpoint async

* add user info endpoint sync

* add unit tests

* fix json format

* Fix types

---------

Co-authored-by: Eirini Koutsaniti <eirini.koutsaniti@cscs.ch>
Co-authored-by: Eirini Koutsaniti <ekoutsaniti@gmail.com>
* Run unittests for all PRs, not only the ones to main (#131)

* small fixes

* bug fix

* update ls rec resp

---------

Co-authored-by: Eirini Koutsaniti <eirini.koutsaniti@cscs.ch>
* Add extract and compress fucntions to v2

* Fix return types
* Run unittests for all PRs, not only the ones to main (#131)

* add mkdir and symlink

* Small fixes

---------

Co-authored-by: Eirini Koutsaniti <eirini.koutsaniti@cscs.ch>
Co-authored-by: Eirini Koutsaniti <ekoutsaniti@gmail.com>
* Run unittests for all PRs, not only the ones to main (#131)

* submit with path to local file

* fixes

* fixes

---------

Co-authored-by: Eirini Koutsaniti <eirini.koutsaniti@cscs.ch>
Co-authored-by: Eirini Koutsaniti <ekoutsaniti@gmail.com>
* Refactor package

* Fix docs references for v1

* Fix type errors in docs

* Update docs for v2

* Small fix

* fix imports
* Retry in case of 429 in v2

* Fix workflow image

* Small fix in systems method
@ekouts ekouts requested a review from rsarm January 20, 2025 16:39
@ekouts ekouts self-assigned this Jan 20, 2025
@rsarm rsarm changed the title Reactor clients and add support for FirecREST v2 Refactor clients and add support for FirecREST v2 Jan 21, 2025
@ekouts ekouts merged commit ab6ee81 into main Jan 22, 2025
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants