Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add thinRuntime #2098

Merged
merged 23 commits into from
Sep 16, 2022
Merged

add thinRuntime #2098

merged 23 commits into from
Sep 16, 2022

Conversation

zwwhdls
Copy link
Member

@zwwhdls zwwhdls commented Aug 28, 2022

Ⅰ. Describe what this PR does

add thinRuntime in order to make general storage easier to integrate fluid
design doc: https://docs.google.com/document/d/1tRNr623891uTS36n071h-iTSIw60c10Jvr27ITMBO5U/edit#heading=h.cnrvl4py38io

Ⅱ. Does this pull request fix one issue?

Ⅲ. List the added test cases (unit test/integration test) if any, please explain if no tests are needed.

Ⅳ. Describe how to verify it

Ⅴ. Special notes for reviews

@codecov
Copy link

codecov bot commented Aug 28, 2022

Codecov Report

Merging #2098 (c33b146) into master (171b52d) will decrease coverage by 1.27%.
The diff coverage is 38.01%.

❗ Current head c33b146 differs from pull request most recent head 3634781. Consider uploading reports for the commit 3634781 to get more accurate results

@@            Coverage Diff             @@
##           master    #2098      +/-   ##
==========================================
- Coverage   52.72%   51.44%   -1.28%     
==========================================
  Files         298      325      +27     
  Lines       21726    23867    +2141     
==========================================
+ Hits        11454    12279     +825     
- Misses       9048    10247    +1199     
- Partials     1224     1341     +117     
Impacted Files Coverage Δ
api/v1alpha1/openapi_generated.go 0.00% <0.00%> (ø)
api/v1alpha1/zz_generated.deepcopy.go 0.00% <0.00%> (ø)
pkg/ddc/thin/master.go 0.00% <0.00%> (ø)
pkg/ddc/thin/master_internal.go 0.00% <0.00%> (ø)
api/v1alpha1/thinruntime_types.go 33.33% <33.33%> (ø)
pkg/ddc/thin/shutdown.go 48.06% <48.06%> (ø)
pkg/ddc/juicefs/transform_resources.go 63.63% <50.00%> (+2.09%) ⬆️
pkg/ddc/thin/metadata.go 51.28% <51.28%> (ø)
pkg/ddc/thin/create_volume.go 53.84% <53.84%> (ø)
pkg/ddc/thin/node.go 54.25% <54.25%> (ø)
... and 23 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


result.Done = true

datasetUFSTotalBytes, err := t.TotalStorageBytes()
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What if no fuse running pod exists, in which case UfsTotal will be calculated wrong(e.g. 0.00B)

Worker ThinCompTemplateSpec `json:"worker,omitempty"`

// The component spec of thinRuntime
Fuse ThinFuseSpec `json:"fuse,omitempty"`
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some storage, for example NFS, does not use Fuse. Maybe it's better to use something like DataClient or PosixClient instead of Fuse?

Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
@cheyang
Copy link
Collaborator

cheyang commented Sep 16, 2022

@zwwhdls Thanks very much for your great contribution to Fluid community.

Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
@cheyang cheyang merged commit 5ae714b into fluid-cloudnative:master Sep 16, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants