Add dawnbench demo #14
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
cheyang
requested changes
Jul 28, 2020
dawnbench/imagenet/runtime.yaml
Outdated
| resources: | ||
| limits: | ||
| cpu: "50" | ||
| memory: "150G" |
There was a problem hiding this comment.
默认cpu和memory的limits设置得比较低，训练较慢，因此直接把上限调整到较高的指。后面会继续精细化调整每种容器的参数
dawnbench/imagenet/runtime.yaml
Outdated
| imageTag: "2.3.0-SNAPSHOT-b7629dc" | ||
| imagePullPolicy: Always | ||
| env: | ||
| MAX_IDLE_THREADS: "64" |
cheyang
requested changes
Jul 28, 2020
docs/dawnbench_cn/README.md
Outdated
|
|
||
| ## 执行测试 | ||
|
|
||
| 根据IO负载压力从高到低划分，有两种不同的dawnbench训练任务，分别是`job-a`和`job-b`。我们使用`arena`简化机器学习任务的部署流程。 |
There was a problem hiding this comment.
- 不用说job-a和job-b
- 可以通过一个链接告诉用户如何安装arena ： https://github.com/kubeflow/arena/releases/tag/v0.5.0
Closed
cheyang
added a commit
that referenced
this pull request
Nov 22, 2021
* Add juicefs runtime (#11) * Add juicefs runtime Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * format --no-update when bucket is none & fix typo & fix test (#12) Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * Add doc (#13) * add juicefs_runtime doc & fix bug * add en doc Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * update juicefs_runtime.md (#14) Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * Add node label after scheduling dataset (#1040) * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Prefer fuse node affinity, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Prefer fuse node affinity, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Prefer fuse node affinity, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * update config Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> Signed-off-by: zwwhdls <zww@hdls.me> * add ut for healthcheck. (#1051) Signed-off-by: LDawns <lsm@smail.nju.edu.cn> Signed-off-by: zwwhdls <zww@hdls.me> * Add mount propagation in node-driver-registrar (#1049) node-driver-registrar will mount kubelet-dir on {{ .Values.csi.kubelet.rootDir }} without 'HostToContainer' or 'Bidirectional'. If another pod mount a temporary device on their volume directory like '${kubelet-dir}/lib/kubelet/pods/xxx/volumes/' which create before node-driver-registrar and delete after node-driver-registrar is created will cause device deconstruction to fail. Signed-off-by: tuji.yyf <tuji.yyf@alibaba-inc.com> Signed-off-by: zwwhdls <zww@hdls.me> * add ut for template_engine.go and metadata.go (#1039) Signed-off-by: littletiger123 <mg20330006@smail.nju.edu.cn> Signed-off-by: zwwhdls <zww@hdls.me> * add master and fuse resource option for jindoruntime (#1046) * implement master and fuse resource option Signed-off-by: frankleaf <frank.wt@alibaba-inc.com> * fix ut Signed-off-by: frankleaf <frank.wt@alibaba-inc.com> Signed-off-by: zwwhdls <zww@hdls.me> * add test case of cert builder (#1042) * add test case of cert Signed-off-by: yangyuliufeng <qlw705706@gmail.com> * prepare the test environment Signed-off-by: yangyuliufeng <qlw705706@gmail.com> Signed-off-by: zwwhdls <zww@hdls.me> * implement SyncScheduleInfoToCacheNodes (#15) Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * Fix ci (#16) * implement SyncScheduleInfoToCacheNodes * fix golangci-lint Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * fix env/port format & adjust import format (#17) Signed-off-by: zwwhdls <zww@hdls.me> * Add test (#18) * add test * update chart Signed-off-by: zwwhdls <zww@hdls.me> * update juicefsruntime unit test (#19) * add jucefsruntime ut * fix test * update juicefsruntime test Signed-off-by: zwwhdls <zww@hdls.me> * fix confluct Signed-off-by: zwwhdls <zww@hdls.me> * add some test (#20) Signed-off-by: zwwhdls <zww@hdls.me> * Fix cache dir (#21) * fix cache dir Signed-off-by: zwwhdls <zww@hdls.me> * update mountpoint & parse option Signed-off-by: zwwhdls <zww@hdls.me> * fix test Signed-off-by: zwwhdls <zww@hdls.me> * fix nodeSelector in fuse Signed-off-by: zwwhdls <zww@hdls.me> * update doc Signed-off-by: zwwhdls <zww@hdls.me> * fix test (#22) Signed-off-by: zwwhdls <zww@hdls.me> * change JuiceFSRuntimeStatus to RuntimeStatus (#23) * change JuiceFSRuntimeStatus to RuntimeStatus Signed-off-by: ldd91 <lvdongdong30@gmail.com> * sync metadata after fuse pod up Signed-off-by: ldd91 <lvdongdong30@gmail.com> * sync metadata after fuse pod up Signed-off-by: ldd91 <lvdongdong30@gmail.com> * update metaurl in encryptOption (#24) --signoff Signed-off-by: zwwhdls <zww@hdls.me> * fix golangci-lint Signed-off-by: zwwhdls <zww@hdls.me> * fix typo Signed-off-by: zwwhdls <zww@hdls.me> * add test in util Signed-off-by: zwwhdls <zww@hdls.me> * add tests & fix Signed-off-by: zwwhdls <zww@hdls.me> * add tests Signed-off-by: zwwhdls <zww@hdls.me> * add tests Signed-off-by: zwwhdls <zww@hdls.me> * disassemble cmd/main.go into several small files. Signed-off-by: zwwhdls <zww@hdls.me> Co-authored-by: ldd91 <lvdongdong30@gmail.com> Co-authored-by: cheyang <cheyang@163.com> Co-authored-by: LDawn <38764512+LDawns@users.noreply.github.com> Co-authored-by: Yifan Yuan <tuji.yyf@alibaba-inc.com> Co-authored-by: littletiger123 <32997459+littletiger123@users.noreply.github.com> Co-authored-by: frankleaf <62129564+frankleaf@users.noreply.github.com> Co-authored-by: yangyuliufeng <30432274+yangyuliufeng@users.noreply.github.com>
Dice21
pushed a commit
to Dice21/fluid
that referenced
this pull request
Nov 22, 2021
* Add juicefs runtime (fluid-cloudnative#11) * Add juicefs runtime Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * format --no-update when bucket is none & fix typo & fix test (fluid-cloudnative#12) Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * Add doc (fluid-cloudnative#13) * add juicefs_runtime doc & fix bug * add en doc Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * update juicefs_runtime.md (fluid-cloudnative#14) Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * Add node label after scheduling dataset (fluid-cloudnative#1040) * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Prefer fuse node affinity, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Prefer fuse node affinity, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Prefer fuse node affinity, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * update config Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> Signed-off-by: zwwhdls <zww@hdls.me> * add ut for healthcheck. (fluid-cloudnative#1051) Signed-off-by: LDawns <lsm@smail.nju.edu.cn> Signed-off-by: zwwhdls <zww@hdls.me> * Add mount propagation in node-driver-registrar (fluid-cloudnative#1049) node-driver-registrar will mount kubelet-dir on {{ .Values.csi.kubelet.rootDir }} without 'HostToContainer' or 'Bidirectional'. If another pod mount a temporary device on their volume directory like '${kubelet-dir}/lib/kubelet/pods/xxx/volumes/' which create before node-driver-registrar and delete after node-driver-registrar is created will cause device deconstruction to fail. Signed-off-by: tuji.yyf <tuji.yyf@alibaba-inc.com> Signed-off-by: zwwhdls <zww@hdls.me> * add ut for template_engine.go and metadata.go (fluid-cloudnative#1039) Signed-off-by: littletiger123 <mg20330006@smail.nju.edu.cn> Signed-off-by: zwwhdls <zww@hdls.me> * add master and fuse resource option for jindoruntime (fluid-cloudnative#1046) * implement master and fuse resource option Signed-off-by: frankleaf <frank.wt@alibaba-inc.com> * fix ut Signed-off-by: frankleaf <frank.wt@alibaba-inc.com> Signed-off-by: zwwhdls <zww@hdls.me> * add test case of cert builder (fluid-cloudnative#1042) * add test case of cert Signed-off-by: yangyuliufeng <qlw705706@gmail.com> * prepare the test environment Signed-off-by: yangyuliufeng <qlw705706@gmail.com> Signed-off-by: zwwhdls <zww@hdls.me> * implement SyncScheduleInfoToCacheNodes (fluid-cloudnative#15) Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * Fix ci (fluid-cloudnative#16) * implement SyncScheduleInfoToCacheNodes * fix golangci-lint Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * fix env/port format & adjust import format (fluid-cloudnative#17) Signed-off-by: zwwhdls <zww@hdls.me> * Add test (fluid-cloudnative#18) * add test * update chart Signed-off-by: zwwhdls <zww@hdls.me> * update juicefsruntime unit test (fluid-cloudnative#19) * add jucefsruntime ut * fix test * update juicefsruntime test Signed-off-by: zwwhdls <zww@hdls.me> * fix confluct Signed-off-by: zwwhdls <zww@hdls.me> * add some test (fluid-cloudnative#20) Signed-off-by: zwwhdls <zww@hdls.me> * Fix cache dir (fluid-cloudnative#21) * fix cache dir Signed-off-by: zwwhdls <zww@hdls.me> * update mountpoint & parse option Signed-off-by: zwwhdls <zww@hdls.me> * fix test Signed-off-by: zwwhdls <zww@hdls.me> * fix nodeSelector in fuse Signed-off-by: zwwhdls <zww@hdls.me> * update doc Signed-off-by: zwwhdls <zww@hdls.me> * fix test (fluid-cloudnative#22) Signed-off-by: zwwhdls <zww@hdls.me> * change JuiceFSRuntimeStatus to RuntimeStatus (fluid-cloudnative#23) * change JuiceFSRuntimeStatus to RuntimeStatus Signed-off-by: ldd91 <lvdongdong30@gmail.com> * sync metadata after fuse pod up Signed-off-by: ldd91 <lvdongdong30@gmail.com> * sync metadata after fuse pod up Signed-off-by: ldd91 <lvdongdong30@gmail.com> * update metaurl in encryptOption (fluid-cloudnative#24) --signoff Signed-off-by: zwwhdls <zww@hdls.me> * fix golangci-lint Signed-off-by: zwwhdls <zww@hdls.me> * fix typo Signed-off-by: zwwhdls <zww@hdls.me> * add test in util Signed-off-by: zwwhdls <zww@hdls.me> * add tests & fix Signed-off-by: zwwhdls <zww@hdls.me> * add tests Signed-off-by: zwwhdls <zww@hdls.me> * add tests Signed-off-by: zwwhdls <zww@hdls.me> * disassemble cmd/main.go into several small files. Signed-off-by: zwwhdls <zww@hdls.me> Co-authored-by: ldd91 <lvdongdong30@gmail.com> Co-authored-by: cheyang <cheyang@163.com> Co-authored-by: LDawn <38764512+LDawns@users.noreply.github.com> Co-authored-by: Yifan Yuan <tuji.yyf@alibaba-inc.com> Co-authored-by: littletiger123 <32997459+littletiger123@users.noreply.github.com> Co-authored-by: frankleaf <62129564+frankleaf@users.noreply.github.com> Co-authored-by: yangyuliufeng <30432274+yangyuliufeng@users.noreply.github.com> Signed-off-by: Dice21 <37772976+Dice21@users.noreply.github.com>
Dice21
pushed a commit
to Dice21/fluid
that referenced
this pull request
Nov 22, 2021
* Add juicefs runtime (fluid-cloudnative#11) * Add juicefs runtime Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * format --no-update when bucket is none & fix typo & fix test (fluid-cloudnative#12) Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * Add doc (fluid-cloudnative#13) * add juicefs_runtime doc & fix bug * add en doc Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * update juicefs_runtime.md (fluid-cloudnative#14) Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * Add node label after scheduling dataset (fluid-cloudnative#1040) * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Prefer fuse node affinity, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Prefer fuse node affinity, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Prefer fuse node affinity, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * update config Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> Signed-off-by: zwwhdls <zww@hdls.me> * add ut for healthcheck. (fluid-cloudnative#1051) Signed-off-by: LDawns <lsm@smail.nju.edu.cn> Signed-off-by: zwwhdls <zww@hdls.me> * Add mount propagation in node-driver-registrar (fluid-cloudnative#1049) node-driver-registrar will mount kubelet-dir on {{ .Values.csi.kubelet.rootDir }} without 'HostToContainer' or 'Bidirectional'. If another pod mount a temporary device on their volume directory like '${kubelet-dir}/lib/kubelet/pods/xxx/volumes/' which create before node-driver-registrar and delete after node-driver-registrar is created will cause device deconstruction to fail. Signed-off-by: tuji.yyf <tuji.yyf@alibaba-inc.com> Signed-off-by: zwwhdls <zww@hdls.me> * add ut for template_engine.go and metadata.go (fluid-cloudnative#1039) Signed-off-by: littletiger123 <mg20330006@smail.nju.edu.cn> Signed-off-by: zwwhdls <zww@hdls.me> * add master and fuse resource option for jindoruntime (fluid-cloudnative#1046) * implement master and fuse resource option Signed-off-by: frankleaf <frank.wt@alibaba-inc.com> * fix ut Signed-off-by: frankleaf <frank.wt@alibaba-inc.com> Signed-off-by: zwwhdls <zww@hdls.me> * add test case of cert builder (fluid-cloudnative#1042) * add test case of cert Signed-off-by: yangyuliufeng <qlw705706@gmail.com> * prepare the test environment Signed-off-by: yangyuliufeng <qlw705706@gmail.com> Signed-off-by: zwwhdls <zww@hdls.me> * implement SyncScheduleInfoToCacheNodes (fluid-cloudnative#15) Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * Fix ci (fluid-cloudnative#16) * implement SyncScheduleInfoToCacheNodes * fix golangci-lint Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * fix env/port format & adjust import format (fluid-cloudnative#17) Signed-off-by: zwwhdls <zww@hdls.me> * Add test (fluid-cloudnative#18) * add test * update chart Signed-off-by: zwwhdls <zww@hdls.me> * update juicefsruntime unit test (fluid-cloudnative#19) * add jucefsruntime ut * fix test * update juicefsruntime test Signed-off-by: zwwhdls <zww@hdls.me> * fix confluct Signed-off-by: zwwhdls <zww@hdls.me> * add some test (fluid-cloudnative#20) Signed-off-by: zwwhdls <zww@hdls.me> * Fix cache dir (fluid-cloudnative#21) * fix cache dir Signed-off-by: zwwhdls <zww@hdls.me> * update mountpoint & parse option Signed-off-by: zwwhdls <zww@hdls.me> * fix test Signed-off-by: zwwhdls <zww@hdls.me> * fix nodeSelector in fuse Signed-off-by: zwwhdls <zww@hdls.me> * update doc Signed-off-by: zwwhdls <zww@hdls.me> * fix test (fluid-cloudnative#22) Signed-off-by: zwwhdls <zww@hdls.me> * change JuiceFSRuntimeStatus to RuntimeStatus (fluid-cloudnative#23) * change JuiceFSRuntimeStatus to RuntimeStatus Signed-off-by: ldd91 <lvdongdong30@gmail.com> * sync metadata after fuse pod up Signed-off-by: ldd91 <lvdongdong30@gmail.com> * sync metadata after fuse pod up Signed-off-by: ldd91 <lvdongdong30@gmail.com> * update metaurl in encryptOption (fluid-cloudnative#24) --signoff Signed-off-by: zwwhdls <zww@hdls.me> * fix golangci-lint Signed-off-by: zwwhdls <zww@hdls.me> * fix typo Signed-off-by: zwwhdls <zww@hdls.me> * add test in util Signed-off-by: zwwhdls <zww@hdls.me> * add tests & fix Signed-off-by: zwwhdls <zww@hdls.me> * add tests Signed-off-by: zwwhdls <zww@hdls.me> * add tests Signed-off-by: zwwhdls <zww@hdls.me> * disassemble cmd/main.go into several small files. Signed-off-by: zwwhdls <zww@hdls.me> Co-authored-by: ldd91 <lvdongdong30@gmail.com> Co-authored-by: cheyang <cheyang@163.com> Co-authored-by: LDawn <38764512+LDawns@users.noreply.github.com> Co-authored-by: Yifan Yuan <tuji.yyf@alibaba-inc.com> Co-authored-by: littletiger123 <32997459+littletiger123@users.noreply.github.com> Co-authored-by: frankleaf <62129564+frankleaf@users.noreply.github.com> Co-authored-by: yangyuliufeng <30432274+yangyuliufeng@users.noreply.github.com> Signed-off-by: Dice21 <37772976+Dice21@users.noreply.github.com>
Dice21
pushed a commit
to Dice21/fluid
that referenced
this pull request
Nov 23, 2021
* Add juicefs runtime (fluid-cloudnative#11) * Add juicefs runtime Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * format --no-update when bucket is none & fix typo & fix test (fluid-cloudnative#12) Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * Add doc (fluid-cloudnative#13) * add juicefs_runtime doc & fix bug * add en doc Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * update juicefs_runtime.md (fluid-cloudnative#14) Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * Add node label after scheduling dataset (fluid-cloudnative#1040) * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Prefer fuse node affinity, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Prefer fuse node affinity, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Prefer fuse node affinity, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Update docker image, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * update config Signed-off-by: cheyang <cheyang@163.com> * Sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> * Test for sync up node labels, To #37253115 Signed-off-by: cheyang <cheyang@163.com> Signed-off-by: zwwhdls <zww@hdls.me> * add ut for healthcheck. (fluid-cloudnative#1051) Signed-off-by: LDawns <lsm@smail.nju.edu.cn> Signed-off-by: zwwhdls <zww@hdls.me> * Add mount propagation in node-driver-registrar (fluid-cloudnative#1049) node-driver-registrar will mount kubelet-dir on {{ .Values.csi.kubelet.rootDir }} without 'HostToContainer' or 'Bidirectional'. If another pod mount a temporary device on their volume directory like '${kubelet-dir}/lib/kubelet/pods/xxx/volumes/' which create before node-driver-registrar and delete after node-driver-registrar is created will cause device deconstruction to fail. Signed-off-by: tuji.yyf <tuji.yyf@alibaba-inc.com> Signed-off-by: zwwhdls <zww@hdls.me> * add ut for template_engine.go and metadata.go (fluid-cloudnative#1039) Signed-off-by: littletiger123 <mg20330006@smail.nju.edu.cn> Signed-off-by: zwwhdls <zww@hdls.me> * add master and fuse resource option for jindoruntime (fluid-cloudnative#1046) * implement master and fuse resource option Signed-off-by: frankleaf <frank.wt@alibaba-inc.com> * fix ut Signed-off-by: frankleaf <frank.wt@alibaba-inc.com> Signed-off-by: zwwhdls <zww@hdls.me> * add test case of cert builder (fluid-cloudnative#1042) * add test case of cert Signed-off-by: yangyuliufeng <qlw705706@gmail.com> * prepare the test environment Signed-off-by: yangyuliufeng <qlw705706@gmail.com> Signed-off-by: zwwhdls <zww@hdls.me> * implement SyncScheduleInfoToCacheNodes (fluid-cloudnative#15) Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * Fix ci (fluid-cloudnative#16) * implement SyncScheduleInfoToCacheNodes * fix golangci-lint Signed-off-by: zwwhdls <weiwei.zhu@juicefs.io> Signed-off-by: zwwhdls <zww@hdls.me> * fix env/port format & adjust import format (fluid-cloudnative#17) Signed-off-by: zwwhdls <zww@hdls.me> * Add test (fluid-cloudnative#18) * add test * update chart Signed-off-by: zwwhdls <zww@hdls.me> * update juicefsruntime unit test (fluid-cloudnative#19) * add jucefsruntime ut * fix test * update juicefsruntime test Signed-off-by: zwwhdls <zww@hdls.me> * fix confluct Signed-off-by: zwwhdls <zww@hdls.me> * add some test (fluid-cloudnative#20) Signed-off-by: zwwhdls <zww@hdls.me> * Fix cache dir (fluid-cloudnative#21) * fix cache dir Signed-off-by: zwwhdls <zww@hdls.me> * update mountpoint & parse option Signed-off-by: zwwhdls <zww@hdls.me> * fix test Signed-off-by: zwwhdls <zww@hdls.me> * fix nodeSelector in fuse Signed-off-by: zwwhdls <zww@hdls.me> * update doc Signed-off-by: zwwhdls <zww@hdls.me> * fix test (fluid-cloudnative#22) Signed-off-by: zwwhdls <zww@hdls.me> * change JuiceFSRuntimeStatus to RuntimeStatus (fluid-cloudnative#23) * change JuiceFSRuntimeStatus to RuntimeStatus Signed-off-by: ldd91 <lvdongdong30@gmail.com> * sync metadata after fuse pod up Signed-off-by: ldd91 <lvdongdong30@gmail.com> * sync metadata after fuse pod up Signed-off-by: ldd91 <lvdongdong30@gmail.com> * update metaurl in encryptOption (fluid-cloudnative#24) --signoff Signed-off-by: zwwhdls <zww@hdls.me> * fix golangci-lint Signed-off-by: zwwhdls <zww@hdls.me> * fix typo Signed-off-by: zwwhdls <zww@hdls.me> * add test in util Signed-off-by: zwwhdls <zww@hdls.me> * add tests & fix Signed-off-by: zwwhdls <zww@hdls.me> * add tests Signed-off-by: zwwhdls <zww@hdls.me> * add tests Signed-off-by: zwwhdls <zww@hdls.me> * disassemble cmd/main.go into several small files. Signed-off-by: zwwhdls <zww@hdls.me> Co-authored-by: ldd91 <lvdongdong30@gmail.com> Co-authored-by: cheyang <cheyang@163.com> Co-authored-by: LDawn <38764512+LDawns@users.noreply.github.com> Co-authored-by: Yifan Yuan <tuji.yyf@alibaba-inc.com> Co-authored-by: littletiger123 <32997459+littletiger123@users.noreply.github.com> Co-authored-by: frankleaf <62129564+frankleaf@users.noreply.github.com> Co-authored-by: yangyuliufeng <30432274+yangyuliufeng@users.noreply.github.com> Signed-off-by: Dice21 <37772976+Dice21@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.