NiFi Operator change storageClass

[deebify]

Hello,

I am attempting to update the storage class for a few NiFi repositories from the default storage class to a specific one, but the change is not being applied.

Before it was:

nodes:
  roleGroups:
    default:
      config:
        resources:
          cpu:
            min: 1500m
            max: 5000m
         memory:
            limit: 8448Mi

I would like to change the storage class for flowfileRepo and contentRepo:

nodes:
  roleGroups:
    default:
      config:
        resources:
          cpu:
            min: 1500m
            max: 5000m
          memory:
            limit: 8448Mi
          storage:
            flowfileRepo:
              capacity: 12Gi
              storageClass: 'my-block-storage-class'
            contentRepo:
              capacity: 12Gi
              storageClass: 'my-block-storage-class'
            

[maltesander]

Hi @deebify,

Could you check the NiFi operator logs? I guess you will get an error, something along:

Forbidden: updates to statefulset spec for fields other than 'replicas', 'ordinals', 'template', 'updateStrategy', 'persistentVolumeClaimRetentionPolicy' and 'minReadySeconds' are forbidden

You currently cannot make changes to certain fields (like the storage class). Could you just delete the created NiFi Statefulset so that the NiFi operator can recreate it (Only delete the Statefulset, not the custom resource)?

Cheers,
Malte

[deebify]

Previously, I deleted the NiFi StatefulSet when I encountered that error, but after the StatefulSet came back up, it was still using the old PVC.

[maltesander]

And this did not work this time? If you are just testing (no real data in NiFi), could you delete the content and flowfile PVCs? I got

malte@mdesktop ~> kubectl -n default get pvc -o wide
NAME                                                 STATUS    VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS             VOLUMEATTRIBUTESCLASS   AGE     VOLUMEMODE
content-repository-simple-nifi-node-default-0        Pending                                                                        my-block-storage-class   <unset>                 50s     Filesystem
data-simple-zk-server-default-0                      Bound     pvc-898de825-a236-4493-bd5e-08b5e0517ae9   1Gi        RWO            standard                 <unset>                 5m25s   Filesystem
database-repository-simple-nifi-node-default-0       Bound     pvc-26a8d685-bbd4-49e2-ab89-45cf2af5675e   1Gi        RWO            standard                 <unset>                 5m25s   Filesystem
flowfile-repository-simple-nifi-node-default-0       Pending                                                                        my-block-storage-class   <unset>                 88s     Filesystem
provenance-repository-simple-nifi-node-default-0     Bound     pvc-dd563b89-fb27-45e7-a0ba-899c4a9263c3   2Gi        RWO            standard                 <unset>                 5m25s   Filesystem
simple-nifi-create-reporting-task-1-28-1-5dgfz-tls   Bound     pvc-4d2413f0-4922-45db-9f00-16d70fb0ac5d   1          RWO            secrets.stackable.tech   <unset>                 5m25s   Filesystem
simple-nifi-node-default-0-keystore                  Bound     pvc-34b34d28-434b-45cb-8f59-dae07eabcba0   1          RWO            secrets.stackable.tech   <unset>                 78s     Filesystem
simple-zk-server-default-0-quorum-tls                Bound     pvc-68511bf3-8257-43ce-b2f5-afd02dec6c3e   1          RWO            secrets.stackable.tech   <unset>                 5m25s   Filesystem
simple-zk-server-default-0-server-tls                Bound     pvc-10ca3acc-7d26-4251-8810-82183bb3a22f   1          RWO            secrets.stackable.tech   <unset>                 5m25s   Filesystem
state-repository-simple-nifi-node-default-0          Bound     pvc-3e8e78b7-6428-41f9-85f6-92e3db0c3e86   1Gi        RWO            standard                 <unset>                 5m25s   Filesystem

They are pending because i dont have that storage class, but they were created?

[deebify]

Yes, when I deleted the PVC for the flowfile and content, it created new ones with the required storage class.
Do it need to be manually?

[maltesander]

Yes, unfortunately this must be done manually for now. We want to work around these manual interventions, but there is a lot to consider especially regarding moving/copying/deleting PVCs.

Hope that still works for you :-)

[deebify]

Fortunately I do have backup of these PVCs before this intervention.