Deprecate aks-engine e2e test

[nilo19]

What would you like to be added:

Deprecate aks-engine based e2e test and migrate to use capz.

Why is this needed:

[lzhecheng]

/assign

[feiskyer]

Per https://github.com/Azure/aks-engine:

This project is deprecated for Azure public cloud customers. Please consider using Azure Kubernetes Service (AKS) for managed Kubernetes or Cluster API Provider Azure for self-managed Kubernetes. There are no new features planned; this project will only be updated for CVEs & similar, with Kubernetes 1.24 as the final version to receive updates.

[bridgetkromhout]

Currently in progress.

[bridgetkromhout]

Waiting for CAPZ team to refactor: kubernetes-sigs/cluster-api-provider-azure#1994 (comment)

[bridgetkromhout]

@lzhecheng Please take a look at Azure/aks-engine#4874 - thanks.

[lzhecheng]

I will start adding templates into cloud-provider-azure repo. Here is one of the prerequisite issue.
kubernetes-sigs/cluster-api-provider-azure#2299

[lzhecheng]

An issue on test-infra repo
kubernetes/test-infra#24957

[jackfrancis]

Great to see this woork @lzhecheng!

Because "Basic" LoadBalancer is not supported in capz, will we keep that AKS Engine test in cloud-provider-azure indefinitely?

cc @CecileRobertMichon @bridgetkromhout @ritazh

[lzhecheng]

@jackfrancis as far as I know, basic lb and autoscaling will be verified in downstream tests on aks clusters.

[jackfrancis]

@lzhecheng Thanks for confirming. May I remove this (and other similar) test jobs?:

• https://github.com/kubernetes/test-infra/blob/master/config/jobs/kubernetes-sigs/cloud-provider-azure/cloud-provider-azure-presubmit-1.23.yaml#L25

[lzhecheng]

@lzhecheng Thanks for confirming. May I remove this (and other similar) test jobs?:

• https://github.com/kubernetes/test-infra/blob/master/config/jobs/kubernetes-sigs/cloud-provider-azure/cloud-provider-azure-presubmit-1.23.yaml#L25

I have no strong opinion. I didn't remove these tests because there's no harm to keep them and aks clustesr jobs are not ready yet. Gradually, they will be deleted with the whole release-branch.

[bridgetkromhout]

basic lb and autoscaling will be verified in downstream tests on aks clusters.

@lzhecheng Do we need to open an issue to make sure this happens? Do we know who is going to prepare those tests? Thanks.

[lzhecheng]

basic lb and autoscaling will be verified in downstream tests on aks clusters.

@lzhecheng Do we need to open an issue to make sure this happens? Do we know who is going to prepare those tests? Thanks.

I have created one #1929 and I think @mainred will take the task.