Fix ako statefulset upgrade issue

[XudongLiuHarold]

Signed-off-by: Xudong Liu [email protected]

What this PR does / why we need it

Currently, when users upgrade load-balancer-and-ingress package, they may meet following error:

 USEFUL-ERROR-MESSAGE: kapp: Error: Applying update statefulset/ako (apps/v1) namespace: avi-system:
 Updating resource statefulset/ako (apps/v1) namespace: avi-system:
 StatefulSet.apps "ako" is invalid: spec:
 Forbidden: updates to statefulset spec for fields other than 'replicas', 'template', and 'updateStrategy' are forbidden (reason: Invalid)

if they changed anything in those fields.

To avoid this problem, we add annotations to ignore default kapp-controller rules to ensure upgrade successfully.

Details for the Release Notes (PLEASE PROVIDE)

Users can change statefuleset's template, replica and etc field now.

Which issue(s) this PR fixes

Fixes: #

Describe testing done for PR

Special notes for your reviewer

[HanFa]

LGTM