Sorry, spoke too soon .Ignore the last comment. It looks like the ingress pod caches the certificates. Deleting the pod resulted in a Error getting SSL certificate....local certificate 'xyz' was not found. Using default certificate.