[configgrpc] Remove deprecated ServerConfig.ToListener (#9583) #3

Job	Run time
setup-environment	33s
govulncheck	1m 4s
test-coverage	7m 57s
lint	3m 18s
checks	1m 46s
cross-build-collector (darwin, amd64)	41s
unittest-matrix (~1.22)	5m 2s
cross-build-collector (darwin, arm64)	42s
unittest-matrix (~1.21.5)	5m 7s
cross-build-collector (linux, 386)	43s
cross-build-collector (linux, amd64)	35s
cross-build-collector (linux, arm64)	44s
cross-build-collector (linux, ppc64le)	36s
cross-build-collector (linux, arm, 7)	45s
cross-build-collector (linux, s390x)	45s
cross-build-collector (windows, 386)	39s
cross-build-collector (windows, amd64)	35s
unittest	1s
	31m 33s

Provide feedback