NET-7025 - ci: test-integrations failures in compatibility tests. panics occuring in selectionTracker.TrackIDForSelection

[jmurret]

Description

We are seeing the following panics in CI:

Error: sul-server-0-nckhszq0l ~~ 2023-12-21T21:08:23.587Z [ERROR] agent.controller-runtime: controller panic: controller=consul.io/sidecar-proxy-controller managed_type=mesh.v2beta1.ProxyStateTemplate panic="runtime error: invalid memory address or nil pointer dereference"
  dc1-consul-server-0-nckhszq0l ~~ github.com/hashicorp/go-hclog.Stacktrace
  dc1-consul-server-0-nckhszq0l ~~ 	/home/runner/go/pkg/mod/github.com/hashicorp/go-hclog@v1.5.0/stacktrace.go:51
  dc1-consul-server-0-nckhszq0l ~~ github.com/hashicorp/consul/internal/controller.(*controllerRunner).handlePanic.func1
  dc1-consul-server-0-nckhszq0l ~~ 	/home/runner/work/consul/consul/internal/controller/runner.go:254
  dc1-consul-server-0-nckhszq0l ~~ runtime.gopanic
  dc1-consul-server-0-nckhszq0l ~~ 	/opt/hostedtoolcache/go/1.20.12/x64/src/runtime/panic.go:884
  dc1-consul-server-0-nckhszq0l ~~ runtime.panicmem
  dc1-consul-server-0-nckhszq0l ~~ 	/opt/hostedtoolcache/go/1.20.12/x64/src/runtime/panic.go:260
  dc1-consul-server-0-nckhszq0l ~~ runtime.sigpanic
  dc1-consul-server-0-nckhszq0l ~~ 	/opt/hostedtoolcache/go/1.20.12/x64/src/runtime/signal_unix.go:841
  dc1-consul-server-0-nckhszq0l ~~ github.com/hashicorp/consul/internal/resource/mappers/selectiontracker.(*WorkloadSelectionTracker).TrackIDForSelector
  dc1-consul-server-0-nckhszq0l ~~ 	/home/runner/work/consul/consul/internal/resource/mappers/selectiontracker/selection_tracker.go:80
  dc1-consul-server-0-nckhszq0l ~~ github.com/hashicorp/consul/internal/mesh/internal/controllers/sidecarproxy/cache.(*Cache).TrackService
  dc1-consul-server-0-nckhszq0l ~~ 	/home/runner/work/consul/consul/internal/mesh/internal/controllers/sidecarproxy/cache/cache.go:134
  dc1-consul-server-0-nckhszq0l ~~ github.com/hashicorp/consul/internal/mesh/internal/controllers/sidecarproxy/cache.(*Cache).MapService
  dc1-consul-server-0-nckhszq0l ~~ 	/home/runner/work/consul/consul/internal/mesh/internal/controllers/sidecarproxy/cache/cache.go:143
  dc1-consul-server-0-nckhszq0l ~~ github.com/hashicorp/consul/internal/controller.(*controllerRunner).run.func3.1
  dc1-consul-server-0-nckhszq0l ~~ 	/home/runner/work/consul/consul/internal/controller/runner.go:78
  dc1-consul-server-0-nckhszq0l ~~ github.com/hashicorp/consul/internal/controller.(*controllerRunner).doMap.func1
  dc1-consul-server-0-nckhszq0l ~~ 	/home/runner/work/consul/consul/internal/controller/runner.go:206
  dc1-consul-server-0-nckhszq0l ~~ github.com/hashicorp/consul/internal/controller.(*controllerRunner).handlePanic
  dc1-consul-server-0-nckhszq0l ~~ 	/home/runner/work/consul/consul/internal/controller/runner.go:264
  dc1-consul-server-0-nckhszq0l ~~ github.com/hashicorp/consul/internal/controller.(*controllerRunner).doMap
  dc1-consul-server-0-nckhszq0l ~~ 	/home/runner/work/consul/consul/internal/controller/runner.go:204
  dc1-consul-server-0-nckhszq0l ~~ github.com/hashicorp/consul/internal/controller.(*controllerRunner).runMapper
  dc1-consul-server-0-nckhszq0l ~~ 	/home/runner/work/consul/consul/internal/controller/runner.go:165
  dc1-consul-server-0-nckhszq0l ~~ github.com/hashicorp/consul/internal/controller.(*controllerRunner).run.func3
  dc1-consul-server-0-nckhszq0l ~~ 	/home/runner/work/consul/consul/internal/controller/runner.go:77
  dc1-consul-server-0-nckhszq0l ~~ golang.org/x/sync/errgroup.(*Group).Go.func1
  dc1-consul-server-0-nckhszq0l ~~ 	/home/runner/go/pkg/mod/golang.org/x/sync@v0.3.0/errgroup/errgroup.go:75

Testing & Reproduction steps

Links

PR Checklist

• updated test coverage
• external facing docs updated
• appropriate backport labels added
• not a security concern

[hc-github-team-consul-core]

Backport failed @jmurret. Run: https://github.com/hashicorp/consul/actions/runs/7301962951