[Infra] Only compile core extension headers once

[Infra] Only compile core extension headers once #2663