Revamp grpc support #1000

Job	Run time
build-vegafusion-python-osx-64	22m 13s
build-vegafusion-python-osx-arm64	13m 3s
build-vegafusion-python-linux-arm64	3m 47s
build-vegafusion-python-linux-64	3m 26s
build-vegafusion-python-win-64	35m 23s
build-vegafusion-server-linux-64	13m 48s
build-vegafusion-server-linux-arm64	2m 32s
build-vegafusion-server-osx-64	24m 1s
build-vegafusion-server-osx-arm64	11m 50s
build-vegafusion-server-win-64	29m 19s
build-vegafusion-wasm	10m 43s
check-rust	7m 53s
check-vegafusion-python	10m 38s
test-rust (ubuntu-20.04)	27m 5s
test-rust (windows-2022)	51m 42s
test-rust (macos-14)	25m 41s
test-vegafusion-python-linux-64	31m 10s
test-vegafusion-python-osx-arm64	4m 38s
test-vegafusion-python-win-64	11m 5s
	5h 39m 57s

Provide feedback