Make tokenize CLI tool have nicer command line arguments. #12491

Job	Run time
Push Docker image to Docker Hub (light, .devops/main.Dockerfile, linux/amd64,linux/arm64)	8m 58s
Push Docker image to Docker Hub (full, .devops/full.Dockerfile, linux/amd64,linux/arm64)	9m 27s
Push Docker image to Docker Hub (server, .devops/server.Dockerfile, linux/amd64,linux/arm64)	6m 1s
Push Docker image to Docker Hub (light-cuda, .devops/main-cuda.Dockerfile, linux/amd64)	7m 55s
Push Docker image to Docker Hub (full-cuda, .devops/full-cuda.Dockerfile, linux/amd64)	9m 21s
Push Docker image to Docker Hub (server-cuda, .devops/server-cuda.Dockerfile, linux/amd64)	5m 21s
Push Docker image to Docker Hub (light-rocm, .devops/main-rocm.Dockerfile, linux/amd64,linux/arm64)	3m 16s
Push Docker image to Docker Hub (full-rocm, .devops/full-rocm.Dockerfile, linux/amd64,linux/arm64)	9m 18s
Push Docker image to Docker Hub (server-rocm, .devops/server-rocm.Dockerfile, linux/amd64,linux/a...	2m 54s
Push Docker image to Docker Hub (light-intel, .devops/main-intel.Dockerfile, linux/amd64)	5m 59s
Push Docker image to Docker Hub (server-intel, .devops/server-intel.Dockerfile, linux/amd64)	1m 40s
	1h 10m 10s

Provide feedback