Workflow to check for URL validity is needed

[smalers]

It seems that some websites do not allow the TSTool WebGet command to download the file corresponding to the website URL. Need to figure out how to do this reliably so that a workflow can be implemented to check all the URLs.

[smalers]

I added the command file 00-check-data.tstool, which does a WebGet on each website URL. This requires setting the HTTP User-Agent property as if a web browser is being used because some websites don't allow other software to download the web page. I had to edit the User-Agent to remove commas because it causes a parse error, and was able to get the command to work. This shows 11 errors that need review. I don't have time to fix right now.

For some reason, reading the spreadsheet is very slow and I have not been able to figure out why. Consequently, debugging and checking the data is more painful than other datasets. For now, move on knowing that at least bad URLs can be detected.