Trouble downloading StrawberryPerl64 package means build fails

[matthid]

is a frustrating experience :)

From https://github.com/Microsoft/visualfsharp/blob/master/DEVGUIDE.md I installed the dependencies, cloned the repository and run build.cmd:

Installing StrawberryPerl64 5.22.2.1.
Error downloading 'StrawberryPerl64.5.22.2.1' from 'https://api.nuget.org/v3-flatcontainer/strawberryperl64/5.22.2.1/strawberryperl64.5.22.2.1.nupkg'.
Unable to read data from the transport connection: The connection was closed.
WARNING: Unable to find version '5.22.2.1' of package 'StrawberryPerl64'.
  C:\proj\visualfsharp\.nuget\../artifacts: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'C:\proj\visualfsharp\.nuget\../artifacts'.
  C:\Users\matth\AppData\Local\NuGet\Cache: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'C:\Users\matth\AppData\Local\NuGet\Cache'.
  C:\Users\matth\.nuget\packages\: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'C:\Users\matth\.nuget\packages\'.
  https://www.myget.org/F/fsharp-daily/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://www.myget.org/F/fsharp-daily/api/v3/index.json'.
  https://dotnet.myget.org/F/roslyn-tools/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/roslyn-tools/api/v3/index.json'.
  https://dotnet.myget.org/F/dotnet-core/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/dotnet-core/api/v3/index.json'.
  https://dotnet.myget.org/F/roslyn-master-nightly/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/roslyn-master-nightly/api/v3/index.json'.
  https://dotnet.myget.org/F/roslyn-tools/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/roslyn-tools/api/v3/index.json'.
  https://dotnet.myget.org/F/roslyn/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/roslyn/api/v3/index.json'.
  https://dotnet.myget.org/F/dotnet-buildtools/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/dotnet-buildtools/api/v3/index.json'.
  https://api.nuget.org/v3/index.json: Error downloading 'StrawberryPerl64.5.22.2.1' from 'https://api.nuget.org/v3-flatcontainer/strawberryperl64/5.22.2.1/strawberryperl64.5.22.2.1.nupkg'.
  Unable to read data from the transport connection: The connection was closed.


Errors in packages.config projects
    Error downloading 'StrawberryPerl64.5.22.2.1' from 'https://api.nuget.org/v3-flatcontainer/strawberryperl64/5.22.2.1/strawberryperl64.5.22.2.1.nupkg'.
    Unable to read data from the transport connection: The connection was closed.
    Unable to find version '5.22.2.1' of package 'StrawberryPerl64'.
      C:\proj\visualfsharp\.nuget\../artifacts: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'C:\proj\visualfsharp\.nuget\../artifacts'.
      C:\Users\matth\AppData\Local\NuGet\Cache: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'C:\Users\matth\AppData\Local\NuGet\Cache'.
      C:\Users\matth\.nuget\packages\: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'C:\Users\matth\.nuget\packages\'.
      https://www.myget.org/F/fsharp-daily/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://www.myget.org/F/fsharp-daily/api/v3/index.json'.
      https://dotnet.myget.org/F/roslyn-tools/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/roslyn-tools/api/v3/index.json'.
      https://dotnet.myget.org/F/dotnet-core/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/dotnet-core/api/v3/index.json'.
      https://dotnet.myget.org/F/roslyn-master-nightly/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/roslyn-master-nightly/api/v3/index.json'.
      https://dotnet.myget.org/F/roslyn-tools/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/roslyn-tools/api/v3/index.json'.
      https://dotnet.myget.org/F/roslyn/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/roslyn/api/v3/index.json'.
      https://dotnet.myget.org/F/dotnet-buildtools/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/dotnet-buildtools/api/v3/index.json'.
      https://api.nuget.org/v3/index.json: Error downloading 'StrawberryPerl64.5.22.2.1' from 'https://api.nuget.org/v3-flatcontainer/strawberryperl64/5.22.2.1/strawberryperl64.5.22.2.1.nupkg'.
      Unable to read data from the transport connection: The connection was closed.

NuGet Config files used:
    C:\proj\visualfsharp\.nuget\NuGet.Config

Feeds used:
    C:\Users\matth\AppData\Local\NuGet\Cache
    C:\Users\matth\.nuget\packages\
    C:\proj\visualfsharp\.nuget\../artifacts
    https://www.myget.org/F/fsharp-daily/api/v3/index.json
    https://dotnet.myget.org/F/roslyn-master-nightly/api/v3/index.json
    https://dotnet.myget.org/F/dotnet-core/api/v3/index.json
    https://dotnet.myget.org/F/dotnet-buildtools/api/v3/index.json
    https://dotnet.myget.org/F/roslyn-tools/api/v3/index.json
    https://api.nuget.org/v3/index.json
    https://dotnet.myget.org/F/roslyn/api/v3/index.json
Error: Nuget restore failed

or sometimes

Errors in packages.config projects
    Error downloading 'StrawberryPerl64.5.22.2.1' from 'https://api.nuget.org/v3-flatcontainer/strawberryperl64/5.22.2.1/strawberryperl64.5.22.2.1.nupkg'.
    The download of 'https://api.nuget.org/v3-flatcontainer/strawberryperl64/5.22.2.1/strawberryperl64.5.22.2.1.nupkg' timed out because no data was received for 60000ms.
      Exception of type 'System.TimeoutException' was thrown.
    Unable to find version '5.22.2.1' of package 'StrawberryPerl64'.
      C:\proj\visualfsharp\.nuget\../artifacts: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'C:\proj\visualfsharp\.nuget\../artifacts'.
      C:\Users\matth\AppData\Local\NuGet\Cache: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'C:\Users\matth\AppData\Local\NuGet\Cache'.
      C:\Users\matth\.nuget\packages\: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'C:\Users\matth\.nuget\packages\'.
      https://www.myget.org/F/fsharp-daily/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://www.myget.org/F/fsharp-daily/api/v3/index.json'.
      https://dotnet.myget.org/F/roslyn-master-nightly/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/roslyn-master-nightly/api/v3/index.json'.
      https://dotnet.myget.org/F/dotnet-core/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/dotnet-core/api/v3/index.json'.
      https://dotnet.myget.org/F/dotnet-buildtools/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/dotnet-buildtools/api/v3/index.json'.
      https://dotnet.myget.org/F/roslyn-tools/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/roslyn-tools/api/v3/index.json'.
      https://dotnet.myget.org/F/roslyn-tools/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/roslyn-tools/api/v3/index.json'.
      https://dotnet.myget.org/F/roslyn/api/v3/index.json: Package 'StrawberryPerl64.5.22.2.1' is not found on source 'https://dotnet.myget.org/F/roslyn/api/v3/index.json'.
      https://api.nuget.org/v3/index.json: Error downloading 'StrawberryPerl64.5.22.2.1' from 'https://api.nuget.org/v3-flatcontainer/strawberryperl64/5.22.2.1/strawberryperl64.5.22.2.1.nupkg'.
      The download of 'https://api.nuget.org/v3-flatcontainer/strawberryperl64/5.22.2.1/strawberryperl64.5.22.2.1.nupkg' timed out because no data was received for 60000ms.
      Exception of type 'System.TimeoutException' was thrown.

Please provide a succinct description of the issue.

Expected behavior

Non-Error message? Successful Build?

Actual behavior

See error above.

Known workarounds

@forki told me to git clean -xdf but I tried several times and I gave up now.
I downloaded the package manually via NuGet website (which was giving 504 errors as well). But eventually the manual download worked and I copied it to the Cache folder (C:\Users\matth\AppData\Local\NuGet\Cache) manually.
So I guess this is a NuGet server bug? Will open an issue there as well...

Related information

Provide any related information

• Operating system: Windows 10 latest
• Branch: master
• Indications of severity: As long as it works for others, no idea?

[forki]

Yeah unfortunately this is very common.

[realvictorprm]

Is there somewhere the story why we need this big package @forki?

[vasily-kirichenko]

It's used to run tests. Why do you ask?

[realvictorprm]

cc @vasily-kirichenko
It's a very big package (about 700mb?) and consumes always space on my main hard drive which is very small. Can we somehow refactor the tests so we aren't depending on this nuget package anymore?

[forki]

Yes we could refactor the tests to use f#. @enricosada started a long time ago. Don't know status.

[realvictorprm]

Thanks @forki. So I asume @dsyme was fine with this too, right?
@enricosada I would like to take care of re-factoring the tests. Will be a nice and educational experience.

[forki]

Don't underestimate the amount of work

[realvictorprm]

@forki Do we have a seperate issue for this? Should I open one to stop spamming here with details?

[forki]

Go through @enricosada's pull request history. Must be somewhere

[enricosada]

Yes we could refactor the tests to use f#. @enricosada started a long time ago. Don't know status.

for test/fsharp (cambridege suite) is done.

For fsharpqa i need to finish the PR, is closed until i have time to finish it, but was like 80 test not passing of 2900, and some refactoring needed to address feedback on how integrate it better. #872
Will do in the summer i hope, for sure not before sdk 2.0 is done

[dsyme]

I'd love to get rid of the dependence on Perl in that test suite. But yes, it's an annoyingly large job.

[cartermp]

I think the core issue here was a NuGet server problem that was resolved. I haven't run into the issue with downloading the package for a very long time. It's a separate issue to remove the dependency altogether, but at least it seems to always download 🙃