Downloading North America fails at 3/4 complete

[Firebird]

I am wondering if it is just so big that any disturbance in the force, i.e. a fluctuating internet connection causes a fail, although at this moment I can't see why it would seemingly fail for everybody at the same place - unless it isn't.

Maybe we just haven't set it up to auto-recover from interruptions.

[Greg]

There's no resuming in the download function that is currently used by Matrix. This had several advantages at the time of writing but I didn't anticipate the zipped NA region to be so large, or I would have written Matrix differently.

While I can't find anything server-side that would interrupt the download, I'm looking into ways to make Matrix more robust for client-side issues without a major redesign of the installation function at this stage. One option would be offering the file straight from a selection of servers (so it can be downloaded with or without the help of a download manager first), then pointing Matrix to that file so it skips the downloading part and goes straight to unpacking. I'm currently working on that option but it won't be ready by tomorrow...

[dimi]

Hi, I also have the problem that the download failes afte a few hundred MBs. Have tried emptying the temp folder. Will wait for the new option

[Greg]

Thanks for the report Dimi. Could you also provide the error log in %LOCALAPPDATA%\Military_AI_Works please, just to make sure your issue is related?

[Greg]

Those still having issues downloading North America, please try again. I made the zip file considerably smaller by removing a version control folder that shouldn't have been included in the release (thanks Pete).

No changes were made to the download system yet, but the smaller file size (while still more than a gig) could make whatever is interrupting your download less likely to occur so it's worth a try.

[dimi]

Thanks for the report Dimi. Could you also provide the error log in %LOCALAPPDATA%\Military_AI_Works please, just to make sure your issue is related?

Hi Greg,

of course:

2018-09-22 10:09:15.9965 - ERROR: Download Error
EXCEPTION: System.Net.WebException: An exception occurred during a WebClient request. --->

System.IO.IOException: Received an unexpected EOF or 0 bytes from the transport stream.
at System.Net.ConnectStream.EndRead(IAsyncResult asyncResult)
at System.Net.WebClient.DownloadBitsReadCallbackState(DownloadBitsState state, IAsyncResult

result)
--- End of inner exception stack trace ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task

task)
at Matrix.Wpf.MainWindow.<DownloadFile>d__29.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task

task)
at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd(Task task)
at Matrix.Wpf.MainWindow.<ClickInstallButton>d__34.MoveNext()
====================================================================
2018-09-22 10:39:15.7939 - ERROR: Download Error
EXCEPTION: System.Net.WebException: An exception occurred during a WebClient request. --->

System.IO.IOException: Received an unexpected EOF or 0 bytes from the transport stream.
at System.Net.ConnectStream.EndRead(IAsyncResult asyncResult)
at System.Net.WebClient.DownloadBitsReadCallbackState(DownloadBitsState state, IAsyncResult

result)
--- End of inner exception stack trace ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task

task)
at Matrix.Wpf.MainWindow.<DownloadFile>d__29.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task

task)
at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd(Task task)
at Matrix.Wpf.MainWindow.<ClickInstallButton>d__34.MoveNext()
====================================================================
2018-09-22 10:49:15.5909 - ERROR: Download Error
EXCEPTION: System.Net.WebException: An exception occurred during a WebClient request. --->

System.IO.IOException: Received an unexpected EOF or 0 bytes from the transport stream.
at System.Net.ConnectStream.EndRead(IAsyncResult asyncResult)
at System.Net.WebClient.DownloadBitsReadCallbackState(DownloadBitsState state, IAsyncResult

result)
--- End of inner exception stack trace ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task

task)
at Matrix.Wpf.MainWindow.<DownloadFile>d__29.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task

task)
at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd(Task task)
at Matrix.Wpf.MainWindow.<ClickInstallButton>d__34.MoveNext()
====================================================================
2018-09-22 11:49:15.8444 - ERROR: Download Error
EXCEPTION: System.Net.WebException: An exception occurred during a WebClient request. --->

System.IO.IOException: Received an unexpected EOF or 0 bytes from the transport stream.
at System.Net.ConnectStream.EndRead(IAsyncResult asyncResult)
at System.Net.WebClient.DownloadBitsReadCallbackState(DownloadBitsState state, IAsyncResult

result)
--- End of inner exception stack trace ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task

task)
at Matrix.Wpf.MainWindow.<DownloadFile>d__29.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task

task)
at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd(Task task)
at Matrix.Wpf.MainWindow.<ClickInstallButton>d__34.MoveNext()
====================================================================
2018-09-22 12:29:15.2201 - ERROR: Download Error
EXCEPTION: System.Net.WebException: An exception occurred during a WebClient request. --->

System.IO.IOException: Received an unexpected EOF or 0 bytes from the transport stream.
at System.Net.ConnectStream.EndRead(IAsyncResult asyncResult)
at System.Net.WebClient.DownloadBitsReadCallbackState(DownloadBitsState state, IAsyncResult

result)
--- End of inner exception stack trace ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task

task)
at Matrix.Wpf.MainWindow.<DownloadFile>d__29.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task

task)
at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd(Task task)
at Matrix.Wpf.MainWindow.<ClickInstallButton>d__34.MoveNext()
====================================================================
2018-09-22 14:19:16.5001 - ERROR: Download Error
EXCEPTION: System.Net.WebException: An exception occurred during a WebClient request. --->

System.IO.IOException: Received an unexpected EOF or 0 bytes from the transport stream.
at System.Net.ConnectStream.EndRead(IAsyncResult asyncResult)
at System.Net.WebClient.DownloadBitsReadCallbackState(DownloadBitsState state, IAsyncResult

result)
--- End of inner exception stack trace ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task

task)
at Matrix.Wpf.MainWindow.<DownloadFile>d__29.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task

task)
at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd(Task task)
at Matrix.Wpf.MainWindow.<ClickInstallButton>d__34.MoveNext()
====================================================================
2018-09-22 14:59:16.7199 - ERROR: Download Error
EXCEPTION: System.Net.WebException: An exception occurred during a WebClient request. --->

System.IO.IOException: Received an unexpected EOF or 0 bytes from the transport stream.
at System.Net.ConnectStream.EndRead(IAsyncResult asyncResult)
at System.Net.WebClient.DownloadBitsReadCallbackState(DownloadBitsState state, IAsyncResult

result)
--- End of inner exception stack trace ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task

task)
at Matrix.Wpf.MainWindow.<DownloadFile>d__29.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task

task)
at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd(Task task)
at Matrix.Wpf.MainWindow.<ClickInstallButton>d__34.MoveNext()
====================================================================

I've just started the download again, will keep you posted!

[dimi]

The download stopped again:

2018-09-23 12:30:01.4901 - ERROR: Download Error
EXCEPTION: System.Net.WebException: An exception occurred during a WebClient request. ---> System.IO.IOException: Received an unexpected EOF or 0 bytes from the transport stream.
at System.Net.ConnectStream.EndRead(IAsyncResult asyncResult)
at System.Net.WebClient.DownloadBitsReadCallbackState(DownloadBitsState state, IAsyncResult result)
--- End of inner exception stack trace ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Matrix.Wpf.MainWindow.<DownloadFile>d__29.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd(Task task)
at Matrix.Wpf.MainWindow.<ClickInstallButton>d__34.MoveNext()
====================================================================

[Greg]

Thanks Dimi. I appreciate you patience while I'm working on this issue.

[a320skipper]

Hi Greg,

thank you very much for your continued efforts!

I will try again now and let you know the result...

[dimi]

Thanks Dimi. I appreciate you patience while I'm working on this issue.

Thank you for your great add-on!

[a320skipper]

Ok, tried it again many times without success. 3/4 down the road it stops. I will wait now until it is solved for us unlucky users. Love your packages, so it is well worth the waiting for me!

[Firebird]

I have just had a thought, and I am not saying that this is anything to do with the cause, but what is your systems virtual memory set to?

[a320skipper]

I'm running win7 with the Option "automatically manage page file size for all drives" resulting in 16334 MB (with RAM 16GB)

I hope this is what your looking for...thanks for chiming in...

[bvanhout]

Seeing so many are having problems with what appears to be file size, I know this may mean a whole lot of extra work, but would it not help if the NA package was split into sub-regions to reduce the file size. eg Canada, US East Coast, US West Coast and South of the border down Mexico way. (sorry Greg)

[Firebird]

I'm running win7 with the Option "automatically manage page file size for all drives" resulting in 16334 MB (with RAM 16GB)

I hope this is what your looking for...thanks for chiming in...

That was indeed was I was looking for. I was trying to think of a reason why the temp folder could be a reason that the transfers failing and the only thing that I could think of was that the Virtual mem was set to a small enough mount and that the download went to that particular part of the files system.

Having an automatic size and 16GB or ram shouldn't cause this issue, unless the virtual mem was nearly full. Of course the only way to test this would be to try the download immediately after a clean shutdown and startup before anything else is attempted but I would be surprised if that made any difference.

[a320skipper]

Hi Steve,

thank you for your thoughts! I will try that tomorrow and Report again here.

[a320skipper]

@Steve, @Greg

THANK YOU it finally worked this morning! Downloading after a fresh reboot of my PC might have been the solution.

[Firebird]

Hmmm. OK so there there must be a link to the virtual mem you have assigned and how much has been used, as it gets cleaned out every time you cold reboot.

How that can help us I am not sure but I am now wondering is whether other people that had download issues that were fixed by cleaning out the temp folder were actually due to the vmem being cleaned out by reboot.

So lets see what other people that are having issues can supply us in terms of info.
Those that have issues can you please tell us what your virtual memory and your physical memory settings are and try after cold reboot.

[bvanhout]

I was one of those who managed to download after cleaning the temp folder without a reboot.