Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

increase timeout for websocket compression tests #52086

Merged
merged 3 commits into from
Apr 30, 2021

Conversation

danmoseley
Copy link
Member

Relates to #52031

This test is failing all the time. In such a situation we should disable or fix it immediately.

I don't know why it is timing out, but we should be able to quickly see if it is indeed hanging rather than just slow.

@ghost
Copy link

ghost commented Apr 30, 2021

Tagging subscribers to this area: @dotnet/ncl
See info in area-owners.md if you want to be subscribed.

Issue Details

Relates to #52031

This test is failing all the time. In such a situation we should disable or fix it immediately.

I don't know why it is timing out, but we should be able to quickly see if it is indeed hanging rather than just slow.

Author: danmoseley
Assignees: -
Labels:

area-System.Net

Milestone: -

@danmoseley
Copy link
Member Author

/azp help

@azure-pipelines

This comment has been minimized.

@danmoseley
Copy link
Member Author

/azp list

@azure-pipelines

This comment has been minimized.

@danmoseley
Copy link
Member Author

I made it 30 seconds for everything as it's not quite only ARM. Also, it should never make a passing test any slower.

TestResults 
| join kind=inner WorkItems on WorkItemId 
| join kind=inner Jobs on JobId
| where Finished >= datetime(2021-3-1 0:00:00)
//and Type == "System.Net.WebSockets.Tests.WebSocketDeflateTests"
and Method == "PayloadShouldHaveSimilarSizeWhenSplitIntoSegments"
//and Result == 'Fail'
//and QueueName1 contains "arm"
| summarize count() by Result, QueueAlias, Arguments, Message //, bin(Duration, 1)
Result QueueAlias Arguments Message count_
Fail alpine.312.arm64.open windowBits: 15 System.Threading.Tasks.TaskCanceledException : A task was canceled. 68
Fail ubuntu.1804.arm32.open windowBits: 14 System.Threading.Tasks.TaskCanceledException : A task was canceled. 120
Fail ubuntu.1804.arm32.open windowBits: 15 System.Threading.Tasks.TaskCanceledException : A task was canceled. 120
Fail alpine.313.arm32.open windowBits: 14 System.Threading.Tasks.TaskCanceledException : A task was canceled. 76
Fail alpine.313.arm32.open windowBits: 15 System.Threading.Tasks.TaskCanceledException : A task was canceled. 76
Fail ubuntu.1804.arm64.open windowBits: 15 System.Threading.Tasks.TaskCanceledException : A task was canceled. 8
Fail osx.1013.amd64.open System.Threading.Tasks.TaskCanceledException : A task was canceled. 2

@danmoseley
Copy link
Member Author

I notice in the above table that it's always window bits 14 or 15, and (judging by the identical numbers) when it fails for one it always fails for the other.

I also now notice that @CarnaViire already pointed this out :)

I will update this to skip 14 and 15 while this is investigated.

@danmoseley
Copy link
Member Author

I also should have filtered out PR validation:

TestResults 
| join kind=inner WorkItems on WorkItemId 
| join kind=inner Jobs on JobId
| where Finished >= datetime(2021-3-1 0:00:00)
and Type == "System.Net.WebSockets.Tests.WebSocketDeflateTests"
and Branch == "refs/heads/main"
| summarize count() by Method, Result, QueueAlias, Arguments, Message //, bin(Duration, 1)
Method Result QueueAlias Arguments Message count_
PayloadShouldHaveSimilarSizeWhenSplitIntoSegments Fail alpine.313.arm32.open windowBits: 14 System.Threading.Tasks.TaskCanceledException : A task was canceled. 10
PayloadShouldHaveSimilarSizeWhenSplitIntoSegments Fail alpine.313.arm32.open windowBits: 15 System.Threading.Tasks.TaskCanceledException : A task was canceled. 10
PayloadShouldHaveSimilarSizeWhenSplitIntoSegments Fail ubuntu.1804.arm32.open windowBits: 14 System.Threading.Tasks.TaskCanceledException : A task was canceled. 18
PayloadShouldHaveSimilarSizeWhenSplitIntoSegments Fail ubuntu.1804.arm32.open windowBits: 15 System.Threading.Tasks.TaskCanceledException : A task was canceled. 18
PayloadShouldHaveSimilarSizeWhenSplitIntoSegments Fail alpine.312.arm64.open windowBits: 15 System.Threading.Tasks.TaskCanceledException : A task was canceled. 8
ReceiveInvalidCompressedData Fail ubuntu.1804.amd64.android.open Assert.Equal() Failure\n ↓ (pos 0)\nExpected: The message was compressed using an unsup···\nActual: ZLibUnsupportedCompression\n ↑ (pos 0) 4
ReceiveUncompressedMessageWhenCompressionEnabled Fail ubuntu.1804.amd64.android.open Assert.Equal() Failure\n ↓ (pos 0)\nExpected: The WebSocket received compressed frame w···\nActual: net_Websockets_PerMessageCompressedFlagWh···\n ↑ (pos 0) 4
WebSocketWithoutDeflateShouldThrowOnCompressedMessage Fail ubuntu.1804.amd64.android.open Assert.Equal() Failure\n ↓ (pos 0)\nExpected: The WebSocket received compressed frame w···\nActual: net_Websockets_PerMessageCompressedFlagWh···\n ↑ (pos 0) 4
PayloadShouldHaveSimilarSizeWhenSplitIntoSegments Fail ubuntu.1804.arm64.open windowBits: 15 System.Threading.Tasks.TaskCanceledException : A task was canceled. 8

@danmoseley
Copy link
Member Author

The Android failures above show that resources were not loaded. That's clearly unrelated and no doubt we'll see it again if it's not fixed.

@CarnaViire CarnaViire merged commit 7213840 into dotnet:main Apr 30, 2021
@danmoseley danmoseley deleted the can.token branch April 30, 2021 13:51
@karelz karelz added this to the 6.0.0 milestone May 20, 2021
@ghost ghost locked as resolved and limited conversation to collaborators Jun 19, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants