Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cellular_test is extremely flaky #396

Open
bartekpacia opened this issue Sep 30, 2022 · 5 comments
Open

cellular_test is extremely flaky #396

bartekpacia opened this issue Sep 30, 2022 · 5 comments
Labels
bug Something isn't working platform: ios iOS is affected tests Related to Patrol's own testing & CI infra

Comments

@bartekpacia
Copy link
Contributor

bartekpacia commented Sep 30, 2022

First reported here.

This happens only on a physical device. I've not seen this happen even once on the Simulator.

@bartekpacia bartekpacia added bug Something isn't working platform: ios iOS is affected labels Sep 30, 2022
@bartekpacia bartekpacia changed the title Flutter Driver service dies at suddenly and randomly and test fail Flutter Driver service dies randomly when performing native actions on iOS Sep 30, 2022
@bartekpacia
Copy link
Contributor Author

bartekpacia commented Oct 19, 2022

I couldn't reproduce this yesterday on my private iPhone 12 mini running iOS 16.

Needs further investigation.

@bartekpacia
Copy link
Contributor Author

bartekpacia commented Oct 20, 2022

Today I did more testing on my iPhone.

wifi_test

Run 5 times, all passed.

airplane_mode_test

Run 6 times, all passed.

dark_mode_test

Run 6 times, all passed.

cellular_test

This one is broken, fails every time.

Logs

Running cellular_test.dart on Barteks-iPhone...
Running "flutter pub get" in example...
2,140ms
Automatically signing iOS for device deployment using specified development team in Xcode project: U3EG6EALX7
Running Xcode build...
Xcode build done. 12.3s
Installing and launching...
20.7s
VMServiceFlutterDriver: Connecting to Flutter application at http://127.0.0.1:52868/p5uSpgcHJeE=/
VMServiceFlutterDriver: Isolate found with number: 3221138191963991
VMServiceFlutterDriver: Isolate is paused at start.
VMServiceFlutterDriver: Attempting to resume isolate
Patrol: creating NativeAutomator
host: localhost
port: 8081
packageName: pl.leancode.patrol.example
bundleId: pl.leancode.patrol.Example
Patrol: Initializing PatrolBinding...
00:00 +0: disables and enables cellular twice
VMServiceFlutterDriver: Connected to Flutter application.
fopen failed for data file: errno = 2 (No such file or directory)
Errors found! Invalidating cache...
Patrol: configure() started
Patrol: configure() succeeded
fopen failed for data file: errno = 2 (No such file or directory)
Errors found! Invalidating cache...
Patrol: disableCellular() started
2022-10-20 21:09:00.191984+0200 AutomatorServerUITests-Runner[75213:5581828] PatrolServer: INFO: disabling cellular...
t = 56.73s Press Application 'com.apple.springboard'[0.90, 0.01] for 0.1 seconds, then drag to Application 'com.apple.springboard'[0.90, 0.20] with velocity of 500.00 pixels per second, and then hold for 0.0 seconds
t = 56.73s Wait for com.apple.springboard to idle
t = 59.74s Find the Application 'com.apple.springboard'
t = 59.86s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 59.87s Check for interrupting elements affecting " " Application
t = 59.89s Wait for pl.leancode.patrol.Example to idle
[Default] Received request to exchange capabilities, remote interface capabilities are: <XCTCapabilities: 0x28120aaa0>: {
"query runtime issue reporting" = 1;
"query runtime issue reporting/automation type mismatch" = 1;
}
[Default] Received request to notify when the main run loop is idle
[Default] Idle notifier finished setting up run loop observer
[Default] Idle notifier run loop observer fired
[Default] Sending main run loop idle reply
[Default] Received request to notify when animations are idle
[Default] Sending animations idle reply with error: (null)
[Default] Received request to fetch matches for query: ↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7
[Default] Evaluating query:
↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7
[Default] Getting root element snapshot
[Default] Getting snapshot for App element pid: 75220 for query ↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7
[Default] Query requires iOS snapshot attributes XC_kAXXCAttributeElementType, XC_kAXXCAttributeElementBaseType, XC_kAXXCAttributeIdentifier, XC_kAXXCAttributeAutomationType, XC_kAXXCAttributeTraits.
[Default] XCTPerformOnMainRunLoop[not MT]: about to CFRunLoopPerform
[Default] XCTPerformOnMainRunLoop[not MT]: waiting with 30.00s responsiveness timeout
[Default] XCTPerformOnMainRunLoop[MT]: inside CFRunLoopPerform
[Default] XCTPerformOnMainRunLoop[MT]: MT responded in time (won the race to the busy flag)
[Default] XCTPerformOnMainRunLoop[not MT]: waiting 60.00s for work to complete
[Default] Got main window <AXUIElementRef 0x281ea9bf0> {pid=75220} {uid=[ID:4 hash:0x13dd879e0]}
[Default] Capturing hierarchy with attributes XC_kAXXCAttributeElementType, XC_kAXXCAttributeElementBaseType, XC_kAXXCAttributeParent, XC_kAXXCAttributeIdentifier, XC_kAXXCAttributeAutomationType, XC_kAXXCAttributeTraits
[Default] Capturing hierarchy with parameters {
attributes = (
5003,
5004,
5002,
5019,
5058,
2004
);
maxArrayCount = 2147483647;
maxChildren = 2147483647;
maxDepth = 2147483647;
snapshotKeyHonorModalViews = 0;
traverseFromParentsToChildren = 1;
}
[Default] Snapshot attributes 5003, 5004, 5002, 5019, 5058, 2004
[Default] Got snapshot for <AXUIElementRef 0x281e63360> {pid=75220} {uid=[ID:1 hash:0x0]}
[Default] Got app orientation 0
[Default] Captured accessibility snapshot data in 0.10s
[Default] Found main window: Window
[Default] XCTPerformOnMainRunLoop[not MT]: about to CFRunLoopPerform
[Default] XCTPerformOnMainRunLoop[not MT]: waiting with 30.00s responsiveness timeout
[Default] XCTPerformOnMainRunLoop[MT]: inside CFRunLoopPerform
[Default] XCTPerformOnMainRunLoop[MT]: MT responded in time (won the race to the busy flag)
[Default] XCTPerformOnMainRunLoop[not MT]: waiting 60.00s for work to complete
[Default] XCTElementQuery: set data source for rootElementSnapshot to <XCTAutomationSession: 0x283473420>
[Default] Finding all matches with input Application, pid: 75220 using transformers
↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7
[Default] [Match All] applied transformer Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7 to input {(
Application, pid: 75220
)}, found {(
)}
[Default] [Match All] setting out related elements in early return {(
)}
[Default] Current tree:
Application, 0x13dd89ed0, pid: 75220 <App element pid: 75220>
Window (Main), 0x13dd96c00 <AX element pid: 75220, elementOrHash.elementID: 5332564448.4>
Other, 0x13dda3f00 <AX element pid: 75220, elementOrHash.elementID: 5334221312.5>
Other, 0x13dda0b90 <AX element pid: 75220, elementOrHash.elementID: 5334224080.6>
Other, 0x13dda0ca0 <AX element pid: 75220, elementOrHash.elementID: 5334191216.7>
[Default] Query ↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7 found matching snapshots: {(
)} (error: (null))
[Default] Replying to query ↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7 with results: <XCTElementQueryResults: 0x281ea4bd0> (error: (null))
t = 60.34s Synthesize event
t = 60.46s Find the Application 'com.apple.springboard'
t = 60.51s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 60.52s Find the Application 'com.apple.springboard'
t = 60.54s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 61.19s Wait for com.apple.springboard to idle
t = 61.48s Waiting 10.0s for "cellular-data-button" Switch to exist
t = 62.51s Checking Expect predicate exists == 1 for object "cellular-data-button" Switch
t = 62.51s Checking existence of "cellular-data-button" Switch
t = 62.68s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 62.69s Find the "cellular-data-button" Switch
t = 62.79s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 62.80s Tap "cellular-data-button" Switch
t = 62.80s Wait for com.apple.springboard to idle
t = 62.91s Find the "cellular-data-button" Switch
t = 63.04s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 63.04s Check for interrupting elements affecting "cellular-data-button" Switch
t = 63.14s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 63.17s Synthesize event
t = 63.54s Wait for com.apple.springboard to idle
t = 63.68s Tap Application 'com.apple.springboard'[0.90, 0.10]
t = 63.68s Wait for com.apple.springboard to idle
t = 63.77s Find the Application 'com.apple.springboard'
t = 63.85s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 63.86s Check for interrupting elements affecting " " Application
t = 63.94s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 63.96s Synthesize event
t = 64.06s Find the Application 'com.apple.springboard'
t = 64.15s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 64.44s Wait for com.apple.springboard to idle
2022-10-20 21:09:08.720561+0200 AutomatorServerUITests-Runner[75213:5581828] PatrolServer: INFO: done disabling cellular
Patrol: disableCellular() succeeded
Patrol: enableCellular() started
2022-10-20 21:09:08.747258+0200 AutomatorServerUITests-Runner[75213:5581828] PatrolServer: INFO: enabling cellular...
t = 65.28s Press Application 'com.apple.springboard'[0.90, 0.01] for 0.1 seconds, then drag to Application 'com.apple.springboard'[0.90, 0.20] with velocity of 500.00 pixels per second, and then hold for 0.0 seconds
t = 65.28s Wait for com.apple.springboard to idle
t = 65.39s Find the Application 'com.apple.springboard'
t = 65.44s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 65.44s Check for interrupting elements affecting " " Application
t = 65.45s Wait for pl.leancode.patrol.Example to idle
[Default] Received request to notify when the main run loop is idle
[Default] Idle notifier finished setting up run loop observer
[Default] Idle notifier run loop observer fired
[Default] Sending main run loop idle reply
[Default] Received request to notify when animations are idle
[Default] Sending animations idle reply with error: (null)
[Default] Received request to fetch matches for query: ↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7
[Default] Evaluating query:
↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7
[Default] Getting root element snapshot
[Default] Getting snapshot for App element pid: 75220 for query ↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7
[Default] Query requires iOS snapshot attributes XC_kAXXCAttributeElementType, XC_kAXXCAttributeElementBaseType, XC_kAXXCAttributeIdentifier, XC_kAXXCAttributeAutomationType, XC_kAXXCAttributeTraits.
[Default] XCTPerformOnMainRunLoop[not MT]: about to CFRunLoopPerform
[Default] XCTPerformOnMainRunLoop[not MT]: waiting with 30.00s responsiveness timeout
[Default] XCTPerformOnMainRunLoop[MT]: inside CFRunLoopPerform
[Default] XCTPerformOnMainRunLoop[MT]: MT responded in time (won the race to the busy flag)
[Default] XCTPerformOnMainRunLoop[not MT]: waiting 60.00s for work to complete
[Default] Got main window <AXUIElementRef 0x281e94b70> {pid=75220} {uid=[ID:4 hash:0x13dd879e0]}
[Default] Capturing hierarchy with attributes XC_kAXXCAttributeElementType, XC_kAXXCAttributeElementBaseType, XC_kAXXCAttributeParent, XC_kAXXCAttributeIdentifier, XC_kAXXCAttributeAutomationType, XC_kAXXCAttributeTraits
[Default] Capturing hierarchy with parameters {
attributes = (
5003,
5004,
5002,
5019,
5058,
2004
);
maxArrayCount = 2147483647;
maxChildren = 2147483647;
maxDepth = 2147483647;
snapshotKeyHonorModalViews = 0;
traverseFromParentsToChildren = 1;
}
[Default] Snapshot attributes 5003, 5004, 5002, 5019, 5058, 2004
[Default] Got snapshot for <AXUIElementRef 0x281e942a0> {pid=75220} {uid=[ID:1 hash:0x0]}
[Default] Got app orientation 0
[Default] Captured accessibility snapshot data in 0.00s
[Default] Found main window: Window
[Default] XCTPerformOnMainRunLoop[not MT]: about to CFRunLoopPerform
t = 65.56s Synthesize event
[Default] XCTPerformOnMainRunLoop[not MT]: waiting with 30.00s responsiveness timeout
[Default] XCTPerformOnMainRunLoop[MT]: inside CFRunLoopPerform
[Default] XCTPerformOnMainRunLoop[MT]: MT responded in time (won the race to the busy flag)
[Default] XCTPerformOnMainRunLoop[not MT]: waiting 60.00s for work to complete
[Default] XCTElementQuery: set data source for rootElementSnapshot to <XCTAutomationSession: 0x283473420>
[Default] Finding all matches with input Application, pid: 75220 using transformers
↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7
[Default] [Match All] applied transformer Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7 to input {(
Application, pid: 75220
)}, found {(
)}
[Default] [Match All] setting out related elements in early return {(
)}
[Default] Current tree:
Application, 0x13f506ca0, pid: 75220 <App element pid: 75220>
Window (Main), 0x13f404f10 <AX element pid: 75220, elementOrHash.elementID: 5332564448.4>
Other, 0x13f405970 <AX element pid: 75220, elementOrHash.elementID: 5334221312.5>
Other, 0x13f405a80 <AX element pid: 75220, elementOrHash.elementID: 5334224080.6>
Other, 0x13f406520 <AX element pid: 75220, elementOrHash.elementID: 5334191216.7>
[Default] Query ↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7 found matching snapshots: {(
)} (error: (null))
[Default] Replying to query ↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7 with results: <XCTElementQueryResults: 0x281e94210> (error: (null))
t = 65.66s Find the Application 'com.apple.springboard'
t = 65.70s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 65.70s Find the Application 'com.apple.springboard'
t = 65.73s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 66.37s Wait for com.apple.springboard to idle
t = 66.47s Waiting 10.0s for "cellular-data-button" Switch to exist
t = 67.49s Checking Expect predicate exists == 1 for object "cellular-data-button" Switch
t = 67.49s Checking existence of "cellular-data-button" Switch
t = 67.63s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 67.64s Find the "cellular-data-button" Switch
t = 67.73s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 67.75s Tap "cellular-data-button" Switch
t = 67.75s Wait for com.apple.springboard to idle
t = 67.86s Find the "cellular-data-button" Switch
t = 67.98s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 67.99s Check for interrupting elements affecting "cellular-data-button" Switch
t = 68.07s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 68.08s Synthesize event
t = 68.46s Wait for com.apple.springboard to idle
t = 68.57s Tap Application 'com.apple.springboard'[0.90, 0.10]
t = 68.57s Wait for com.apple.springboard to idle
t = 68.66s Find the Application 'com.apple.springboard'
t = 68.75s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 68.76s Check for interrupting elements affecting " " Application
t = 68.83s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 68.84s Synthesize event
t = 68.95s Find the Application 'com.apple.springboard'
t = 69.04s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 69.33s Wait for com.apple.springboard to idle
2022-10-20 21:09:13.606765+0200 AutomatorServerUITests-Runner[75213:5581828] PatrolServer: INFO: done enabling cellular
Patrol: enableCellular() succeeded
Patrol: disableCellular() started
2022-10-20 21:09:13.619696+0200 AutomatorServerUITests-Runner[75213:5581828] PatrolServer: INFO: disabling cellular...
t = 70.15s Press Application 'com.apple.springboard'[0.90, 0.01] for 0.1 seconds, then drag to Application 'com.apple.springboard'[0.90, 0.20] with velocity of 500.00 pixels per second, and then hold for 0.0 seconds
t = 70.15s Wait for com.apple.springboard to idle
t = 70.27s Find the Application 'com.apple.springboard'
t = 70.31s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 70.32s Check for interrupting elements affecting " " Application
t = 70.32s Wait for pl.leancode.patrol.Example to idle
[Default] Received request to notify when the main run loop is idle
[Default] Idle notifier finished setting up run loop observer
[Default] Idle notifier run loop observer fired
[Default] Sending main run loop idle reply
[Default] Received request to notify when animations are idle
[Default] Sending animations idle reply with error: (null)
[Default] Received request to fetch matches for query: ↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7
[Default] Evaluating query:
↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7
[Default] Getting root element snapshot
[Default] Getting snapshot for App element pid: 75220 for query ↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7
[Default] Query requires iOS snapshot attributes XC_kAXXCAttributeElementType, XC_kAXXCAttributeElementBaseType, XC_kAXXCAttributeIdentifier, XC_kAXXCAttributeAutomationType, XC_kAXXCAttributeTraits.
[Default] XCTPerformOnMainRunLoop[not MT]: about to CFRunLoopPerform
[Default] XCTPerformOnMainRunLoop[not MT]: waiting with 30.00s responsiveness timeout
[Default] XCTPerformOnMainRunLoop[MT]: inside CFRunLoopPerform
[Default] XCTPerformOnMainRunLoop[MT]: MT responded in time (won the race to the busy flag)
[Default] XCTPerformOnMainRunLoop[not MT]: waiting 60.00s for work to complete
[Default] Got main window <AXUIElementRef 0x281e7af70> {pid=75220} {uid=[ID:4 hash:0x13dd879e0]}
[Default] Capturing hierarchy with attributes XC_kAXXCAttributeElementType, XC_kAXXCAttributeElementBaseType, XC_kAXXCAttributeParent, XC_kAXXCAttributeIdentifier, XC_kAXXCAttributeAutomationType, XC_kAXXCAttributeTraits
[Default] Capturing hierarchy with parameters {
attributes = (
5003,
5004,
5002,
5019,
5058,
2004
);
maxArrayCount = 2147483647;
maxChildren = 2147483647;
maxDepth = 2147483647;
snapshotKeyHonorModalViews = 0;
traverseFromParentsToChildren = 1;
}
[Default] Snapshot attributes 5003, 5004, 5002, 5019, 5058, 2004
[Default] Got snapshot for <AXUIElementRef 0x281e5fc90> {pid=75220} {uid=[ID:1 hash:0x0]}
[Default] Got app orientation 0
[Default] Captured accessibility snapshot data in 0.00s
[Default] Found main window: Window
[Default] XCTPerformOnMainRunLoop[not MT]: about to CFRunLoopPerform
[Default] XCTPerformOnMainRunLoop[not MT]: waiting with 30.00s responsiveness timeout
[Default] XCTPerformOnMainRunLoop[MT]: inside CFRunLoopPerform
[Default] XCTPerformOnMainRunLoop[MT]: MT responded in time (won the race to the busy flag)
[Default] XCTPerformOnMainRunLoop[not MT]: waiting 60.00s for work to complete
[Default] XCTElementQuery: set data source for rootElementSnapshot to <XCTAutomationSession: 0x283473420>
[Default] Finding all matches with input Application, pid: 75220 using transformers
↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7
[Default] [Match All] applied transformer Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7 to input {(
Application, pid: 75220
)}, found {(
)}
[Default] [Match All] setting out related elements in early return {(
)}
[Default] Current tree:
Application, 0x13f304c30, pid: 75220 <App element pid: 75220>
Window (Main), 0x13f308980 <AX element pid: 75220, elementOrHash.elementID: 5332564448.4>
Other, 0x13f308a90 <AX element pid: 75220, elementOrHash.elementID: 5334221312.5>
Other, 0x13f307610 <AX element pid: 75220, elementOrHash.elementID: 5334224080.6>
Other, 0x13f307720 <AX element pid: 75220, elementOrHash.elementID: 5334191216.7>
[Default] Query ↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7 found matching snapshots: {(
)} (error: (null))
[Default] Replying to query ↪︎ Descendants matching predicate identifier == "NotificationShortLookView" OR elementType == 7 with results: <XCTElementQueryResults: 0x281e553e0> (error: (null))
t = 70.43s Synthesize event
t = 70.52s Find the Application 'com.apple.springboard'
t = 70.57s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 70.57s Find the Application 'com.apple.springboard'
t = 70.60s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 71.23s Wait for com.apple.springboard to idle
t = 71.34s Waiting 10.0s for "cellular-data-button" Switch to exist
t = 72.35s Checking Expect predicate exists == 1 for object "cellular-data-button" Switch
t = 72.35s Checking existence of "cellular-data-button" Switch
t = 72.49s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 72.49s Find the "cellular-data-button" Switch
t = 72.59s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 72.59s Tap "cellular-data-button" Switch
t = 72.59s Wait for com.apple.springboard to idle
t = 72.70s Find the "cellular-data-button" Switch
t = 72.82s Ignoring failure to get hierarchy for remote element in process 71802 (Error getting main window kAXErrorServerNotFound)
t = 72.83s Check for interrupting elements affecting "cellular-data-button" Switch
*** If you believe this error represents a bug, please attach the result bundle at /Users/bartek/Library/Developer/Xcode/DerivedData/AutomatorServer-bpharltabsnzaydolhzwjvvazaql/Logs/Test/Test-AutomatorServer-2022.10.20_9-07-51-+0200.xcresult
2022-10-20 21:09:16.218 xcodebuild[67366:3864939] [MT] IDETestOperationsObserverDebug: 78.971 elapsed -- Testing started completed.
2022-10-20 21:09:16.218 xcodebuild[67366:3864939] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start
2022-10-20 21:09:16.218 xcodebuild[67366:3864939] [MT] IDETestOperationsObserverDebug: 78.971 sec, +78.971 sec -- end

Unhandled exception:
DriverError: Failed to fulfill RequestData due to remote error
Original error: ext.flutter.driver: (112) Service has disappeared
Original stack trace:
#0 new _OutstandingRequest (package:vm_service/src/vm_service.dart:1746:45)
#1 VmService._call (package:vm_service/src/vm_service.dart:2262:21)
#2 VmService.callServiceExtension (package:vm_service/src/vm_service.dart:2233:14)
#3 VMServiceFlutterDriver.sendCommand (package:flutter_driver/src/driver/vmservice_driver.dart:306:66)
#4 FlutterDriver.requestData (package:flutter_driver/src/driver/driver.dart:522:45)
#5 integrationDriver (package:integration_test/integration_test_driver.dart:76:42)

#0 VMServiceFlutterDriver.sendCommand (package:flutter_driver/src/driver/vmservice_driver.dart:318:7)

#1 FlutterDriver.requestData (package:flutter_driver/src/driver/driver.dart:522:39)

#2 integrationDriver (package:integration_test/integration_test_driver.dart:76:29)

2022-10-20 21:09:16.299 xcodebuild[67366:3864939] [MT] IDEResultKit: Warning: While writing a result bundle to /Users/bartek/Library/Developer/Xcode/DerivedData/AutomatorServer-bpharltabsnzaydolhzwjvvazaql/Logs/Test/Test-AutomatorServer-2022.10.20_9-07-51-+0200.xcresult, not all contents have been imported, as the Staging directory still contains the following files/directories: ["1_Test"]

Test session results, code coverage, and logs:
/Users/bartek/Library/Developer/Xcode/DerivedData/AutomatorServer-bpharltabsnzaydolhzwjvvazaql/Logs/Test/Test-AutomatorServer-2022.10.20_9-07-51-+0200.xcresult
Testing failed:
Lost connection to DTServiceHub
testRunPatrolServer() encountered an error (Encountered a problem with the test runner after launch. If you believe this error represents a bug, please attach the result bundle at /Users/bartek/Library/Developer/Xcode/DerivedData/AutomatorServer-bpharltabsnzaydolhzwjvvazaql/Logs/Test/Test-AutomatorServer-2022.10.20_9-07-51-+0200.xcresult. (Underlying Error: Lost connection to DTServiceHub))

** TEST FAILED **
Unhandled exception:
Exception: Test failed. See logs above. Also, consider running with --verbose.

@bartekpacia bartekpacia changed the title Flutter Driver service dies randomly when performing native actions on iOS cellular_test is extremely flaky Oct 20, 2022
@bartekpacia
Copy link
Contributor Author

Fortunately, this is not as bad as I initially though.

cellular_test.dart requires further investigation.

@bartekpacia
Copy link
Contributor Author

@bartekpacia
Copy link
Contributor Author

Action item:

  • create issue on Apple Developers site with minimal repro

@jBorkowska jBorkowska added P1 High-priority issues at the top of the work list tests Related to Patrol's own testing & CI infra and removed P1 High-priority issues at the top of the work list labels Nov 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working platform: ios iOS is affected tests Related to Patrol's own testing & CI infra
Projects
None yet
Development

No branches or pull requests

2 participants