Skip to content

Commit

Permalink
Update non-concurrent tests (project-chip#3714)
Browse files Browse the repository at this point in the history
  • Loading branch information
@simonhmorris1
simonhmorris1 committed Dec 11, 2023
1 parent ac920cf commit 86bb3c1
Show file tree
Hide file tree
Showing 3 changed files with 134 additions and 177 deletions.
194 changes: 113 additions & 81 deletions src/app/tests/suites/certification/Test_TC_DD_3_2.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ name:

PICS:
- MCORE.ROLE.COMMISSIONEE
- MCORE.DD.NON_CONCURRENT_CONNECTION

config:
nodeId: 0x12344321
Expand Down Expand Up @@ -50,6 +51,41 @@ tests:
CHIP:SC: Received PBKDF param response
disabled: true

- label:
"Step 2a: Commissioner reads General Commissioning cluster attribute SupportsConcurrentConnection"
verification: |
Verify in TH(CHIP-TOOL)
CHIP:EM: Found matching exchange: 27352i, Delegate: 0x5130000217d0
CHIP:DMG: ReportDataMessage =
CHIP:DMG: {
CHIP:DMG: AttributeReportIBs =
CHIP:DMG: [
CHIP:DMG: AttributeReportIB =
CHIP:DMG: {
CHIP:DMG: AttributeDataIB =
CHIP:DMG: {
CHIP:DMG: DataVersion = 0x76e985c6,
CHIP:DMG: AttributePathIB =
CHIP:DMG: {
CHIP:DMG: Endpoint = 0x0,
CHIP:DMG: Cluster = 0x30,
CHIP:DMG: Attribute = 0x0000_0004,
CHIP:DMG: }
CHIP:DMG:
CHIP:DMG: Data = false,
CHIP:DMG: },
CHIP:DMG:
CHIP:DMG: },
CHIP:DMG:
CHIP:DMG: ],
CHIP:DMG:
CHIP:DMG: SuppressResponse = true,
CHIP:DMG: InteractionModelRevision = 11
CHIP:DMG: }
CHIP:CTL: Successfully finished commissioning step 'ReadCommissioningInfo2'
disabled: true

- label:
"Step 3: Commissioner SHALL re-arm Fail-safe timer on Commissionee
within 60s (the autonomously Fail-safe timer length set by
Expand Down Expand Up @@ -298,62 +334,31 @@ tests:

- label:
"Step 9: Commissioner instructs Commissionee to connect to operational
network if not already connected"
network, DUT does not send ConnectNetworkResponse on commissioning channel"
verification: |
Verify in TH(CHIP-TOOL)
[1651218834.137891][3273:3278] CHIP:CTL: Enabling thread network
[1651218834.138014][3273:3278] CHIP:DMG: ICR moving to [AddingComm]
[1651218834.138086][3273:3278] CHIP:DMG: ICR moving to [AddedComma]
[1651218834.138236][3273:3278] CHIP:IN: Prepared secure message 0xffffb9ba7938 to 0x0000000000000001 (1) of type 0x8 and protocolId (0, 1) on exchange 45046i with MessageCounter:12011392.
[1651218834.138325][3273:3278] CHIP:IN: Sending encrypted msg 0xffffb9ba7938 with MessageCounter:12011392 to 0x0000000000000001 (1) at monotonic time: 310788 msec
[1651218834.138522][3273:3278] CHIP:DMG: ICR moving to [CommandSen]
[1651218834.138628][3273:3278] CHIP:DMG: ICR moving to [AwaitingDe]
[1651218834.231701][3273:3278] CHIP:DL: HandlePlatformSpecificBLEEvent 16387
[1651218834.426948][3273:3276] CHIP:DL: Indication received, conn = 0xffffb0044210
[1651218834.427186][3273:3278] CHIP:DL: HandlePlatformSpecificBLEEvent 16389
[1651218834.427443][3273:3278] CHIP:EM: Received message of type 0x9 with protocolId (0, 1) and MessageCounter:8508044 on exchange 45046i
CHIP:EM: Found matching exchange: 45046i, Delegate: 0xffffb0040000
CHIP:DMG: ICR moving to [ResponseRe]
CHIP:DMG: InvokeResponseMessage =
CHIP:DMG: {
CHIP:DMG: suppressResponse = false,
CHIP:DMG: InvokeResponseIBs =
CHIP:DMG: [
CHIP:DMG: InvokeResponseIB =
CHIP:DMG: {
CHIP:DMG: CommandDataIB =
CHIP:DMG: {
CHIP:DMG: CommandPathIB =
CHIP:DMG: {
CHIP:DMG: EndpointId = 0x0,
CHIP:DMG: ClusterId = 0x31,
CHIP:DMG: CommandId = 0x7,
CHIP:DMG: },
CHIP:DMG:
CHIP:DMG: CommandData =
CHIP:DMG: {
CHIP:DMG: 0x0 = 0,
CHIP:DMG: 0x1 = "",
CHIP:DMG: 0x2 = 0,
CHIP:DMG: },
CHIP:DMG: },
CHIP:DMG:
CHIP:DMG: },
CHIP:DMG:
CHIP:DMG: ],
CHIP:DMG:
CHIP:DMG: InteractionModelRevision = 1
CHIP:DMG: },
CHIP:DMG: Received Command Response Data, Endpoint=0 Cluster=0x0000_0031 Command=0x0000_0007
CHIP:CTL: Received ConnectNetwork response
CHIP:DMG: Received Command Response Data, Endpoint=0 Cluster=0x0000_0030 Command=0x0000_0001
CHIP:CTL: Received ArmFailSafe response errorCode=0
CHIP:CTL: Successfully finished commissioning step 'FailsafeBeforeWiFiEnable'
CHIP:CTL: Commissioning stage next step: 'FailsafeBeforeWiFiEnable' -> 'WiFiNetworkEnable'
CHIP:CTL: Setting wifi connection time min = 20
CHIP:CTL: Performing next commissioning step 'WiFiNetworkEnable'
CHIP:CTL: SendCommand kWiFiNetworkEnable, supportsConcurrentConnection=0
CHIP:DMG: ICR moving to [AddingComm]
CHIP:DMG: ICR moving to [AddedComma]
CHIP:EM: <<< [E:27363i S:23451 M:255935542] (S) Msg TX to 0:FFFFFFFB00000000 [0000] [BLE] --- Type 0001:08 (IM:InvokeCommandRequest)
CHIP:DMG: ICR moving to [CommandSen]
CHIP:CTL: Successfully finished commissioning step 'WiFiNetworkEnable'
disabled: true

- label:
"Step 10: Commissioning channel between the Commissioner and
Commissionee is terminated."
verification: |
1. Terminate the connection between the Commissionee and the Commissioner. (i.e. remove network access or terminate commissioning process)
Verify in TH(CHIP-TOOL)
CHIP:CTL: Commissioning stage next step: 'WiFiNetworkEnable' -> 'FindOperational'
CHIP:CTL: Performing next commissioning step 'FindOperational'
disabled: true

- label:
Expand All @@ -362,10 +367,22 @@ tests:
verification: |
Verify in TH(CHIP-TOOL)
CHIP:DL: Avahi resolve found
CHIP:DIS: Node ID resolved for 0x0000000000000001
CHIP:DIS: Addr 0: [fd11:22::9d96:8fcf:10cf:799e]:5540
CHIP:CTL: OperationalDiscoveryComplete for device ID 0x0000000000000001
CHIP:CTL: Performing next commissioning step 'FindOperational'
CHIP:IN: Expiring all sessions for node <00000000000007CE, 1>!!
CHIP:CSM: FindOrEstablishSession: PeerId = [1:00000000000007CE]
CHIP:CSM: FindOrEstablishSession: No existing OperationalSessionSetup instance found
CHIP:DIS: OperationalSessionSetup[1:00000000000007CE]: State change 1 --> 2
CHIP:DMG: ICR moving to [AwaitingDe]
CHIP:DL: HandlePlatformSpecificBLEEvent 16387
CHIP:DIS: Checking node lookup status after 201 ms
CHIP:DIS: UDP:[fe80::e65f:1ff:fec2:47af%eth0]:5540: new best score: 7
CHIP:DIS: UDP:172.16.62.162%eth0:5540: score has not improved: 2
CHIP:DIS: Checking node lookup status after 6478 ms
CHIP:DIS: OperationalSessionSetup[1:00000000000007CE]: Updating device address to UDP:[fe80::e65f:1ff:fec2:47af%eth0]:5540 while in state 2
CHIP:DIS: OperationalSessionSetup[1:00000000000007CE]: State change 2 --> 3
CHIP:IN: SecureSession[0x51200002d040]: Allocated Type:2 LSID:23452
CHIP:SC: Initiating session on local FabricIndex 1 from 0x000000000001B669 -> 0x00000000000007CE
CHIP:EM: <<< [E:27364i S:0 M:74187585] (U) Msg TX to 0:0000000000000000 [0000] [UDP:[fe80::e65f:1ff:fec2:47af%eth0]:5540] --- Type 0000:30 (SecureChannel:CASE_Sigma1)
disabled: true

- label:
Expand All @@ -375,45 +392,60 @@ tests:
Verify in TH(CHIP-TOOL)
CHIP:SC: Sent Sigma1 msg
CHIP:CTL: Address resolved for node: 0x0000000000000001
CHIP:EM: Received message of type 0x31 with protocolId (0, 0) and MessageCounter:1066460336 on exchange 45047i
CHIP:EM: Found matching exchange: 45047i, Delegate: 0xffffa400f7f8
CHIP:EM: Rxd Ack; Removing MessageCounter:2352378411 from Retrans Table on exchange 45047i
CHIP:EM: Removed CHIP MessageCounter:2352378411 from RetransTable on exchange 45047i
CHIP:DIS: OperationalSessionSetup[1:00000000000007CE]: State change 3 --> 4
CHIP:EM: >>> [E:27364i S:0 M:167444416 (Ack:74187585)] (U) Msg RX from 0:0000000000000000 [0000] --- Type 0000:31 (SecureChannel:CASE_Sigma2)
CHIP:EM: Found matching exchange: 27364i, Delegate: 0x517000011508
CHIP:EM: Rxd Ack; Removing MessageCounter:74187585 from Retrans Table on exchange 27364i
CHIP:SC: Received Sigma2 msg
CHIP:SC: Peer assigned session session ID 2
CHIP:SC: The device does not support GetClock_RealTimeMS() API. This will eventually result in CASE session setup failures.
CHIP:IN: Generating compressed fabric ID using uncompressed fabric ID 0x0000000000000001 and root pubkey
CHIP:IN: 0x04, 0x6e, 0x3e, 0x58, 0x9d, 0x08, 0xd6, 0xae,
CHIP:IN: 0xe9, 0xff, 0x9b, 0x8f, 0xba, 0x6f, 0x57, 0x73,
CHIP:IN: 0x21, 0xc4, 0xe2, 0x7b, 0x09, 0xe4, 0x24, 0x7f,
CHIP:IN: 0x55, 0x44, 0x3b, 0xf2, 0x7c, 0x13, 0x45, 0x3b,
CHIP:IN: 0x82, 0xa8, 0x42, 0x96, 0xb4, 0x36, 0x78, 0x20,
CHIP:IN: 0xa1, 0x37, 0x69, 0xf0, 0x20, 0xc9, 0x20, 0x7e,
CHIP:IN: 0x66, 0x45, 0x84, 0x53, 0x1b, 0x3e, 0xd2, 0x61,
CHIP:IN: 0xb6, 0x89, 0x27, 0xfd, 0xe8, 0x23, 0x69, 0x6d,
CHIP:IN: 0x93,
CHIP:IN: Generated compressed fabric ID
CHIP:IN: 0xa3, 0x54, 0xab, 0x2a, 0xa2, 0x1f, 0x8e, 0x48,
CHIP:SC: Peer assigned session session ID 61842
CHIP:SC: Found MRP parameters in the message
CHIP:SC: Sending Sigma3
CHIP:EM: Piggybacking Ack for MessageCounter:1066460336 on exchange: 45047i
CHIP:IN: Prepared unauthenticated message 0xaaaad7ce1bf8 to 0x0000000000000000 (0) of type 0x32 and protocolId (0, 0) on exchange 45047i with MessageCounter:2352378412.
CHIP:IN: Sending unauthenticated msg 0xaaaad7ce1bf8 with MessageCounter:2352378412 to 0x0000000000000000 at monotonic time: 315803 msec
CHIP:EM: <<< [E:27364i S:0 M:74187586 (Ack:167444416)] (U) Msg TX to 0:0000000000000000 [0000] [UDP:[fe80::e65f:1ff:fec2:47af%eth0]:5540] --- Type 0000:32 (SecureChannel:CASE_Sigma3)
CHIP:SC: Sent Sigma3 msg
CHIP:EM: Received message of type 0x40 with protocolId (0, 0) and MessageCounter:1066460337 on exchange 45047i
CHIP:EM: Found matching exchange: 45047i, Delegate: 0xffffa400f7f8
CHIP:EM: Rxd Ack; Removing MessageCounter:2352378412 from Retrans Table on exchange 45047i
CHIP:EM: Removed CHIP MessageCounter:2352378412 from RetransTable on exchange 45047i
CHIP:EM: >>> [E:27364i S:0 M:167444417 (Ack:74187586)] (U) Msg RX from 0:0000000000000000 [0000] --- Type 0000:40 (SecureChannel:StatusReport)
CHIP:EM: Found matching exchange: 27364i, Delegate: 0x517000011508
CHIP:SC: Success status report received. Session was established
CHIP:IN: New secure session created for device 0x0000000000000001, LSID:2 PSID:2!
CHIP:SC: SecureSession[0x51200002d040, LSID:23452]: State change 'kEstablishing' --> 'kActive'
CHIP:IN: SecureSession[0x51200002d040]: Activated - Type:2 LSID:23452
CHIP:IN: New secure session activated for device <00000000000007CE, 1>, LSID:23452 PSID:61842!
CHIP:DIS: OperationalSessionSetup[1:00000000000007CE]: State change 4 --> 5
CHIP:CTL: Successfully finished commissioning step 'FindOperational'
disabled: true

- label: "Step 13: Commissioner sends CommissioningComplete command"
verification: |
Verify in TH(CHIP-TOOL)
CHIP:CTL: Received CommissioningComplete response
CHIP:CTL: Rendezvous cleanup
CHIP:TOO: Device commissioning completed with success
CHIP:DMG: InvokeResponseMessage =
CHIP:DMG: {
CHIP:DMG: suppressResponse = false,
CHIP:DMG: InvokeResponseIBs =
CHIP:DMG: [
CHIP:DMG: InvokeResponseIB =
CHIP:DMG: {
CHIP:DMG: CommandDataIB =
CHIP:DMG: {
CHIP:DMG: CommandPathIB =
CHIP:DMG: {
CHIP:DMG: EndpointId = 0x0,
CHIP:DMG: ClusterId = 0x30,
CHIP:DMG: CommandId = 0x5,
CHIP:DMG: },
CHIP:DMG:
CHIP:DMG: CommandFields =
CHIP:DMG: {
CHIP:DMG: 0x0 = 0,
CHIP:DMG: 0x1 = "" (0 chars),
CHIP:DMG: },
CHIP:DMG: },
CHIP:DMG:
CHIP:DMG: },
CHIP:DMG:
CHIP:DMG: ],
CHIP:DMG:
CHIP:DMG: InteractionModelRevision = 11
CHIP:DMG: },
CHIP:DMG: Received Command Response Data, Endpoint=0 Cluster=0x0000_0030 Command=0x0000_0005
CHIP:CTL: Received CommissioningComplete response, errorCode=0
CHIP:CTL: Successfully finished commissioning step 'SendComplete'
disabled: true
59 changes: 11 additions & 48 deletions src/app/tests/suites/certification/Test_TC_DD_3_6.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ tests:
- label: "Note"
verification: |
Chip-tool command used below are an example to verify the DUT as commissioner test cases. For certification test, we expect DUT should have a capability or way to run the equivalent command.
Test Harness as a Commissionee device that is not connected to an operational network (i.e. BLE, Wi-Fi, or Ethernet) and is prepared for commissioning as a Non-concurrent device
disabled: true

- label: "Preconditions"
Expand Down Expand Up @@ -64,6 +65,13 @@ tests:
CHIP:SC: Received PBKDF param response
disabled: true

- label:
"Step 3a: Commissioner reads commissioning information, including SupportsConcurrentConnection attribute
from General Commissioining Cluster"
verification: |
Verify in DUT as commissioner side that SupportsConcurrentConnection is false
disabled: true

- label:
"Step 4: Commissioner SHALL re-arm Fail-safe timer on Commissionee
within 60s (the autonomously Fail-safe timer length set by
Expand Down Expand Up @@ -317,55 +325,10 @@ tests:

- label:
"Step 10: Commissioner instructs Commissionee to connect to
operational network if not already connected"
operational network"
verification: |
Verify in DUT as commissioner side
[1651218834.137891][3273:3278] CHIP:CTL: Enabling thread network
[1651218834.138014][3273:3278] CHIP:DMG: ICR moving to [AddingComm]
[1651218834.138086][3273:3278] CHIP:DMG: ICR moving to [AddedComma]
[1651218834.138236][3273:3278] CHIP:IN: Prepared secure message 0xffffb9ba7938 to 0x0000000000000001 (1) of type 0x8 and protocolId (0, 1) on exchange 45046i with MessageCounter:12011392.
[1651218834.138325][3273:3278] CHIP:IN: Sending encrypted msg 0xffffb9ba7938 with MessageCounter:12011392 to 0x0000000000000001 (1) at monotonic time: 310788 msec
[1651218834.138522][3273:3278] CHIP:DMG: ICR moving to [CommandSen]
[1651218834.138628][3273:3278] CHIP:DMG: ICR moving to [AwaitingDe]
[1651218834.231701][3273:3278] CHIP:DL: HandlePlatformSpecificBLEEvent 16387
[1651218834.426948][3273:3276] CHIP:DL: Indication received, conn = 0xffffb0044210
[1651218834.427186][3273:3278] CHIP:DL: HandlePlatformSpecificBLEEvent 16389
[1651218834.427443][3273:3278] CHIP:EM: Received message of type 0x9 with protocolId (0, 1) and MessageCounter:8508044 on exchange 45046i
CHIP:EM: Found matching exchange: 45046i, Delegate: 0xffffb0040000
CHIP:DMG: ICR moving to [ResponseRe]
CHIP:DMG: InvokeResponseMessage =
CHIP:DMG: {
CHIP:DMG: suppressResponse = false,
CHIP:DMG: InvokeResponseIBs =
CHIP:DMG: [
CHIP:DMG: InvokeResponseIB =
CHIP:DMG: {
CHIP:DMG: CommandDataIB =
CHIP:DMG: {
CHIP:DMG: CommandPathIB =
CHIP:DMG: {
CHIP:DMG: EndpointId = 0x0,
CHIP:DMG: ClusterId = 0x31,
CHIP:DMG: CommandId = 0x7,
CHIP:DMG: },
CHIP:DMG:
CHIP:DMG: CommandData =
CHIP:DMG: {
CHIP:DMG: 0x0 = 0,
CHIP:DMG: 0x1 = "",
CHIP:DMG: 0x2 = 0,
CHIP:DMG: },
CHIP:DMG: },
CHIP:DMG:
CHIP:DMG: },
CHIP:DMG:
CHIP:DMG: ],
CHIP:DMG:
CHIP:DMG: InteractionModelRevision = 1
CHIP:DMG: },
CHIP:DMG: Received Command Response Data, Endpoint=0 Cluster=0x0000_0031 Command=0x0000_0007
CHIP:CTL: Received ConnectNetwork response
Verify in DUT as commissioner, DUT does not wait for ConnectNetworkResponse
on commissioning channel and moves onto next step.
disabled: true

- label:
Expand Down
Loading

0 comments on commit 86bb3c1

Please sign in to comment.