From 383b33ccad8fd441353a71d04dfb358f598ec55d Mon Sep 17 00:00:00 2001 From: pm937925 Date: Tue, 10 Aug 2021 12:51:39 +0530 Subject: [PATCH 1/4] 4.0: IGMP Snooping gNMI SAMPLE test cases --- ...MP_Snooping_gNMI_Subscription_Testplan.md} | 141 ++++++++++++++++-- ...{ON_CHANGE_TOPOLOGY.PNG => topology_1.PNG} | Bin 2 files changed, 128 insertions(+), 13 deletions(-) rename TestPlans/manageability/mgmt-framework/{ON_CHANGE_Subscription_Testplan.md => IGMP_Snooping_gNMI_Subscription_Testplan.md} (60%) rename TestPlans/manageability/mgmt-framework/images/{ON_CHANGE_TOPOLOGY.PNG => topology_1.PNG} (100%) diff --git a/TestPlans/manageability/mgmt-framework/ON_CHANGE_Subscription_Testplan.md b/TestPlans/manageability/mgmt-framework/IGMP_Snooping_gNMI_Subscription_Testplan.md similarity index 60% rename from TestPlans/manageability/mgmt-framework/ON_CHANGE_Subscription_Testplan.md rename to TestPlans/manageability/mgmt-framework/IGMP_Snooping_gNMI_Subscription_Testplan.md index 1ed5be5f7527..0968b5b86cf9 100644 --- a/TestPlans/manageability/mgmt-framework/ON_CHANGE_Subscription_Testplan.md +++ b/TestPlans/manageability/mgmt-framework/IGMP_Snooping_gNMI_Subscription_Testplan.md @@ -1,14 +1,15 @@ # SQA Test Plan -# ON_CHANGE subscription mechanism for streaming telemetry +# IGMP Snooping gNMI Subscription TestPlan # SONiC 3.2.0 Release [TOC] # Test Plan Revision History -| Rev | Date | Author | Change Description | -| :--: | :--------: | :------------------: | :--------------------------: | -| 0.1 | 5/1/2021 | Prudvi Mangadu | Initial version | -| 0.1 | 13/1/2021 | Prudvi Mangadu | Addressing review comments | +| Rev | Date | Author | Change Description | +| :--: | :--------: | :------------------: | :--------------------------: | +| 0.1 | 05/01/2021 | Prudvi Mangadu | Initial version | +| 0.2 | 13/01/2021 | Prudvi Mangadu | Addressing review comments | +| 0.3 | 03/08/2021 | Prudvi Mangadu | Adding SAMPLE Wildcard with path keys test cases | # List of Reviewers | Function | Name | @@ -31,39 +32,60 @@ | REST | Representational State Transfer | | HLD | High Level Design Document | | URI | Uniform Resource Identifier | +| WCKV | Wildcard Path key value | ### Objective The main objective of this document is to cover the test cases that will be executed to verify the ON_CHANGE - Subscription. Topologies and test cases for testing the feature will be discussed as part of this document. +and Wildcard SAMPLE Subscription. Topologies and test cases for testing the feature will be discussed as part of this + document. -ON_CHANGE support going to be supported in 3.2 release. +ON_CHANGE support going to be supported in 3.2 release. + +SAMPLE with wildcard path key support going to be supported in 4.0.0 release. + +gNMI Server should support wild cards in path key for all subscription modes. +Example: /openconfig-interfaces:interfaces/interface[name=*]/config. Path can contain any number of wildcard key values. ### Scope This test plan will cover following aspects of ON_CHANGE Subscription. -1. Supported only for igmp-snooping URI mentioned under 10.4 - Onchange supported URI Paths of the [Telemetry - Subscribe RPC](https://github.com/BRCM-SONIC/sonic_doc_private/blob/master/manageability/mgmt-framework/Telemetry_Subscribe_RPC.md) +1. ON_CHANGE Supported only for igmp-snooping URI mentioned under 10.4 - Onchange supported URI Paths of the [Telemetry + Subscribe RPC] 2. Subscribe each URI to ON_CHANGE and Validating the ON_CHANGE notification. +3. Subscribe each URI to SAMPLE with WCKV and Validating the Update and Delete notification w.r.t sample_interval. +4. Subscribe each URI to SAMPLE with WCKV and Validating the Update notification w.r.t suppress_redundant. +5. SAMPLE WCKV supports only for paths avaliable in [Telementry Subscription Path] + # Feature Overview +**ON CHANGE Subscription:** Server sends data updates to the client when the value of subscribed path is changed. This mode is not suitable for frequently changing values like counters. Server can reject the ON_CHANGE subscribe request if it cannot support ON_CHANGE updates to the requested paths. Once accepted, server first sends current data for the subscribed paths to client (initial sync). Thereafter server sends only the delta updates to client when the values are changed on the server. +**SAMPLE Subscription:** +Server samples the data values periodically and streams the data to the client. +Client would specify the paths and sample interval through the Subscribe request. +Server would reject the request if it cannot support the requested sample interval. + # 1 Test Focus Areas ## 1.1 Functional Testing - Subscribe URI to ON_CHANGE and Validating the current data first time(initial sync). - Subscribe URI to ON_CHANGE and Validating the delta data. - + - Subscribe path value wildcard URI to SAMPLE and Validating the current data first time(initial sync). + - Subscribe path value wildcard URI to SAMPLE and Validating the sample update and delete w.r.t sample interval. + ## 1.2 Scale and Performance Testing - Subscribe Multiple/MAX URIs to ON_CHANGE and Validating the ON_CHANGE notification. + - Subscribe Multiple/MAX URIs to SAMPLE and Validating the Update and delete notification. ## 1.3 Negative Testing - Server should reject the ON_CHANGE subscribe request if it cannot support ON_CHANGE updates to the requested paths + - Server should reject the SAMPLE wildcard subscribe request if it cannot support. ## 1.4 Reboot/Reload/Upgrade Testing - - Verify ON_CHANGE Subscription across + - Verify ON_CHANGE and SAMPLE wildcard path key Subscription across ``` - Warm reboot - Fast reboot @@ -76,7 +98,7 @@ Note: If management interface or telemetry service goes down, Re-Subscription re # 2 Topologies ## 2.1 Topology -![Topology](images/ON_CHANGE_TOPOLOGY.PNG "Figure 1: Topology") +![Topology](images/topology_1.PNG "Figure 1: Topology") # 3 Test Case and Objectives ## 3.1 Functional @@ -144,6 +166,38 @@ Note: If management interface or telemetry service goes down, Re-Subscription re | **Type** | **Functional** | | **Steps** | 1) Subscribe the URI to the ON_CHANGE notification, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Now delete the Subscribe path values multiple time
4) Verify that server sends only the delta updates to client for each time values get change.
| +### 3.1.9 Verify that SAMPLE WCKV subscription will send initial sync and then only send updates to client w.r.t to SAMPLE_INTERVAL. +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_001** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify that SAMPLE subscription will send initial sync and then only send updates to client w.r.t to SAMPLE_INTERVAL. ** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | 1) Subscribe Path with SAMPLE and SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates to client for every SAMPLE_INTERVAL.
| + +### 3.1.10 Verify that SAMPLE WCKV subscription with SUPPRESS_REDUNDANT will send initial sync and then only send non-redundant updates to client. +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_002** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify that SAMPLE subscription with SUPPRESS_REDUNDANT will send initial sync and then only send non-redundant updates to client ** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | 1) Subscribe Path with SAMPLE and SUPPRESS_REDUNDANT, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server should not sends updates to client for every SAMPLE_INTERVAL.
|4) Verify that server sends updates to client for every SAMPLE_INTERVAL if update is not redundant..
| + +### 3.1.11 Verify that SAMPLE WCKV subscription will send initial sync and send the modified data in update w.r.t user change. +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_003** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify that SAMPLE subscription will send initial sync and send the modified data in update w.r.t user change ** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | 1) Subscribe Path with SAMPLE and SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates to client for every SAMPLE_INTERVAL.
|4) Now change the value of the DB using any UI type.
|5) Verify that server sends updates modified values to client for every SAMPLE_INTERVAL.
| + +### 3.1.12 Verify that Server should not send SAMPLE notification once delete notification received to client. +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_004** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify that Server should not send SAMPLE notification once delete notification received to client.** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | 1) Subscribe Paths with SAMPLE and different SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates of both paths to client with corresponding SAMPLE_INTERVAL.
|4) Now un-config the value to remove from DB.
|5) Verify that server sends delete notification to client and stop sending the update notification.
| + ## 3.2 Scale and Performance Test Cases ### 3.2.1 Verify that ON_CHANGE notification with Multiple/MAX URIs to ON_CHANGE subscription. @@ -170,6 +224,22 @@ Note: If management interface or telemetry service goes down, Re-Subscription re | **Type** | **Functional** | | **Steps** | 1) client1 can subscribe for paths A, B, C and client2 can subscribe to B, C, D
2) Verify that initial sync of A gets notified to only client1 whereas B should be notified to both
3) Kill client2.
4) Now change the Subscribe path values
5) Verify that delta updates of A gets notified to only client1 whereas B should be notified to client1 as client2 is killed.
| +### 3.2.4 Verify that SAMPLE WCKV subscription with Multi paths with same SAMPLE_INTERVAL. +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_005** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify that SAMPLE subscription with Multi paths with same SAMPLE_INTERVAL** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | 1) Subscribe Paths with SAMPLE and same SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates of both paths to client for every SAMPLE_INTERVAL.
| + +### 3.2.5 Verify that SAMPLE WCKV subscription with Multi paths with different SAMPLE_INTERVAL. +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_006** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify that SAMPLE subscription with Multi paths with different SAMPLE_INTERVAL.** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | 1) Subscribe Paths with SAMPLE and different SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates of both paths to client with corresponding SAMPLE_INTERVAL.
| + ## 3.3 Negative Test Cases ### 3.3.1 Verify that Server should reject the ON_CHANGE subscribe request for URIs not support ON_CHANGE. @@ -230,6 +300,51 @@ Note: If management interface or telemetry service goes down, Re-Subscription re | **Type** | **Functional** | | **Steps** | Verify ON_CHANGE Subscription across telemetry docker restart
| +### 3.4.6 Verify SAMPLE WCKV Subscription across warm reboot +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_007** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify SAMPLE WCKV Subscription across warm reboot** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | Verify SAMPLE WCKV Subscription across warm reboot
| + +### 3.4.7 Verify SAMPLE WCKV Subscription across fast reboot +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_008** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify SAMPLE WCKV Subscription across warm reboot** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | Verify SAMPLE WCKV Subscription across warm reboot
| + +### 3.4.8 Verify SAMPLE WCKV Subscription across System reload +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_009** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify SAMPLE WCKV Subscription across warm reboot** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | Verify SAMPLE WCKV Subscription across warm reboot
| + +### 3.4.9 Verify SAMPLE WCKV Subscription across config reload +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_010** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify SAMPLE WCKV Subscription across warm reboot** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | Verify SAMPLE WCKV Subscription across warm reboot
| + +### 3.4.10 Verify SAMPLE WCKV Subscription across telemetry docker restart +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_011** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify SAMPLE WCKV Subscription across warm reboot** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | Verify SAMPLE WCKV Subscription across warm reboot
| + ## 4 Reference Links - +HLD: [Telemetry Subscribe RPC]
+Supported Path: [Telementry Subscription Path] + +[Telemetry Subscribe RPC]: https://github.com/BRCM-SONIC/sonic_doc_private/blob/master/manageability/mgmt-framework/Telemetry_Subscribe_RPC.md +[Telementry Subscription Path]:https://github.com/BRCM-SONIC/sonic_doc_private/blob/master/manageability/mgmt-framework/Telemetry_Subscribe_Paths.md + diff --git a/TestPlans/manageability/mgmt-framework/images/ON_CHANGE_TOPOLOGY.PNG b/TestPlans/manageability/mgmt-framework/images/topology_1.PNG similarity index 100% rename from TestPlans/manageability/mgmt-framework/images/ON_CHANGE_TOPOLOGY.PNG rename to TestPlans/manageability/mgmt-framework/images/topology_1.PNG From db8d5db14fd75dc8695da28b6640bbf66a326c93 Mon Sep 17 00:00:00 2001 From: pm937925 Date: Mon, 16 Aug 2021 17:58:20 +0530 Subject: [PATCH 2/4] Addressing review comments --- ...GMP_Snooping_gNMI_Subscription_Testplan.md | 68 +++++++++++++++---- 1 file changed, 55 insertions(+), 13 deletions(-) diff --git a/TestPlans/manageability/mgmt-framework/IGMP_Snooping_gNMI_Subscription_Testplan.md b/TestPlans/manageability/mgmt-framework/IGMP_Snooping_gNMI_Subscription_Testplan.md index 0968b5b86cf9..d9454b6a9849 100644 --- a/TestPlans/manageability/mgmt-framework/IGMP_Snooping_gNMI_Subscription_Testplan.md +++ b/TestPlans/manageability/mgmt-framework/IGMP_Snooping_gNMI_Subscription_Testplan.md @@ -10,6 +10,7 @@ | 0.1 | 05/01/2021 | Prudvi Mangadu | Initial version | | 0.2 | 13/01/2021 | Prudvi Mangadu | Addressing review comments | | 0.3 | 03/08/2021 | Prudvi Mangadu | Adding SAMPLE Wildcard with path keys test cases | +| 0.4 | 16/08/2021 | Prudvi Mangadu | Addressing review comments| # List of Reviewers | Function | Name | @@ -180,7 +181,7 @@ Note: If management interface or telemetry service goes down, Re-Subscription re | **Test Name** | **Verify that SAMPLE subscription with SUPPRESS_REDUNDANT will send initial sync and then only send non-redundant updates to client ** | | **Test Setup** | **Topology** | | **Type** | **Functional** | -| **Steps** | 1) Subscribe Path with SAMPLE and SUPPRESS_REDUNDANT, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server should not sends updates to client for every SAMPLE_INTERVAL.
|4) Verify that server sends updates to client for every SAMPLE_INTERVAL if update is not redundant..
| +| **Steps** | 1) Subscribe Path with SAMPLE and SUPPRESS_REDUNDANT, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server should not sends updates to client for every SAMPLE_INTERVAL.
4) Verify that server sends updates to client for every SAMPLE_INTERVAL if update is not redundant..
| ### 3.1.11 Verify that SAMPLE WCKV subscription will send initial sync and send the modified data in update w.r.t user change. | **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_003** | @@ -188,15 +189,39 @@ Note: If management interface or telemetry service goes down, Re-Subscription re | **Test Name** | **Verify that SAMPLE subscription will send initial sync and send the modified data in update w.r.t user change ** | | **Test Setup** | **Topology** | | **Type** | **Functional** | -| **Steps** | 1) Subscribe Path with SAMPLE and SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates to client for every SAMPLE_INTERVAL.
|4) Now change the value of the DB using any UI type.
|5) Verify that server sends updates modified values to client for every SAMPLE_INTERVAL.
| +| **Steps** | 1) Subscribe Path with SAMPLE and SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates to client for every SAMPLE_INTERVAL.
4) Now change the value of the DB using any UI type.
5) Verify that server sends updates modified values to client for every SAMPLE_INTERVAL.
| -### 3.1.12 Verify that Server should not send SAMPLE notification once delete notification received to client. +### 3.1.12 Verify that Server should send SAMPLE Updates for date if any present along with delete notification received to client. | **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_004** | | -------------- | :----------------------------------------------------------- | -| **Test Name** | **Verify that Server should not send SAMPLE notification once delete notification received to client.** | +| **Test Name** | **Verify that Server should send SAMPLE Updates for date if any present along with delete notification received to client.** | | **Test Setup** | **Topology** | | **Type** | **Functional** | -| **Steps** | 1) Subscribe Paths with SAMPLE and different SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates of both paths to client with corresponding SAMPLE_INTERVAL.
|4) Now un-config the value to remove from DB.
|5) Verify that server sends delete notification to client and stop sending the update notification.
| +| **Steps** | 1) Subscribe Paths with SAMPLE and different SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates of both paths to client with corresponding SAMPLE_INTERVAL.
4) Now un-config the value to remove from DB.
5) Verify that server sends delete notification to client along it should sending the update notification if any data present.
| + +### 3.1.13 Verify that Server should send only sync responce when no date avaliable. +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_012** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify that Server should send only sync responce when no date avaliable.** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | 1) Subscribe Paths which has no data with SAMPLE and different SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server sends only the sync responce but not data.
| + +### 3.1.14 Verify that Server should send corecte notification for Create, update and delete within one sample interval . +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_013** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify that Server should send corecte notification for Create, update and delete within one sample interval** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | 1) Subscribe Paths which has no data with SAMPLE and different SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates to client for every SAMPLE_INTERVAL.
4) Now Create, update and delete within one sample interval the value of the DB.
5) Verify that server sends updates modified values to client for every SAMPLE_INTERVAL.
| + +### 3.1.15 Verify that SAMPLE with non wildcard subscription will send initial sync and then only send updates to client w.r.t to SAMPLE_INTERVAL. +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_016** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify that SAMPLE with non wildcard subscription will send initial sync and then only send updates to client w.r.t to SAMPLE_INTERVAL. ** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | 1) Subscribe non wildcard Path with SAMPLE and SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates to client for every SAMPLE_INTERVAL.
| ## 3.2 Scale and Performance Test Cases @@ -240,6 +265,14 @@ Note: If management interface or telemetry service goes down, Re-Subscription re | **Type** | **Functional** | | **Steps** | 1) Subscribe Paths with SAMPLE and different SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates of both paths to client with corresponding SAMPLE_INTERVAL.
| +### 3.2.6 Verify that SAMPLE WCKV subscription with Multi paths one with suppress_redundant=true and other with suppress_redundant=false. +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_015** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify that SAMPLE WCKV subscription with Multi paths one with suppress_redundant=true and other with suppress_redundant=false..** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | 1) Subscribe Paths with SAMPLE and different suppress_redundant, make sure Server accepts the subscribe request
2) Verify that server first sends current data for both subscribed paths to client (initial sync)
3) Verify that server should only sends updates of suppress_redundant=false path to client with corresponding SAMPLE_INTERVAL.
| + ## 3.3 Negative Test Cases ### 3.3.1 Verify that Server should reject the ON_CHANGE subscribe request for URIs not support ON_CHANGE. @@ -258,6 +291,15 @@ Note: If management interface or telemetry service goes down, Re-Subscription re | **Type** | **Functional** | | **Steps** | 1) Subscribe the URI to the ON_CHANGE notification, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Un-Subscribe the URI and change the Subscribe path values multiple time
4) Verify that server should not send updates to client.
| +### 3.3.3 Verify that Server should return error for request with sample_interval < min_interval . +| **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_014** | +| -------------- | :----------------------------------------------------------- | +| **Test Name** | **Verify that Server should return error for request with sample_interval < min_interval** | +| **Test Setup** | **Topology** | +| **Type** | **Functional** | +| **Steps** | 1)Subscribe Path with SAMPLE and SAMPLE_INTERVAL(less than 20sec), make sure Server returns error.
| + + ## 3.4 Reboot/Reload/Upgrade Test Cases ### 3.4.1 Verify ON_CHANGE Subscription across warm reboot. @@ -311,34 +353,34 @@ Note: If management interface or telemetry service goes down, Re-Subscription re ### 3.4.7 Verify SAMPLE WCKV Subscription across fast reboot | **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_008** | | -------------- | :----------------------------------------------------------- | -| **Test Name** | **Verify SAMPLE WCKV Subscription across warm reboot** | +| **Test Name** | **Verify SAMPLE WCKV Subscription across fast reboot** | | **Test Setup** | **Topology** | | **Type** | **Functional** | -| **Steps** | Verify SAMPLE WCKV Subscription across warm reboot
| +| **Steps** | Verify SAMPLE WCKV Subscription across fast reboot
| ### 3.4.8 Verify SAMPLE WCKV Subscription across System reload | **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_009** | | -------------- | :----------------------------------------------------------- | -| **Test Name** | **Verify SAMPLE WCKV Subscription across warm reboot** | +| **Test Name** | **Verify SAMPLE WCKV Subscription across System reload** | | **Test Setup** | **Topology** | | **Type** | **Functional** | -| **Steps** | Verify SAMPLE WCKV Subscription across warm reboot
| +| **Steps** | Verify SAMPLE WCKV Subscription across System reload
| ### 3.4.9 Verify SAMPLE WCKV Subscription across config reload | **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_010** | | -------------- | :----------------------------------------------------------- | -| **Test Name** | **Verify SAMPLE WCKV Subscription across warm reboot** | +| **Test Name** | **Verify SAMPLE WCKV Subscription across config reload** | | **Test Setup** | **Topology** | | **Type** | **Functional** | -| **Steps** | Verify SAMPLE WCKV Subscription across warm reboot
| +| **Steps** | Verify SAMPLE WCKV Subscription across config reload
| ### 3.4.10 Verify SAMPLE WCKV Subscription across telemetry docker restart | **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_011** | | -------------- | :----------------------------------------------------------- | -| **Test Name** | **Verify SAMPLE WCKV Subscription across warm reboot** | +| **Test Name** | **Verify SAMPLE WCKV Subscription across telemetry docker restart** | | **Test Setup** | **Topology** | | **Type** | **Functional** | -| **Steps** | Verify SAMPLE WCKV Subscription across warm reboot
| +| **Steps** | Verify SAMPLE WCKV Subscription across telemetry docker restart
| ## 4 Reference Links From 8f3015eb1f9ee07a4ac726bbcf039ee5889efd81 Mon Sep 17 00:00:00 2001 From: pm937925 Date: Tue, 17 Aug 2021 09:49:55 +0530 Subject: [PATCH 3/4] Minor corrections --- .../IGMP_Snooping_gNMI_Subscription_Testplan.md | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/TestPlans/manageability/mgmt-framework/IGMP_Snooping_gNMI_Subscription_Testplan.md b/TestPlans/manageability/mgmt-framework/IGMP_Snooping_gNMI_Subscription_Testplan.md index d9454b6a9849..9ca927ab9f3d 100644 --- a/TestPlans/manageability/mgmt-framework/IGMP_Snooping_gNMI_Subscription_Testplan.md +++ b/TestPlans/manageability/mgmt-framework/IGMP_Snooping_gNMI_Subscription_Testplan.md @@ -170,7 +170,7 @@ Note: If management interface or telemetry service goes down, Re-Subscription re ### 3.1.9 Verify that SAMPLE WCKV subscription will send initial sync and then only send updates to client w.r.t to SAMPLE_INTERVAL. | **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_001** | | -------------- | :----------------------------------------------------------- | -| **Test Name** | **Verify that SAMPLE subscription will send initial sync and then only send updates to client w.r.t to SAMPLE_INTERVAL. ** | +| **Test Name** | **Verify that SAMPLE subscription will send initial sync and then only send updates to client w.r.t to SAMPLE_INTERVAL.** | | **Test Setup** | **Topology** | | **Type** | **Functional** | | **Steps** | 1) Subscribe Path with SAMPLE and SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates to client for every SAMPLE_INTERVAL.
| @@ -178,7 +178,7 @@ Note: If management interface or telemetry service goes down, Re-Subscription re ### 3.1.10 Verify that SAMPLE WCKV subscription with SUPPRESS_REDUNDANT will send initial sync and then only send non-redundant updates to client. | **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_002** | | -------------- | :----------------------------------------------------------- | -| **Test Name** | **Verify that SAMPLE subscription with SUPPRESS_REDUNDANT will send initial sync and then only send non-redundant updates to client ** | +| **Test Name** | **Verify that SAMPLE subscription with SUPPRESS_REDUNDANT will send initial sync and then only send non-redundant updates to client.** | | **Test Setup** | **Topology** | | **Type** | **Functional** | | **Steps** | 1) Subscribe Path with SAMPLE and SUPPRESS_REDUNDANT, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server should not sends updates to client for every SAMPLE_INTERVAL.
4) Verify that server sends updates to client for every SAMPLE_INTERVAL if update is not redundant..
| @@ -186,7 +186,7 @@ Note: If management interface or telemetry service goes down, Re-Subscription re ### 3.1.11 Verify that SAMPLE WCKV subscription will send initial sync and send the modified data in update w.r.t user change. | **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_003** | | -------------- | :----------------------------------------------------------- | -| **Test Name** | **Verify that SAMPLE subscription will send initial sync and send the modified data in update w.r.t user change ** | +| **Test Name** | **Verify that SAMPLE subscription will send initial sync and send the modified data in update w.r.t user change.** | | **Test Setup** | **Topology** | | **Type** | **Functional** | | **Steps** | 1) Subscribe Path with SAMPLE and SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates to client for every SAMPLE_INTERVAL.
4) Now change the value of the DB using any UI type.
5) Verify that server sends updates modified values to client for every SAMPLE_INTERVAL.
| @@ -207,10 +207,10 @@ Note: If management interface or telemetry service goes down, Re-Subscription re | **Type** | **Functional** | | **Steps** | 1) Subscribe Paths which has no data with SAMPLE and different SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server sends only the sync responce but not data.
| -### 3.1.14 Verify that Server should send corecte notification for Create, update and delete within one sample interval . +### 3.1.14 Verify that Server should send correct notification for Create, update and delete within one sample interval . | **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_013** | | -------------- | :----------------------------------------------------------- | -| **Test Name** | **Verify that Server should send corecte notification for Create, update and delete within one sample interval** | +| **Test Name** | **Verify that Server should send correct notification for Create, update and delete within one sample interval** | | **Test Setup** | **Topology** | | **Type** | **Functional** | | **Steps** | 1) Subscribe Paths which has no data with SAMPLE and different SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates to client for every SAMPLE_INTERVAL.
4) Now Create, update and delete within one sample interval the value of the DB.
5) Verify that server sends updates modified values to client for every SAMPLE_INTERVAL.
| @@ -218,7 +218,7 @@ Note: If management interface or telemetry service goes down, Re-Subscription re ### 3.1.15 Verify that SAMPLE with non wildcard subscription will send initial sync and then only send updates to client w.r.t to SAMPLE_INTERVAL. | **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_016** | | -------------- | :----------------------------------------------------------- | -| **Test Name** | **Verify that SAMPLE with non wildcard subscription will send initial sync and then only send updates to client w.r.t to SAMPLE_INTERVAL. ** | +| **Test Name** | **Verify that SAMPLE with non wildcard subscription will send initial sync and then only send updates to client w.r.t to SAMPLE_INTERVAL.** | | **Test Setup** | **Topology** | | **Type** | **Functional** | | **Steps** | 1) Subscribe non wildcard Path with SAMPLE and SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates to client for every SAMPLE_INTERVAL.
| @@ -268,7 +268,7 @@ Note: If management interface or telemetry service goes down, Re-Subscription re ### 3.2.6 Verify that SAMPLE WCKV subscription with Multi paths one with suppress_redundant=true and other with suppress_redundant=false. | **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_015** | | -------------- | :----------------------------------------------------------- | -| **Test Name** | **Verify that SAMPLE WCKV subscription with Multi paths one with suppress_redundant=true and other with suppress_redundant=false..** | +| **Test Name** | **Verify that SAMPLE WCKV subscription with Multi paths one with suppress_redundant=true and other with suppress_redundant=false.** | | **Test Setup** | **Topology** | | **Type** | **Functional** | | **Steps** | 1) Subscribe Paths with SAMPLE and different suppress_redundant, make sure Server accepts the subscribe request
2) Verify that server first sends current data for both subscribed paths to client (initial sync)
3) Verify that server should only sends updates of suppress_redundant=false path to client with corresponding SAMPLE_INTERVAL.
| From a0e87167bab6acf5f18b03ef2b411d74e80d9710 Mon Sep 17 00:00:00 2001 From: pm937925 Date: Wed, 18 Aug 2021 22:59:28 +0530 Subject: [PATCH 4/4] Updated the Approval date --- .../IGMP_Snooping_gNMI_Subscription_Testplan.md | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/TestPlans/manageability/mgmt-framework/IGMP_Snooping_gNMI_Subscription_Testplan.md b/TestPlans/manageability/mgmt-framework/IGMP_Snooping_gNMI_Subscription_Testplan.md index 9ca927ab9f3d..377426342341 100644 --- a/TestPlans/manageability/mgmt-framework/IGMP_Snooping_gNMI_Subscription_Testplan.md +++ b/TestPlans/manageability/mgmt-framework/IGMP_Snooping_gNMI_Subscription_Testplan.md @@ -22,9 +22,9 @@ # List of Approvers | Function | Name | Date Approved | | :-------: | :--------------------: | :-----------: | -| DEV | Sachin Holla | | -| DEV | Balachandra Mani | | -| QA | Kalyan Vadlamani | | +| DEV | Sachin Holla | 16/08/2021 | +| DEV | Balachandra Mani | 16/08/2021 | +| QA | Kalyan Vadlamani | 16/08/2021 | # Definition/Abbreviation | **Term** | **Meaning** | @@ -33,7 +33,7 @@ | REST | Representational State Transfer | | HLD | High Level Design Document | | URI | Uniform Resource Identifier | -| WCKV | Wildcard Path key value | +| WCKV | Wildcard Path key value | ### Objective The main objective of this document is to cover the test cases that will be executed to verify the ON_CHANGE @@ -54,7 +54,7 @@ This test plan will cover following aspects of ON_CHANGE Subscription. 2. Subscribe each URI to ON_CHANGE and Validating the ON_CHANGE notification. 3. Subscribe each URI to SAMPLE with WCKV and Validating the Update and Delete notification w.r.t sample_interval. 4. Subscribe each URI to SAMPLE with WCKV and Validating the Update notification w.r.t suppress_redundant. -5. SAMPLE WCKV supports only for paths avaliable in [Telementry Subscription Path] +5. SAMPLE WCKV supports only for paths available in [Telementry Subscription Path] # Feature Overview @@ -199,13 +199,13 @@ Note: If management interface or telemetry service goes down, Re-Subscription re | **Type** | **Functional** | | **Steps** | 1) Subscribe Paths with SAMPLE and different SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server first sends current data for the subscribed paths to client (initial sync)
3) Verify that server sends updates of both paths to client with corresponding SAMPLE_INTERVAL.
4) Now un-config the value to remove from DB.
5) Verify that server sends delete notification to client along it should sending the update notification if any data present.
| -### 3.1.13 Verify that Server should send only sync responce when no date avaliable. +### 3.1.13 Verify that Server should send only sync response when no date available. | **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_012** | | -------------- | :----------------------------------------------------------- | -| **Test Name** | **Verify that Server should send only sync responce when no date avaliable.** | +| **Test Name** | **Verify that Server should send only sync response when no date available.** | | **Test Setup** | **Topology** | | **Type** | **Functional** | -| **Steps** | 1) Subscribe Paths which has no data with SAMPLE and different SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server sends only the sync responce but not data.
| +| **Steps** | 1) Subscribe Paths which has no data with SAMPLE and different SAMPLE_INTERVAL, make sure Server accepts the subscribe request
2) Verify that server sends only the sync response but not data.
| ### 3.1.14 Verify that Server should send correct notification for Create, update and delete within one sample interval . | **Test ID** | **IGMP_SNOOPING_SAMPLE_WC_013** |