Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Everflow Test is failing. packets are dropped at egress #3215

Closed
chitra-raghavan opened this issue Jul 24, 2019 · 1 comment
Closed

Everflow Test is failing. packets are dropped at egress #3215

chitra-raghavan opened this issue Jul 24, 2019 · 1 comment

Comments

@chitra-raghavan
Copy link
Contributor

Description

Everflow test is failing. The incoming packets hit the everflow acl rule, but packets are dropped at egress.

Steps to reproduce the issue:
1.Run the script everflow_testbed.yml

Upon sending traffic from script with source ip as 20.0.0.10 , the packet drop is seen on the Tx.

Ingress port : Ethernet28
Egress port : Ethernet88

Describe the results you received:
Sript log :

root@b5f7a6864880:~# ptf --test-dir acstests everflow_tb_test.EverflowTest --platform-dir ptftests --platform remote -t 'asic_type="broadcom";hwsku="DellEMC-S5^C2f-C32";router_mac="3c:2c:30:6d:7e:80";src_port="7";dst_ports="22";session_src_ip="1.1.1.1";session_dst_ip="2.2.2.2";session_ttl="1";session_dscp="8";verbose=True'
WARNING: No route found for IPv6 destination :: (no default route?)
everflow_tb_test.EverflowTest ... Test "Verify SRC IP match" FAILED
Test "Verify DST IP match" FAILED
Test "Verify L4 SRC port match" FAILED
Test "Verify L4 DST port match" FAILED
Test "Verify IP protocol match" FAILED
Test "Verify TCP flags match" FAILED
Test "Verify L4 SRC port range match" FAILED
Test "Verify L4 DST port range match" FAILED
Test "Verify IP DSCP match" FAILED
Passed 0 test of 9
FAIL

======================================================================
FAIL: everflow_tb_test.EverflowTest
----------------------------------------------------------------------
Traceback (most recent call last):
  File "acstests/everflow_tb_test.py", line 271, in runTest
    assert(tests_passed == tests_total)
AssertionError

----------------------------------------------------------------------
Ran 1 test in 10.635s

FAILED (failures=1)

******************************************
ATTENTION: SOME TESTS DID NOT PASS!!!

The following tests failed:
EverflowTest

******************************************

DUT configs :


root@sonic-s5232-01:~# show mirror_session
Name            Status    SRC IP     DST IP    GRE     DSCP    TTL    Queue    Policer
--------------  --------  ---------  --------  ------  ------  -----  -------  ---------
everflow0       active    10.1.0.32  10.0.0.7
test_session_1  active    1.1.1.1    2.2.2.2   0x6558  8       1      0

root@sonic-s5232-01:~# show ip route 2.2.2.2
Routing entry for 2.2.2.0/24
  Known via "static", distance 1, metric 0, best
  Last update 00:00:08 ago
  * 10.0.0.45, via Ethernet88

root@sonic-s5232-01:~#
root@sonic-s5232-01:~#
root@sonic-s5232-01:~# show acl rule
Table     Rule       Priority  Action                  Match
--------  -------  ----------  ----------------------  ----------------------------
EVERFLOW  RULE_1         9999  MIRROR: test_session_1  SRC_IP: 20.0.0.10/32
EVERFLOW  RULE_2         9998  MIRROR: test_session_1  DST_IP: 30.0.0.10/32
EVERFLOW  RULE_3         9997  MIRROR: test_session_1  L4_SRC_PORT: 4661
EVERFLOW  RULE_4         9996  MIRROR: test_session_1  L4_DST_PORT: 4661
EVERFLOW  RULE_5         9995  MIRROR: test_session_1  ETHER_TYPE: 4660
EVERFLOW  RULE_6         9994  MIRROR: test_session_1  IP_PROTOCOL: 126
EVERFLOW  RULE_7         9993  MIRROR: test_session_1  TCP_FLAGS: 0x12/0x12
EVERFLOW  RULE_8         9992  MIRROR: test_session_1  L4_SRC_PORT_RANGE: 4672-4681
EVERFLOW  RULE_9         9991  MIRROR: test_session_1  L4_DST_PORT_RANGE: 4672-4681
EVERFLOW  RULE_10        9990  MIRROR: test_session_1  DSCP: 51
root@sonic-s5232-01:~#

drivshell>fp show entry 160
fp show entry 160
EID 0x000000a0: gid=0x7,
         slice=9, slice_idx=0, part =0, prio=0x270f, flags=0x10602, Installed, Enabled, color_indep=1
         slice=10, slice_idx=0, part =1, prio=0x270f, flags=0x10604, Installed, Enabled, color_indep=1
         slice=11, slice_idx=0, part =2, prio=0x270f, flags=0x10608, Installed, Enabled, color_indep=1

 SrcIp6
    Part:0 Offset0: 48 Width0:  16
    Part:0 Offset1: 64 Width1:  16
    Part:0 Offset6: 36 Width6:   4
    Part:0 Offset7: 40 Width7:   4
    Part:0 Offset8: 44 Width8:   4
    Part:0 Offset9: 80 Width9:   4
    Part:0 Offset10: 84 Width10:   4
    Part:0 Offset11: 88 Width11:   4
    Part:0 Offset12: 92 Width12:   4
    Part:0 Offset13: 96 Width13:   4
    Part:1 Offset2:  0 Width2:  16
    Part:1 Offset3: 20 Width3:  16
    Part:2 Offset4:  0 Width4:  16
    Part:2 Offset5: 20 Width5:  16
    DATA=0x1400000a
    MASK=0xffffffff
 SrcIp
    Part:0 Offset0: 48 Width0:  16
    Part:0 Offset1: 64 Width1:  16
    DATA=0x1400000a
    MASK=0xffffffff
 InPorts
     DATA=0x00000000000000000000000000000004888888888888888c2222222222222222
     MASK=0x0000000000000000000000000000000c888888888888888e2222222222222222
 _InPorts_0
   Instance=0
     DATA=0x0222222222
     MASK=0x0222222222
   Instance=1
     DATA=0x0222222223
     MASK=0x0222222223
 _InPorts_1
   Instance=0
     DATA=0x8888
     MASK=0x8888
   Instance=1
     DATA=0x8888
     MASK=0x8888
 _InPorts_2
   Instance=0
     DATA=0x888
     MASK=0x8888
   Instance=1
     DATA=0x4888
     MASK=0xc888
         action={act=MirrorIngress, param0=0(0), param1=1006632961(0x3c000001), param2=0(0), param3=0(0)}
         action={act=EgressClassSelect, param0=11(0xb), param1=0(0), param2=0(0), param3=0(0)}
         action={act=NewClassId, param0=3(0x3), param1=0(0), param2=0(0), param3=0(0)}
         policer=
         statistics={stat id 142  slice = 9 idx=8 entries=3}{Bytes}{Packets}{GreenBytes}{GreenPackets}{YellowBytes}{YellowPackets}{RedBytes}{RedPackets}
         Extended statistics=NULL

DUT Counters

Upon sending traffic from script with source ip as 20.0.0.10 , the packet drop is seen on the Tx.

Ingress port : Ethernet28
Egress port : Ethernet88

root@sonic-s5232-01:~# show queue counters Ethernet88
Last cached time was 2019-07-24 11:04:44.123333
      Port    TxQ    Counter/pkts    Counter/bytes    Drop/pkts    Drop/bytes
----------  -----  --------------  ---------------  -----------  ------------
Ethernet88    UC0              68            6,666            0             0
Ethernet88    UC1               0                0            0             0
Ethernet88    UC2               0                0            0             0
Ethernet88    UC3               0                0            0             0
Ethernet88    UC4               0                0            0             0
Ethernet88    UC5               0                0            0             0
Ethernet88    UC6               0                0            0             0
Ethernet88    UC7               0                0            0             0
Ethernet88    UC8             N/A              N/A          N/A           N/A
Ethernet88    UC9             N/A              N/A          N/A           N/A
Ethernet88   MC10               0                0            0             0
Ethernet88   MC11               0                0        4,500       468,000
Ethernet88   MC12               0                0            0             0
Ethernet88   MC13               0                0            0             0
Ethernet88   MC14               0                0            0             0
Ethernet88   MC15               0                0            0             0
Ethernet88   MC16               0                0            0             0
Ethernet88   MC17               0                0            0             0
Ethernet88   MC18             N/A              N/A          N/A           N/A
Ethernet88   MC19             N/A              N/A          N/A           N/A

root@sonic-s5232-01:~# show interfaces counters
Last cached time was 2019-07-24 11:05:09.349287
      IFACE    STATE    RX_OK      RX_BPS    RX_UTIL    RX_ERR    RX_DRP    RX_OVR    TX_OK       TX_BPS    TX_UTIL    TX_ERR    TX_DRP    TX_OVR
-----------  -------  -------  ----------  ---------  --------  --------  --------  -------  -----------  ---------  --------  --------  --------
  Ethernet0        U       36  124.60 B/s      0.00%         0        35         0       36   131.46 B/s      0.00%         0         0         0
  Ethernet4        U       37  127.99 B/s      0.00%         0        36         0       37   135.72 B/s      0.00%         0         0         0
  Ethernet8        U       39  135.45 B/s      0.00%         0        38         0      539  2101.66 B/s      0.00%         0         0         0
 Ethernet12        U       37  127.99 B/s      0.00%         0        36         0       37   135.72 B/s      0.00%         0         0         0
 Ethernet16        U       37  127.99 B/s      0.00%         0        36         0      537  2094.43 B/s      0.00%         0         0         0
 Ethernet20        U       39  135.45 B/s      0.00%         0        38         0    1,039  4060.38 B/s      0.00%         0         0         0
 Ethernet24        U       35  120.54 B/s      0.00%         0        34         0       35   129.39 B/s      0.00%         0         0         0
 Ethernet28        U    4,537  17.34 KB/s      0.00%         0        36         0      537  2094.43 B/s      0.00%         0         0         0
 Ethernet32        U       35  127.99 B/s      0.00%         0        34         0       37   135.72 B/s      0.00%         0         0         0
 Ethernet36        U       37  127.99 B/s      0.00%         0        36         0      537  2094.47 B/s      0.00%         0         0         0
 Ethernet40        U       37  127.99 B/s      0.00%         0        36         0       37   135.75 B/s      0.00%         0         0         0
 Ethernet44        U       37  127.99 B/s      0.00%         0        36         0       37   135.75 B/s      0.00%         0         0         0
 Ethernet48        U       37  127.99 B/s      0.00%         0        36         0       37   135.75 B/s      0.00%         0         0         0
 Ethernet52        U       35  120.54 B/s      0.00%         0        34         0      535  2088.14 B/s      0.00%         0         0         0
 Ethernet56        U       43  149.31 B/s      0.00%         0        42         0      543  2117.22 B/s      0.00%         0         0         0
 Ethernet60        U       39  134.93 B/s      0.00%         0        38         0      541  2109.99 B/s      0.00%         0         0         0
 Ethernet64        U       37  127.99 B/s      0.00%         0        36         0       37   135.75 B/s      0.00%         0         0         0
 Ethernet68        U       37  127.99 B/s      0.00%         0        36         0       37   135.75 B/s      0.00%         0         0         0
 Ethernet72        U       36  124.64 B/s      0.00%         0        35         0       36   132.97 B/s      0.00%         0         0         0
 Ethernet76        U       37  127.99 B/s      0.00%         0        36         0       37   135.75 B/s      0.00%         0         0         0
 Ethernet80        U       36  121.37 B/s      0.00%         0        36         0       37   135.75 B/s      0.00%         0         0         0
 Ethernet84        U       35  120.54 B/s      0.00%         0        34         0       35   129.43 B/s      0.00%         0         0         0
 Ethernet88        U       35  121.97 B/s      0.00%         0        34         0       35   127.99 B/s      0.00%         0     4,500         0
 Ethernet92        U       35  121.97 B/s      0.00%         0        34         0       35   127.99 B/s      0.00%         0         0         0
 Ethernet96        U       37  127.99 B/s      0.00%         0        36         0       37   135.75 B/s      0.00%         0         0         0
Ethernet100        U       34  113.91 B/s      0.00%         0        34         0       35   129.43 B/s      0.00%         0         0         0
Ethernet104        U       37  127.99 B/s      0.00%         0        36         0       37   135.75 B/s      0.00%         0         0         0
Ethernet108        U       35  120.54 B/s      0.00%         0        34         0       35   129.43 B/s      0.00%         0         0         0
Ethernet112        U       37  127.99 B/s      0.00%         0        36         0       37   135.75 B/s      0.00%         0         0         0
Ethernet116        U       37  127.99 B/s      0.00%         0        36         0       37   135.75 B/s      0.00%         0         0         0
Ethernet120        U       37  127.99 B/s      0.00%         0        36         0       37   135.75 B/s      0.00%         0         0         0
Ethernet124        U       36  121.37 B/s      0.00%         0        36         0       37   135.75 B/s      0.00%         0         0         0
Ethernet128        X        0    0.00 B/s      0.00%         0         0         0        0     0.00 B/s      0.00%         0         0         0
Ethernet129        X        0    0.00 B/s      0.00%         0         0         0        0     0.00 B/s      0.00%         0         0         0


root@sonic-s5232-01:~# bcmcmd "show c ce22"
show c ce22
RIPD4_64.ce22               :                    14                 +11               1/s
RIPD6_64.ce22               :                    14                 +11               1/s
RUC_64.ce22                 :                    28                 +22               2/s
RDBGC0_64.ce22              :                    28                 +22               2/s
CLMIB_R127.ce22             :                    28                 +22               2/s
CLMIB_RPKT.ce22             :                    28                 +22               2/s
CLMIB_RUCA.ce22             :                    28                 +22               2/s
CLMIB_RPRM.ce22             :                    28                 +22               2/s
CLMIB_RPOK.ce22             :                    28                 +22               2/s
CLMIB_RBYT.ce22             :                 2,506              +1,988             178/s
CLMIB_T127.ce22             :                    28                 +22               2/s
CLMIB_T255.ce22             :                     1                  +1
CLMIB_TPOK.ce22             :                    29                 +23               2/s
CLMIB_TPKT.ce22             :                    29                 +23               2/s
CLMIB_TUCA.ce22             :                    28                 +22               2/s
CLMIB_TMCA.ce22             :                     1                  +1
CLMIB_TBYT.ce22             :                 2,856              +2,276             151/s
CLMIB_RPROG0.ce22           :                     7                  +5
CLMIB_RPROG1.ce22           :                    14                 +11               1/s
CLMIB_RPROG2.ce22           :                     7                  +6               1/s
UC_PERQ_PKT(0).ce22         :                    29                 +23               2/s
UC_PERQ_BYTE(0).ce22        :                 2,856              +2,276             151/s
PERQ_DROP_PKT(1).ce22       :                 4,500              +4,500
PERQ_DROP_BYTE(1).ce22      :               468,000            +468,000
DROP_PKT_YEL.ce22           :                 4,000              +4,000

drivshell>

Describe the results you expected:

Additional information you deem important (e.g. issue happens only occasionally):

**Output of `show version`:**

   root@sonic-s5232-01:~# show ver

SONiC Software Version: SONiC.HEAD.37-7af54690
Distribution: Debian 9.9
Kernel: 4.9.0-9-2-amd64
Build commit: 7af54690
Build date: Fri Jul 19 07:15:34 UTC 2019
Built by: johnar@jenkins-worker-4

Platform: x86_64-dellemc_s5232f_c3538-r0
HwSKU: DellEMC-S5232f-C32
ASIC: broadcom
Serial Number: CN01WJVTCES0094Q0019
Uptime: 11:25:03 up  5:08,  1 user,  load average: 0.16, 0.25, 0.26

Docker images:
REPOSITORY                 TAG                 IMAGE ID            SIZE
docker-syncd-brcm          HEAD.37-7af54690    a8ebd71331fe        391MB
docker-syncd-brcm          latest              a8ebd71331fe        391MB
docker-lldp-sv2            HEAD.37-7af54690    752eadc4cc08        298MB
docker-lldp-sv2            latest              752eadc4cc08        298MB
docker-dhcp-relay          HEAD.37-7af54690    9bd97c62e79d        288MB
docker-dhcp-relay          latest              9bd97c62e79d        288MB
docker-database            HEAD.37-7af54690    2c9d1038220b        280MB
docker-database            latest              2c9d1038220b        280MB
docker-snmp-sv2            HEAD.37-7af54690    1bb3dbc4b411        312MB
docker-snmp-sv2            latest              1bb3dbc4b411        312MB
docker-orchagent           HEAD.37-7af54690    5eedb956b38c        320MB
docker-orchagent           latest              5eedb956b38c        320MB
docker-teamd               HEAD.37-7af54690    eb5b1f024df5        302MB
docker-teamd               latest              eb5b1f024df5        302MB
docker-sonic-telemetry     HEAD.37-7af54690    200d48c081ae        303MB
docker-sonic-telemetry     latest              200d48c081ae        303MB
docker-router-advertiser   HEAD.37-7af54690    3eb858a5906b        280MB
docker-router-advertiser   latest              3eb858a5906b        280MB
docker-platform-monitor    HEAD.37-7af54690    8fcdd7d0bf6d        325MB
docker-platform-monitor    latest              8fcdd7d0bf6d        325MB
docker-fpm-frr             HEAD.37-7af54690    c6947d30c39d        318MB
docker-fpm-frr             latest              c6947d30c39d        318MB


**Attach debug file `sudo generate_dump`:**

```
(paste your output here)
```
@chitra-raghavan chitra-raghavan changed the title Everflow Test isfailing. packets are dropped at egress Everflow Test is failing. packets are dropped at egress Jul 24, 2019
@stcheng
Copy link
Contributor

stcheng commented Sep 19, 2019

we're seeing constant passing on this test case

@stcheng stcheng closed this as completed Sep 19, 2019
mssonicbld added a commit that referenced this issue Aug 7, 2024
@mssonicbld
[submodule] Update submodule sonic-utilities to the latest HEAD autom…
06df234 
…atically (#19832)

#### Why I did it
src/sonic-utilities
```
* 317e6495 - (HEAD -> master, origin/master, origin/HEAD) Fix kexec_unload failure on secure boot enabled platforms (#3439) (34 hours ago) [Vivek]
* 557d6886 - [Mellanox] Add support for Mellanox-SN4700-O32 and Mellanox-SN4700-V64 (#3450) (34 hours ago) [Andriy Yurkiv]
* 018eb737 - Fix to use IPv6 linklocal address as snmp agent address (#3215) (35 hours ago) [SuvarnaMeenakshi]
```
#### How I did it
#### How to verify it
#### Description for the changelog
mssonicbld added a commit that referenced this issue Aug 13, 2024
@mssonicbld
[submodule] Update submodule sonic-utilities to the latest HEAD autom…
bc839ec 
…atically (#19895)

#### Why I did it
src/sonic-utilities
```
* 8cf1c66d - (HEAD -> 202405, origin/202405) Fix to use IPv6 linklocal address as snmp agent address (#3215) (7 hours ago) [SuvarnaMeenakshi]
```
#### How I did it
#### How to verify it
#### Description for the changelog
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@stcheng @chitra-raghavan