[VPP-1774] Segfault in i40e_asq_send_command

[vvalderrv]

When trying to bring up an i40e interface with the dpdk driver and dpdk 19.08 compiled in debug mode, VPP segfaults in i40e_asq_send_command with the following trace:
Thread 1 "vpp_main" received signal SIGSEGV, Segmentation fault.
0x00007fffb07b9f07 in i40e_asq_send_command (hw=0x7fc1fff9d340, desc=0x7fffb9880cc0, buff=0x7fc2002c3b80, buff_size=16, cmd_details=0x0)
    at /home/aloaugus/vpp/build-root/build-vpp_debug-native/external/dpdk-19.08/drivers/net/i40e/base/i40e_adminq.c:933
933 wr32(hw, hw->aq.asq.tail, hw->aq.asq.next_to_use);
(gdb) bt
#0  0x00007fffb07b9f07 in i40e_asq_send_command (hw=0x7fc1fff9d340, desc=0x7fffb9880cc0, buff=0x7fc2002c3b80, buff_size=16, cmd_details=0x0)
    at /home/aloaugus/vpp/build-root/build-vpp_debug-native/external/dpdk-19.08/drivers/net/i40e/base/i40e_adminq.c:933
#1  0x00007fffb0812e1c in i40e_aq_remove_macvlan (hw=0x7fc1fff9d340, seid=390, mv_list=0x7fc2002c3b80, count=1, cmd_details=0x0)
    at /home/aloaugus/vpp/build-root/build-vpp_debug-native/external/dpdk-19.08/drivers/net/i40e/base/i40e_common.c:3121
#2  0x00007fffb0992a10 in i40e_remove_macvlan_filters (vsi=0x7fc1fff1aac0, filter=0x7fc1fff1c280, total=1) at /home/aloaugus/vpp/build-root/build-vpp_debug-native/external/dpdk-19.08/drivers/net/i40e/i40e_ethdev.c:6881
#3  0x00007fffb09bd4b8 in i40e_vsi_delete_mac (vsi=0x7fc1fff1aac0, addr=0x7fffb98856c0) at /home/aloaugus/vpp/build-root/build-vpp_debug-native/external/dpdk-19.08/drivers/net/i40e/i40e_ethdev.c:7319
#4  0x00007fffb0a2172b in i40e_set_default_mac_addr (dev=0x7fffb3069d00 <rte_eth_devices>, mac_addr=0x7fc1fff1a500) at /home/aloaugus/vpp/build-root/build-vpp_debug-native/external/dpdk-19.08/drivers/net/i40e/i40e_ethdev.c:11962
#5  0x00007fffaffb3491 in rte_eth_dev_mac_restore (dev=0x7fffb3069d00 <rte_eth_devices>, dev_info=0x7fffb9885770) at /home/aloaugus/vpp/build-root/build-vpp_debug-native/external/dpdk-19.08/lib/librte_ethdev/rte_ethdev.c:1357
#6  0x00007fffaffb35d5 in rte_eth_dev_config_restore (dev=0x7fffb3069d00 <rte_eth_devices>, dev_info=0x7fffb9885770, port_id=0)
    at /home/aloaugus/vpp/build-root/build-vpp_debug-native/external/dpdk-19.08/lib/librte_ethdev/rte_ethdev.c:1388
#7  0x00007fffaffb37e9 in rte_eth_dev_start (port_id=0) at /home/aloaugus/vpp/build-root/build-vpp_debug-native/external/dpdk-19.08/lib/librte_ethdev/rte_ethdev.c:1435
#8  0x00007fffb2732604 in dpdk_device_start (xd=0x7fffb9842740) at /home/aloaugus/vpp/src/plugins/dpdk/device/common.c:168
#9  0x00007fffb274b25d in dpdk_interface_admin_up_down (vnm=0x7ffff7b64520 <vnet_main>, hw_if_index=1, flags=1) at /home/aloaugus/vpp/src/plugins/dpdk/device/device.c:483
#10 0x00007ffff6c71bb4 in vnet_sw_interface_set_flags_helper (vnm=0x7ffff7b64520 <vnet_main>, sw_if_index=1, flags=VNET_SW_INTERFACE_FLAG_ADMIN_UP, helper_flags=(unknown: 0)) at /home/aloaugus/vpp/src/vnet/interface.c:455
#11 0x00007ffff6c71cde in vnet_sw_interface_set_flags (vnm=0x7ffff7b64520 <vnet_main>, sw_if_index=1, flags=VNET_SW_INTERFACE_FLAG_ADMIN_UP) at /home/aloaugus/vpp/src/vnet/interface.c:504
#12 0x00007ffff6c8d3b1 in set_state (vm=0x7ffff66b5dc0 <vlib_global_main>, input=0x7fffb9885f00, cmd=0x7fffb9534e40) at /home/aloaugus/vpp/src/vnet/interface_cli.c:902
#13 0x00007ffff63c7085 in vlib_cli_dispatch_sub_commands (vm=0x7ffff66b5dc0 <vlib_global_main>, cm=0x7ffff66b5fd0 <vlib_global_main+528>, input=0x7fffb9885f00, parent_command_index=66) at /home/aloaugus/vpp/src/vlib/cli.c:645
#14 0x00007ffff63c6f1a in vlib_cli_dispatch_sub_commands (vm=0x7ffff66b5dc0 <vlib_global_main>, cm=0x7ffff66b5fd0 <vlib_global_main+528>, input=0x7fffb9885f00, parent_command_index=36) at /home/aloaugus/vpp/src/vlib/cli.c:606
#15 0x00007ffff63c6f1a in vlib_cli_dispatch_sub_commands (vm=0x7ffff66b5dc0 <vlib_global_main>, cm=0x7ffff66b5fd0 <vlib_global_main+528>, input=0x7fffb9885f00, parent_command_index=0) at /home/aloaugus/vpp/src/vlib/cli.c:606
#16 0x00007ffff63c74b0 in vlib_cli_input (vm=0x7ffff66b5dc0 <vlib_global_main>, input=0x7fffb9885f00, function=0x7ffff646d6de <unix_vlib_cli_output>, function_arg=0) at /home/aloaugus/vpp/src/vlib/cli.c:746
#17 0x00007ffff6473514 in unix_cli_process_input (cm=0x7ffff66b67a0 <unix_cli_main>, cli_file_index=0) at /home/aloaugus/vpp/src/vlib/unix/cli.c:2525
#18 0x00007ffff6474086 in unix_cli_process (vm=0x7ffff66b5dc0 <vlib_global_main>, rt=0x7fffb9875000, f=0x0) at /home/aloaugus/vpp/src/vlib/unix/cli.c:2641
#19 0x00007ffff64148e4 in vlib_process_bootstrap (_a=140736284985712) at /home/aloaugus/vpp/src/vlib/main.c:1468
#20 0x00007ffff5eb7a48 in clib_calljmp () from /home/aloaugus/vpp/build-root/install-vpp_debug-native/vpp/lib/libvppinfra.so.20.01
#21 0x00007fffb8460940 in ?? ()
#22 0x00007ffff64149ec in vlib_process_startup (vm=0x7ffff66b5dc0 <vlib_global_main>, p=0x259, f=0x0) at /home/aloaugus/vpp/src/vlib/main.c:1490
Backtrace stopped: previous frame inner to this frame (corrupt stack?)
 
DBGvpp# show int
              Name               Idx    State  MTU (L3/IP4/IP6/MPLS)     Counter          Count
FortyGigabitEthernet5e/0/0        1     down         9000/0/0/0
local0                            0     down          0/0/0/0
DBGvpp# set interface state FortyGigabitEthernet5e/0/0  up
vl_msg_api_trace_save:252: Message table length 44998
 
 
Configuration:
VPP : last commit on master : 1146ff4bcd336d8efc19405f1d83914e6115a01f
 
show version verbose
Version:                  v20.01-rc0~171-g1146ff4bc
Compiled by:              root
Compile host:             524b94e75c4d
Compile date:             Wed Sep 11 12:42:53 UTC 2019
Compile location:         /home/mraoul/dev/vpp
Compiler:                 GCC 7.4.0
Current PID:              19052
 
OS : Ubuntu 18.04.2 LTS
 
Network card : Intel Corporation Ethernet Controller XL710 for 40GbE QSFP+ (rev 02)
 
Network card driver infos :
driver: i40e
version: 2.1.14-k
firmware-version: 6.01 0x800036bb 0.385.33
expansion-rom-version:
bus-info: 0000:d8:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes