Коммутаторы MES2324 подключены к серверам supermicro гигабитными портами по LACP на 2-4порта. При горячей перезагрузке сервера часто (а если перезагрузить через watchdog - то вообще всегда) возникает ситуация, когда LACP не собирается.
При этом сервер считает сессию LACP установленой, а коммутатор нет: видно LACP-пакеты, которые идут от коммутатора к серверу и наоборот, на сервере на всех 4 линках сессии LACP установлены, видно параметры соседа (коммутатора) - мак, итд. Коммутатор же соседа не видит.
Прошивка 4.0.18R2.
Прилагаю подробный багрепорт:
Начальная конфигурация:
Код: Выделить всё
MES2324#show run
no spanning-tree
!
vlan database
vlan 2-4094
exit
!
interface gigabitethernet1/0/1
description server-lacp
lacp timeout short
lacp port-priority 101
channel-group 1 mode auto
exit
!
interface gigabitethernet1/0/2
description server-lacp
lacp timeout short
lacp port-priority 102
channel-group 1 mode auto
exit
!
interface gigabitethernet1/0/3
description server-lacp
lacp timeout short
lacp port-priority 103
channel-group 1 mode auto
exit
!
interface gigabitethernet1/0/4
description server-lacp
lacp timeout short
lacp port-priority 104
channel-group 1 mode auto
exit
!
interface Port-channel1
speed 1000
negotiation 1000f
switchport mode trunk
switchport trunk allowed vlan add 2-9
exit
!
!
end
MES2324#show bootvar
Active-image: flash://system/images/mes3300-4018-R2.ros
Version: 4.0.18
Commit: 3aa407fd
Build: 2 (master)
MD5 Digest: 27e88b5c6577254715d91cacde23b709
Date: 13-Jul-2022
Time: 15:28:52
Inactive-image: flash://system/images/_mes3300-4017-R4.ros
Version: 4.0.17
Commit: 98da2ea5
Build: 4 (master)
MD5 Digest: f1bb3ea00008aeea3df71d87009c36bd
Date: 07-May-2022
Time: 12:56:04
Включаем сервер, все ок, LACP собирается:
Код: Выделить всё
MES2324#13-Jul-2022 15:31:49 %INIT-I-Startup: Warm Startup
13-Jul-2022 15:32:17 %LINK-I-Up: gi1/0/1
13-Jul-2022 15:32:18 %LINK-I-Up: gi1/0/4
13-Jul-2022 15:32:18 %LINK-I-Up: gi1/0/3
13-Jul-2022 15:32:19 %LINK-I-Up: gi1/0/2
13-Jul-2022 15:32:25 %LINK-W-Down: gi1/0/3
13-Jul-2022 15:32:25 %LINK-W-Down: gi1/0/4
13-Jul-2022 15:32:25 %LINK-W-Down: gi1/0/1
13-Jul-2022 15:32:25 %LINK-W-Down: gi1/0/2
13-Jul-2022 15:32:28 %LINK-I-Up: gi1/0/1
13-Jul-2022 15:32:28 %LINK-I-Up: gi1/0/2
13-Jul-2022 15:33:17 %LINK-W-Down: gi1/0/1
13-Jul-2022 15:33:17 %LINK-W-Down: gi1/0/2
13-Jul-2022 15:33:19 %LINK-I-Up: gi1/0/3
13-Jul-2022 15:33:19 %LINK-I-Up: gi1/0/4
13-Jul-2022 15:33:20 %LINK-I-Up: gi1/0/1
13-Jul-2022 15:33:20 %LINK-I-Up: gi1/0/2
13-Jul-2022 15:33:26 %TRUNK-I-PORTADDED: Port gi1/0/1 added to Po1
13-Jul-2022 15:33:26 %LINK-I-Up: Po1
13-Jul-2022 15:33:26 %LINK-I-Up: Vlan 1
13-Jul-2022 15:33:26 %LINK-I-Up: Vlan 2
13-Jul-2022 15:33:26 %LINK-I-Up: Vlan 3
13-Jul-2022 15:33:26 %LINK-I-Up: Vlan 4
13-Jul-2022 15:33:26 %LINK-I-Up: Vlan 5
13-Jul-2022 15:33:26 %LINK-I-Up: Vlan 6
13-Jul-2022 15:33:26 %LINK-I-Up: Vlan 7
13-Jul-2022 15:33:26 %LINK-I-Up: Vlan 8
13-Jul-2022 15:33:26 %LINK-I-Up: Vlan 9
13-Jul-2022 15:33:27 %TRUNK-I-PORTADDED: Port gi1/0/2 added to Po1
13-Jul-2022 15:33:27 %TRUNK-I-PORTADDED: Port gi1/0/3 added to Po1
13-Jul-2022 15:33:27 %TRUNK-I-PORTADDED: Port gi1/0/4 added to Po1
MES2324#
MES2324#show lacp Port-Channel 1
Port-Channel Po1
Minimal links required: 1
Port Type Gigabit Ethernet
Attached Lag id:
Actor
System Priority:1
MAC Address: a8:f9:4b:36:f7:40
Admin Key: 1000
Oper Key: 1000
Partner
System Priority:65535
MAC Address: 00:15:17:6a:65:a6
Oper Key: 17
MES2324#show interfaces Port-Channel 1
Po1 is up (connected)
Interface index is 1000
Hardware is aggregated ethernet interface(s), MAC address is a8:f9:4b:36:f7:41
Interface MTU is 1500
Link is up for 0 days, 0 hours, 0 minutes and 20 seconds
Link aggregation type is LACP
No. of members in this port-channel: 4 (active 4, minimum required 1)
gigabitethernet1/0/1, full-duplex, LACP active, 1000Mbps (active)
gigabitethernet1/0/2, full-duplex, LACP active, 1000Mbps (active)
gigabitethernet1/0/3, full-duplex, LACP active, 1000Mbps (active)
gigabitethernet1/0/4, full-duplex, LACP active, 1000Mbps (active)
Active bandwidth is 4000Mbps
15 second input rate is 4 Kbit/s
15 second output rate is 4 Kbit/s
229 packets input, 24146 bytes received
49 broadcasts, 180 multicasts
0 input errors, 0 FCS, 0 alignment
0 oversize, 0 internal MAC
0 pause frames received
173 packets output, 20352 bytes sent
6 broadcasts, 167 multicasts
0 output errors, 0 collisions
0 excessive collisions, 0 late collisions
0 pause frames transmitted
0 symbol errors, 0 carrier, 0 SQE test error
MES2324#
Перезагружаем сервер на горячую, port channel не собриается:
Код: Выделить всё
MES2324#13-Jul-2022 16:02:35 %LINK-W-Down: gi1/0/1
13-Jul-2022 16:02:35 %TRUNK-W-PORTREMOVED: Port gi1/0/1 removed from Po1
13-Jul-2022 16:02:36 %LINK-W-Down: gi1/0/2
13-Jul-2022 16:02:36 %LINK-W-Down: gi1/0/3
13-Jul-2022 16:02:36 %LINK-W-Down: gi1/0/4
13-Jul-2022 16:02:36 %TRUNK-W-PORTREMOVED: Port gi1/0/2 removed from Po1
13-Jul-2022 16:02:36 %TRUNK-W-PORTREMOVED: Port gi1/0/3 removed from Po1
13-Jul-2022 16:02:36 %TRUNK-W-PORTREMOVED: Port gi1/0/4 removed from Po1
13-Jul-2022 16:02:36 %LINK-W-Down: Po1
13-Jul-2022 16:02:36 %LINK-W-Down: Vlan 1
13-Jul-2022 16:02:36 %LINK-W-Down: Vlan 2
13-Jul-2022 16:02:36 %LINK-W-Down: Vlan 3
13-Jul-2022 16:02:36 %LINK-W-Down: Vlan 4
13-Jul-2022 16:02:36 %LINK-W-Down: Vlan 5
13-Jul-2022 16:02:36 %LINK-W-Down: Vlan 6
13-Jul-2022 16:02:36 %LINK-W-Down: Vlan 7
13-Jul-2022 16:02:36 %LINK-W-Down: Vlan 8
13-Jul-2022 16:02:36 %LINK-W-Down: Vlan 9
13-Jul-2022 16:03:02 %LINK-I-Up: gi1/0/2
13-Jul-2022 16:03:02 %LINK-I-Up: gi1/0/4
13-Jul-2022 16:03:02 %LINK-I-Up: gi1/0/1
13-Jul-2022 16:03:02 %LINK-I-Up: gi1/0/3
13-Jul-2022 16:03:10 %LINK-W-Down: gi1/0/3
13-Jul-2022 16:03:10 %LINK-W-Down: gi1/0/2
13-Jul-2022 16:03:10 %LINK-W-Down: gi1/0/4
13-Jul-2022 16:03:10 %LINK-W-Down: gi1/0/1
13-Jul-2022 16:03:13 %LINK-I-Up: gi1/0/2
13-Jul-2022 16:03:13 %LINK-I-Up: gi1/0/1
13-Jul-2022 16:04:02 %LINK-W-Down: gi1/0/1
13-Jul-2022 16:04:02 %LINK-W-Down: gi1/0/2
13-Jul-2022 16:04:04 %LINK-I-Up: gi1/0/3
13-Jul-2022 16:04:04 %LINK-I-Up: gi1/0/4
13-Jul-2022 16:04:05 %LINK-I-Up: gi1/0/1
13-Jul-2022 16:04:05 %LINK-I-Up: gi1/0/2
MES2324#show lacp Port-Channel 1
Port-Channel Po1
Minimal links required: 1
Port Type Gigabit Ethernet
Attached Lag id:
Actor
System Priority:1
MAC Address: a8:f9:4b:36:f7:40
Admin Key: 1000
Oper Key: 1000
Partner
System Priority:0
MAC Address: 00:00:00:00:00:00
Oper Key: 0
MES2324#show interfaces Port-Channel 1
Po1 is down (not connected)
Interface index is 1000
Hardware is aggregated ethernet interface(s), MAC address is a8:f9:4b:36:f7:41
Interface MTU is 1500
Link aggregation type is LACP
No. of members in this port-channel: 4 (active 0, minimum required 1)
gigabitethernet1/0/1, LACP active, 1000Mbps (inactive)
gigabitethernet1/0/2, LACP active, 1000Mbps (inactive)
gigabitethernet1/0/3, LACP active, 1000Mbps (inactive)
gigabitethernet1/0/4, LACP active, 1000Mbps (inactive)
Active bandwidth is 0Mbps
15 second input rate is 0 Kbit/s
15 second output rate is 0 Kbit/s
2020 packets input, 248908 bytes received
148 broadcasts, 1872 multicasts
0 input errors, 0 FCS, 0 alignment
0 oversize, 0 internal MAC
0 pause frames received
2096 packets output, 288580 bytes sent
151 broadcasts, 1945 multicasts
0 output errors, 0 collisions
0 excessive collisions, 0 late collisions
0 pause frames transmitted
0 symbol errors, 0 carrier, 0 SQE test error
Входящие/исходящие пакеты на физических интерфейсах видно:
Код: Выделить всё
MES2324#show interfaces GigabitEthernet 1/0/1 | include bytes
2037 packets input, 262197 bytes received
2020 packets output, 253568 bytes sent
MES2324#show interfaces GigabitEthernet 1/0/1 | include bytes
2042 packets input, 262837 bytes received
2025 packets output, 254208 bytes sent
MES2324#show interfaces GigabitEthernet 1/0/2 | include bytes
3400 packets input, 340880 bytes received
2025 packets output, 254478 bytes sent
MES2324#show interfaces GigabitEthernet 1/0/2 | include bytes
3402 packets input, 341136 bytes received
2028 packets output, 254862 bytes sent
Пытаемся манипулировать портами на свиче, чтобы вновь поднять port channel:
Код: Выделить всё
MES2324#conf t
MES2324(config)#interface GigabitEthernet 1/0/3
MES2324(config-if)#shut
MES2324(config-if)#13-Jul-2022 16:13:04 %LINK-W-Down: gi1/0/3
no shut
MES2324(config-if)#13-Jul-2022 16:13:23 %LINK-I-Up: gi1/0/3
MES2324(config-if)#13-Jul-2022 16:14:27 %LINK-W-Down: gi1/0/3
13-Jul-2022 16:14:36 %LINK-I-Up: gi1/0/3
MES2324(config-if)#
MES2324(config-if)#ex
MES2324(config)#interface GigabitEthernet 1/0/1
MES2324(config-if)#shut
MES2324(config-if)#13-Jul-2022 16:15:23 %LINK-W-Down: gi1/0/1
no shut
MES2324(config-if)#13-Jul-2022 16:15:31 %LINK-I-Up: gi1/0/1
MES2324(config-if)#
MES2324(config-if)#
MES2324(config-if)#ex
MES2324(config)#interface range GigabitEthernet1/0/1-3
MES2324(config-if-range)#shut
13-Jul-2022 16:16:05 %LINK-W-Down: gi1/0/1
13-Jul-2022 16:16:05 %LINK-W-Down: gi1/0/2
MES2324(config-if-range)#13-Jul-2022 16:16:05 %LINK-W-Down: gi1/0/3
13-Jul-2022 16:16:05 %TRUNK-I-PORTADDED: Port gi1/0/4 added to Po1
13-Jul-2022 16:16:05 %LINK-I-Up: Po1
13-Jul-2022 16:16:05 %LINK-I-Up: Vlan 1
13-Jul-2022 16:16:05 %LINK-I-Up: Vlan 2
13-Jul-2022 16:16:05 %LINK-I-Up: Vlan 3
13-Jul-2022 16:16:05 %LINK-I-Up: Vlan 4
13-Jul-2022 16:16:05 %LINK-I-Up: Vlan 5
13-Jul-2022 16:16:05 %LINK-I-Up: Vlan 6
13-Jul-2022 16:16:05 %LINK-I-Up: Vlan 7
13-Jul-2022 16:16:05 %LINK-I-Up: Vlan 8
13-Jul-2022 16:16:05 %LINK-I-Up: Vlan 9
no shut
MES2324(config-if-range)#13-Jul-2022 16:16:26 %LINK-I-Up: gi1/0/3
13-Jul-2022 16:16:28 %LINK-I-Up: gi1/0/2
13-Jul-2022 16:16:29 %TRUNK-I-PORTADDED: Port gi1/0/3 added to Po1
13-Jul-2022 16:16:29 %LINK-I-Up: gi1/0/1
13-Jul-2022 16:16:31 %TRUNK-I-PORTADDED: Port gi1/0/2 added to Po1
13-Jul-2022 16:16:31 %TRUNK-I-PORTADDED: Port gi1/0/1 added to Po1
После того, как некоторые любые, порты погашены, port channel начинает работать. Если погасить все, то точно.
Дамп пакетов со стороны сервера:
Работоспособный линк:
Код: Выделить всё
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 200
Down Delay (ms): 200
802.3ad info
LACP rate: fast
Min links: 1
Aggregator selection policy (ad_select): stable
Active Aggregator Info:
Aggregator ID: 1
Number of ports: 4
Actor Key: 17
Partner Key: 1000
Partner Mac Address: a8:f9:4b:36:f7:40
Slave Interface: eth0.bond
MII Status: up
Speed: 1000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 00:15:17:6a:65:a6
Aggregator ID: 1
Slave queue ID: 0
Slave Interface: eth1.bond
MII Status: up
Speed: 1000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 00:15:17:6a:65:a7
Aggregator ID: 1
Slave queue ID: 0
Slave Interface: eth2.bond
MII Status: up
Speed: 1000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 00:25:90:13:84:c4
Aggregator ID: 1
Slave queue ID: 0
Slave Interface: eth3.bond
MII Status: up
Speed: 1000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 00:25:90:13:84:c5
Aggregator ID: 1
Slave queue ID: 0
# dmesg |grep bond
[ 53.370625] bonding: Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011)
[ 53.370628] bonding: MII link monitoring set to 100 ms
[ 53.716995] 8021q: adding VLAN 0 to HW filter on device eth0.bond
[ 53.717132] bonding: eth0: enslaving eth0.bond as a backup interface with a down link.
[ 53.912460] 8021q: adding VLAN 0 to HW filter on device eth1.bond
[ 53.912600] bonding: eth0: enslaving eth1.bond as a backup interface with a down link.
[ 53.988369] 8021q: adding VLAN 0 to HW filter on device eth2.bond
[ 53.988718] bonding: eth0: enslaving eth2.bond as a backup interface with a down link.
[ 54.064167] 8021q: adding VLAN 0 to HW filter on device eth3.bond
[ 54.064518] bonding: eth0: enslaving eth3.bond as a backup interface with a down link.
[ 54.134102] device eth0.bond entered promiscuous mode
[ 54.134143] device eth1.bond entered promiscuous mode
[ 54.134186] device eth2.bond entered promiscuous mode
[ 54.134295] device eth3.bond entered promiscuous mode
[ 56.171132] e1000e: eth0.bond NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
[ 56.216132] bonding: eth0: link status up for interface eth0.bond, enabling it in 0 ms.
[ 56.216137] bonding: eth0: link status definitely up for interface eth0.bond, 1000 Mbps full duplex.
[ 56.368571] e1000e: eth1.bond NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
[ 56.415609] bonding: eth0: link status up for interface eth1.bond, enabling it in 200 ms.
[ 56.615091] bonding: eth0: link status definitely up for interface eth1.bond, 1000 Mbps full duplex.
[ 57.259391] e1000e: eth2.bond NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
[ 57.309288] e1000e: eth3.bond NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
[ 57.313268] bonding: eth0: link status up for interface eth2.bond, enabling it in 200 ms.
[ 57.313272] bonding: eth0: link status up for interface eth3.bond, enabling it in 200 ms.
[ 57.512740] bonding: eth0: link status definitely up for interface eth2.bond, 1000 Mbps full duplex.
[ 57.512745] bonding: eth0: link status definitely up for interface eth3.bond, 1000 Mbps full duplex.
# tcpdump -i eth0.bond -ne -XXX
dropped privs to tcpdump
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth0.bond, link-type EN10MB (Ethernet), capture size 262144 bytes
14:00:45.199268 a8:f9:4b:36:f7:43 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 a8f9 4b36 f743 8809 0101 ........K6.C....
0x0010: 0114 0001 a8f9 4b36 f740 03e8 0067 0033 ......K6.@...g.3
0x0020: 3f00 0000 0214 ffff 0015 176a 65a6 0011 ?..........je...
0x0030: 00ff 0001 3f00 0000 0310 0000 0000 0000 ....?...........
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
14:00:45.346083 00:15:17:6a:65:a6 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 0015 176a 65a6 8809 0101 .........je.....
0x0010: 0114 ffff 0015 176a 65a6 0011 00ff 0001 .......je.......
0x0020: 3f00 0000 0214 0001 a8f9 4b36 f740 03e8 ?.........K6.@..
0x0030: 0067 0033 3f00 0000 0310 0000 0000 0000 .g.3?...........
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
14:00:46.199261 a8:f9:4b:36:f7:43 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 a8f9 4b36 f743 8809 0101 ........K6.C....
0x0010: 0114 0001 a8f9 4b36 f740 03e8 0067 0033 ......K6.@...g.3
0x0020: 3f00 0000 0214 ffff 0015 176a 65a6 0011 ?..........je...
0x0030: 00ff 0001 3f00 0000 0310 0000 0000 0000 ....?...........
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
14:00:46.246054 00:15:17:6a:65:a6 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 0015 176a 65a6 8809 0101 .........je.....
0x0010: 0114 ffff 0015 176a 65a6 0011 00ff 0001 .......je.......
0x0020: 3f00 0000 0214 0001 a8f9 4b36 f740 03e8 ?.........K6.@..
0x0030: 0067 0033 3f00 0000 0310 0000 0000 0000 .g.3?...........
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
14:00:47.146095 00:15:17:6a:65:a6 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 0015 176a 65a6 8809 0101 .........je.....
0x0010: 0114 ffff 0015 176a 65a6 0011 00ff 0001 .......je.......
0x0020: 3f00 0000 0214 0001 a8f9 4b36 f740 03e8 ?.........K6.@..
0x0030: 0067 0033 3f00 0000 0310 0000 0000 0000 .g.3?...........
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
14:00:47.199292 a8:f9:4b:36:f7:43 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 a8f9 4b36 f743 8809 0101 ........K6.C....
0x0010: 0114 0001 a8f9 4b36 f740 03e8 0067 0033 ......K6.@...g.3
0x0020: 3f00 0000 0214 ffff 0015 176a 65a6 0011 ?..........je...
0x0030: 00ff 0001 3f00 0000 0310 0000 0000 0000 ....?...........
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
14:00:48.199351 a8:f9:4b:36:f7:43 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 a8f9 4b36 f743 8809 0101 ........K6.C....
0x0010: 0114 0001 a8f9 4b36 f740 03e8 0067 0033 ......K6.@...g.3
0x0020: 3f00 0000 0214 ffff 0015 176a 65a6 0011 ?..........je...
0x0030: 00ff 0001 3f00 0000 0310 0000 0000 0000 ....?...........
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
14:00:48.346101 00:15:17:6a:65:a6 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 0015 176a 65a6 8809 0101 .........je.....
0x0010: 0114 ffff 0015 176a 65a6 0011 00ff 0001 .......je.......
0x0020: 3f00 0000 0214 0001 a8f9 4b36 f740 03e8 ?.........K6.@..
0x0030: 0067 0033 3f00 0000 0310 0000 0000 0000 .g.3?...........
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
^C
8 packets captured
8 packets received by filter
0 packets dropped by kernel
Зависший на свиче port channel:
Код: Выделить всё
# cat /proc/net/bonding/eth0
Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011)
Bonding Mode: IEEE 802.3ad Dynamic link aggregation
Transmit Hash Policy: layer2+3 (2)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 200
Down Delay (ms): 200
802.3ad info
LACP rate: fast
Min links: 1
Aggregator selection policy (ad_select): stable
Active Aggregator Info:
Aggregator ID: 1
Number of ports: 4
Actor Key: 17
Partner Key: 1000
Partner Mac Address: a8:f9:4b:36:f7:40
Slave Interface: eth0.bond
MII Status: up
Speed: 1000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 00:15:17:6a:65:a6
Aggregator ID: 1
Slave queue ID: 0
Slave Interface: eth1.bond
MII Status: up
Speed: 1000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 00:15:17:6a:65:a7
Aggregator ID: 1
Slave queue ID: 0
Slave Interface: eth2.bond
MII Status: up
Speed: 1000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 00:25:90:13:84:c4
Aggregator ID: 1
Slave queue ID: 0
Slave Interface: eth3.bond
MII Status: up
Speed: 1000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 00:25:90:13:84:c5
Aggregator ID: 1
Slave queue ID: 0
# dmesg |grep bond
[ 53.291288] bonding: Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011)
[ 53.291290] bonding: MII link monitoring set to 100 ms
[ 53.637201] 8021q: adding VLAN 0 to HW filter on device eth0.bond
[ 53.637339] bonding: eth0: enslaving eth0.bond as a backup interface with a down link.
[ 53.832726] 8021q: adding VLAN 0 to HW filter on device eth1.bond
[ 53.832866] bonding: eth0: enslaving eth1.bond as a backup interface with a down link.
[ 53.908585] 8021q: adding VLAN 0 to HW filter on device eth2.bond
[ 53.908935] bonding: eth0: enslaving eth2.bond as a backup interface with a down link.
[ 53.984382] 8021q: adding VLAN 0 to HW filter on device eth3.bond
[ 53.984732] bonding: eth0: enslaving eth3.bond as a backup interface with a down link.
[ 54.054155] device eth0.bond entered promiscuous mode
[ 54.054197] device eth1.bond entered promiscuous mode
[ 54.054240] device eth2.bond entered promiscuous mode
[ 54.054350] device eth3.bond entered promiscuous mode
[ 56.061378] e1000e: eth0.bond NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
[ 56.134343] bonding: eth0: link status up for interface eth0.bond, enabling it in 0 ms.
[ 56.134348] bonding: eth0: link status definitely up for interface eth0.bond, 1000 Mbps full duplex.
[ 56.292801] e1000e: eth1.bond NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
[ 56.333819] bonding: eth0: link status up for interface eth1.bond, enabling it in 200 ms.
[ 56.533302] bonding: eth0: link status definitely up for interface eth1.bond, 1000 Mbps full duplex.
[ 57.431898] e1000e: eth2.bond NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
[ 57.530697] bonding: eth0: link status up for interface eth2.bond, enabling it in 200 ms.
[ 57.614458] e1000e: eth3.bond NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
[ 57.630437] bonding: eth0: link status up for interface eth3.bond, enabling it in 200 ms.
[ 57.730177] bonding: eth0: link status definitely up for interface eth2.bond, 1000 Mbps full duplex.
[ 57.829974] bonding: eth0: link status definitely up for interface eth3.bond, 1000 Mbps full duplex.
# tcpdump -i eth0.bond -ne -XXX
dropped privs to tcpdump
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth0.bond, link-type EN10MB (Ethernet), capture size 262144 bytes
14:10:45.014819 a8:f9:4b:36:f7:43 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 a8f9 4b36 f743 8809 0101 ........K6.C....
0x0010: 0114 0001 a8f9 4b36 f740 03e8 0067 0033 ......K6.@...g.3
0x0020: 0700 0000 0214 ffff 0015 176a 65a6 0011 ...........je...
0x0030: 00ff 0001 0f00 0000 0310 0000 0000 0000 ................
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
14:10:45.303095 00:15:17:6a:65:a6 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 0015 176a 65a6 8809 0101 .........je.....
0x0010: 0114 ffff 0015 176a 65a6 0011 00ff 0001 .......je.......
0x0020: 0f00 0000 0214 0001 a8f9 4b36 f740 03e8 ..........K6.@..
0x0030: 0067 0033 0700 0000 0310 0000 0000 0000 .g.3............
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
14:10:46.014863 a8:f9:4b:36:f7:43 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 a8f9 4b36 f743 8809 0101 ........K6.C....
0x0010: 0114 0001 a8f9 4b36 f740 03e8 0067 0033 ......K6.@...g.3
0x0020: 0700 0000 0214 ffff 0015 176a 65a6 0011 ...........je...
0x0030: 00ff 0001 0f00 0000 0310 0000 0000 0000 ................
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
14:10:46.203102 00:15:17:6a:65:a6 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 0015 176a 65a6 8809 0101 .........je.....
0x0010: 0114 ffff 0015 176a 65a6 0011 00ff 0001 .......je.......
0x0020: 0f00 0000 0214 0001 a8f9 4b36 f740 03e8 ..........K6.@..
0x0030: 0067 0033 0700 0000 0310 0000 0000 0000 .g.3............
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
14:10:47.014960 a8:f9:4b:36:f7:43 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 a8f9 4b36 f743 8809 0101 ........K6.C....
0x0010: 0114 0001 a8f9 4b36 f740 03e8 0067 0033 ......K6.@...g.3
0x0020: 0700 0000 0214 ffff 0015 176a 65a6 0011 ...........je...
0x0030: 00ff 0001 0f00 0000 0310 0000 0000 0000 ................
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
14:10:47.103091 00:15:17:6a:65:a6 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 0015 176a 65a6 8809 0101 .........je.....
0x0010: 0114 ffff 0015 176a 65a6 0011 00ff 0001 .......je.......
0x0020: 0f00 0000 0214 0001 a8f9 4b36 f740 03e8 ..........K6.@..
0x0030: 0067 0033 0700 0000 0310 0000 0000 0000 .g.3............
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
14:10:48.014950 a8:f9:4b:36:f7:43 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 a8f9 4b36 f743 8809 0101 ........K6.C....
0x0010: 0114 0001 a8f9 4b36 f740 03e8 0067 0033 ......K6.@...g.3
0x0020: 0700 0000 0214 ffff 0015 176a 65a6 0011 ...........je...
0x0030: 00ff 0001 0f00 0000 0310 0000 0000 0000 ................
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
14:10:48.303097 00:15:17:6a:65:a6 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 0015 176a 65a6 8809 0101 .........je.....
0x0010: 0114 ffff 0015 176a 65a6 0011 00ff 0001 .......je.......
0x0020: 0f00 0000 0214 0001 a8f9 4b36 f740 03e8 ..........K6.@..
0x0030: 0067 0033 0700 0000 0310 0000 0000 0000 .g.3............
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
14:10:49.015051 a8:f9:4b:36:f7:43 > 01:80:c2:00:00:02, ethertype Slow Protocols (0x8809), length 124: LACPv1, length 110
0x0000: 0180 c200 0002 a8f9 4b36 f743 8809 0101 ........K6.C....
0x0010: 0114 0001 a8f9 4b36 f740 03e8 0067 0033 ......K6.@...g.3
0x0020: 0700 0000 0214 ffff 0015 176a 65a6 0011 ...........je...
0x0030: 00ff 0001 0f00 0000 0310 0000 0000 0000 ................
0x0040: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0050: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0060: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0070: 0000 0000 0000 0000 0000 0000 ............
^C
9 packets captured
9 packets received by filter
0 packets dropped by kernel
5 packets dropped by interface
Проблема успешно воссоздаваема (практически 100%), если нужна дополнительная информация, напишите, выложу ее здесь.