netdev - Re: PROBLEM: XGBE unable to autoneg when advertising only 1GbE KX mode

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [<thread-prev] [day] [month] [year] [list]
Date:   Thu, 19 May 2022 12:53:11 -0500
From:   Tom Lendacky <thomas.lendacky@....com>
To:     "Pighin, Anthony (Nokia - CA/Ottawa)" <anthony.pighin@...ia.com>,
        "S-k, Shyam-sundar" <Shyam-sundar.S-k@....com>
Cc:     "netdev@...r.kernel.org" <netdev@...r.kernel.org>
Subject: Re: PROBLEM: XGBE unable to autoneg when advertising only 1GbE KX
 mode

On 5/18/22 13:58, Pighin, Anthony (Nokia - CA/Ottawa) wrote:
> Tested on Linux 5.15.22.

Can you supply some additional information about the system this is on?

Adding Shyam, as he will be taking over maintainership for this driver (I 
just need to get around sending the patch for that).

Thanks,
Tom

> 
> Step 1. Force (both sides) of the Link to advertise 1000baseKX/Full only
> root@...alhost:~# ethtool --change bp3 advertise 0x20000
> root@...alhost:~# ethtool bp3
> Settings for bp3:
>          Supported ports: [ Backplane ]
>          Supported link modes:   1000baseKX/Full
>                                  10000baseKR/Full
>                                  10000baseR_FEC
>          Supported pause frame use: Symmetric Receive-only
>          Supports auto-negotiation: Yes
>          Supported FEC modes: Not reported
>          Advertised link modes:  1000baseKX/Full
>          Advertised pause frame use: No
>          Advertised auto-negotiation: Yes
>          Advertised FEC modes: Not reported
>          Speed: Unknown!
>          Duplex: Unknown! (255)
>          Port: None
>          PHYAD: 0
>          Transceiver: internal
>          Auto-negotiation: on
>          Current message level: 0x00000034 (52)
>                                 link ifdown ifup
>          Link detected: no
> 
> Step 2. Bring Up both sides of the Link:
> root@...alhost:~# ip link set bp3 up
> 
> Result. Link stays Down:
> root@...alhost:~# ethtool bp3
> Settings for bp3:
>          Supported ports: [ Backplane ]
>          Supported link modes:   1000baseKX/Full
>                                  10000baseKR/Full
>                                  10000baseR_FEC
>          Supported pause frame use: Symmetric Receive-only
>          Supports auto-negotiation: Yes
>          Supported FEC modes: Not reported
>          Advertised link modes:  1000baseKX/Full
>          Advertised pause frame use: No
>          Advertised auto-negotiation: Yes
>          Advertised FEC modes: Not reported
>          Link partner advertised link modes:  Not reported
>          Link partner advertised pause frame use: No
>          Link partner advertised auto-negotiation: Yes
>          Link partner advertised FEC modes: Not reported
>          Speed: Unknown!
>          Duplex: Full
>          Port: None
>          PHYAD: 0
>          Transceiver: internal
>          Auto-negotiation: on
>          Current message level: 0x00000034 (52)
>                                 link ifdown ifup
>          Link detected: no
> 
> Step 3. Change one side of the Link to advertise 1000baseKX/Full and 10000baseKR/Full:
> root@...alhost:~# ethtool --change bp3 advertise 0xa000
> 
> Result: Link comes Up at 1000baseKX/Full:
> root@...alhost:~# ethtool bp3
> Settings for bp3:
>          Supported ports: [ Backplane ]
>          Supported link modes:   1000baseKX/Full
>                                  10000baseKR/Full
>                                  10000baseR_FEC
>          Supported pause frame use: Symmetric Receive-only
>          Supports auto-negotiation: Yes
>          Supported FEC modes: Not reported
>          Advertised link modes:  1000baseKX/Full
>                                  10000baseKR/Full
>          Advertised pause frame use: No
>          Advertised auto-negotiation: Yes
>          Advertised FEC modes: Not reported
>          Link partner advertised link modes:  1000baseKX/Full
>          Link partner advertised pause frame use: No
>          Link partner advertised auto-negotiation: Yes
>          Link partner advertised FEC modes: Not reported
>          Speed: 1000Mb/s
>          Duplex: Full
>          Port: None
>          PHYAD: 0
>          Transceiver: internal
>          Auto-negotiation: on
>          Current message level: 0x00000034 (52)
>                                 link ifdown ifup
>          Link detected: yes
> 
> 
> Logs during initial Link up failures (when only advertising 1000baseKX/Full):
> 
> [  581.429431] xgbe_isr_task:493: amd-xgbe 0000:0d:00.7 bp3: DMA_ISR=0x00020000
> [  581.429437] xgbe_isr_task:542: amd-xgbe 0000:0d:00.7 bp3: MAC_ISR=0x03000001
> [  581.429722] xgbe_isr_task:493: amd-xgbe 0000:0d:00.7 bp3: DMA_ISR=0x00020000
> [  581.429724] xgbe_isr_task:542: amd-xgbe 0000:0d:00.7 bp3: MAC_ISR=0x02000001
> [  581.542950] xgbe_isr_task:493: amd-xgbe 0000:0d:00.7 bp3: DMA_ISR=0x00020000
> [  581.542954] xgbe_isr_task:542: amd-xgbe 0000:0d:00.7 bp3: MAC_ISR=0x00000001
> [  581.661399] xgbe_check_link_timeout:1292: amd-xgbe 0000:0d:00.7 bp3: AN link timeout
> [  581.661403] __xgbe_phy_config_aneg:1214: amd-xgbe 0000:0d:00.7 bp3: AN PHY configuration
> [  581.663591] xgbe_phy_kx_1000_mode:2160: amd-xgbe 0000:0d:00.7 bp3: 1GbE KX mode set
> [  581.663602] xgbe_an73_disable:422: amd-xgbe 0000:0d:00.7 bp3: CL73 AN disabled
> [  581.663618] xgbe_an37_disable:381: amd-xgbe 0000:0d:00.7 bp3: CL37 AN disabled
> [  581.663639] xgbe_an73_init:1051: amd-xgbe 0000:0d:00.7 bp3: CL73 AN initialized
> [  581.663650] xgbe_an73_restart:412: amd-xgbe 0000:0d:00.7 bp3: CL73 AN enabled/restarted
> [  581.763656] xgbe_an_isr_task:695: amd-xgbe 0000:0d:00.7 bp3: AN interrupt received
> [  581.763672] xgbe_an73_state_machine:847: amd-xgbe 0000:0d:00.7 bp3: CL73 AN Incompatible-Link
> [  581.763676] xgbe_an73_state_machine:907: amd-xgbe 0000:0d:00.7 bp3: CL73 AN result: No-Link
> [  581.763682] xgbe_isr_task:493: amd-xgbe 0000:0d:00.7 bp3: DMA_ISR=0x00020000
> [  581.763685] xgbe_isr_task:542: amd-xgbe 0000:0d:00.7 bp3: MAC_ISR=0x02000001
> [  581.764848] xgbe_isr_task:493: amd-xgbe 0000:0d:00.7 bp3: DMA_ISR=0x00020000
> [  581.764851] xgbe_isr_task:542: amd-xgbe 0000:0d:00.7 bp3: MAC_ISR=0x03000001
> [  581.765865] xgbe_isr_task:493: amd-xgbe 0000:0d:00.7 bp3: DMA_ISR=0x00020000
> [  581.765867] xgbe_isr_task:542: amd-xgbe 0000:0d:00.7 bp3: MAC_ISR=0x02000001
> [  581.766258] xgbe_isr_task:493: amd-xgbe 0000:0d:00.7 bp3: DMA_ISR=0x00020000
> [  581.766260] xgbe_isr_task:542: amd-xgbe 0000:0d:00.7 bp3: MAC_ISR=0x03000001
> [  581.767364] xgbe_phy_kr_mode:2132: amd-xgbe 0000:0d:00.7 bp3: 10GbE KR mode set
> [  581.767593] xgbe_isr_task:493: amd-xgbe 0000:0d:00.7 bp3: DMA_ISR=0x00020000
> [  581.767596] xgbe_isr_task:542: amd-xgbe 0000:0d:00.7 bp3: MAC_ISR=0x02000001
> [  581.769699] xgbe_phy_power_off:2053: amd-xgbe 0000:0d:00.7 bp3: phy powered off
> [  581.772065] xgbe_isr_task:493: amd-xgbe 0000:0d:00.7 bp3: DMA_ISR=0x00020000
> [  581.772068] xgbe_isr_task:542: amd-xgbe 0000:0d:00.7 bp3: MAC_ISR=0x03000001
> [  581.773534] xgbe_isr_task:493: amd-xgbe 0000:0d:00.7 bp3: DMA_ISR=0x00020000
> [  581.773537] xgbe_isr_task:542: amd-xgbe 0000:0d:00.7 bp3: MAC_ISR=0x02000001
> [  581.773593] xgbe_phy_kr_mode:2132: amd-xgbe 0000:0d:00.7 bp3: 10GbE KR mode set
> [  581.773604] xgbe_an73_disable:422: amd-xgbe 0000:0d:00.7 bp3: CL73 AN disabled
> [  581.773619] xgbe_an37_disable:381: amd-xgbe 0000:0d:00.7 bp3: CL37 AN disabled
> [  581.773626] xgbe_an73_state_machine:913: amd-xgbe 0000:0d:00.7 bp3:  PHY Reset
> [  581.773628] xgbe_an73_state_machine:847: amd-xgbe 0000:0d:00.7 bp3: CL73 AN Ready
> [  581.773723] xgbe_isr_task:493: amd-xgbe 0000:0d:00.7 bp3: DMA_ISR=0x00020000
> [  581.773726] xgbe_isr_task:542: amd-xgbe 0000:0d:00.7 bp3: MAC_ISR=0x00000001
> 
> Anthony