NVIDIA ConnectX-7 CLI出力結果

実験用のNVIDIA 400G NIC ConnectX-7 NICが手元に確保できましたのでOSFP-RHSパッケージの光トランシーバーを一通り試験しました。正常時のステータス表示内容の参考にしてください。

• 対向は電源環境の制限もあり、スイッチではなくBroadcomの400G NIC P1400GDを使用しています。
• P1400GDはQSFP-DDとQSFP112両方対応していますのでそれぞれ試験を行いました。
• "LINK_TYPE_P1=2"を実行しethernet modeに変更しています。
• "ethtool -m(version 6.11)"の出力も正常です

組み合わせ表

CX7側linux CLI出力

$ sudo mlxconfig -d /dev/mst/mt4129_pciconf0 query

 Device #1 
----------
 Device type: ConnectX7 
 Name: MCX75310AAS-NEA_Ax 
 Description: NVIDIA ConnectX-7 HHHL Adapter card; 400GbE / NDR IB (default mode); Single-port OSFP; PCIe 5.0 x16; Crypto Disabled; Secure Boot Enabled;
 Device: /dev/mst/mt4129_pciconf0
  (cut) 
 LINK_TYPE_P1 ETH(2) 
　(cut) 

$ sudo mlxlink -d /dev/mst/mt4129_pciconf0 -m
 
Operational Info
----------------
State                              : Active 
Physical state                     : LinkUp 
Speed                              : 400G 
Width                              : 4x 
FEC                                : Standard_RS-FEC - (544,514) 
Loopback Mode                      : No Loopback 
Auto Negotiation                   : ON 

Supported Info
--------------
Enabled Link Speed (Ext.)          : 0x00013ff2 (400G_4X,200G_2X,200G_4X,100G_1X,100G_2X,100G_4X,50G_1X,50G_2X,40G,25G,10G,1G) 
Supported Cable Speed (Ext.)       : 0x00010000 (400G_4X) 

Troubleshooting Info
--------------------
Status Opcode                      : 0 
Group Opcode                       : N/A 
Recommendation                     : No issue was observed 

Tool Information
----------------
Firmware Version                   : 28.39.2048 
amBER Version                      : 5.75 
MFT Version                        : mft 4.33.0-169 

Module Info
-----------
Temperature [C]                    : 49 [-10..80]
Voltage [mV]                       : 3229.9 [3000..3600]
Bias Current [mA]                  : 52.148,52.148,52.148,52.148 [10..130]
Rx Power Current [dBm]             : 2,2,2,2 [-10..6]
Tx Power Current [dBm]             : 2,2,2,2 [-4..6]
Identifier                         : OSFP
Compliance                         : IB NDR,400G-FR4
Cable Technology                   : 1310 nm EML
Cable Type                         : Optical Module (separated)
OUI                                : Other
Vendor Name                        : WAVESPLITTER
Vendor Part Number                 : WST-OR4-FR4-C
Vendor Serial Number               : CYxxxxxxxxxx
Rev                                : 01
Wavelength [nm]                    : 1301
Transfer Distance [m]              : 0.0
Attenuation (5g,7g,12g,25g)[dB]    : N/A
FW Version                         : 1.15.0
Digital Diagnostic Monitoring      : Yes
Power Class                        : 4 (8.0 W max)
MAX Power                          : 9.0 W max
CDR RX                             : ON,ON,ON,ON
CDR TX                             : ON,ON,ON,ON
LOS Alarm                          : N/A
SNR Media Lanes [dB]               : N/A
SNR Host Lanes [dB]                : N/A
IB Cable Width                     : 1x,2x,4x
Memory Map Revision                : 64
Linear Direct Drive                : 0
Cable Breakout                     : Unspecified
SMF Length                         : 2km
Cable Rx AMP                       : 2
Cable Rx Emphasis (Pre)            : 7
Cable Rx Post Emphasis             : 2
Cable Tx Equalization              : 0
Wavelength Tolerance               : 36.5nm
Module State                       : Ready state
DataPath state [per lane]          : DPActivated,DPActivated,DPActivated,DPActivated
Rx Output Valid [per lane]         : 0,0,0,0
Nominal bit rate                   : N/A
Rx Power Type                      : Average power
Manufacturing Date                 : 19_01_25
Active Set Host Compliance Code    : IB NDR
Active Set Media Compliance Code   : 400G-FR4
Error Code Response                : ConfigUndefined
Module FW Fault                    : 0
DataPath FW Fault                  : 0
Tx Fault [per lane]                : 0,0,0,0
Tx LOS [per lane]                  : 0,0,0,0
Tx CDR LOL [per lane]              : 0,0,0,0
Rx LOS [per lane]                  : 0,0,0,0
Rx CDR LOL [per lane]              : 0,0,0,0
Tx Adaptive EQ Fault [per lane]    : 0,0,0,0

使用機材