Performance Test Report

Main information about performance test:

• VyOS version: 1.4.1
• Date: 2025-01-22 12:10 UTC
• Traffic generator: TRex
• Traffic test method: ndr
• Traffic packet size: 1518

Test Summary

Parameter	Measured value
Bitrate	20.16 Gbps
Packet rate	1.66 Mpps
Drop Rate	0.0%

TRex Device Details

CPU Information

Architecture:                         x86_64
CPU op-mode(s):                       32-bit, 64-bit
Address sizes:                        46 bits physical, 48 bits virtual
Byte Order:                           Little Endian
CPU(s):                               16
On-line CPU(s) list:                  0-7
Off-line CPU(s) list:                 8-15
Vendor ID:                            GenuineIntel
Model name:                           Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz
CPU family:                           6
Model:                                85
Thread(s) per core:                   1
Core(s) per socket:                   8
Socket(s):                            1
Stepping:                             4
BogoMIPS:                             5999.99
Flags:                                fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves ida arat pku ospke
Hypervisor vendor:                    KVM
Virtualization type:                  full
L1d cache:                            256 KiB (8 instances)
L1i cache:                            256 KiB (8 instances)
L2 cache:                             8 MiB (8 instances)
L3 cache:                             24.8 MiB (1 instance)
NUMA node(s):                         1
NUMA node0 CPU(s):                    0-7
Vulnerability Gather data sampling:   Unknown: Dependent on hypervisor status
Vulnerability Itlb multihit:          Processor vulnerable
Vulnerability L1tf:                   Mitigation; PTE Inversion
Vulnerability Mds:                    Vulnerable; SMT Host state unknown
Vulnerability Meltdown:               Vulnerable
Vulnerability Mmio stale data:        Vulnerable
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed:               Vulnerable
Vulnerability Spec rstack overflow:   Not affected
Vulnerability Spec store bypass:      Vulnerable
Vulnerability Spectre v1:             Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers
Vulnerability Spectre v2:             Vulnerable; STIBP: disabled; PBRSB-eIBRS: Not affected; BHI: Vulnerable
Vulnerability Srbds:                  Not affected
Vulnerability Tsx async abort:        Not affected

Configuration

    - port_limit      : 2
      version         : 2
      c               : 6
      interfaces      : ['0000:00:06.0', '0000:00:07.0']
      port_info       :
            - ip         : 10.0.11.21
              src_mac    : '06:40:38:24:33:47'
              default_gw : 10.0.11.11
              dest_mac   : '06:e8:91:41:20:a9'
            - ip         : 10.0.12.21
              src_mac    : '06:75:87:50:82:05'
              default_gw : 10.0.12.11
              dest_mac   : '06:ff:9e:d9:7e:47'
      platform:
          master_thread_id: 0
          latency_thread_id: 1
          dual_if:
              - socket: 0
                threads: [2,3,4,5,6,7]

Interfaces Information

Command: sudo ethtool -i enp4s0f0np0
Output:

Command: sudo ethtool -l enp4s0f0np0
Output:

Command: sudo ethtool -g enp4s0f0np0
Output:

Command: sudo ethtool -k enp4s0f0np0
Output:

Command: sudo ethtool -c enp4s0f0np0
Output:

Command: sudo ethtool -i enp4s0f1np1
Output:

Command: sudo ethtool -l enp4s0f1np1
Output:

Command: sudo ethtool -g enp4s0f1np1
Output:

Command: sudo ethtool -k enp4s0f1np1
Output:

Command: sudo ethtool -c enp4s0f1np1
Output:

DUT Details

CPU Information

Architecture:                         x86_64
CPU op-mode(s):                       32-bit, 64-bit
Address sizes:                        46 bits physical, 48 bits virtual
Byte Order:                           Little Endian
CPU(s):                               4
On-line CPU(s) list:                  0-3
Vendor ID:                            GenuineIntel
Model name:                           Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz
CPU family:                           6
Model:                                85
Thread(s) per core:                   2
Core(s) per socket:                   2
Socket(s):                            1
Stepping:                             4
BogoMIPS:                             6000.01
Flags:                                fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch pti fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves ida arat pku ospke
Hypervisor vendor:                    KVM
Virtualization type:                  full
L1d cache:                            64 KiB (2 instances)
L1i cache:                            64 KiB (2 instances)
L2 cache:                             2 MiB (2 instances)
L3 cache:                             24.8 MiB (1 instance)
NUMA node(s):                         1
NUMA node0 CPU(s):                    0-3
Vulnerability Gather data sampling:   Unknown: Dependent on hypervisor status
Vulnerability Itlb multihit:          Processor vulnerable
Vulnerability L1tf:                   Mitigation; PTE Inversion
Vulnerability Mds:                    Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Meltdown:               Mitigation; PTI
Vulnerability Mmio stale data:        Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed:               Vulnerable
Vulnerability Spec rstack overflow:   Not affected
Vulnerability Spec store bypass:      Vulnerable
Vulnerability Spectre v1:             Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:             Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Retpoline
Vulnerability Srbds:                  Not affected
Vulnerability Tsx async abort:        Not affected

General Information

Version:          VyOS 1.4.1
Release train:    sagitta
Release flavor:   aws

Built by:         VyOS Networks Iberia S.L.U.
Built on:         Thu 19 Dec 2024 16:04 UTC
Build UUID:       954ce8be-f8e2-4f9a-ad94-6c263e17544a
Build commit ID:  98c72c5c45a7a1-dirty

Architecture:     x86_64
Boot via:         installed image
System type:      KVM guest

Hardware vendor:  Amazon EC2
Hardware model:   c5n.xlarge
Hardware S/N:     ec22f731-8598-51a8-f7d8-dcab92cb2bab
Hardware UUID:    ec22f731-8598-51a8-f7d8-dcab92cb2bab

Copyright:        VyOS maintainers and contributors

Interfaces Information

Command: sudo ethtool -i eth6
Output:

Command: sudo ethtool -l eth6
Output:

Command: sudo ethtool -g eth6
Output:

Command: sudo ethtool -k eth6
Output:

Command: sudo ethtool -c eth6
Output:

Command: sudo ethtool -i eth7
Output:

Command: sudo ethtool -l eth7
Output:

Command: sudo ethtool -g eth7
Output:

Command: sudo ethtool -k eth7
Output:

Command: sudo ethtool -c eth7
Output:

Configuration

set firewall flowtable ft1 interface 'eth1'
set firewall flowtable ft1 interface 'eth2'
set firewall flowtable ft1 offload 'software'
set firewall group interface-group ft-ifaces interface 'eth1'
set firewall group interface-group ft-ifaces interface 'eth2'
set firewall ipv4 forward filter default-action 'accept'
set firewall ipv4 forward filter rule 20 action 'jump'
set firewall ipv4 forward filter rule 20 inbound-interface group 'ft-ifaces'
set firewall ipv4 forward filter rule 20 jump-target 'off_ft1'
set firewall ipv4 name off_ft1 default-action 'accept'
set firewall ipv4 name off_ft1 rule 10 action 'offload'
set firewall ipv4 name off_ft1 rule 10 offload-target 'ft1'
set interfaces ethernet eth0 address 'dhcp'
set interfaces ethernet eth0 description 'MGMT'
set interfaces ethernet eth0 hw-id '06:cb:ed:f4:fd:e9'
set interfaces ethernet eth0 mtu '1500'
set interfaces ethernet eth1 address 'dhcp'
set interfaces ethernet eth1 description 'TREX1'
set interfaces ethernet eth1 dhcp-options no-default-route
set interfaces ethernet eth1 hw-id '06:e8:91:41:20:a9'
set interfaces ethernet eth1 mtu '1500'
set interfaces ethernet eth2 address 'dhcp'
set interfaces ethernet eth2 description 'TREX2'
set interfaces ethernet eth2 dhcp-options no-default-route
set interfaces ethernet eth2 hw-id '06:ff:9e:d9:7e:47'
set interfaces ethernet eth2 mtu '1500'
set interfaces loopback lo
set protocols static route 16.0.0.0/8 next-hop 10.0.11.21
set protocols static route 48.0.0.0/8 next-hop 10.0.12.21
set service ntp allow-client address '127.0.0.0/8'
set service ntp allow-client address '169.254.0.0/16'
set service ntp allow-client address '10.0.0.0/8'
set service ntp allow-client address '172.16.0.0/12'
set service ntp allow-client address '192.168.0.0/16'
set service ntp allow-client address '::1/128'
set service ntp allow-client address 'fe80::/10'
set service ntp allow-client address 'fc00::/7'
set service ntp server time1.vyos.net
set service ntp server time2.vyos.net
set service ntp server time3.vyos.net
set service ssh client-keepalive-interval '180'
set service ssh port '22'
set system config-management commit-revisions '100'
set system conntrack modules ftp
set system conntrack modules h323
set system conntrack modules nfs
set system conntrack modules pptp
set system conntrack modules sip
set system conntrack modules sqlnet
set system conntrack modules tftp
set system console device ttyS0 speed '115200'
set system domain-name 'eu-south-1.compute.internal'
set system host-name 'VyOS-for-Performance-Tests'
set system sysctl parameter net.core.rmem_default value '134217728'
set system sysctl parameter net.core.rmem_max value '536870912'
set system sysctl parameter net.core.wmem_default value '134217728'
set system sysctl parameter net.core.wmem_max value '536870912'
set system syslog global facility all level 'info'
set system syslog global facility local7 level 'debug'

Performance Test

Test Command

cd /opt/trex/v3.06; ./ndr --stl --bi-dir --port 0 1 --force-map -v -x 10 -t 45 --profile stl/bench.py --prof-tun size={args.size},vm=cached --output /tmp/trex_summary.json

Test Results

Status                            :Calculation of max rate for DUT

Title                             :bench
Running Rate                      :11.22 Gbps
Running Rate (% of max)           :100.00 %
Max Rate                          :11.22 Gbps       
Drop Rate                         :10.95400 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :35.04 seconds
BW Per Core                       :8.22 Gbit/Sec @100% per core
TX PPS bi-directional             :1.85 MPPS
RX PPS bi-directional             :1.65 MPPS
TX Utilization                    :69.55 %
TRex CPU                          :91.20 %
Total TX L1 bi-directional        :22.79 Gbps     
Total RX L1 bi-directional        :20.3 Gbps     
Total TX L2 bi-directional        :22.49 Gbps     
Total RX L2 bi-directional        :20.03 Gbps     


Status                            :Drops happened, searching for NDR
Interval                          :[0,100]


Status                            :Looking for NDR
Interval                          :[0,100]

Title                             :bench
Iteration                         :0
Running Rate                      :5.61 Gbps
Running Rate (% of max)           :50.00 %
Max Rate                          :11.22 Gbps       
Drop Rate                         :0.00007 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :60.02 seconds
BW Per Core                       :8.50 Gbit/Sec @100% per core
TX PPS bi-directional             :924 KPPS
RX PPS bi-directional             :924 KPPS
TX Utilization                    :34.71 %
TRex CPU                          :44.03 %
Total TX L1 bi-directional        :11.37 Gbps     
Total RX L1 bi-directional        :11.37 Gbps     
Total TX L2 bi-directional        :11.23 Gbps     
Total RX L2 bi-directional        :11.23 Gbps     
Distance from current Optimum     :50.00 %


Status                            :Looking for NDR
Interval                          :[50,100]

Title                             :bench
Iteration                         :1
Running Rate                      :8.42 Gbps
Running Rate (% of max)           :75.00 %
Max Rate                          :11.22 Gbps       
Drop Rate                         :0.00027 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :120.04 seconds
BW Per Core                       :7.95 Gbit/Sec @100% per core
TX PPS bi-directional             :1.39 MPPS
RX PPS bi-directional             :1.39 MPPS
TX Utilization                    :52.07 %
TRex CPU                          :70.63 %
Total TX L1 bi-directional        :17.06 Gbps     
Total RX L1 bi-directional        :17.06 Gbps     
Total TX L2 bi-directional        :16.84 Gbps     
Total RX L2 bi-directional        :16.84 Gbps     
Distance from current Optimum     :25.00 %


Status                            :Looking for NDR
Interval                          :[75,100]

Title                             :bench
Iteration                         :2
Running Rate                      :9.81 Gbps
Running Rate (% of max)           :87.50 %
Max Rate                          :11.22 Gbps       
Drop Rate                         :0.00181 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :180.06 seconds
BW Per Core                       :8.05 Gbit/Sec @100% per core
TX PPS bi-directional             :1.62 MPPS
RX PPS bi-directional             :1.62 MPPS
TX Utilization                    :60.67 %
TRex CPU                          :81.28 %
Total TX L1 bi-directional        :19.88 Gbps     
Total RX L1 bi-directional        :19.88 Gbps     
Total TX L2 bi-directional        :19.62 Gbps     
Total RX L2 bi-directional        :19.62 Gbps     
Distance from current Optimum     :12.50 %


Status                            :Drops beyond Desired rate occurred
Interval                          :[87,100]

Title                             :bench
Iteration                         :3
Running Rate                      :10.51 Gbps
Running Rate (% of max)           :93.75 %
Max Rate                          :11.22 Gbps       
Drop Rate                         :5.23657 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :240.08 seconds
BW Per Core                       :8.03 Gbit/Sec @100% per core
TX PPS bi-directional             :1.73 MPPS
RX PPS bi-directional             :1.64 MPPS
TX Utilization                    :65.00 %
TRex CPU                          :87.24 %
Total TX L1 bi-directional        :21.3 Gbps     
Total RX L1 bi-directional        :20.21 Gbps     
Total TX L2 bi-directional        :21.02 Gbps     
Total RX L2 bi-directional        :19.95 Gbps     
Distance from current Optimum     :6.25 %


Status                            :Drops beyond Desired rate occurred
Interval                          :[87,93]

Title                             :bench
Iteration                         :4
Running Rate                      :10.16 Gbps
Running Rate (% of max)           :90.62 %
Max Rate                          :11.22 Gbps       
Drop Rate                         :0.15383 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :300.09 seconds
BW Per Core                       :8.03 Gbit/Sec @100% per core
TX PPS bi-directional             :1.67 MPPS
RX PPS bi-directional             :1.67 MPPS
TX Utilization                    :62.83 %
TRex CPU                          :84.32 %
Total TX L1 bi-directional        :20.59 Gbps     
Total RX L1 bi-directional        :20.51 Gbps     
Total TX L2 bi-directional        :20.32 Gbps     
Total RX L2 bi-directional        :20.24 Gbps     
Distance from current Optimum     :3.12 %


Status                            :Looking for NDR
Interval                          :[87,90]

Title                             :bench
Iteration                         :5
Running Rate                      :10.02 Gbps
Running Rate (% of max)           :89.06 %
Max Rate                          :11.22 Gbps       
Drop Rate                         :0.00201 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :360.11 seconds
BW Per Core                       :8.03 Gbit/Sec @100% per core
TX PPS bi-directional             :1.65 MPPS
RX PPS bi-directional             :1.65 MPPS
TX Utilization                    :61.99 %
TRex CPU                          :83.22 %
Total TX L1 bi-directional        :20.31 Gbps     
Total RX L1 bi-directional        :20.31 Gbps     
Total TX L2 bi-directional        :20.05 Gbps     
Total RX L2 bi-directional        :20.05 Gbps     
Distance from current Optimum     :1.56 %


Status                            :Looking for NDR
Interval                          :[89,90]

Title                             :bench
Iteration                         :6
Running Rate                      :10.08 Gbps
Running Rate (% of max)           :89.84 %
Max Rate                          :11.22 Gbps       
Drop Rate                         :0.00368 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :420.13 seconds
BW Per Core                       :8.01 Gbit/Sec @100% per core
TX PPS bi-directional             :1.66 MPPS
RX PPS bi-directional             :1.66 MPPS
TX Utilization                    :62.33 %
TRex CPU                          :83.94 %
Total TX L1 bi-directional        :20.42 Gbps     
Total RX L1 bi-directional        :20.42 Gbps     
Total TX L2 bi-directional        :20.16 Gbps     
Total RX L2 bi-directional        :20.16 Gbps     
Distance from current Optimum     :0.78 %

Title                             :bench
Total Iterations                  :7
Max Rate                          :11.22 Gbps       
Optimal P-Drop Rate               :10.08 Gbps
P-Drop Rate (% of max)            :89.84 %
Drop Rate at Optimal P-Drop Rate  :0.00368 % of oPackets
Queue Full at Optimal P-Drop Rate :0.00 % of oPackets
Elapsed Time                      :455.17 seconds
BW Per Core                       :8.01 Gbit/Sec @100% per core
TX PPS bi-directional             :1.66 MPPS
RX PPS bi-directional             :1.66 MPPS
TX Utilization                    :62.33 %
TRex CPU                          :83.94 %
Total TX L1 bi-directional        :20.42 Gbps     
Total RX L1 bi-directional        :20.42 Gbps     
Total TX L2 bi-directional        :20.16 Gbps     
Total RX L2 bi-directional        :20.16 Gbps     
Distance from current Optimum     :0.00 %
NDR(s) bi-directional             :20.16 Gbps 

Bench Run has finished :-)

{'BW per core [Gbit/sec @100% per core]': '8.01Gbit/Sec @100% per core',
 'CPU Utilization [%]': '83.94',
 'Drop Rate [%]': '0.0',
 'Elapsed Time [Sec]': '455.17',
 'Line Utilization [%]': '62.33',
 'Max Rate [bps]': '11.22 Gbps',
 'NDR points': ['20.16 Gbps'],
 'OPT RX Rate [bps]': '10.08 Gbps',
 'OPT Rate (Multiplier) [%]': '89.84375',
 'OPT TX Rate [bps]': '10.08 Gbps',
 'Queue Full [%]': '0.0%',
 'RX [MPPS]': '1.66 MPPS',
 'RX [bps]': '20.16 Gbps',
 'TX [MPPS]': '1.66 MPPS',
 'TX [bps]': '20.16 Gbps',
 'Title': 'bench',
 'Total Iterations': 6,
 'Total RX L1': '20.42 Gbps',
 'Total TX L1': '20.42 Gbps',
 'latency': {},
 'valid_latency': True}