Performance Test Report

Main information about performance test:

• VyOS version: 1.4.1
• Date: 2025-01-16 16:12 UTC
• Traffic generator: TRex
• Traffic test method: ndr
• Traffic packet size: 64

Test Summary

Parameter	Measured value
Bitrate	695.00 Mbps
Packet rate	1.36 Mpps
Drop Rate	0.01%

TRex Device Details

CPU Information

Architecture:                         x86_64
CPU op-mode(s):                       32-bit, 64-bit
Address sizes:                        46 bits physical, 48 bits virtual
Byte Order:                           Little Endian
CPU(s):                               16
On-line CPU(s) list:                  0-7
Off-line CPU(s) list:                 8-15
Vendor ID:                            GenuineIntel
Model name:                           Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz
CPU family:                           6
Model:                                85
Thread(s) per core:                   1
Core(s) per socket:                   8
Socket(s):                            1
Stepping:                             4
BogoMIPS:                             5999.99
Flags:                                fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves ida arat pku ospke
Hypervisor vendor:                    KVM
Virtualization type:                  full
L1d cache:                            256 KiB (8 instances)
L1i cache:                            256 KiB (8 instances)
L2 cache:                             8 MiB (8 instances)
L3 cache:                             24.8 MiB (1 instance)
NUMA node(s):                         1
NUMA node0 CPU(s):                    0-7
Vulnerability Gather data sampling:   Unknown: Dependent on hypervisor status
Vulnerability Itlb multihit:          Processor vulnerable
Vulnerability L1tf:                   Mitigation; PTE Inversion
Vulnerability Mds:                    Vulnerable; SMT Host state unknown
Vulnerability Meltdown:               Vulnerable
Vulnerability Mmio stale data:        Vulnerable
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed:               Vulnerable
Vulnerability Spec rstack overflow:   Not affected
Vulnerability Spec store bypass:      Vulnerable
Vulnerability Spectre v1:             Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers
Vulnerability Spectre v2:             Vulnerable; STIBP: disabled; PBRSB-eIBRS: Not affected; BHI: Vulnerable
Vulnerability Srbds:                  Not affected
Vulnerability Tsx async abort:        Not affected

Configuration

    - port_limit      : 2
      version         : 2
      c               : 6
      interfaces      : ['0000:00:06.0', '0000:00:07.0']
      port_info       :
            - ip         : 10.0.11.21
              src_mac    : '06:af:99:2b:ce:c1'
              default_gw : 10.0.11.11
              dest_mac   : '06:7c:7c:ce:8a:65'
            - ip         : 10.0.12.21
              src_mac    : '06:9d:78:60:af:55'
              default_gw : 10.0.12.11
              dest_mac   : '06:8f:a9:41:e0:69'
      platform:
          master_thread_id: 0
          latency_thread_id: 1
          dual_if:
              - socket: 0
                threads: [2,3,4,5,6,7]

Interfaces Information

Command: sudo ethtool -i enp4s0f0np0
Output:

Command: sudo ethtool -l enp4s0f0np0
Output:

Command: sudo ethtool -g enp4s0f0np0
Output:

Command: sudo ethtool -k enp4s0f0np0
Output:

Command: sudo ethtool -c enp4s0f0np0
Output:

Command: sudo ethtool -i enp4s0f1np1
Output:

Command: sudo ethtool -l enp4s0f1np1
Output:

Command: sudo ethtool -g enp4s0f1np1
Output:

Command: sudo ethtool -k enp4s0f1np1
Output:

Command: sudo ethtool -c enp4s0f1np1
Output:

DUT Details

CPU Information

Architecture:                         x86_64
CPU op-mode(s):                       32-bit, 64-bit
Address sizes:                        46 bits physical, 48 bits virtual
Byte Order:                           Little Endian
CPU(s):                               4
On-line CPU(s) list:                  0-3
Vendor ID:                            GenuineIntel
Model name:                           Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz
CPU family:                           6
Model:                                85
Thread(s) per core:                   2
Core(s) per socket:                   2
Socket(s):                            1
Stepping:                             4
BogoMIPS:                             5999.99
Flags:                                fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch pti fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves ida arat pku ospke
Hypervisor vendor:                    KVM
Virtualization type:                  full
L1d cache:                            64 KiB (2 instances)
L1i cache:                            64 KiB (2 instances)
L2 cache:                             2 MiB (2 instances)
L3 cache:                             24.8 MiB (1 instance)
NUMA node(s):                         1
NUMA node0 CPU(s):                    0-3
Vulnerability Gather data sampling:   Unknown: Dependent on hypervisor status
Vulnerability Itlb multihit:          Processor vulnerable
Vulnerability L1tf:                   Mitigation; PTE Inversion
Vulnerability Mds:                    Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Meltdown:               Mitigation; PTI
Vulnerability Mmio stale data:        Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed:               Vulnerable
Vulnerability Spec rstack overflow:   Not affected
Vulnerability Spec store bypass:      Vulnerable
Vulnerability Spectre v1:             Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:             Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Retpoline
Vulnerability Srbds:                  Not affected
Vulnerability Tsx async abort:        Not affected

General Information

Version:          VyOS 1.4.1
Release train:    sagitta
Release flavor:   aws

Built by:         VyOS Networks Iberia S.L.U.
Built on:         Thu 19 Dec 2024 16:04 UTC
Build UUID:       954ce8be-f8e2-4f9a-ad94-6c263e17544a
Build commit ID:  98c72c5c45a7a1-dirty

Architecture:     x86_64
Boot via:         installed image
System type:      KVM guest

Hardware vendor:  Amazon EC2
Hardware model:   c5n.xlarge
Hardware S/N:     ec246803-cc95-ad07-f5a2-a842090eb5da
Hardware UUID:    ec246803-cc95-ad07-f5a2-a842090eb5da

Copyright:        VyOS maintainers and contributors

Interfaces Information

Command: sudo ethtool -i eth6
Output:

Command: sudo ethtool -l eth6
Output:

Command: sudo ethtool -g eth6
Output:

Command: sudo ethtool -k eth6
Output:

Command: sudo ethtool -c eth6
Output:

Command: sudo ethtool -i eth7
Output:

Command: sudo ethtool -l eth7
Output:

Command: sudo ethtool -g eth7
Output:

Command: sudo ethtool -k eth7
Output:

Command: sudo ethtool -c eth7
Output:

Configuration

set interfaces ethernet eth0 address 'dhcp'
set interfaces ethernet eth0 description 'MGMT'
set interfaces ethernet eth0 hw-id '06:34:be:b6:f8:93'
set interfaces ethernet eth0 mtu '1500'
set interfaces ethernet eth1 address 'dhcp'
set interfaces ethernet eth1 description 'TREX1'
set interfaces ethernet eth1 dhcp-options no-default-route
set interfaces ethernet eth1 hw-id '06:7c:7c:ce:8a:65'
set interfaces ethernet eth1 mtu '1500'
set interfaces ethernet eth2 address 'dhcp'
set interfaces ethernet eth2 description 'TREX2'
set interfaces ethernet eth2 dhcp-options no-default-route
set interfaces ethernet eth2 hw-id '06:8f:a9:41:e0:69'
set interfaces ethernet eth2 mtu '1500'
set interfaces loopback lo
set protocols static route 16.0.0.0/8 next-hop 10.0.11.21
set protocols static route 48.0.0.0/8 next-hop 10.0.12.21
set service ntp allow-client address '127.0.0.0/8'
set service ntp allow-client address '169.254.0.0/16'
set service ntp allow-client address '10.0.0.0/8'
set service ntp allow-client address '172.16.0.0/12'
set service ntp allow-client address '192.168.0.0/16'
set service ntp allow-client address '::1/128'
set service ntp allow-client address 'fe80::/10'
set service ntp allow-client address 'fc00::/7'
set service ntp server time1.vyos.net
set service ntp server time2.vyos.net
set service ntp server time3.vyos.net
set service ssh client-keepalive-interval '180'
set service ssh port '22'
set system config-management commit-revisions '100'
set system conntrack modules ftp
set system conntrack modules h323
set system conntrack modules nfs
set system conntrack modules pptp
set system conntrack modules sip
set system conntrack modules sqlnet
set system conntrack modules tftp
set system console device ttyS0 speed '115200'
set system domain-name 'eu-south-1.compute.internal'
set system host-name 'VyOS-for-Performance-Tests'
set system sysctl parameter net.core.rmem_default value '134217728'
set system sysctl parameter net.core.rmem_max value '536870912'
set system sysctl parameter net.core.wmem_default value '134217728'
set system sysctl parameter net.core.wmem_max value '536870912'
set system syslog global facility all level 'info'
set system syslog global facility local7 level 'debug'

Performance Test

Test Command

cd /opt/trex/v3.03; ./ndr --stl --bi-dir --port 0 1 --force-map -v -x 10 -t 45 --profile stl/bench.py --prof-tun size={args.size},vm=cached --output /tmp/trex_summary.json

Test Results

Status                            :Calculation of max rate for DUT

Title                             :bench
Running Rate                      :557.4 Mbps
Running Rate (% of max)           :100.00 %
Max Rate                          :557.4 Mbps       
Drop Rate                         :72.50115 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :35.04 seconds
BW Per Core                       :0.37 Gbit/Sec @100% per core
TX PPS bi-directional             :2.18 MPPS
RX PPS bi-directional             :588 KPPS
TX Utilization                    :4.48 %
TRex CPU                          :99.57 %
Total TX L1 bi-directional        :1.47 Gbps     
Total RX L1 bi-directional        :394.94 Mbps     
Total TX L2 bi-directional        :1.12 Gbps     
Total RX L2 bi-directional        :300.91 Mbps     


Status                            :Drops happened, searching for NDR
Interval                          :[0,100]


Status                            :Looking for NDR
Interval                          :[0,100]

Title                             :bench
Iteration                         :0
Running Rate                      :278.21 Mbps
Running Rate (% of max)           :50.00 %
Max Rate                          :557.4 Mbps       
Drop Rate                         :0.00030 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :60.02 seconds
BW Per Core                       :0.33 Gbit/Sec @100% per core
TX PPS bi-directional             :1.09 MPPS
RX PPS bi-directional             :1.09 MPPS
TX Utilization                    :2.23 %
TRex CPU                          :55.40 %
Total TX L1 bi-directional        :730.39 Mbps     
Total RX L1 bi-directional        :730.33 Mbps     
Total TX L2 bi-directional        :556.45 Mbps     
Total RX L2 bi-directional        :556.44 Mbps     
Distance from current Optimum     :50.00 %


Status                            :Drops beyond Desired rate occurred
Interval                          :[50,100]

Title                             :bench
Iteration                         :1
Running Rate                      :417.21 Mbps
Running Rate (% of max)           :75.00 %
Max Rate                          :557.4 Mbps       
Drop Rate                         :14.69835 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :120.04 seconds
BW Per Core                       :0.35 Gbit/Sec @100% per core
TX PPS bi-directional             :1.63 MPPS
RX PPS bi-directional             :1.39 MPPS
TX Utilization                    :3.34 %
TRex CPU                          :80.48 %
Total TX L1 bi-directional        :1.1 Gbps     
Total RX L1 bi-directional        :934.94 Mbps     
Total TX L2 bi-directional        :834.45 Mbps     
Total RX L2 bi-directional        :712.33 Mbps     
Distance from current Optimum     :25.00 %


Status                            :Looking for NDR
Interval                          :[50,75]

Title                             :bench
Iteration                         :2
Running Rate                      :347.49 Mbps
Running Rate (% of max)           :62.50 %
Max Rate                          :557.4 Mbps       
Drop Rate                         :0.00501 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :180.06 seconds
BW Per Core                       :0.34 Gbit/Sec @100% per core
TX PPS bi-directional             :1.36 MPPS
RX PPS bi-directional             :1.36 MPPS
TX Utilization                    :2.78 %
TRex CPU                          :68.00 %
Total TX L1 bi-directional        :912.32 Mbps     
Total RX L1 bi-directional        :912.19 Mbps     
Total TX L2 bi-directional        :695.0 Mbps     
Total RX L2 bi-directional        :695.0 Mbps     
Distance from current Optimum     :12.50 %


Status                            :Drops beyond Desired rate occurred
Interval                          :[62,75]

Title                             :bench
Iteration                         :3
Running Rate                      :384.37 Mbps
Running Rate (% of max)           :68.75 %
Max Rate                          :557.4 Mbps       
Drop Rate                         :6.87249 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :240.08 seconds
BW Per Core                       :0.35 Gbit/Sec @100% per core
TX PPS bi-directional             :1.5 MPPS
RX PPS bi-directional             :1.4 MPPS
TX Utilization                    :3.08 %
TRex CPU                          :73.48 %
Total TX L1 bi-directional        :1.01 Gbps     
Total RX L1 bi-directional        :942.81 Mbps     
Total TX L2 bi-directional        :768.76 Mbps     
Total RX L2 bi-directional        :718.33 Mbps     
Distance from current Optimum     :6.25 %


Status                            :Drops beyond Desired rate occurred
Interval                          :[62,68]

Title                             :bench
Iteration                         :4
Running Rate                      :365.13 Mbps
Running Rate (% of max)           :65.62 %
Max Rate                          :557.4 Mbps       
Drop Rate                         :2.47154 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :300.10 seconds
BW Per Core                       :0.35 Gbit/Sec @100% per core
TX PPS bi-directional             :1.43 MPPS
RX PPS bi-directional             :1.39 MPPS
TX Utilization                    :2.93 %
TRex CPU                          :70.19 %
Total TX L1 bi-directional        :958.48 Mbps     
Total RX L1 bi-directional        :936.71 Mbps     
Total TX L2 bi-directional        :730.27 Mbps     
Total RX L2 bi-directional        :713.68 Mbps     
Distance from current Optimum     :3.12 %


Status                            :Drops beyond Desired rate occurred
Interval                          :[62,65]

Title                             :bench
Iteration                         :5
Running Rate                      :356.69 Mbps
Running Rate (% of max)           :64.06 %
Max Rate                          :557.4 Mbps       
Drop Rate                         :0.67285 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :360.12 seconds
BW Per Core                       :0.33 Gbit/Sec @100% per core
TX PPS bi-directional             :1.39 MPPS
RX PPS bi-directional             :1.39 MPPS
TX Utilization                    :2.86 %
TRex CPU                          :71.14 %
Total TX L1 bi-directional        :936.33 Mbps     
Total RX L1 bi-directional        :934.31 Mbps     
Total TX L2 bi-directional        :713.4 Mbps     
Total RX L2 bi-directional        :711.86 Mbps     
Distance from current Optimum     :1.56 %


Status                            :Drops beyond Desired rate occurred
Interval                          :[62,64]

Title                             :bench
Iteration                         :6
Running Rate                      :352.76 Mbps
Running Rate (% of max)           :63.28 %
Max Rate                          :557.4 Mbps       
Drop Rate                         :0.24584 % of oPackets
Queue Full                        :0.00 % of oPackets
Elapsed Time                      :420.14 seconds
BW Per Core                       :0.34 Gbit/Sec @100% per core
TX PPS bi-directional             :1.38 MPPS
RX PPS bi-directional             :1.38 MPPS
TX Utilization                    :2.83 %
TRex CPU                          :69.27 %
Total TX L1 bi-directional        :926.01 Mbps     
Total RX L1 bi-directional        :924.87 Mbps     
Total TX L2 bi-directional        :705.53 Mbps     
Total RX L2 bi-directional        :704.66 Mbps     
Distance from current Optimum     :0.78 %

Title                             :bench
Total Iterations                  :7
Max Rate                          :557.4 Mbps       
Optimal P-Drop Rate               :347.49 Mbps
P-Drop Rate (% of max)            :62.50 %
Drop Rate at Optimal P-Drop Rate  :0.00501 % of oPackets
Queue Full at Optimal P-Drop Rate :0.00 % of oPackets
Elapsed Time                      :455.18 seconds
BW Per Core                       :0.34 Gbit/Sec @100% per core
TX PPS bi-directional             :1.36 MPPS
RX PPS bi-directional             :1.36 MPPS
TX Utilization                    :2.78 %
TRex CPU                          :68.00 %
Total TX L1 bi-directional        :912.32 Mbps     
Total RX L1 bi-directional        :912.19 Mbps     
Total TX L2 bi-directional        :695.0 Mbps     
Total RX L2 bi-directional        :695.0 Mbps     
Distance from current Optimum     :0.00 %
NDR(s) bi-directional             :695.0 Mbps 

Bench Run has finished :-)

{'BW per core [Gbit/sec @100% per core]': '0.34Gbit/Sec @100% per core',
 'CPU Utilization [%]': '68.0',
 'Drop Rate [%]': '0.01',
 'Elapsed Time [Sec]': '455.18',
 'Line Utilization [%]': '2.78',
 'Max Rate [bps]': '557.4 Mbps',
 'NDR points': ['695.0 Mbps'],
 'OPT RX Rate [bps]': '347.49 Mbps',
 'OPT Rate (Multiplier) [%]': '62.5',
 'OPT TX Rate [bps]': '347.49 Mbps',
 'Queue Full [%]': '0.0%',
 'RX [MPPS]': '1.36 MPPS',
 'RX [bps]': '695.0 Mbps',
 'TX [MPPS]': '1.36 MPPS',
 'TX [bps]': '695.0 Mbps',
 'Title': 'bench',
 'Total Iterations': 6,
 'Total RX L1': '912.19 Mbps',
 'Total TX L1': '912.32 Mbps',
 'latency': {},
 'valid_latency': True}