🐟

Amazon VPC間の接続方法による帯域の違い

2023/02/05に公開

はじめに

いきなりですが、皆さんは以下のような2つのVPC間を接続する際にはどのような方法を取るでしょうか?(オレンジ矢印部分)

前提や要件により様々な方法が考えられますが、今回は以下4パターンでVPC間を接続した際の帯域について考察&測定していこうと思います。

  1. VPC Peering
  2. Transit Gateway(TGW)
  3. Internet Gateway(IGW)
  4. NAT Gateway(NAT GW)

内容には最新の注意を払っていますが、今回の測定結果はあくまで参考としてください。
測定は2023/02/04に実施しました。

帯域の測定方法

今回はVPC AVPC BにEC2インスタンス(c6gn.8xlarge)を以下のように配置し、iperfコマンド(iperf2)を用いて①〜④の帯域測定を30秒間行います。
コネクション数は"1, 5, 10, 20, 50"の5パターンで測定します。
※iPerfによる帯域測定の注意点(事前申請必要)などはAWSでテストする前に事前確認をしように記載してありますので、実際にテストやろうと思っている方は参考にしてください。

事前考察

帯域を計測する前にAWS公式ドキュメントから最大帯域を考察してみようと思います。
前提として、今回の計測ではc6gn.8xlarge(帯域50Gbps)インスタンスを利用するため、最大50Gbpsの帯域が使えると想定されます。
以上を踏まえて、経路や測定方法(シングルフロー or マルチフロー)ごとに帯域の推察を行います。

参考: AWS公式ドキュメント

シングルフローの場合

シングルフローとは5-tuple(送信元IP, 送信元ポート番号, 宛先IP, 宛先ポート番号, プロトコル番号)が同一のものを示しているようです。

接続方法 想定帯域 想定根拠
①VPC Peering 5Gbps 参考ドキュメントa.およびb.。シングルフロー制約。
②Transit Gateway(TGW) 5Gbps 参考ドキュメントa.およびc.。シングルフロー制約。
③Internet Gateway(IGW) 5Gbps 参考ドキュメントa.およびd.。シングルフロー制約。
④NAT Gateway(NAT GW) 5Gbps 参考ドキュメントa.およびe.。シングルフロー制約。

マルチフローの場合

マルチフローの場合、最大50Gbpsの帯域を使い切るには、少なくとも10コネクション(マルチフロー)が必要と事前考察しました。
--> シングルフロー制限5Gbps*10コネクションが50Gbpsのため。

接続方法 想定帯域 想定根拠
①VPC Peering 50Gbps 参考ドキュメントa.およびb.。EC2インスタンス(c6gn.8xlarge)帯域上限。
②Transit Gateway(TGW) 50Gbps 参考ドキュメントa.およびc.。EC2インスタンス(c6gn.8xlarge)帯域上限。
③Internet Gateway(IGW) 25Gbps 参考ドキュメントa.およびd.。マルチフロー制約。
④NAT Gateway(NAT GW) 25Gbps 参考ドキュメントa.およびe.。マルチフロー制約。

帯域測定結果

実際に帯域測定を行った結果が以下表です。
コネクション数1がシングルフロー、コネクション数1を超えるものがマルチフローです。

接続方法 帯域
(コネクション数:1)
帯域
(コネクション数:5)
帯域
(コネクション数:10)
帯域
(コネクション数:20)
帯域
(コネクション数:50)
①VPC Peering 9.53 Gbps 47.6 Gbps 49.6 Gbps 49.6 Gbps 49.6 Gbps
②Transit Gateway(TGW) 4.96 Gbps 18.5 Gbps 32.2 Gbps 39.3 Gbps 46.4 Gbps
③Internet Gateway(IGW) 4.78 Gbps 18.6 Gbps 23.9 Gbps 23.9 Gbps 23.9 Gbps
④NAT Gateway(NAT GW) 1回目 712 Mbps 4.89 Gbps 14.1 Gbps 19.2 Gbps 23.9 Gbps
④NAT Gateway(NAT GW) 2回目 ※1 788 Mbps 4.30 Gbps 8.11 Gbps 22.2 Gbps 36.4 Gbps

※1 NAT GWだけは事前考察とかなり異なる結果だったため2回測定しました。

帯域測定コマンドや出力結果

測定した際にiPerfクライアントから発行したコマンドや出力結果を↓においておきます。
ウィンドウサイズなどの詳細を知りたい方はご覧ください。
NAT GWの2回目計測はzennの文字数制限により省いてあります。

測定コマンドやrowデータ

前提

  • ルートテーブルやSG, NACLは事前に許可設定が必要
  • iPerf(Server, Client)インストール

測定コマンド(iPerf client側から発行するコマンド)

array=("1" "5" "10" "20" "50")  # 多重度(コネクション数)の指定
DESTINATION_IP="10.100.8.222"   # iPerfサーバのIP, Private or Public IPを指定
for i in "${array[@]}"; do iperf -c ${DESTINATION_IP} -t 30 -e -P $i; done

出力結果

## PCX(-P 1)
------------------------------------------------------------
Client connecting to 10.100.8.222, TCP port 5001 with pid 2046
Write buffer size:  128 KByte
TCP window size: 3.27 MByte (default)
------------------------------------------------------------
[  3] local 10.0.0.4 port 37458 connected with 10.100.8.222 port 5001 (ct=0.17 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[  3] 0.00-30.00 sec  33.3 GBytes  9.53 Gbits/sec  272648/0          0       -1K/721 us  1652146.84

## PCX(-P 5)
------------------------------------------------------------
Client connecting to 10.100.8.222, TCP port 5001 with pid 2058
Write buffer size:  128 KByte
TCP window size: 2.41 MByte (default)
------------------------------------------------------------
[  7] local 10.0.0.4 port 44160 connected with 10.100.8.222 port 5001 (ct=0.11 ms)
[  6] local 10.0.0.4 port 44150 connected with 10.100.8.222 port 5001 (ct=0.14 ms)
[  4] local 10.0.0.4 port 44128 connected with 10.100.8.222 port 5001 (ct=0.17 ms)
[  5] local 10.0.0.4 port 44148 connected with 10.100.8.222 port 5001 (ct=0.12 ms)
[  3] local 10.0.0.4 port 44138 connected with 10.100.8.222 port 5001 (ct=0.14 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[  7] 0.00-30.00 sec  33.3 GBytes  9.53 Gbits/sec  272640/0          0       -1K/532 us  2239056.93
[  6] 0.00-30.00 sec  33.3 GBytes  9.53 Gbits/sec  272644/0          0       -1K/287 us  4150440.78
[  4] 0.00-30.00 sec  33.3 GBytes  9.53 Gbits/sec  272669/0          0       -1K/192 us  6204688.66
[  5] 0.00-30.00 sec  33.3 GBytes  9.53 Gbits/sec  272641/0          0       -1K/163 us  7307840.31
[  3] 0.00-30.00 sec  33.3 GBytes  9.53 Gbits/sec  272651/0          0       -1K/131 us  9093025.36
[SUM] 0.00-30.00 sec   166 GBytes  47.6 Gbits/sec  1363245/0         0

## PCX(-P 10)
------------------------------------------------------------
Client connecting to 10.100.8.222, TCP port 5001 with pid 2066
Write buffer size:  128 KByte
TCP window size: 1.11 MByte (default)
------------------------------------------------------------
[ 11] local 10.0.0.4 port 35762 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[  9] local 10.0.0.4 port 35726 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 10] local 10.0.0.4 port 35740 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 12] local 10.0.0.4 port 35746 connected with 10.100.8.222 port 5001 (ct=0.11 ms)
[  5] local 10.0.0.4 port 35684 connected with 10.100.8.222 port 5001 (ct=0.13 ms)
[  3] local 10.0.0.4 port 35664 connected with 10.100.8.222 port 5001 (ct=0.16 ms)
[  6] local 10.0.0.4 port 35692 connected with 10.100.8.222 port 5001 (ct=0.11 ms)
[  4] local 10.0.0.4 port 35678 connected with 10.100.8.222 port 5001 (ct=0.13 ms)
[  7] local 10.0.0.4 port 35704 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[  8] local 10.0.0.4 port 35716 connected with 10.100.8.222 port 5001 (ct=0.11 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[  9] 0.00-30.00 sec  29.5 GBytes  8.46 Gbits/sec  241990/0          0       -1K/246 us  4297791.60
[ 10] 0.00-30.00 sec  14.9 GBytes  4.27 Gbits/sec  122096/0          0       -1K/239 us  2231896.14
[  5] 0.00-30.00 sec  14.7 GBytes  4.20 Gbits/sec  120118/0          0       -1K/244 us  2150802.03
[  4] 0.00-30.00 sec  29.5 GBytes  8.44 Gbits/sec  241439/0          0       -1K/92 us  11465786.55
[ 11] 0.00-30.00 sec  13.6 GBytes  3.89 Gbits/sec  111375/0          0       -1K/637 us  763822.03
[ 12] 0.00-30.00 sec  13.9 GBytes  3.97 Gbits/sec  113554/0          0       -1K/158 us  3139733.77
[  3] 0.00-30.00 sec  14.6 GBytes  4.19 Gbits/sec  119746/0          0       -1K/217 us  2410811.12
[  6] 0.00-30.00 sec  14.6 GBytes  4.19 Gbits/sec  119940/0          0       -1K/176 us  2977229.29
[  7] 0.00-30.00 sec  14.8 GBytes  4.23 Gbits/sec  120973/0          0       -1K/145 us  3644842.24
[  8] 0.00-30.00 sec  13.3 GBytes  3.81 Gbits/sec  109020/0          0       -1K/73 us  6524275.35
[SUM] 0.00-30.00 sec   173 GBytes  49.6 Gbits/sec  1420251/0         0

## PCX(-P 20)
------------------------------------------------------------
Client connecting to 10.100.8.222, TCP port 5001 with pid 2079
Write buffer size:  128 KByte
TCP window size:  878 KByte (default)
------------------------------------------------------------
[ 21] local 10.0.0.4 port 37214 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 19] local 10.0.0.4 port 37186 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 22] local 10.0.0.4 port 37198 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[  3] local 10.0.0.4 port 37056 connected with 10.100.8.222 port 5001 (ct=0.17 ms)
[  6] local 10.0.0.4 port 37064 connected with 10.100.8.222 port 5001 (ct=0.11 ms)
[  4] local 10.0.0.4 port 37058 connected with 10.100.8.222 port 5001 (ct=0.14 ms)
[ 12] local 10.0.0.4 port 37086 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[  7] local 10.0.0.4 port 37074 connected with 10.100.8.222 port 5001 (ct=0.11 ms)
[  5] local 10.0.0.4 port 37070 connected with 10.100.8.222 port 5001 (ct=0.11 ms)
[ 11] local 10.0.0.4 port 37092 connected with 10.100.8.222 port 5001 (ct=0.11 ms)
[  9] local 10.0.0.4 port 37100 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[  8] local 10.0.0.4 port 37108 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 13] local 10.0.0.4 port 37138 connected with 10.100.8.222 port 5001 (ct=0.08 ms)
[ 10] local 10.0.0.4 port 37122 connected with 10.100.8.222 port 5001 (ct=0.11 ms)
[ 14] local 10.0.0.4 port 37148 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 15] local 10.0.0.4 port 37150 connected with 10.100.8.222 port 5001 (ct=0.11 ms)
[ 16] local 10.0.0.4 port 37162 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 17] local 10.0.0.4 port 37152 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 18] local 10.0.0.4 port 37172 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 20] local 10.0.0.4 port 37174 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[ 21] 0.00-30.00 sec  6.35 GBytes  1.82 Gbits/sec  52013/0          0       -1K/1390 us  163471.10
[ 19] 0.00-30.00 sec  5.78 GBytes  1.65 Gbits/sec  47324/0          0       -1K/633 us  326613.81
[ 22] 0.00-30.01 sec  5.66 GBytes  1.62 Gbits/sec  46366/0          0       -1K/513 us  394815.22
[  3] 0.00-30.00 sec  4.73 GBytes  1.35 Gbits/sec  38722/0          0       -1K/352 us  480615.44
[  6] 0.00-30.00 sec  4.83 GBytes  1.38 Gbits/sec  39595/0          0       -1K/266 us  650259.77
[  4] 0.00-30.00 sec  10.8 GBytes  3.09 Gbits/sec  88294/0          0       -1K/168 us  2296116.58
[ 12] 0.00-30.00 sec  11.9 GBytes  3.40 Gbits/sec  97144/0          0       -1K/140 us  3031339.71
[  7] 0.00-30.00 sec  10.9 GBytes  3.12 Gbits/sec  89224/0          0       -1K/123 us  3169222.05
[  5] 0.00-30.00 sec  9.03 GBytes  2.59 Gbits/sec  73990/0          0       -1K/118 us  2739334.31
[ 11] 0.00-30.00 sec  5.90 GBytes  1.69 Gbits/sec  48312/0          0       -1K/130 us  1623448.37
[  9] 0.00-30.01 sec  4.96 GBytes  1.42 Gbits/sec  40613/0          0       -1K/120 us  1478421.59
[  8] 0.00-30.00 sec  5.13 GBytes  1.47 Gbits/sec  42056/0          0       -1K/109 us  1685687.83
[ 13] 0.00-30.00 sec  7.47 GBytes  2.14 Gbits/sec  61215/0          0       -1K/113 us  2366573.48
[ 10] 0.00-30.00 sec  6.62 GBytes  1.89 Gbits/sec  54214/0          0       -1K/103 us  2299384.56
[ 14] 0.00-30.00 sec  11.4 GBytes  3.26 Gbits/sec  93301/0          0       -1K/49 us  8318885.33
[ 15] 0.00-30.00 sec  10.4 GBytes  2.97 Gbits/sec  84901/0          0       -1K/36 us  10302467.72
[ 16] 0.00-30.00 sec  6.73 GBytes  1.93 Gbits/sec  55119/0          0       -1K/78 us  3086981.68
[ 17] 0.00-30.00 sec  22.7 GBytes  6.51 Gbits/sec  186147/0          0       -1K/35 us  23236583.19
[ 18] 0.00-30.00 sec  11.0 GBytes  3.16 Gbits/sec  90433/0          0       -1K/38 us  10396149.91
[ 20] 0.00-30.00 sec  11.2 GBytes  3.20 Gbits/sec  91498/0          0       -1K/27 us  14804617.04
[SUM] 0.00-30.01 sec   173 GBytes  49.6 Gbits/sec  1420481/0         0

## PCX(-P 50)
------------------------------------------------------------
Client connecting to 10.100.8.222, TCP port 5001 with pid 2109
Write buffer size:  128 KByte
TCP window size:  975 KByte (default)
------------------------------------------------------------
[ 53] local 10.0.0.4 port 44066 connected with 10.100.8.222 port 5001 (ct=0.08 ms)
[ 49] local 10.0.0.4 port 44060 connected with 10.100.8.222 port 5001 (ct=0.08 ms)
[ 51] local 10.0.0.4 port 44074 connected with 10.100.8.222 port 5001 (ct=0.08 ms)
[  3] local 10.0.0.4 port 43678 connected with 10.100.8.222 port 5001 (ct=0.12 ms)
[  6] local 10.0.0.4 port 43692 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[  5] local 10.0.0.4 port 43684 connected with 10.100.8.222 port 5001 (ct=0.12 ms)
[  7] local 10.0.0.4 port 43708 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[  8] local 10.0.0.4 port 43710 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[  9] local 10.0.0.4 port 43712 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 11] local 10.0.0.4 port 43714 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 10] local 10.0.0.4 port 43730 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 13] local 10.0.0.4 port 43746 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 14] local 10.0.0.4 port 43754 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 12] local 10.0.0.4 port 43760 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 15] local 10.0.0.4 port 43772 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 16] local 10.0.0.4 port 43764 connected with 10.100.8.222 port 5001 (ct=0.13 ms)
[ 18] local 10.0.0.4 port 43786 connected with 10.100.8.222 port 5001 (ct=0.13 ms)
[ 20] local 10.0.0.4 port 43800 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 19] local 10.0.0.4 port 43802 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 17] local 10.0.0.4 port 43804 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 23] local 10.0.0.4 port 43808 connected with 10.100.8.222 port 5001 (ct=0.08 ms)
[ 21] local 10.0.0.4 port 43814 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 22] local 10.0.0.4 port 43820 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 25] local 10.0.0.4 port 43816 connected with 10.100.8.222 port 5001 (ct=0.08 ms)
[ 24] local 10.0.0.4 port 43834 connected with 10.100.8.222 port 5001 (ct=0.08 ms)
[ 27] local 10.0.0.4 port 43850 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 29] local 10.0.0.4 port 43860 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 28] local 10.0.0.4 port 43870 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 32] local 10.0.0.4 port 43884 connected with 10.100.8.222 port 5001 (ct=0.08 ms)
[ 30] local 10.0.0.4 port 43898 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 26] local 10.0.0.4 port 43838 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 31] local 10.0.0.4 port 43910 connected with 10.100.8.222 port 5001 (ct=0.08 ms)
[ 33] local 10.0.0.4 port 43902 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 34] local 10.0.0.4 port 43920 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 35] local 10.0.0.4 port 43934 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 36] local 10.0.0.4 port 43952 connected with 10.100.8.222 port 5001 (ct=0.08 ms)
[ 38] local 10.0.0.4 port 43940 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 37] local 10.0.0.4 port 43960 connected with 10.100.8.222 port 5001 (ct=0.08 ms)
[ 42] local 10.0.0.4 port 43972 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 40] local 10.0.0.4 port 43978 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 39] local 10.0.0.4 port 43974 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 43] local 10.0.0.4 port 43994 connected with 10.100.8.222 port 5001 (ct=0.10 ms)
[ 44] local 10.0.0.4 port 44006 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 45] local 10.0.0.4 port 44018 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 46] local 10.0.0.4 port 44020 connected with 10.100.8.222 port 5001 (ct=0.08 ms)
[ 47] local 10.0.0.4 port 44032 connected with 10.100.8.222 port 5001 (ct=0.08 ms)
[ 41] local 10.0.0.4 port 44048 connected with 10.100.8.222 port 5001 (ct=0.09 ms)
[ 50] local 10.0.0.4 port 44056 connected with 10.100.8.222 port 5001 (ct=0.08 ms)
[  4] local 10.0.0.4 port 43672 connected with 10.100.8.222 port 5001 (ct=0.15 ms)
[ 48] local 10.0.0.4 port 44034 connected with 10.100.8.222 port 5001 (ct=0.08 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[ 53] 0.00-30.00 sec  3.21 GBytes   919 Mbits/sec  26289/0          0       -1K/1101 us  104314.97
[ 49] 0.00-30.00 sec  2.07 GBytes   592 Mbits/sec  16930/0          0       -1K/633 us  116842.66
[  3] 0.00-30.00 sec  4.57 GBytes  1.31 Gbits/sec  37409/0          0       -1K/313 us  522116.98
[  5] 0.00-30.00 sec  2.11 GBytes   604 Mbits/sec  17275/0          0       -1K/269 us  280544.72
[  8] 0.00-30.00 sec  4.60 GBytes  1.32 Gbits/sec  37708/0          0       -1K/152 us  1083815.95
[  9] 0.00-30.00 sec  3.66 GBytes  1.05 Gbits/sec  30010/0          0       -1K/52 us  2521237.75
[ 10] 0.00-30.00 sec  2.63 GBytes   754 Mbits/sec  21583/0          0       -1K/113 us  834435.91
[ 13] 0.00-30.00 sec  2.67 GBytes   765 Mbits/sec  21885/0          0       -1K/111 us  861357.47
[ 14] 0.00-30.00 sec  2.68 GBytes   769 Mbits/sec  21993/0          0       -1K/99 us  970444.68
[ 15] 0.00-30.00 sec  5.53 GBytes  1.58 Gbits/sec  45312/0          0       -1K/41 us  4828262.36
[ 16] 0.00-30.00 sec  5.65 GBytes  1.62 Gbits/sec  46246/0          0       -1K/38 us  5316903.18
[ 18] 0.00-30.00 sec  2.07 GBytes   594 Mbits/sec  16994/0          0       -1K/93 us  798280.21
[ 20] 0.00-30.00 sec  4.54 GBytes  1.30 Gbits/sec  37163/0          0       -1K/73 us  2223999.34
[ 23] 0.00-30.00 sec  4.74 GBytes  1.36 Gbits/sec  38795/0          0       -1K/60 us  2824947.14
[ 21] 0.00-30.01 sec  3.04 GBytes   871 Mbits/sec  24913/0          0       -1K/52 us  2092831.49
[ 22] 0.00-30.00 sec  3.24 GBytes   928 Mbits/sec  26540/0          0       -1K/9 us  12883374.67
[ 24] 0.00-30.00 sec  2.03 GBytes   581 Mbits/sec  16635/0          0       -1K/10 us  7267767.49
[ 27] 0.00-30.00 sec  5.54 GBytes  1.59 Gbits/sec  45421/0          0       -1K/9 us  22048217.37
[ 32] 0.00-30.00 sec  2.69 GBytes   769 Mbits/sec  22014/0          0       -1K/9 us  10685589.43
[ 30] 0.00-30.00 sec  5.53 GBytes  1.58 Gbits/sec  45320/0          0       -1K/8 us  24750068.01
[ 26] 0.00-30.00 sec  3.02 GBytes   864 Mbits/sec  24721/0          0       -1K/8 us  13500578.72
[ 33] 0.00-30.00 sec  3.65 GBytes  1.04 Gbits/sec  29880/0          0       -1K/8 us  16317709.58
[ 35] 0.00-30.00 sec  3.22 GBytes   922 Mbits/sec  26384/0          0       -1K/8 us  14407111.56
[ 38] 0.00-30.00 sec  3.08 GBytes   882 Mbits/sec  25242/0          0       -1K/8 us  13785258.20
[ 42] 0.00-30.00 sec  3.70 GBytes  1.06 Gbits/sec  30276/0          0       -1K/9 us  14696957.29
[ 40] 0.00-30.00 sec  6.73 GBytes  1.93 Gbits/sec  55101/0          0       -1K/10 us  24072054.03
[ 39] 0.00-30.00 sec  2.70 GBytes   772 Mbits/sec  22093/0          0       -1K/10 us  9652111.82
[ 43] 0.00-30.00 sec  6.88 GBytes  1.97 Gbits/sec  56369/0          0       -1K/10 us  24625681.18
[ 45] 0.00-30.00 sec  6.96 GBytes  1.99 Gbits/sec  57021/0          0       -1K/11 us  22647745.80
[ 46] 0.00-30.00 sec  3.63 GBytes  1.04 Gbits/sec  29766/0          0       -1K/14 us  9288693.28
[ 47] 0.00-30.00 sec  3.04 GBytes   871 Mbits/sec  24913/0          0       -1K/20 us  5441475.21
[ 41] 0.00-30.00 sec  2.99 GBytes   857 Mbits/sec  24509/0          0       -1K/25 us  4282955.39
[ 50] 0.00-30.00 sec  3.02 GBytes   864 Mbits/sec  24730/0          0       -1K/16 us  6752063.37
[  4] 0.00-30.00 sec  3.04 GBytes   871 Mbits/sec  24917/0          0       -1K/24 us  4535738.20
[ 48] 0.00-30.00 sec  3.15 GBytes   902 Mbits/sec  25811/0          0       -1K/19 us  5935120.24
[ 51] 0.00-30.01 sec  3.24 GBytes   927 Mbits/sec  26514/0          0       -1K/301 us  384784.76
[  6] 0.00-30.01 sec  2.05 GBytes   588 Mbits/sec  16824/0          0       -1K/300 us  244947.11
[  7] 0.00-30.01 sec  2.08 GBytes   596 Mbits/sec  17056/0          0       -1K/234 us  318389.22
[ 11] 0.00-30.01 sec  2.65 GBytes   760 Mbits/sec  21744/0          0       -1K/130 us  730581.45
[ 12] 0.00-30.01 sec  3.64 GBytes  1.04 Gbits/sec  29836/0          0       -1K/78 us  1670921.86
[ 19] 0.00-30.01 sec  2.01 GBytes   576 Mbits/sec  16486/0          0       -1K/85 us  847101.87
[ 17] 0.00-30.01 sec  3.18 GBytes   909 Mbits/sec  26010/0          0       -1K/54 us  2103841.55
[ 25] 0.00-30.01 sec  4.62 GBytes  1.32 Gbits/sec  37827/0          0       -1K/9 us  18359834.08
[ 29] 0.00-30.01 sec  2.62 GBytes   749 Mbits/sec  21427/0          0       -1K/10 us  9359592.45
[ 28] 0.00-30.01 sec  3.59 GBytes  1.03 Gbits/sec  29417/0          0       -1K/9 us  14277926.65
[ 31] 0.00-30.01 sec  3.17 GBytes   908 Mbits/sec  25974/0          0       -1K/8 us  14181775.65
[ 34] 0.00-30.01 sec  2.15 GBytes   615 Mbits/sec  17589/0          0       -1K/10 us  7682639.15
[ 36] 0.00-30.01 sec  2.06 GBytes   589 Mbits/sec  16863/0          0       -1K/9 us  8184640.50
[ 37] 0.00-30.01 sec  2.06 GBytes   589 Mbits/sec  16863/0          0       -1K/11 us  6695159.83
[ 44] 0.00-30.01 sec  2.71 GBytes   775 Mbits/sec  22178/0          0       -1K/12 us  8072021.31
[SUM] 0.00-30.01 sec   173 GBytes  49.6 Gbits/sec  1420776/0         0

## IGW(-P 1)
------------------------------------------------------------
Client connecting to 52.194.245.77, TCP port 5001 with pid 2281
Write buffer size:  128 KByte
TCP window size: 1.74 MByte (default)
------------------------------------------------------------
[  3] local 10.0.0.4 port 56846 connected with 52.194.245.77 port 5001 (ct=0.21 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[  3] 0.00-30.00 sec  16.7 GBytes  4.78 Gbits/sec  136869/0          0       -1K/858 us  696957.03

## IGW(-P 5)
------------------------------------------------------------
Client connecting to 52.194.245.77, TCP port 5001 with pid 2284
Write buffer size:  128 KByte
TCP window size: 1.51 MByte (default)
------------------------------------------------------------
[  7] local 10.0.0.4 port 53360 connected with 52.194.245.77 port 5001 (ct=0.15 ms)
[  6] local 10.0.0.4 port 53352 connected with 52.194.245.77 port 5001 (ct=0.14 ms)
[  4] local 10.0.0.4 port 53322 connected with 52.194.245.77 port 5001 (ct=0.20 ms)
[  5] local 10.0.0.4 port 53342 connected with 52.194.245.77 port 5001 (ct=0.15 ms)
[  3] local 10.0.0.4 port 53328 connected with 52.194.245.77 port 5001 (ct=0.17 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[  7] 0.00-30.00 sec  8.20 GBytes  2.35 Gbits/sec  67140/0          0       -1K/899 us  326291.36
[  6] 0.00-30.00 sec  14.7 GBytes  4.21 Gbits/sec  120492/0          0       -1K/235 us  2240095.18
[  4] 0.00-30.00 sec  16.7 GBytes  4.78 Gbits/sec  136862/0          0       -1K/215 us  2781186.96
[  5] 0.00-30.00 sec  16.7 GBytes  4.78 Gbits/sec  136865/0          0       -1K/131 us  4564570.04
[  3] 0.00-30.00 sec  8.51 GBytes  2.44 Gbits/sec  69737/0          0       -1K/180 us  1692581.40
[SUM] 0.00-30.00 sec  64.8 GBytes  18.6 Gbits/sec  531096/0         0

## IGW(-P 10)
------------------------------------------------------------
Client connecting to 52.194.245.77, TCP port 5001 with pid 2292
Write buffer size:  128 KByte
TCP window size:  950 KByte (default)
------------------------------------------------------------
[ 10] local 10.0.0.4 port 36092 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[  9] local 10.0.0.4 port 36080 connected with 52.194.245.77 port 5001 (ct=0.14 ms)
[  8] local 10.0.0.4 port 36086 connected with 52.194.245.77 port 5001 (ct=0.14 ms)
[  4] local 10.0.0.4 port 36036 connected with 52.194.245.77 port 5001 (ct=0.19 ms)
[  6] local 10.0.0.4 port 36056 connected with 52.194.245.77 port 5001 (ct=0.14 ms)
[  3] local 10.0.0.4 port 36040 connected with 52.194.245.77 port 5001 (ct=0.17 ms)
[ 11] local 10.0.0.4 port 36068 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[  7] local 10.0.0.4 port 36060 connected with 52.194.245.77 port 5001 (ct=0.15 ms)
[  5] local 10.0.0.4 port 36058 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 15] local 10.0.0.4 port 36076 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[ 10] 0.00-30.00 sec  4.78 GBytes  1.37 Gbits/sec  39138/0          0       -1K/821 us  208273.98
[  9] 0.00-30.00 sec  8.19 GBytes  2.35 Gbits/sec  67131/0          0       -1K/406 us  722397.20
[  8] 0.00-30.00 sec  16.7 GBytes  4.78 Gbits/sec  136857/0          0       -1K/170 us  3517274.35
[  4] 0.00-30.00 sec  5.27 GBytes  1.51 Gbits/sec  43195/0          0       -1K/219 us  861656.62
[  6] 0.00-30.00 sec  9.86 GBytes  2.82 Gbits/sec  80793/0          0       -1K/147 us  2401284.05
[  3] 0.00-30.00 sec  6.95 GBytes  1.99 Gbits/sec  56928/0          0       -1K/123 us  2022121.62
[ 11] 0.00-30.00 sec  4.83 GBytes  1.38 Gbits/sec  39532/0          0       -1K/117 us  1476047.47
[  7] 0.00-30.00 sec  5.63 GBytes  1.61 Gbits/sec  46093/0          0       -1K/106 us  1899688.60
[  5] 0.00-30.00 sec  16.7 GBytes  4.78 Gbits/sec  136878/0          0       -1K/80 us  7474810.70
[ 15] 0.00-30.00 sec  4.69 GBytes  1.34 Gbits/sec  38415/0          0       -1K/83 us  2021944.85
[SUM] 0.00-30.00 sec  83.6 GBytes  23.9 Gbits/sec  684960/0         0

## IGW(-P 20)
------------------------------------------------------------
Client connecting to 52.194.245.77, TCP port 5001 with pid 2304
Write buffer size:  128 KByte
TCP window size:  806 KByte (default)
------------------------------------------------------------
[ 23] local 10.0.0.4 port 57498 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 20] local 10.0.0.4 port 57482 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 21] local 10.0.0.4 port 57492 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[  5] local 10.0.0.4 port 57360 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[  6] local 10.0.0.4 port 57344 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[  3] local 10.0.0.4 port 57314 connected with 52.194.245.77 port 5001 (ct=0.20 ms)
[  4] local 10.0.0.4 port 57328 connected with 52.194.245.77 port 5001 (ct=0.17 ms)
[  7] local 10.0.0.4 port 57364 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[  8] local 10.0.0.4 port 57374 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[  9] local 10.0.0.4 port 57378 connected with 52.194.245.77 port 5001 (ct=0.14 ms)
[ 10] local 10.0.0.4 port 57392 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 11] local 10.0.0.4 port 57402 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 12] local 10.0.0.4 port 57412 connected with 52.194.245.77 port 5001 (ct=0.15 ms)
[ 13] local 10.0.0.4 port 57428 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 14] local 10.0.0.4 port 57442 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 15] local 10.0.0.4 port 57446 connected with 52.194.245.77 port 5001 (ct=0.14 ms)
[ 17] local 10.0.0.4 port 57458 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 16] local 10.0.0.4 port 57452 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 18] local 10.0.0.4 port 57460 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 19] local 10.0.0.4 port 57466 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[ 23] 0.00-30.00 sec  2.27 GBytes   650 Mbits/sec  18592/0          5       -1K/1368 us  59373.79
[ 20] 0.00-30.00 sec  2.31 GBytes   662 Mbits/sec  18930/0          0       -1K/694 us  119170.76
[ 21] 0.00-30.00 sec  3.86 GBytes  1.10 Gbits/sec  31582/0          4       -1K/290 us  475804.81
[  5] 0.00-30.00 sec  2.09 GBytes   598 Mbits/sec  17099/0         21       -1K/400 us  186755.08
[  6] 0.00-30.01 sec  2.16 GBytes   618 Mbits/sec  17681/0          0       -1K/295 us  261802.42
[  3] 0.00-30.00 sec  4.09 GBytes  1.17 Gbits/sec  33465/0         32       -1K/146 us  1001350.02
[  4] 0.00-30.00 sec  6.16 GBytes  1.76 Gbits/sec  50449/0         33       -1K/63 us  3498305.98
[  7] 0.00-30.00 sec  7.44 GBytes  2.13 Gbits/sec  60955/0         18       -1K/45 us  5917590.23
[  8] 0.00-30.00 sec  3.66 GBytes  1.05 Gbits/sec  29968/0          5       -1K/90 us  1454712.60
[  9] 0.00-30.00 sec  6.91 GBytes  1.98 Gbits/sec  56625/0         12       -1K/38 us  6510437.77
[ 10] 0.00-30.00 sec  2.19 GBytes   628 Mbits/sec  17975/0         13       -1K/130 us  604088.42
[ 11] 0.00-30.00 sec  6.27 GBytes  1.79 Gbits/sec  51325/0         23       -1K/33 us  6794974.84
[ 12] 0.00-30.01 sec  2.93 GBytes   838 Mbits/sec  23984/0          0       -1K/89 us  1177164.25
[ 13] 0.00-30.00 sec  2.77 GBytes   794 Mbits/sec  22715/0         26       -1K/85 us  1167501.06
[ 14] 0.00-30.00 sec  3.91 GBytes  1.12 Gbits/sec  32021/0         11       -1K/66 us  2119444.33
[ 15] 0.00-30.00 sec  11.7 GBytes  3.34 Gbits/sec  95590/0         27       -1K/17 us  24566411.17
[ 17] 0.00-30.01 sec  3.65 GBytes  1.04 Gbits/sec  29874/0          5       -1K/60 us  2174983.47
[ 16] 0.00-30.01 sec  2.84 GBytes   813 Mbits/sec  23269/0          0       -1K/63 us  1613183.58
[ 18] 0.00-30.00 sec  2.60 GBytes   745 Mbits/sec  21314/0          0       -1K/61 us  1526525.26
[ 19] 0.00-30.00 sec  3.87 GBytes  1.11 Gbits/sec  31669/0         12       -1K/50 us  2766972.13
[SUM] 0.00-30.01 sec  83.6 GBytes  23.9 Gbits/sec  685082/0       247

## IGW(-P 50)
------------------------------------------------------------
Client connecting to 52.194.245.77, TCP port 5001 with pid 2328
Write buffer size:  128 KByte
TCP window size:  297 KByte (default)
------------------------------------------------------------
[ 50] local 10.0.0.4 port 33532 connected with 52.194.245.77 port 5001 (ct=0.11 ms)
[ 51] local 10.0.0.4 port 33516 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 52] local 10.0.0.4 port 33528 connected with 52.194.245.77 port 5001 (ct=0.11 ms)
[  3] local 10.0.0.4 port 33076 connected with 52.194.245.77 port 5001 (ct=0.20 ms)
[  4] local 10.0.0.4 port 33078 connected with 52.194.245.77 port 5001 (ct=0.16 ms)
[  5] local 10.0.0.4 port 33090 connected with 52.194.245.77 port 5001 (ct=0.15 ms)
[  6] local 10.0.0.4 port 33100 connected with 52.194.245.77 port 5001 (ct=0.15 ms)
[  7] local 10.0.0.4 port 33116 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[  8] local 10.0.0.4 port 33126 connected with 52.194.245.77 port 5001 (ct=0.14 ms)
[ 10] local 10.0.0.4 port 33142 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 11] local 10.0.0.4 port 33154 connected with 52.194.245.77 port 5001 (ct=0.14 ms)
[ 13] local 10.0.0.4 port 33156 connected with 52.194.245.77 port 5001 (ct=0.14 ms)
[  9] local 10.0.0.4 port 33158 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 12] local 10.0.0.4 port 33162 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 14] local 10.0.0.4 port 33166 connected with 52.194.245.77 port 5001 (ct=0.14 ms)
[ 16] local 10.0.0.4 port 33198 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 15] local 10.0.0.4 port 33182 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 17] local 10.0.0.4 port 33204 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 18] local 10.0.0.4 port 33212 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 20] local 10.0.0.4 port 33226 connected with 52.194.245.77 port 5001 (ct=0.14 ms)
[ 19] local 10.0.0.4 port 33234 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 21] local 10.0.0.4 port 33246 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 22] local 10.0.0.4 port 33272 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 24] local 10.0.0.4 port 33262 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 25] local 10.0.0.4 port 33284 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 27] local 10.0.0.4 port 33286 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 29] local 10.0.0.4 port 33288 connected with 52.194.245.77 port 5001 (ct=0.15 ms)
[ 28] local 10.0.0.4 port 33304 connected with 52.194.245.77 port 5001 (ct=0.14 ms)
[ 23] local 10.0.0.4 port 33308 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 26] local 10.0.0.4 port 33316 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 33] local 10.0.0.4 port 33330 connected with 52.194.245.77 port 5001 (ct=0.11 ms)
[ 30] local 10.0.0.4 port 33344 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 32] local 10.0.0.4 port 33354 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 34] local 10.0.0.4 port 33366 connected with 52.194.245.77 port 5001 (ct=0.14 ms)
[ 31] local 10.0.0.4 port 33378 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 36] local 10.0.0.4 port 33402 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 37] local 10.0.0.4 port 33406 connected with 52.194.245.77 port 5001 (ct=0.11 ms)
[ 35] local 10.0.0.4 port 33392 connected with 52.194.245.77 port 5001 (ct=0.11 ms)
[ 39] local 10.0.0.4 port 33420 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 41] local 10.0.0.4 port 33440 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 43] local 10.0.0.4 port 33448 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 40] local 10.0.0.4 port 33426 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 42] local 10.0.0.4 port 33474 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 38] local 10.0.0.4 port 33450 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 45] local 10.0.0.4 port 33478 connected with 52.194.245.77 port 5001 (ct=0.11 ms)
[ 48] local 10.0.0.4 port 33484 connected with 52.194.245.77 port 5001 (ct=0.13 ms)
[ 47] local 10.0.0.4 port 33508 connected with 52.194.245.77 port 5001 (ct=0.11 ms)
[ 49] local 10.0.0.4 port 33510 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 44] local 10.0.0.4 port 33496 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ 46] local 10.0.0.4 port 33466 connected with 52.194.245.77 port 5001 (ct=0.12 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[ 50] 0.00-30.01 sec  1.79 GBytes   511 Mbits/sec  14637/0         25       -1K/558 us  114582.18
[ 51] 0.00-30.00 sec  1.57 GBytes   448 Mbits/sec  12825/0         38       -1K/293 us  191238.52
[ 52] 0.00-30.00 sec  1.17 GBytes   335 Mbits/sec  9583/0         10       -1K/454 us  92214.61
[  3] 0.00-30.00 sec  1.19 GBytes   341 Mbits/sec  9743/0         36       -1K/351 us  121270.28
[  4] 0.00-30.00 sec  1.06 GBytes   304 Mbits/sec  8686/0         91       -1K/365 us  103962.02
[  5] 0.00-30.00 sec  2.56 GBytes   734 Mbits/sec  20994/0        189       -1K/69 us  1329168.73
[  6] 0.00-30.00 sec  1.16 GBytes   331 Mbits/sec  9471/0         45       -1K/157 us  263538.15
[  7] 0.00-30.00 sec  1.27 GBytes   364 Mbits/sec  10413/0         63       -1K/157 us  289747.37
[  8] 0.00-30.00 sec  2.16 GBytes   618 Mbits/sec  17692/0         94       -1K/40 us  1932339.44
[ 10] 0.00-30.01 sec  2.23 GBytes   639 Mbits/sec  18280/0          0       -1K/23 us  3471628.14
[ 11] 0.00-30.00 sec  2.82 GBytes   806 Mbits/sec  23072/0        109       -1K/33 us  3054580.32
[ 13] 0.00-30.02 sec  1.18 GBytes   339 Mbits/sec  9696/0         93       -1K/165 us  256589.91
[  9] 0.00-30.01 sec  1.37 GBytes   391 Mbits/sec  11204/0        112       -1K/103 us  475021.46
[ 12] 0.00-30.01 sec  2.36 GBytes   676 Mbits/sec  19334/0         67       -1K/21 us  4021553.35
[ 14] 0.00-30.02 sec  1.39 GBytes   399 Mbits/sec  11427/0         41       -1K/81 us  616025.52
[ 16] 0.00-30.02 sec  1.38 GBytes   396 Mbits/sec  11342/0         41       -1K/79 us  626918.72
[ 15] 0.00-30.02 sec  1.36 GBytes   390 Mbits/sec  11153/0         43       -1K/86 us  566216.78
[ 17] 0.00-30.00 sec  1.16 GBytes   333 Mbits/sec  9524/0         54       -1K/111 us  374833.65
[ 18] 0.00-30.02 sec  1.20 GBytes   344 Mbits/sec  9841/0         36       -1K/101 us  425475.31
[ 20] 0.00-30.02 sec  2.26 GBytes   646 Mbits/sec  18496/0         51       -1K/13 us  6212282.87
[ 19] 0.00-30.00 sec  2.15 GBytes   616 Mbits/sec  17635/0          0       -1K/15 us  5136130.50
[ 21] 0.00-30.01 sec  1.05 GBytes   301 Mbits/sec  8621/0          0       -1K/15 us  2510323.35
[ 22] 0.00-30.01 sec  2.52 GBytes   722 Mbits/sec  20656/0         28       -1K/19 us  4748824.06
[ 25] 0.00-30.01 sec  2.02 GBytes   578 Mbits/sec  16541/0          0       -1K/13 us  5557879.54
[ 27] 0.00-30.01 sec  2.97 GBytes   850 Mbits/sec  24326/0         48       -1K/17 us  6250540.82
[ 29] 0.00-30.00 sec  1.07 GBytes   307 Mbits/sec  8775/0         28       -1K/48 us  798635.16
[ 28] 0.00-30.01 sec  1.20 GBytes   343 Mbits/sec  9808/0         14       -1K/45 us  951891.37
[ 23] 0.00-30.00 sec  1.99 GBytes   569 Mbits/sec  16273/0        122       -1K/9 us  7899079.45
[ 26] 0.00-30.00 sec  2.25 GBytes   644 Mbits/sec  18436/0         31       -1K/9 us  8949115.88
[ 33] 0.00-30.01 sec  2.18 GBytes   623 Mbits/sec  17834/0         48       -1K/12 us  6491906.58
[ 30] 0.00-30.02 sec  1.15 GBytes   330 Mbits/sec  9453/0         37       -1K/39 us  1058411.68
[ 32] 0.00-30.01 sec  1024 MBytes   286 Mbits/sec  8188/0         32       -1K/63 us  567703.87
[ 34] 0.00-30.00 sec  1.70 GBytes   485 Mbits/sec  13886/0         17       -1K/15 us  4044397.06
[ 31] 0.00-30.02 sec  1.08 GBytes   309 Mbits/sec  8836/0         30       -1K/58 us  665204.19
[ 36] 0.00-30.01 sec   994 MBytes   278 Mbits/sec  7954/0         23       -1K/57 us  609419.78
[ 37] 0.00-30.01 sec  1.90 GBytes   543 Mbits/sec  15555/0         18       -1K/14 us  4852141.62
[ 35] 0.00-30.00 sec  1.21 GBytes   345 Mbits/sec  9878/0         54       -1K/43 us  1003536.17
[ 39] 0.00-30.00 sec  2.68 GBytes   767 Mbits/sec  21953/0        103       -1K/10 us  9590007.12
[ 41] 0.00-30.01 sec  2.10 GBytes   600 Mbits/sec  17187/0         41       -1K/8 us  9382539.88
[ 43] 0.00-30.00 sec  2.05 GBytes   587 Mbits/sec  16799/0         90       -1K/8 us  9174214.66
[ 40] 0.00-30.02 sec  1.00 GBytes   287 Mbits/sec  8213/0         46       -1K/29 us  1236574.11
[ 42] 0.00-30.02 sec  1.22 GBytes   349 Mbits/sec  9987/0         10       -1K/32 us  1362829.24
[ 38] 0.00-30.00 sec  1.07 GBytes   306 Mbits/sec  8746/0          0       -1K/26 us  1469564.93
[ 45] 0.00-30.01 sec  2.61 GBytes   748 Mbits/sec  21393/0         53       -1K/7 us  13349041.16
[ 48] 0.00-30.01 sec  1.91 GBytes   546 Mbits/sec  15615/0         70       -1K/13 us  5246567.27
[ 47] 0.00-30.00 sec  1.77 GBytes   508 Mbits/sec  14535/0         69       -1K/10 us  6350320.50
[ 49] 0.00-30.00 sec  2.80 GBytes   800 Mbits/sec  22899/0         18       -1K/6 us  16673733.15
[ 44] 0.00-30.00 sec  1.14 GBytes   327 Mbits/sec  9369/0         23       -1K/41 us  998370.74
[ 46] 0.00-30.00 sec  1.19 GBytes   340 Mbits/sec  9732/0         32       -1K/21 us  2024471.76
[ 24] 0.00-30.02 sec  1.08 GBytes   310 Mbits/sec  8887/0         43       -1K/46 us  843488.98
[SUM] 0.00-30.02 sec  83.7 GBytes  23.9 Gbits/sec  685383/0      2366

## NATGW(-P 1)
------------------------------------------------------------
Client connecting to 52.194.245.77, TCP port 5001 with pid 1810
Write buffer size:  128 KByte
TCP window size: 1.17 MByte (default)
------------------------------------------------------------
[  3] local 10.0.132.222 port 51194 connected with 52.194.245.77 port 5001 (ct=0.93 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[  3] 0.00-40.20 sec  3.33 GBytes   712 Mbits/sec  27312/0          0       -1K/621 us  143411.19

## NATGW(-P 5)
------------------------------------------------------------
Client connecting to 52.194.245.77, TCP port 5001 with pid 1814
Write buffer size:  128 KByte
TCP window size: 1.09 MByte (default)
------------------------------------------------------------
[  5] local 10.0.132.222 port 57980 connected with 52.194.245.77 port 5001 (ct=1.18 ms)
[  6] local 10.0.132.222 port 58006 connected with 52.194.245.77 port 5001 (ct=1.02 ms)
[  3] local 10.0.132.222 port 57964 connected with 52.194.245.77 port 5001 (ct=1.21 ms)
[  4] local 10.0.132.222 port 57956 connected with 52.194.245.77 port 5001 (ct=1.01 ms)
[  7] local 10.0.132.222 port 57990 connected with 52.194.245.77 port 5001 (ct=0.92 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[  5] 0.00-30.00 sec  5.19 GBytes  1.49 Gbits/sec  42504/0          0       -1K/680 us  273065.09
[  7] 0.00-30.00 sec  7.88 GBytes  2.26 Gbits/sec  64540/0          0       -1K/193 us  1460961.30
[  6] 0.00-31.32 sec  3.21 GBytes   880 Mbits/sec  26285/0          0       -1K/533 us  206377.32
[  4] 0.00-35.24 sec  2.70 GBytes   658 Mbits/sec  22128/0          0       -1K/402 us  204743.10
[  3] 0.00-40.28 sec  3.96 GBytes   844 Mbits/sec  32403/0          0       -1K/311 us  339047.80
[SUM] 0.00-40.28 sec  22.9 GBytes  4.89 Gbits/sec  187860/0         0

## NATGW(-P 10)
------------------------------------------------------------
Client connecting to 52.194.245.77, TCP port 5001 with pid 1821
Write buffer size:  128 KByte
TCP window size: 1.23 MByte (default)
------------------------------------------------------------
[ 12] local 10.0.132.222 port 59024 connected with 52.194.245.77 port 5001 (ct=1.18 ms)
[  9] local 10.0.132.222 port 58988 connected with 52.194.245.77 port 5001 (ct=1.17 ms)
[ 11] local 10.0.132.222 port 59008 connected with 52.194.245.77 port 5001 (ct=1.13 ms)
[  6] local 10.0.132.222 port 58950 connected with 52.194.245.77 port 5001 (ct=0.84 ms)
[  3] local 10.0.132.222 port 58938 connected with 52.194.245.77 port 5001 (ct=0.92 ms)
[  4] local 10.0.132.222 port 58930 connected with 52.194.245.77 port 5001 (ct=1.22 ms)
[  8] local 10.0.132.222 port 58986 connected with 52.194.245.77 port 5001 (ct=0.84 ms)
[  5] local 10.0.132.222 port 58974 connected with 52.194.245.77 port 5001 (ct=0.88 ms)
[ 10] local 10.0.132.222 port 58996 connected with 52.194.245.77 port 5001 (ct=0.97 ms)
[  7] local 10.0.132.222 port 58966 connected with 52.194.245.77 port 5001 (ct=1.20 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[  7] 0.00-30.00 sec  6.99 GBytes  2.00 Gbits/sec  57274/0          0       -1K/96 us  2606523.71
[ 12] 0.00-30.00 sec  8.66 GBytes  2.48 Gbits/sec  70934/0          0       -1K/1278 us  242462.70
[ 11] 0.00-30.01 sec  5.01 GBytes  1.43 Gbits/sec  41048/0          0       -1K/459 us  390607.41
[  4] 0.00-30.00 sec  7.56 GBytes  2.16 Gbits/sec  61922/0          5       -1K/189 us  1431338.17
[  5] 0.00-30.00 sec  9.71 GBytes  2.78 Gbits/sec  79534/0          0       -1K/71 us  4893896.93
[ 10] 0.00-30.01 sec  4.03 GBytes  1.15 Gbits/sec  33035/0          0       -1K/255 us  565908.48
[  3] 0.00-30.04 sec  3.71 GBytes  1.06 Gbits/sec  30420/0          0       -1K/180 us  737431.57
[  6] 0.00-30.36 sec  2.76 GBytes   781 Mbits/sec  22607/0          0       -1K/204 us  478414.58
[  9] 0.00-31.56 sec  6.40 GBytes  1.74 Gbits/sec  52452/0          0       -1K/1250 us  174281.62
[  8] 0.00-35.79 sec  3.97 GBytes   953 Mbits/sec  32540/0          0       -1K/363 us  328253.51
[SUM] 0.00-35.79 sec  58.8 GBytes  14.1 Gbits/sec  481766/0         5

## NATGW(-P 20)
------------------------------------------------------------
Client connecting to 52.194.245.77, TCP port 5001 with pid 1836
Write buffer size:  128 KByte
TCP window size:  837 KByte (default)
------------------------------------------------------------
[ 22] local 10.0.132.222 port 42978 connected with 52.194.245.77 port 5001 (ct=1.21 ms)
[ 20] local 10.0.132.222 port 42966 connected with 52.194.245.77 port 5001 (ct=1.17 ms)
[ 19] local 10.0.132.222 port 42956 connected with 52.194.245.77 port 5001 (ct=1.34 ms)
[  6] local 10.0.132.222 port 42816 connected with 52.194.245.77 port 5001 (ct=0.85 ms)
[  3] local 10.0.132.222 port 42782 connected with 52.194.245.77 port 5001 (ct=0.94 ms)
[  5] local 10.0.132.222 port 42790 connected with 52.194.245.77 port 5001 (ct=1.03 ms)
[  8] local 10.0.132.222 port 42830 connected with 52.194.245.77 port 5001 (ct=0.90 ms)
[ 11] local 10.0.132.222 port 42876 connected with 52.194.245.77 port 5001 (ct=0.85 ms)
[ 10] local 10.0.132.222 port 42870 connected with 52.194.245.77 port 5001 (ct=0.91 ms)
[  7] local 10.0.132.222 port 42842 connected with 52.194.245.77 port 5001 (ct=1.00 ms)
[  9] local 10.0.132.222 port 42858 connected with 52.194.245.77 port 5001 (ct=1.07 ms)
[  4] local 10.0.132.222 port 42806 connected with 52.194.245.77 port 5001 (ct=1.20 ms)
[ 12] local 10.0.132.222 port 42900 connected with 52.194.245.77 port 5001 (ct=0.98 ms)
[ 13] local 10.0.132.222 port 42888 connected with 52.194.245.77 port 5001 (ct=1.04 ms)
[ 15] local 10.0.132.222 port 42916 connected with 52.194.245.77 port 5001 (ct=1.12 ms)
[ 14] local 10.0.132.222 port 42912 connected with 52.194.245.77 port 5001 (ct=1.18 ms)
[ 16] local 10.0.132.222 port 42928 connected with 52.194.245.77 port 5001 (ct=1.19 ms)
[ 18] local 10.0.132.222 port 42944 connected with 52.194.245.77 port 5001 (ct=0.99 ms)
[ 17] local 10.0.132.222 port 42940 connected with 52.194.245.77 port 5001 (ct=1.18 ms)
[ 21] local 10.0.132.222 port 42974 connected with 52.194.245.77 port 5001 (ct=1.00 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[ 22] 0.00-30.00 sec  13.9 GBytes  3.99 Gbits/sec  114153/0          0       -1K/460 us  1084154.74
[ 20] 0.00-30.00 sec  3.31 GBytes   948 Mbits/sec  27119/0          0       -1K/1101 us  107610.32
[  3] 0.00-30.00 sec  2.45 GBytes   700 Mbits/sec  20035/0          0       -1K/325 us  269312.23
[  8] 0.00-30.00 sec  3.96 GBytes  1.13 Gbits/sec  32409/0          0       -1K/123 us  1151038.71
[ 10] 0.00-30.00 sec  4.51 GBytes  1.29 Gbits/sec  36957/0          0       -1K/251 us  643237.78
[  7] 0.00-30.00 sec  12.6 GBytes  3.62 Gbits/sec  103556/0          0       -1K/209 us  2164714.80
[ 12] 0.00-30.01 sec  2.27 GBytes   649 Mbits/sec  18559/0          0       -1K/161 us  503537.05
[ 14] 0.00-30.00 sec   902 MBytes   252 Mbits/sec  7215/0          0       -1K/194 us  162487.29
[ 16] 0.00-30.00 sec  5.92 GBytes  1.69 Gbits/sec  48460/0          0       -1K/139 us  1523073.44
[ 17] 0.00-30.00 sec  1.46 GBytes   418 Mbits/sec  11972/0          0       -1K/132 us  396249.31
[ 19] 0.00-30.01 sec  2.58 GBytes   738 Mbits/sec  21130/0          0       -1K/636 us  145089.89
[  5] 0.00-30.01 sec  4.36 GBytes  1.25 Gbits/sec  35684/0          0       -1K/202 us  771545.64
[ 11] 0.00-30.01 sec  3.42 GBytes   978 Mbits/sec  27976/0          0       -1K/260 us  469955.44
[  9] 0.00-30.01 sec  4.83 GBytes  1.38 Gbits/sec  39590/0          0       -1K/173 us  999604.78
[ 13] 0.00-30.02 sec  1.14 GBytes   327 Mbits/sec  9355/0          0       -1K/173 us  236107.90
[ 15] 0.00-30.01 sec   850 MBytes   238 Mbits/sec  6800/0          0       -1K/224 us  132597.23
[ 18] 0.00-30.01 sec  1.46 GBytes   418 Mbits/sec  11975/0          0       -1K/170 us  307623.53
[ 21] 0.00-30.01 sec  1.84 GBytes   527 Mbits/sec  15074/0          0       -1K/155 us  424696.43
[  6] 0.00-33.87 sec  2.16 GBytes   548 Mbits/sec  17699/0          0       -1K/161 us  425429.42
[  4] 0.00-33.87 sec  1.79 GBytes   453 Mbits/sec  14625/0          0       -1K/129 us  438764.14
[SUM] 0.00-33.87 sec  75.7 GBytes  19.2 Gbits/sec  620343/0         0

## NATGW(-P 50)
------------------------------------------------------------
Client connecting to 52.194.245.77, TCP port 5001 with pid 1859
Write buffer size:  128 KByte
TCP window size:  194 KByte (default)
------------------------------------------------------------
[ 53] local 10.0.132.222 port 40230 connected with 52.194.245.77 port 5001 (ct=1.28 ms)
[ 52] local 10.0.132.222 port 40216 connected with 52.194.245.77 port 5001 (ct=1.01 ms)
[ 49] local 10.0.132.222 port 40196 connected with 52.194.245.77 port 5001 (ct=1.23 ms)
[  4] local 10.0.132.222 port 39762 connected with 52.194.245.77 port 5001 (ct=0.95 ms)
[  5] local 10.0.132.222 port 39786 connected with 52.194.245.77 port 5001 (ct=0.91 ms)
[  6] local 10.0.132.222 port 39788 connected with 52.194.245.77 port 5001 (ct=0.88 ms)
[  7] local 10.0.132.222 port 39806 connected with 52.194.245.77 port 5001 (ct=0.82 ms)
[  3] local 10.0.132.222 port 39778 connected with 52.194.245.77 port 5001 (ct=1.07 ms)
[ 11] local 10.0.132.222 port 39828 connected with 52.194.245.77 port 5001 (ct=0.85 ms)
[  8] local 10.0.132.222 port 39792 connected with 52.194.245.77 port 5001 (ct=1.13 ms)
[ 10] local 10.0.132.222 port 39818 connected with 52.194.245.77 port 5001 (ct=1.08 ms)
[ 14] local 10.0.132.222 port 39866 connected with 52.194.245.77 port 5001 (ct=1.03 ms)
[ 17] local 10.0.132.222 port 39908 connected with 52.194.245.77 port 5001 (ct=0.92 ms)
[ 12] local 10.0.132.222 port 39840 connected with 52.194.245.77 port 5001 (ct=1.20 ms)
[ 13] local 10.0.132.222 port 39856 connected with 52.194.245.77 port 5001 (ct=1.26 ms)
[ 20] local 10.0.132.222 port 39924 connected with 52.194.245.77 port 5001 (ct=1.15 ms)
[ 16] local 10.0.132.222 port 39878 connected with 52.194.245.77 port 5001 (ct=1.18 ms)
[  9] local 10.0.132.222 port 39810 connected with 52.194.245.77 port 5001 (ct=1.54 ms)
[ 21] local 10.0.132.222 port 39930 connected with 52.194.245.77 port 5001 (ct=1.05 ms)
[ 15] local 10.0.132.222 port 39884 connected with 52.194.245.77 port 5001 (ct=1.26 ms)
[ 23] local 10.0.132.222 port 39958 connected with 52.194.245.77 port 5001 (ct=1.03 ms)
[ 18] local 10.0.132.222 port 39894 connected with 52.194.245.77 port 5001 (ct=1.20 ms)
[ 27] local 10.0.132.222 port 39992 connected with 52.194.245.77 port 5001 (ct=0.97 ms)
[ 19] local 10.0.132.222 port 39942 connected with 52.194.245.77 port 5001 (ct=1.07 ms)
[ 22] local 10.0.132.222 port 39944 connected with 52.194.245.77 port 5001 (ct=1.02 ms)
[ 30] local 10.0.132.222 port 40016 connected with 52.194.245.77 port 5001 (ct=0.84 ms)
[ 31] local 10.0.132.222 port 40036 connected with 52.194.245.77 port 5001 (ct=0.83 ms)
[ 26] local 10.0.132.222 port 39972 connected with 52.194.245.77 port 5001 (ct=1.01 ms)
[ 34] local 10.0.132.222 port 40056 connected with 52.194.245.77 port 5001 (ct=0.83 ms)
[ 25] local 10.0.132.222 port 39970 connected with 52.194.245.77 port 5001 (ct=1.26 ms)
[ 24] local 10.0.132.222 port 39984 connected with 52.194.245.77 port 5001 (ct=1.19 ms)
[ 35] local 10.0.132.222 port 40064 connected with 52.194.245.77 port 5001 (ct=0.86 ms)
[ 28] local 10.0.132.222 port 40002 connected with 52.194.245.77 port 5001 (ct=1.19 ms)
[ 29] local 10.0.132.222 port 40012 connected with 52.194.245.77 port 5001 (ct=1.21 ms)
[ 32] local 10.0.132.222 port 40048 connected with 52.194.245.77 port 5001 (ct=1.14 ms)
[ 33] local 10.0.132.222 port 40022 connected with 52.194.245.77 port 5001 (ct=1.22 ms)
[ 38] local 10.0.132.222 port 40072 connected with 52.194.245.77 port 5001 (ct=1.00 ms)
[ 41] local 10.0.132.222 port 40120 connected with 52.194.245.77 port 5001 (ct=0.86 ms)
[ 37] local 10.0.132.222 port 40074 connected with 52.194.245.77 port 5001 (ct=1.02 ms)
[ 39] local 10.0.132.222 port 40088 connected with 52.194.245.77 port 5001 (ct=1.04 ms)
[ 43] local 10.0.132.222 port 40146 connected with 52.194.245.77 port 5001 (ct=0.85 ms)
[ 42] local 10.0.132.222 port 40106 connected with 52.194.245.77 port 5001 (ct=0.99 ms)
[ 40] local 10.0.132.222 port 40098 connected with 52.194.245.77 port 5001 (ct=1.16 ms)
[ 44] local 10.0.132.222 port 40134 connected with 52.194.245.77 port 5001 (ct=1.08 ms)
[ 36] local 10.0.132.222 port 40070 connected with 52.194.245.77 port 5001 (ct=1.40 ms)
[ 47] local 10.0.132.222 port 40188 connected with 52.194.245.77 port 5001 (ct=0.82 ms)
[ 51] local 10.0.132.222 port 40204 connected with 52.194.245.77 port 5001 (ct=0.86 ms)
[ 45] local 10.0.132.222 port 40162 connected with 52.194.245.77 port 5001 (ct=1.20 ms)
[ 46] local 10.0.132.222 port 40174 connected with 52.194.245.77 port 5001 (ct=1.04 ms)
[ 50] local 10.0.132.222 port 40202 connected with 52.194.245.77 port 5001 (ct=1.04 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[  4] 0.00-30.00 sec  2.07 GBytes   593 Mbits/sec  16975/0          0       -1K/603 us  122975.72
[  5] 0.00-30.00 sec  1.93 GBytes   553 Mbits/sec  15825/0          0       -1K/495 us  139669.98
[  6] 0.00-30.01 sec  2.26 GBytes   647 Mbits/sec  18523/0          0       -1K/332 us  243690.31
[  7] 0.00-30.00 sec  1.95 GBytes   557 Mbits/sec  15940/0          0       -1K/396 us  175838.15
[  3] 0.00-30.01 sec  1.21 GBytes   346 Mbits/sec  9897/0          0       -1K/341 us  126771.74
[ 11] 0.00-30.01 sec   828 MBytes   232 Mbits/sec  6628/0          0       -1K/346 us  83667.75
[  8] 0.00-30.02 sec  1.18 GBytes   337 Mbits/sec  9640/0          0       -1K/283 us  148750.37
[ 10] 0.00-30.01 sec   882 MBytes   247 Mbits/sec  7057/0          0       -1K/235 us  131179.18
[ 14] 0.00-30.01 sec  2.70 GBytes   773 Mbits/sec  22116/0          0       -1K/175 us  551977.54
[ 12] 0.00-30.01 sec  1.45 GBytes   416 Mbits/sec  11910/0          0       -1K/208 us  250110.10
[ 13] 0.00-30.01 sec  2.74 GBytes   785 Mbits/sec  22464/0          0       -1K/177 us  554376.80
[ 20] 0.00-30.00 sec  2.57 GBytes   736 Mbits/sec  21062/0          0       -1K/189 us  486881.29
[ 16] 0.00-30.01 sec  1.04 GBytes   298 Mbits/sec  8523/0          0       -1K/137 us  271743.30
[ 21] 0.00-30.01 sec  1.80 GBytes   516 Mbits/sec  14764/0          0       -1K/112 us  575785.22
[ 15] 0.00-30.01 sec  1.05 GBytes   300 Mbits/sec  8593/0          0       -1K/94 us  399282.00
[ 18] 0.00-30.01 sec  1.17 GBytes   335 Mbits/sec  9598/0          0       -1K/131 us  320046.40
[ 27] 0.00-30.01 sec  1.31 GBytes   375 Mbits/sec  10733/0          0       -1K/88 us  532774.50
[ 19] 0.00-30.01 sec  1.26 GBytes   361 Mbits/sec  10332/0          0       -1K/87 us  518610.70
[ 30] 0.00-30.01 sec  1.29 GBytes   370 Mbits/sec  10604/0          0       -1K/70 us  661566.42
[ 31] 0.00-30.01 sec  1.35 GBytes   387 Mbits/sec  11077/0          0       -1K/99 us  488750.00
[ 26] 0.00-30.01 sec  1.34 GBytes   383 Mbits/sec  10970/0          0       -1K/53 us  903893.57
[ 25] 0.00-30.01 sec  1.72 GBytes   491 Mbits/sec  14056/0          0       -1K/87 us  705712.84
[ 28] 0.00-30.00 sec  1.98 GBytes   566 Mbits/sec  16187/0          0       -1K/43 us  1644621.25
[ 29] 0.00-30.01 sec  1015 MBytes   284 Mbits/sec  8122/0          0       -1K/56 us  633473.23
[ 32] 0.00-30.01 sec  2.57 GBytes   734 Mbits/sec  21017/0          0       -1K/65 us  1412205.92
[ 38] 0.00-30.00 sec  2.28 GBytes   652 Mbits/sec  18652/0          0       -1K/43 us  1894910.07
[ 37] 0.00-30.00 sec  1.12 GBytes   321 Mbits/sec  9187/0          0       -1K/85 us  472182.47
[ 39] 0.00-30.00 sec  4.05 GBytes  1.16 Gbits/sec  33188/0          0       -1K/50 us  2899867.47
[ 43] 0.00-30.01 sec   866 MBytes   242 Mbits/sec  6928/0          0       -1K/44 us  687696.32
[ 42] 0.00-30.00 sec  1.35 GBytes   386 Mbits/sec  11046/0          0       -1K/78 us  618686.61
[ 40] 0.00-30.00 sec  4.58 GBytes  1.31 Gbits/sec  37512/0          0       -1K/56 us  2926224.65
[ 44] 0.00-30.00 sec  1.73 GBytes   495 Mbits/sec  14175/0          0       -1K/53 us  1168417.87
[ 36] 0.00-30.00 sec  1.41 GBytes   403 Mbits/sec  11538/0          0       -1K/60 us  840073.96
[ 45] 0.00-30.01 sec  2.20 GBytes   631 Mbits/sec  18051/0          0       -1K/47 us  1677532.22
[ 46] 0.00-30.01 sec  1.12 GBytes   319 Mbits/sec  9139/0          0       -1K/34 us  1174035.70
[ 50] 0.00-30.00 sec  1.11 GBytes   318 Mbits/sec  9108/0          0       -1K/51 us  780201.57
[ 53] 0.00-30.02 sec  1.36 GBytes   388 Mbits/sec  11104/0          0       -1K/1340 us  36178.95
[ 52] 0.00-30.02 sec  2.12 GBytes   606 Mbits/sec  17362/0          0       -1K/638 us  118827.72
[ 49] 0.00-30.02 sec  1.37 GBytes   393 Mbits/sec  11236/0          0       -1K/349 us  140588.62
[ 17] 0.00-30.02 sec  1.82 GBytes   521 Mbits/sec  14902/0          0       -1K/139 us  468159.85
[  9] 0.00-30.03 sec  1.74 GBytes   498 Mbits/sec  14261/0          0       -1K/158 us  394008.13
[ 23] 0.00-30.02 sec  1.21 GBytes   346 Mbits/sec  9898/0          0       -1K/102 us  423740.15
[ 22] 0.00-30.03 sec  1.22 GBytes   348 Mbits/sec  9960/0          0       -1K/77 us  564499.77
[ 34] 0.00-30.02 sec  1.05 GBytes   300 Mbits/sec  8592/0          0       -1K/75 us  500224.71
[ 24] 0.00-30.02 sec  2.05 GBytes   588 Mbits/sec  16831/0          0       -1K/81 us  907161.70
[ 35] 0.00-30.02 sec   813 MBytes   227 Mbits/sec  6505/0          0       -1K/66 us  430366.70
[ 33] 0.00-30.02 sec  1.73 GBytes   495 Mbits/sec  14165/0          0       -1K/47 us  1315827.08
[ 41] 0.00-30.02 sec  1.79 GBytes   512 Mbits/sec  14657/0          0       -1K/77 us  831146.18
[ 47] 0.00-30.02 sec  1.96 GBytes   560 Mbits/sec  16044/0          0       -1K/58 us  1207837.94
[ 51] 0.00-30.02 sec  1.01 GBytes   289 Mbits/sec  8264/0          0       -1K/34 us  1061311.98
[SUM] 0.00-30.03 sec  83.6 GBytes  23.9 Gbits/sec  684918/0         0

## TGW(-P 1)
------------------------------------------------------------
Client connecting to 10.100.8.222, TCP port 5001 with pid 2490
Write buffer size:  128 KByte
TCP window size: 3.02 MByte (default)
------------------------------------------------------------
[  3] local 10.0.0.4 port 56520 connected with 10.100.8.222 port 5001 (ct=9.77 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[  3] 0.00-30.00 sec  17.3 GBytes  4.96 Gbits/sec  141996/0          0       -1K/1200 us  516957.01

## TGW(-P 5)
------------------------------------------------------------
Client connecting to 10.100.8.222, TCP port 5001 with pid 2494
Write buffer size:  128 KByte
TCP window size: 2.54 MByte (default)
------------------------------------------------------------
[  7] local 10.0.0.4 port 50728 connected with 10.100.8.222 port 5001 (ct=1.47 ms)
[  4] local 10.0.0.4 port 50696 connected with 10.100.8.222 port 5001 (ct=1.35 ms)
[  5] local 10.0.0.4 port 50710 connected with 10.100.8.222 port 5001 (ct=1.14 ms)
[  3] local 10.0.0.4 port 50702 connected with 10.100.8.222 port 5001 (ct=0.57 ms)
[  6] local 10.0.0.4 port 50726 connected with 10.100.8.222 port 5001 (ct=0.99 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[  7] 0.00-30.00 sec  9.03 GBytes  2.59 Gbits/sec  73968/0          0       -1K/1901 us  169986.24
[  4] 0.00-30.00 sec  8.31 GBytes  2.38 Gbits/sec  68054/0          0       -1K/894 us  332567.44
[  5] 0.00-30.00 sec  16.6 GBytes  4.75 Gbits/sec  135985/0          0       -1K/345 us  1722100.06
[  3] 0.00-30.00 sec  16.9 GBytes  4.83 Gbits/sec  138244/0          0       -1K/234 us  2581161.35
[  6] 0.00-30.00 sec  13.8 GBytes  3.94 Gbits/sec  112641/0          0       -1K/198 us  2485447.81
[SUM] 0.00-30.00 sec  64.6 GBytes  18.5 Gbits/sec  528892/0         0

## TGW(-P 10)
------------------------------------------------------------
Client connecting to 10.100.8.222, TCP port 5001 with pid 2502
Write buffer size:  128 KByte
TCP window size: 2.29 MByte (default)
------------------------------------------------------------
[  9] local 10.0.0.4 port 34192 connected with 10.100.8.222 port 5001 (ct=1.38 ms)
[ 11] local 10.0.0.4 port 34210 connected with 10.100.8.222 port 5001 (ct=1.05 ms)
[  5] local 10.0.0.4 port 34178 connected with 10.100.8.222 port 5001 (ct=1.27 ms)
[  4] local 10.0.0.4 port 34156 connected with 10.100.8.222 port 5001 (ct=0.53 ms)
[  3] local 10.0.0.4 port 34166 connected with 10.100.8.222 port 5001 (ct=0.58 ms)
[  8] local 10.0.0.4 port 34186 connected with 10.100.8.222 port 5001 (ct=0.66 ms)
[  7] local 10.0.0.4 port 34180 connected with 10.100.8.222 port 5001 (ct=0.67 ms)
[  6] local 10.0.0.4 port 34176 connected with 10.100.8.222 port 5001 (ct=0.78 ms)
[ 12] local 10.0.0.4 port 34226 connected with 10.100.8.222 port 5001 (ct=0.62 ms)
[ 10] local 10.0.0.4 port 34196 connected with 10.100.8.222 port 5001 (ct=0.95 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[  9] 0.00-30.00 sec  14.9 GBytes  4.27 Gbits/sec  122134/0          0       -1K/1406 us  379504.36
[ 11] 0.00-30.00 sec  5.94 GBytes  1.70 Gbits/sec  48654/0          0       -1K/1446 us  146998.69
[  5] 0.00-30.00 sec  11.4 GBytes  3.26 Gbits/sec  93212/0          0       -1K/745 us  546638.48
[  4] 0.00-30.00 sec  9.45 GBytes  2.71 Gbits/sec  77455/0          0       -1K/189 us  1790465.51
[  3] 0.00-30.01 sec  7.19 GBytes  2.06 Gbits/sec  58869/0          0       -1K/429 us  599402.14
[  8] 0.00-30.00 sec  7.49 GBytes  2.15 Gbits/sec  61386/0          0       -1K/340 us  788706.54
[  7] 0.00-30.00 sec  15.0 GBytes  4.28 Gbits/sec  122473/0          0       -1K/193 us  2772473.23
[  6] 0.00-30.00 sec  16.6 GBytes  4.75 Gbits/sec  135884/0          0       -1K/137 us  4333469.52
[ 12] 0.00-30.00 sec  8.02 GBytes  2.30 Gbits/sec  65713/0          0       -1K/216 us  1329087.63
[ 10] 0.00-30.00 sec  16.5 GBytes  4.73 Gbits/sec  135270/0          0       -1K/135 us  4377371.88
[SUM] 0.00-30.01 sec   112 GBytes  32.2 Gbits/sec  921050/0         0

## TGW(-P 20)
------------------------------------------------------------
Client connecting to 10.100.8.222, TCP port 5001 with pid 2514
Write buffer size:  128 KByte
TCP window size: 2.16 MByte (default)
------------------------------------------------------------
[ 16] local 10.0.0.4 port 53866 connected with 10.100.8.222 port 5001 (ct=1.11 ms)
[ 22] local 10.0.0.4 port 53912 connected with 10.100.8.222 port 5001 (ct=0.70 ms)
[ 17] local 10.0.0.4 port 53878 connected with 10.100.8.222 port 5001 (ct=1.08 ms)
[  4] local 10.0.0.4 port 53748 connected with 10.100.8.222 port 5001 (ct=0.69 ms)
[ 12] local 10.0.0.4 port 53822 connected with 10.100.8.222 port 5001 (ct=0.45 ms)
[  8] local 10.0.0.4 port 53794 connected with 10.100.8.222 port 5001 (ct=0.54 ms)
[  7] local 10.0.0.4 port 53790 connected with 10.100.8.222 port 5001 (ct=0.66 ms)
[  6] local 10.0.0.4 port 53780 connected with 10.100.8.222 port 5001 (ct=0.76 ms)
[  3] local 10.0.0.4 port 53754 connected with 10.100.8.222 port 5001 (ct=0.95 ms)
[  9] local 10.0.0.4 port 53804 connected with 10.100.8.222 port 5001 (ct=0.89 ms)
[ 10] local 10.0.0.4 port 53818 connected with 10.100.8.222 port 5001 (ct=0.75 ms)
[  5] local 10.0.0.4 port 53770 connected with 10.100.8.222 port 5001 (ct=1.11 ms)
[ 11] local 10.0.0.4 port 53832 connected with 10.100.8.222 port 5001 (ct=0.91 ms)
[ 13] local 10.0.0.4 port 53850 connected with 10.100.8.222 port 5001 (ct=0.76 ms)
[ 18] local 10.0.0.4 port 53886 connected with 10.100.8.222 port 5001 (ct=0.68 ms)
[ 14] local 10.0.0.4 port 53836 connected with 10.100.8.222 port 5001 (ct=0.93 ms)
[ 19] local 10.0.0.4 port 53890 connected with 10.100.8.222 port 5001 (ct=0.74 ms)
[ 20] local 10.0.0.4 port 53896 connected with 10.100.8.222 port 5001 (ct=0.74 ms)
[ 24] local 10.0.0.4 port 53900 connected with 10.100.8.222 port 5001 (ct=0.73 ms)
[ 15] local 10.0.0.4 port 53854 connected with 10.100.8.222 port 5001 (ct=1.00 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[ 16] 0.00-30.00 sec  9.74 GBytes  2.79 Gbits/sec  79820/0          0       -1K/1879 us  185590.62
[ 13] 0.00-30.00 sec  16.7 GBytes  4.78 Gbits/sec  136727/0          0       -1K/76 us  7859661.51
[ 18] 0.00-30.00 sec  7.30 GBytes  2.09 Gbits/sec  59827/0          0       -1K/196 us  1333596.26
[ 24] 0.00-30.00 sec  1.40 GBytes   402 Mbits/sec  11498/0          0       -1K/210 us  239207.15
[ 22] 0.00-30.00 sec  5.35 GBytes  1.53 Gbits/sec  43838/0          0       -1K/1386 us  138174.04
[ 17] 0.00-30.00 sec  5.99 GBytes  1.71 Gbits/sec  49031/0          0       -1K/830 us  258063.66
[  4] 0.00-30.01 sec  5.44 GBytes  1.56 Gbits/sec  44551/0          0       -1K/785 us  247915.25
[ 12] 0.00-30.00 sec  6.95 GBytes  1.99 Gbits/sec  56934/0          0       -1K/279 us  891461.17
[  8] 0.00-30.00 sec  7.17 GBytes  2.05 Gbits/sec  58720/0          0       -1K/492 us  521395.62
[  7] 0.00-30.00 sec  6.77 GBytes  1.94 Gbits/sec  55481/0          0       -1K/169 us  1434102.75
[  6] 0.00-30.00 sec  11.9 GBytes  3.41 Gbits/sec  97573/0          0       -1K/257 us  1658636.05
[  3] 0.00-30.00 sec  5.36 GBytes  1.53 Gbits/sec  43874/0          0       -1K/335 us  572151.82
[  9] 0.00-30.01 sec  5.25 GBytes  1.50 Gbits/sec  43034/0          0       -1K/243 us  773574.28
[ 10] 0.00-30.02 sec  1.90 GBytes   544 Mbits/sec  15579/0          0       -1K/451 us  150830.70
[  5] 0.00-30.00 sec  12.4 GBytes  3.54 Gbits/sec  101302/0          0       -1K/194 us  2281228.41
[ 11] 0.00-30.00 sec  9.68 GBytes  2.77 Gbits/sec  79306/0          0       -1K/179 us  1935408.15
[ 14] 0.00-30.01 sec  3.15 GBytes   900 Mbits/sec  25772/0          0       -1K/198 us  568424.72
[ 19] 0.00-30.01 sec  7.93 GBytes  2.27 Gbits/sec  65000/0          0       -1K/181 us  1568661.39
[ 20] 0.00-30.01 sec  4.97 GBytes  1.42 Gbits/sec  40713/0          0       -1K/135 us  1317369.70
[ 15] 0.00-30.01 sec  1.92 GBytes   549 Mbits/sec  15705/0          0       -1K/154 us  445455.79
[SUM] 0.00-30.02 sec   137 GBytes  39.3 Gbits/sec  1124285/0         0

## TGW(-P 50)
------------------------------------------------------------
Client connecting to 10.100.8.222, TCP port 5001 with pid 2537
Write buffer size:  128 KByte
TCP window size:  942 KByte (default)
------------------------------------------------------------
[ 47] local 10.0.0.4 port 45658 connected with 10.100.8.222 port 5001 (ct=1.15 ms)
[ 48] local 10.0.0.4 port 45666 connected with 10.100.8.222 port 5001 (ct=0.94 ms)
[ 49] local 10.0.0.4 port 45670 connected with 10.100.8.222 port 5001 (ct=0.91 ms)
[  6] local 10.0.0.4 port 45292 connected with 10.100.8.222 port 5001 (ct=0.59 ms)
[  8] local 10.0.0.4 port 45308 connected with 10.100.8.222 port 5001 (ct=0.64 ms)
[  9] local 10.0.0.4 port 45312 connected with 10.100.8.222 port 5001 (ct=0.62 ms)
[ 13] local 10.0.0.4 port 45342 connected with 10.100.8.222 port 5001 (ct=0.49 ms)
[  4] local 10.0.0.4 port 45260 connected with 10.100.8.222 port 5001 (ct=0.86 ms)
[  5] local 10.0.0.4 port 45280 connected with 10.100.8.222 port 5001 (ct=0.92 ms)
[  3] local 10.0.0.4 port 45272 connected with 10.100.8.222 port 5001 (ct=0.94 ms)
[  7] local 10.0.0.4 port 45298 connected with 10.100.8.222 port 5001 (ct=0.95 ms)
[ 14] local 10.0.0.4 port 45380 connected with 10.100.8.222 port 5001 (ct=0.69 ms)
[ 19] local 10.0.0.4 port 45398 connected with 10.100.8.222 port 5001 (ct=0.59 ms)
[ 16] local 10.0.0.4 port 45364 connected with 10.100.8.222 port 5001 (ct=0.74 ms)
[ 11] local 10.0.0.4 port 45322 connected with 10.100.8.222 port 5001 (ct=0.94 ms)
[ 15] local 10.0.0.4 port 45348 connected with 10.100.8.222 port 5001 (ct=0.83 ms)
[ 24] local 10.0.0.4 port 45442 connected with 10.100.8.222 port 5001 (ct=0.48 ms)
[ 18] local 10.0.0.4 port 45386 connected with 10.100.8.222 port 5001 (ct=0.78 ms)
[ 10] local 10.0.0.4 port 45314 connected with 10.100.8.222 port 5001 (ct=1.07 ms)
[ 12] local 10.0.0.4 port 45326 connected with 10.100.8.222 port 5001 (ct=0.96 ms)
[ 27] local 10.0.0.4 port 45472 connected with 10.100.8.222 port 5001 (ct=0.44 ms)
[ 17] local 10.0.0.4 port 45410 connected with 10.100.8.222 port 5001 (ct=0.93 ms)
[ 21] local 10.0.0.4 port 45418 connected with 10.100.8.222 port 5001 (ct=0.97 ms)
[ 22] local 10.0.0.4 port 45428 connected with 10.100.8.222 port 5001 (ct=0.92 ms)
[ 28] local 10.0.0.4 port 45482 connected with 10.100.8.222 port 5001 (ct=0.58 ms)
[ 20] local 10.0.0.4 port 45430 connected with 10.100.8.222 port 5001 (ct=0.96 ms)
[ 29] local 10.0.0.4 port 45484 connected with 10.100.8.222 port 5001 (ct=0.61 ms)
[ 26] local 10.0.0.4 port 45456 connected with 10.100.8.222 port 5001 (ct=0.84 ms)
[ 23] local 10.0.0.4 port 45446 connected with 10.100.8.222 port 5001 (ct=1.08 ms)
[ 30] local 10.0.0.4 port 45518 connected with 10.100.8.222 port 5001 (ct=0.70 ms)
[ 33] local 10.0.0.4 port 45510 connected with 10.100.8.222 port 5001 (ct=1.08 ms)
[ 39] local 10.0.0.4 port 45598 connected with 10.100.8.222 port 5001 (ct=0.57 ms)
[ 31] local 10.0.0.4 port 45496 connected with 10.100.8.222 port 5001 (ct=1.12 ms)
[ 40] local 10.0.0.4 port 45618 connected with 10.100.8.222 port 5001 (ct=0.67 ms)
[ 25] local 10.0.0.4 port 45464 connected with 10.100.8.222 port 5001 (ct=0.74 ms)
[ 35] local 10.0.0.4 port 45548 connected with 10.100.8.222 port 5001 (ct=0.72 ms)
[ 32] local 10.0.0.4 port 45540 connected with 10.100.8.222 port 5001 (ct=0.99 ms)
[ 42] local 10.0.0.4 port 45630 connected with 10.100.8.222 port 5001 (ct=0.51 ms)
[ 36] local 10.0.0.4 port 45568 connected with 10.100.8.222 port 5001 (ct=0.88 ms)
[ 45] local 10.0.0.4 port 45644 connected with 10.100.8.222 port 5001 (ct=0.66 ms)
[ 34] local 10.0.0.4 port 45532 connected with 10.100.8.222 port 5001 (ct=1.03 ms)
[ 41] local 10.0.0.4 port 45642 connected with 10.100.8.222 port 5001 (ct=0.71 ms)
[ 38] local 10.0.0.4 port 45552 connected with 10.100.8.222 port 5001 (ct=1.06 ms)
[ 37] local 10.0.0.4 port 45584 connected with 10.100.8.222 port 5001 (ct=1.01 ms)
[ 43] local 10.0.0.4 port 45606 connected with 10.100.8.222 port 5001 (ct=0.95 ms)
[ 51] local 10.0.0.4 port 45704 connected with 10.100.8.222 port 5001 (ct=0.70 ms)
[ 50] local 10.0.0.4 port 45680 connected with 10.100.8.222 port 5001 (ct=0.77 ms)
[ 44] local 10.0.0.4 port 45646 connected with 10.100.8.222 port 5001 (ct=1.01 ms)
[ 46] local 10.0.0.4 port 45656 connected with 10.100.8.222 port 5001 (ct=0.98 ms)
[ 52] local 10.0.0.4 port 45694 connected with 10.100.8.222 port 5001 (ct=0.64 ms)
[ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT        NetPwr
[ 49] 0.00-30.01 sec  3.77 GBytes  1.08 Gbits/sec  30859/0          0       -1K/467 us  288647.32
[  8] 0.00-30.00 sec  5.30 GBytes  1.52 Gbits/sec  43379/0          0       -1K/391 us  484679.74
[  9] 0.00-30.01 sec  1.98 GBytes   568 Mbits/sec  16250/0          0       -1K/523 us  135720.83
[ 13] 0.00-30.01 sec  5.24 GBytes  1.50 Gbits/sec  42936/0          0       -1K/247 us  759330.05
[  4] 0.00-30.01 sec  2.96 GBytes   848 Mbits/sec  24279/0          0       -1K/233 us  455171.42
[  5] 0.00-30.01 sec  2.23 GBytes   639 Mbits/sec  18288/0          0       -1K/153 us  522123.07
[  3] 0.00-30.00 sec  4.38 GBytes  1.25 Gbits/sec  35865/0          0       -1K/217 us  722035.52
[  7] 0.00-30.01 sec  3.02 GBytes   865 Mbits/sec  24741/0          0       -1K/212 us  509785.69
[ 19] 0.00-30.01 sec  1.59 GBytes   454 Mbits/sec  12999/0          0       -1K/173 us  328224.69
[ 16] 0.00-30.00 sec  7.12 GBytes  2.04 Gbits/sec  58294/0          0       -1K/129 us  1974078.92
[ 11] 0.00-30.00 sec  5.25 GBytes  1.50 Gbits/sec  43024/0          0       -1K/111 us  1693356.65
[ 15] 0.00-30.01 sec  2.10 GBytes   600 Mbits/sec  17172/0          0       -1K/126 us  595328.04
[ 12] 0.00-30.00 sec  4.79 GBytes  1.37 Gbits/sec  39251/0          0       -1K/138 us  1242515.21
[ 27] 0.00-30.00 sec  1.76 GBytes   505 Mbits/sec  14458/0          0       -1K/119 us  530794.83
[ 28] 0.00-30.00 sec  4.29 GBytes  1.23 Gbits/sec  35130/0          0       -1K/62 us  2475509.56
[ 20] 0.00-30.01 sec  3.50 GBytes  1.00 Gbits/sec  28639/0          0       -1K/75 us  1668016.41
[ 29] 0.00-30.01 sec  3.88 GBytes  1.11 Gbits/sec  31812/0          0       -1K/58 us  2395801.11
[ 26] 0.00-30.00 sec  2.87 GBytes   822 Mbits/sec  23515/0          0       -1K/49 us  2096691.57
[ 23] 0.00-30.00 sec  5.46 GBytes  1.56 Gbits/sec  44752/0          0       -1K/62 us  3153399.56
[ 40] 0.00-30.00 sec  2.84 GBytes   814 Mbits/sec  23285/0          0       -1K/45 us  2260567.07
[ 32] 0.00-30.00 sec  3.06 GBytes   877 Mbits/sec  25092/0          0       -1K/55 us  1993081.76
[ 36] 0.00-30.00 sec  1.49 GBytes   426 Mbits/sec  12194/0          0       -1K/52 us  1024512.46
[ 41] 0.00-30.01 sec  3.42 GBytes   978 Mbits/sec  27985/0          0       -1K/37 us  3303966.22
[ 38] 0.00-30.01 sec  3.89 GBytes  1.11 Gbits/sec  31900/0          0       -1K/43 us  3240630.10
[ 37] 0.00-30.01 sec  3.25 GBytes   929 Mbits/sec  26596/0          0       -1K/29 us  4006153.38
[ 51] 0.00-30.01 sec  3.33 GBytes   952 Mbits/sec  27246/0          0       -1K/41 us  2902813.34
[ 50] 0.00-30.00 sec  9.40 GBytes  2.69 Gbits/sec  76980/0          0       -1K/28 us  12010558.27
[ 44] 0.00-30.00 sec  2.34 GBytes   670 Mbits/sec  19158/0          0       -1K/30 us  2789953.54
[ 46] 0.00-30.00 sec  2.88 GBytes   825 Mbits/sec  23613/0          0       -1K/25 us  4126482.27
[ 47] 0.00-30.01 sec  4.76 GBytes  1.36 Gbits/sec  38955/0          0       -1K/1259 us  135150.22
[ 48] 0.00-30.02 sec  2.44 GBytes   699 Mbits/sec  20007/0          0       -1K/660 us  132348.53
[  6] 0.00-30.02 sec  2.09 GBytes   597 Mbits/sec  17098/0          0       -1K/528 us  141377.10
[ 14] 0.00-30.01 sec  2.05 GBytes   588 Mbits/sec  16823/0          0       -1K/218 us  337043.09
[ 24] 0.00-30.01 sec  2.36 GBytes   677 Mbits/sec  19362/0          0       -1K/88 us  961011.01
[ 18] 0.00-30.01 sec  4.21 GBytes  1.21 Gbits/sec  34519/0          0       -1K/119 us  1266886.37
[ 10] 0.00-30.01 sec  2.96 GBytes   847 Mbits/sec  24244/0          0       -1K/87 us  1216998.94
[ 17] 0.00-30.02 sec  2.47 GBytes   708 Mbits/sec  20268/0          0       -1K/63 us  1404612.52
[ 21] 0.00-30.01 sec  2.07 GBytes   593 Mbits/sec  16962/0          0       -1K/93 us  796659.46
[ 22] 0.00-30.01 sec  1.92 GBytes   549 Mbits/sec  15724/0          0       -1K/57 us  1204871.79
[ 30] 0.00-30.01 sec  1.69 GBytes   485 Mbits/sec  13873/0          0       -1K/81 us  748121.97
[ 33] 0.00-30.02 sec  1.99 GBytes   570 Mbits/sec  16324/0          0       -1K/53 us  1344881.79
[ 39] 0.00-30.01 sec  2.81 GBytes   805 Mbits/sec  23052/0          0       -1K/60 us  1677781.02
[ 31] 0.00-30.01 sec  3.51 GBytes  1.01 Gbits/sec  28766/0          0       -1K/47 us  2673035.76
[ 25] 0.00-30.02 sec  2.31 GBytes   661 Mbits/sec  18918/0          0       -1K/62 us  1332242.21
[ 35] 0.00-30.02 sec  2.87 GBytes   821 Mbits/sec  23516/0          0       -1K/55 us  1866975.54
[ 42] 0.00-30.01 sec  2.91 GBytes   834 Mbits/sec  23867/0          0       -1K/42 us  2482137.48
[ 45] 0.00-30.01 sec  2.76 GBytes   789 Mbits/sec  22577/0          0       -1K/37 us  2664895.64
[ 34] 0.00-30.01 sec  3.08 GBytes   883 Mbits/sec  25272/0          0       -1K/46 us  2399456.47
[ 43] 0.00-30.01 sec  1.84 GBytes   527 Mbits/sec  15084/0          0       -1K/51 us  1291703.77
[ 52] 0.00-30.02 sec  1.71 GBytes   489 Mbits/sec  13997/0          0       -1K/26 us  2350773.00
[SUM] 0.00-30.02 sec   162 GBytes  46.4 Gbits/sec  1328900/0         0

帯域測定結果の感想

事前考察した結果とは若干異なる結果となりました。
特にドキュメントからではわからないなーと感じたのは以下です。

  • VPC Peering接続でシングルフロー制限値の2倍近い帯域(9.53Gbps)を利用できた。
  • TGW接続ではある程度コネクションを張らないと想定値の50Gbpsに近づけなかった。
  • NAT GW接続ではシングルフローコネクションで想定値の1/5程度の帯域しか利用できなかった。
  • NAT GW接続では想定値25Gbpsを超えてスケールした。
  • NAT GWは高額・・・(今回の測定で$89程度の費用が発生しました..)

まとめ

今回はVPC間の接続方法による帯域の違いを考察&測定してみました。
AWSドキュメントからでは読みきれない部分をDeepDiveしていく上での参考となれば幸いです。
また、今回の記事を読んでくださった方がAWSのネットワークに少しでも興味を持ってくれたなら最高に嬉しいです。

ここまで読んでくださってありがとうございました。

Discussion