🌊

Nutanix CE 2.0 マルチノード on VMware Workstation 17 Pro

2024/07/23に公開

Jeroen Tielen氏のページがベースです。キャプチャが古かったりなので自分の備忘を兼ねて残します。要件などは上記ページに書いてるので確認してください。個人利用無償のVMware Workstation 17 proを使うことにより、HWの要件が厳しいNutanix CE 2.0がNestedとして簡単にインストールできます。

ホストPCスペック

Head Head Head
OS windows10Pro
CPU i7-10700(8C16T)
memory 128GB 32GB☓4個
disk1 512GB NVMe システムディスク
disk2 1TB NVMe 仮想マシンは全てこのディスク

VMware Workstation 17 proのディスクは2TBの制限があるので注意

用意するもの

  1. VMware Workstation Pro 17 personal版
    (Broadcomのサイトから個人利用無料版をWindows/Linux/Macの製品をダウンロード)
  2. Nutanix CE 2.0 ISO
  3. TeraTerm 等のTerminal software
  4. ネットワークアドレス(自分のアドレス形態でIPをメモしておく)
AHV CVM ClusterVIP
Node1 192.168.0.31 192.168.0.34 192.168.0.37
Node2 192.168.0.32 192.168.0.35
Node3 192.168.0.33 192.168.0.36

手順


Broadcomのサイトから無料でPersonal版をダウンロードできる。インストールは特筆することなし


新規仮想マシンの作成

標準のまま次へ

CEインストーラをセットしておく

□Linux
□CentOS 7 64bit


□仮想マシン名入力「Nutanix Node1」
□場所:十分に空きのあるドライブを設定
※そのままにするとCドライブにできてしまうので注意。今回はDドライブを仮想マシン用に用意しているのでDドライブに変更


□AHVドライブ用に64GB
□仮想ディスクを単一ファイルにチェック


□ハードウェアをカスタマイズをクリック
もしくは完了してからノードの設定画面を開く


□メモリは32GBに設定

□「プロセッサごとのコア数」を4、
□仮想化エンジンの「Intel VT-x~」にチェック
※「Intel VT-x~」は時折外れるのでそれっぽいエラーが出たらこいつのチェックをすることになる。


□ネットワークアダプタは「ブリッジ」にチェック
画面を閉じる


完了

残りのディスク追加する必要があるため、ノード選択→設定

ハードディスク→次へ

SCSI

新規作成

CVM要件の200GBの要件を単一ファイルで作成

そのまま完了

DATA要件の500GBの要件を単一ファイルで作成

そのまま完了

構成はこんな感じです。サウンドカードは消す必要ないと思ったのでそのまま。

仮想マシンを作成したフォルダを開いて、拡張子vmxのファイルをテキストエディタで開く

disk.EnableUUID = "TRUE"
を最下行に追加する。このパラメータの追加を忘れてVMパワーオンすると、disk.EnableUUID = "FALSE"で値が入ってしまうのでTRUEに修正する。


パワーオンする

コンソール画面が表示されるがこのまま放置するとNutanix インストーラでTerminalサイズエラーが出てしまうので次の対応する

表示→ゲストを拡大縮小→「自由に拡大縮小」を選ぶ

disk.EnableUUID = "TRUE"が有効になっていればserialが入る。
ちなみにdisk.EnableUUIDを入れないとSerialは空欄になるがインストールはできる。しかし、マルチクラスターの作成でmedusaサービスのアップで止まるので結局失敗します。serialが入っていない場合はノードをパワーオフしてからvmxを開き、disk.EnableUUID = "FALSE"となっている部分のFALSEをTRUEに変える。


[H]、[C]、[D]を正しく入力、ネットワークアドレスを入力、Next Page
(USBからインストールしたことある人なら気づくと思うが[ I ]は無い)


page downで飛ばして I acceptに「Spaceキー」でチェックし、Startクリックする。
Ctrl+ALTでVMware Workstationのコンソールからマウス操作を開放できる。1台目のインストールは上記で完了。2台目と、3台目も同じ要領で新規仮想マシンの作成から実施する。一応、同じISOを使って並行インストールもできたので1台ずつやる意味は無いかも


インストールが終わるとメディアを抜け画面がでるが、仮想では抜く必要もないのでそのままYで実行


3台目までのインストールが完了したらVMware Workstationのコンソールからはおさらば
TeratermからAHVにsshログインする。


続行

root
nutanix/4u


CVMにsshでログインする
ssh nutanix@192.168.0.34
nutanix/4u

CVMにログイン可能になるまで結構時間かかるのでコーヒーブレイク
上記のCVM起動まで3ノード横並びにしておく

コマンド実行部分

virsh cluster -s 192.168.0.34,192.168.0.35,192.168.0.36 create
nutanix@NTNX-e582b0ce-A-CVM:192.168.0.34:~$ genesis status
2024-07-13 17:31:17.652643: Services running on this node:
  foundation: [3453, 3518, 3519]
  genesis: [2740, 2858, 2882, 2883]

nutanix@NTNX-e582b0ce-A-CVM:192.168.0.34:~$ cluster -s 192.168.0.34,192.168.0.35,192.168.0.36 create
2024-07-13 17:35:19,694Z INFO MainThread cluster:2943 Executing action create on SVMs 192.168.0.34,192.168.0.35,192.168.0.36
2024-07-13 17:35:22,735Z INFO MainThread cluster:1007 Discovered node:
ip: 192.168.0.35
        rackable_unit_serial: e3ed9767
        node_position: A
        node_uuid: c1828ad3-87fd-43b3-9640-78bb31bc21ed

2024-07-13 17:35:22,735Z INFO MainThread cluster:1007 Discovered node:
ip: 192.168.0.34
        rackable_unit_serial: e582b0ce
        node_position: A
        node_uuid: 81bef046-41f8-4562-bb6a-93d46bf46b98

2024-07-13 17:35:22,735Z INFO MainThread cluster:1007 Discovered node:
ip: 192.168.0.36
        rackable_unit_serial: 3eac8c57
        node_position: A
        node_uuid: 38476de3-27b3-458b-8adb-a2071dba7235
~中略~ 10分くらい掛かった

2024-07-13 17:44:39,799Z INFO MainThread cluster:1450 Running CE cluster post-create script
2024-07-13 17:44:39,834Z INFO MainThread cluster:3104 Success!
設定コマンド
nutanix@NTNX-e582b0ce-A-CVM:192.168.0.34:~$ cluster start
~中略~
                               XTrim   UP       [19261, 19529, 19530, 19531]
                       ClusterHealth   UP       [19433, 19658, 19889, 19894, 19898, 19903, 19970, 19971, 19973, 19978, 19979, 20002, 20003, 20007, 20015, 20017, 20020, 20035, 20036, 20039, 20121, 20122, 20148, 20149, 20159, 20160, 20164, 20165, 21717, 21718, 21719, 21720, 21721, 21723, 21724, 21726, 21728, 21729, 21730, 21731, 21733, 21751, 21830, 21831]
2024-07-13 17:48:36,554Z INFO MainThread cluster:3104 Success!

nutanix@NTNX-e582b0ce-A-CVM:192.168.0.34:~$ ncli cluster edit-params new-name=3node_cluster

    Cluster Id                : 00061d24-6b7d-bec6-07f9-000c2927ad92::574490479696522642
    Cluster Uuid              : 00061d24-6b7d-bec6-07f9-000c2927ad92
    Cluster Name              : 3node_cluster
    Cluster Version           : 6.5.2
    Cluster Full Version      : el7.3-release-fraser-6.5.2-stable-f2ce4db7d67f495ebfd6208bef9ab0afec9c74af
    Node Count                : 3
    Block Count               : 3
    Shadow Clones Status      : Enabled
    Has Self Encrypting Disk  : no
    Cluster Masquerading I... :
    Cluster Masquerading PORT :
    Is registered to PC       : false
    Rebuild Reservation       : Disabled
    Encryption In Transit     : Disabled
    Is LTS                    : true
    External Data Services... :
    Support Verbosity Level   : BASIC_COREDUMP
    Lock Down Status          : Disabled
    Password Remote Login ... : Enabled
    Timezone                  : UTC
    On-Disk Dedup             : Disabled
    NCC Version               : ncc-4.6.2.1
    Common Criteria Mode      : Disabled
    Degraded Node Monitoring  : Enabled

nutanix@NTNX-e582b0ce-A-CVM:192.168.0.34:~$ ncli cluster set-external-ip-address external-ip-address=192.168.0.37

    Cluster Id                : 00061d24-6b7d-bec6-07f9-000c2927ad92::574490479696522642
    Cluster Uuid              : 00061d24-6b7d-bec6-07f9-000c2927ad92
    Cluster Name              : 3node_cluster
    Cluster Version           : 6.5.2
    Cluster Full Version      : el7.3-release-fraser-6.5.2-stable-f2ce4db7d67f495ebfd6208bef9ab0afec9c74af
    External IP address       : 192.168.0.37
    Node Count                : 3
    Block Count               : 3
    Shadow Clones Status      : Enabled
    Has Self Encrypting Disk  : no
    Cluster Masquerading I... :
    Cluster Masquerading PORT :
    Is registered to PC       : false
    Rebuild Reservation       : Disabled
    Encryption In Transit     : Disabled
    Is LTS                    : true
    External Data Services... :
    Support Verbosity Level   : BASIC_COREDUMP
    Lock Down Status          : Disabled
    Password Remote Login ... : Enabled
    Timezone                  : UTC
    On-Disk Dedup             : Disabled
    NCC Version               : ncc-4.6.2.1
    Common Criteria Mode      : Disabled
    Degraded Node Monitoring  : Enabled

nutanix@NTNX-e582b0ce-A-CVM:192.168.0.34:~$ ncli cluster add-to-name-servers servers=192.168.0.13

    Name Servers              : 192.168.0.13, 8.8.8.8, 8.8.4.4

nutanix@NTNX-e582b0ce-A-CVM:192.168.0.34:~$ ncli cluster add-to-ntp-servers servers=ntp.nict.jp

    NTP Servers               : 1.pool.ntp.org, 0.pool.ntp.org, ntp.nict.jp
確認コマンド
nutanix@NTNX-e582b0ce-A-CVM:192.168.0.34:~$ ncc health_checks run_all
####################################################
# TIMESTAMP : Sat Jul 13 18:01:29 2024 (UTC +0000) #
####################################################
Cluster Name: 3node_cluster
Cluster Id: 574490479696522642
Cluster UUID: 00061d24-6b7d-bec6-07f9-000c2927ad92
Cluster Version: 6.5.2
NCC Version: 4.6.2.1-3f9070e4
    CVM ID(Svmid)            : 4
    CVM external IP          : 192.168.0.34
    Hypervisor IP            : 192.168.0.31
    Hypervisor version       : Nutanix 20220304.342
    Node serial              : 81bef046-41f8-4562-bb6a-93d46bf46b98
    Model                    : CommunityEdition
    Node Position            : A
    Block S/N                : e582b0ce

    CVM ID(Svmid)            : 5
    CVM external IP          : 192.168.0.35
    Hypervisor IP            : 192.168.0.32
    Hypervisor version       : Nutanix 20220304.342
    Node serial              : c1828ad3-87fd-43b3-9640-78bb31bc21ed
    Model                    : CommunityEdition
    Node Position            : A
    Block S/N                : e3ed9767

    CVM ID(Svmid)            : 6
    CVM external IP          : 192.168.0.36
    Hypervisor IP            : 192.168.0.33
    Hypervisor version       : Nutanix 20220304.342
    Node serial              : 38476de3-27b3-458b-8adb-a2071dba7235
    Model                    : CommunityEdition
    Node Position            : A
    Block S/N                : 3eac8c57


Running : health_checks run_all
[==================                                ] 36%


/health_checks/data_protection_checks/ahv_sync_rep_checks/ports_open_check                                                                    [ PASS ]
------------------------------------------------------------------------------------------------------------------------------------------------------+
/health_checks/hardware_checks/chassis_cpus_type_check                                                                                        [ PASS ]
------------------------------------------------------------------------------------------------------------------------------------------------------+
/health_checks/system_checks/cluster_active_upgrade_check                                                                                     [ INFO ]
------------------------------------------------------------------------------------------------------------------------------------------------------+
/health_checks/sar_checks/sar_stats_threshold_check                                                                                           [ INFO ]
------------------------------------------------------------------------------------------------------------------------------------------------------+
/health_checks/network_checks/ipv6_config_check                                                                                               [ INFO ]
------------------------------------------------------------------------------------------------------------------------------------------------------+
/health_checks/system_checks/hostname_resolution_check                                                                                        [ WARN ]
------------------------------------------------------------------------------------------------------------------------------------------------------+
/health_checks/stargate_checks/node_storage_tier_skew_check                                                                                   [ WARN ]
------------------------------------------------------------------------------------------------------------------------------------------------------+
/health_checks/system_checks/default_password_check                                                                                           [ FAIL ]
------------------------------------------------------------------------------------------------------------------------------------------------------+
/health_checks/hypervisor_checks/vm_checks                                                                                                    [ FAIL ]
------------------------------------------------------------------------------------------------------------------------------------------------------+
/health_checks/system_checks/dns_server_check                                                                                                 [ FAIL ]
------------------------------------------------------------------------------------------------------------------------------------------------------+
+-----------------------+
| State         | Count |
+-----------------------+
| Pass          | 164   |
| Info          | 3     |
| Warning       | 2     |
| Fail          | 3     |
| Total Plugins | 172   |
+-----------------------+
Plugin output written to /home/nutanix/data/logs/ncc-output-latest.log

nutanix@NTNX-e582b0ce-A-CVM:192.168.0.34:~$ cluster status | grep -v UP
2024-07-13 18:08:29,841Z INFO MainThread zookeeper_session.py:191 cluster is attempting to connect to Zookeeper
2024-07-13 18:08:29,850Z INFO Dummy-1 zookeeper_session.py:625 ZK session establishment complete, sessionId=0x390ad2b84da01c2, negotiated timeout=20 secs
2024-07-13 18:08:29,862Z INFO MainThread cluster:2943 Executing action status on SVMs 192.168.0.34,192.168.0.35,192.168.0.36
The state of the cluster: start
Lockdown mode: Disabled

        CVM: 192.168.0.34 Up

        CVM: 192.168.0.35 Up

        CVM: 192.168.0.36 Up, ZeusLeader
2024-07-13 18:08:32,711Z INFO MainThread cluster:3104 Success!

Prism Elementログイン


https://xxx.xxx.xxx.xxx:9440/


admin
nutanix/4u


パスワード変更

変更したパスワード入力

Nutanix Communityのメアドとパスワード入力
登録して間もないとroleが付与されてないというエラーが出るのでハマる



prism の起動確認

3ノード構築後のDドライブの容量1TBもいらなかった。

Prism Centralを入れたパターン

同ホストでPrism Centralの構築を実施したのでその記録を残す
8コア16スレッド、128GBのメモリを3ノードに分けるのでカツカツになる。
Prism Centralはcpu 6、memory28GB、disk500GBの制約がある

リソースの分け方をどうするか
・Node1
CPU8、メモリ52GBでVM構築
→CVMは4コア必要、最小2コアが要件なのでインストールが終わった後にCVMのパラメータを修正し、
2コアに変更する。これで6コア使える。

・Node2、Node3
CPU4、メモリ32GBでVM構築
これで構築を想定していた。

先に結果を書くと3ノードクラスタを組んで想定外だったのは、
Node1をクラスタ組む前にCPU数を2に変更してからクラスタ組むと、Node2とNode3もCPU数が2になってしまった。ただ、CVMのCPUを減らす手順とほぼ同じ方法でCPU数を4に変更できた。
以下は↑での反省を活かしてクラスタを組んでからNode1のCPUを減らす流れにしています。

マルチノードクラスタ組むところ
nutanix@NTNX-402415f8-A-CVM:192.168.0.34:~$ cluster -s 192.168.0.34,192.168.0.35,192.168.0.36 create
2024-07-27 18:44:23,838Z INFO MainThread cluster:2943 Executing action create on SVMs 192.168.0.34,192.168.0.35,192.168.0.36
2024-07-27 18:44:26,895Z INFO MainThread cluster:1007 Discovered node:
ip: 192.168.0.35
        rackable_unit_serial: 58b3d18c
        node_position: A
        node_uuid: 2dd0861b-06aa-4ad1-987f-f9f692cc57f6

2024-07-27 18:44:26,896Z INFO MainThread cluster:1007 Discovered node:
ip: 192.168.0.36
        rackable_unit_serial: d8f2a846
        node_position: A
        node_uuid: 018f877f-be4a-4d0e-8030-22767b848b69

2024-07-27 18:44:26,896Z INFO MainThread cluster:1007 Discovered node:
ip: 192.168.0.34
        rackable_unit_serial: 402415f8
        node_position: A
        node_uuid: 927b980e-38b6-4468-b4d0-e60c35dfd1e4
        
~省略~        
                                Flow   UP       [22464, 22695, 22696, 22697]
                             Anduril   UP       [22554, 22793, 22794, 22795]
                               XTrim   UP       [22713, 22964, 22965, 22966]
                       ClusterHealth   UP       [22796, 23016, 23017, 23084, 23086]
2024-07-27 18:52:51,963Z INFO MainThread cluster:1450 Running CE cluster post-create script
2024-07-27 18:52:52,032Z INFO MainThread cluster:3104 Success!


nutanix@NTNX-402415f8-A-CVM:192.168.0.34:~$ ncli cluster edit-params new-name=3node_cluster

    Cluster Id                : 00061e3f-0447-9bc4-3a79-000c29952976::4213398978619058550
    Cluster Uuid              : 00061e3f-0447-9bc4-3a79-000c29952976
    Cluster Name              : 3node_cluster
    Cluster Version           : 6.5.2
    Cluster Full Version      : el7.3-release-fraser-6.5.2-stable-f2ce4db7d67f495ebfd6208bef9ab0afec9c74af
    Node Count                : 3
    Block Count               : 3
    Shadow Clones Status      : Enabled
    Has Self Encrypting Disk  : no
    Cluster Masquerading I... :
    Cluster Masquerading PORT :
    Is registered to PC       : false
    Rebuild Reservation       : Disabled
    Encryption In Transit     : Disabled
    Is LTS                    : true
    External Data Services... :
    Support Verbosity Level   : BASIC_COREDUMP
    Lock Down Status          : Disabled
    Password Remote Login ... : Enabled
    Timezone                  : UTC
    On-Disk Dedup             : Disabled
    NCC Version               : ncc-4.6.2.1
    Common Criteria Mode      : Disabled
    Degraded Node Monitoring  : Enabled
nutanix@NTNX-402415f8-A-CVM:192.168.0.34:~$ ncli cluster set-external-ip-address external-ip-address=192.168.0.37

    Cluster Id                : 00061e3f-0447-9bc4-3a79-000c29952976::4213398978619058550
    Cluster Uuid              : 00061e3f-0447-9bc4-3a79-000c29952976
    Cluster Name              : 3node_cluster
    Cluster Version           : 6.5.2
    Cluster Full Version      : el7.3-release-fraser-6.5.2-stable-f2ce4db7d67f495ebfd6208bef9ab0afec9c74af
    External IP address       : 192.168.0.37
    Node Count                : 3
    Block Count               : 3
    Shadow Clones Status      : Enabled
    Has Self Encrypting Disk  : no
    Cluster Masquerading I... :
    Cluster Masquerading PORT :
    Is registered to PC       : false
    Rebuild Reservation       : Disabled
    Encryption In Transit     : Disabled
    Is LTS                    : true
    External Data Services... :
    Support Verbosity Level   : BASIC_COREDUMP
    Lock Down Status          : Disabled
    Password Remote Login ... : Enabled
    Timezone                  : UTC
    On-Disk Dedup             : Disabled
    NCC Version               : ncc-4.6.2.1
    Common Criteria Mode      : Disabled
    Degraded Node Monitoring  : Enabled
nutanix@NTNX-402415f8-A-CVM:192.168.0.34:~$ ncli cluster add-to-name-servers servers=192.168.0.1

    Name Servers              : 192.168.0.1, 8.8.8.8, 8.8.4.4
nutanix@NTNX-402415f8-A-CVM:192.168.0.34:~$ ncli cluster add-to-ntp-servers servers=ntp.nict.jp

    NTP Servers               : 1.pool.ntp.org, 0.pool.ntp.org, ntp.nict.jp

Prismの起動確認
次にCPU減らすノードの作業

CVMのCPU減らす
nutanix@NTNX-402415f8-A-CVM:192.168.0.34:~$ virsh dominfo NTNX-402415f8-A-CVM
Id:             3
Name:           NTNX-402415f8-A-CVM
UUID:           8fddb7a0-985c-4075-823b-695690b26355
OS Type:        hvm
State:          running
CPU(s):         4
CPU time:       108.5s
Max memory:     16777216 KiB
Used memory:    16777216 KiB
Persistent:     yes
Autostart:      enable
Managed save:   no
Security model: selinux
Security DOI:   0
Security label: system_u:system_r:svirt_t:s0:c557,c812 (enforcing)

AHVにスイッチ
[root@NTNX-402415f8-A ~]# virsh list
 Id   Name                  State
-------------------------------------
 1    NTNX-402415f8-A-CVM   running
 
[root@NTNX-402415f8-A ~]# virsh shutdown 1
Domain 1 is being shutdown

[root@NTNX-402415f8-A ~]# virsh list
 Id   Name   State
--------------------

virsh edit NTNX-402415f8-A-CVM

  <vcpu placement='static' cpuset='0-7'>4</vcpu>
      <cell id='0' cpus='0-3' memory='16777216' unit='KiB' memAccess='shared'/>
8コア中4コアをCVMで取ってるので、4コア中2コアを使うよう修正
  <vcpu placement='static' cpuset='0-7'>2</vcpu>
      <cell id='0' cpus='0-1' memory='16777216' unit='KiB' memAccess='shared'/>

virsh start NTNX-402415f8-A-CVM
起動待ち
ncc health_checks run_all

nutanix@NTNX-402415f8-A-CVM:192.168.0.34:~$ virsh dominfo NTNX-402415f8-A-CVM
Id:             3
Name:           NTNX-402415f8-A-CVM
UUID:           8fddb7a0-985c-4075-823b-695690b26355
OS Type:        hvm
State:          running
CPU(s):         2
CPU time:       4698.8s
Max memory:     16777216 KiB
Used memory:    16777216 KiB
Persistent:     yes
Autostart:      enable
Managed save:   no
Security model: selinux
Security DOI:   0
Security label: system_u:system_r:svirt_t:s0:c557,c812 (enforcing)
Prism Centralデプロイ中~デプロイ後の確認
nutanix@NTNX-402415f8-A-CVM:192.168.0.34:~$ ncli software list software-type=PRISM_CENTRAL
    [None]
nutanix@NTNX-402415f8-A-CVM:192.168.0.34:~$ ecli
<ergon> task.list
Task UUID                             Parent Task UUID                      Component       Sequence-id  Type                                                       Status
12d6c4aa-17ea-45ed-a843-bbb9d78a39c4  9d7d93db-43ce-447d-af59-734df493c8bf  Acropolis       24           kVmSetPowerState                                           kSucceeded
a0dce090-c0fa-53e3-9b25-ab72ff8a17f7                                        anduril         2            VmSetPowerState                                            kSucceeded
9d7d93db-43ce-447d-af59-734df493c8bf  74eab9c1-9382-438f-6f26-e0b481434f4b  Uhura           2            VmChangePowerState                                         kSucceeded
1e2c1a89-6349-46ac-b20b-5bbd97ed5b11  a49778de-0a74-4e22-a2db-d155b0df42fc  Acropolis       23           kVmCreate                                                  kSucceeded
181cf44a-8a84-53b4-8d75-30d947ecec75                                        anduril         1            VmCreate                                                   kSucceeded
a49778de-0a74-4e22-a2db-d155b0df42fc  74eab9c1-9382-438f-6f26-e0b481434f4b  Uhura           1            VmCreate                                                   kSucceeded
d23cfcb4-0615-414e-58aa-da75bc8c08f5  d82346d4-46c1-417d-4b40-d1683e8346b9  kCluster        4            Post Deployment Steps                                      kRunning
ffbe6947-c6cf-4234-5b36-77c49a09272f  d82346d4-46c1-417d-4b40-d1683e8346b9  kCluster        3            Cluster Creation                                           kSucceeded
74eab9c1-9382-438f-6f26-e0b481434f4b  d82346d4-46c1-417d-4b40-d1683e8346b9  kCluster        2            VM Deployment                                              kSucceeded
a43c4b85-618c-4cad-4406-c62b100ba8ac  d82346d4-46c1-417d-4b40-d1683e8346b9  kCluster        1            Setup State Machine                                        kSucceeded
d82346d4-46c1-417d-4b40-d1683e8346b9  7a496be7-7383-4179-6c5f-199f4554032d  infra           3            AppDeployment                                              kRunning
562e9406-1c4c-4d55-6777-9a2c144377df  7a496be7-7383-4179-6c5f-199f4554032d  infra           2            Tarball Extraction                                         kSucceeded
7a496be7-7383-4179-6c5f-199f4554032d  9f64b10e-d4c2-4b51-639f-78347526515a  infra           1            Prism Central Deployment                                   kRunning
efb39708-6f3b-49bb-7e8d-05228d4936e3  9f64b10e-d4c2-4b51-639f-78347526515a  cluster_config  2            kDownload                                                  kSucceeded
9f64b10e-d4c2-4b51-639f-78347526515a                                        cluster_config  1            kPrismCentralDeploymentRequest                             kRunning
f0ab25e4-0dba-4084-8b98-b906c956d065                                        Acropolis       22           kHandleRf1VmAfterAosMaintenance                            kSucceeded
5c20679b-081a-48f3-af8a-f0db71d25765                                        Acropolis       21           kHandleRf1VmAfterAosMaintenance                            kSucceeded
eb1bea00-a1cf-412c-9fc8-213a8f27b38e                                        Acropolis       20           kHandleRf1VmAfterAosMaintenance                            kSucceeded
938af5d7-b11a-4c2d-b3ce-dfedf669aa37                                        Acropolis       19           kHostRestoreVmLocality                                     kSucceeded
c3b69572-dd91-4f8e-bd78-88294c5884bf                                        Acropolis       18           kHostSwapAttach                                            kSucceeded
823b4901-274e-44bd-805c-8b80d74419f8                                        Acropolis       17           kHostRestoreVmLocality                                     kSucceeded
1e374a5a-44a3-4728-97a1-9365190f3fa4                                        Acropolis       16           kHostSwapAttach                                            kSucceeded
effc5d50-4548-468c-895e-6e25c549b3ff                                        Acropolis       15           kHostRestoreVmLocality                                     kSucceeded
27d7b8a1-7c1c-4800-bdfd-61987e151616                                        Acropolis       14           kHostSwapAttach                                            kSucceeded
22327f7f-57aa-4f91-5af3-9daa0a919b6e  b752f94b-211b-4ce8-bf7c-b3fa85a28a18  NCC             4            HealthCheck                                                kSucceeded
180d3f26-28b0-49ea-42f3-a5fa4bb33f50  b752f94b-211b-4ce8-bf7c-b3fa85a28a18  NCC             3            HealthCheck                                                kSucceeded
e024d6f6-519f-45c8-7b39-c56820534e9d  b752f94b-211b-4ce8-bf7c-b3fa85a28a18  NCC             2            HealthCheck                                                kSucceeded
b752f94b-211b-4ce8-bf7c-b3fa85a28a18                                        NCC             1            HealthCheck                                                kSucceeded
21a01af4-3254-4437-9579-74528c3e7731                                        Acropolis       13           kNetworkCreate                                             kSucceeded
cf27ce2e-dec9-49ea-908d-3154205b7154                                        Acropolis       12           kHandleRf1VmAfterAosMaintenance                            kSucceeded
6c05a1e3-30cb-46b2-5ebe-d5b106692a2c  71058499-9a80-4980-7a11-bc87b54f6158  cluster_sync    4            Password sync on 192.168.0.36                              kSucceeded
92706fa5-aa25-41bb-7e3c-aaa8607d93e4  71058499-9a80-4980-7a11-bc87b54f6158  cluster_sync    3            Password sync on 192.168.0.35                              kSucceeded
aa6ee7db-ae6c-4d95-71e5-4eb8600d4089  71058499-9a80-4980-7a11-bc87b54f6158  cluster_sync    2            Password sync on 192.168.0.34 (master)                     kSucceeded
71058499-9a80-4980-7a11-bc87b54f6158                                        cluster_sync    1            Password sync: Password changed for admin or nutanix user  kSucceeded
ffd3b4f7-e55f-437c-99bc-83a2280db989                                        Acropolis       11           kHostRestoreVmLocality                                     kSucceeded
c129140a-4569-4ed0-8e64-296733229244                                        Acropolis       10           kHostRestoreVmLocality                                     kSucceeded
e15d72e0-5d0c-41e9-80d3-b10169cfa7c8                                        Acropolis       9            kHostRestoreVmLocality                                     kSucceeded
ecf930b5-26f8-4283-b3e2-6237db5cb904                                        Acropolis       8            kHandleRf1VmAfterAosMaintenance                            kSucceeded
9455f1c5-5015-49e5-9276-4247bae39fb3                                        Acropolis       7            kHandleRf1VmAfterAosMaintenance                            kSucceeded
f3de6a3c-4517-47a9-94b9-222d85c056bc                                        Acropolis       6            kHostRestoreVmLocality                                     kSucceeded
<ergon>
<ergon> task.get d82346d4-46c1-417d-4b40-d1683e8346b9
{
  "canceled": false,
  "cluster_uuid": "00061e3f-0447-9bc4-3a79-000c29952976",
  "component": "infra",
  "create_time_usecs": "2024-07-27T20:04:58.242947Z",
  "deleted": false,
  "display_name": "Application Deployment",
  "entity_list": [
    {
      "entity_id": "00061e3f-0447-9bc4-3a79-000c29952976",
      "entity_type": "kCluster"
    }
  ],
  "ext_id": "ZXJnb24=:d82346d4-46c1-417d-4b40-d1683e8346b9",
  "internal_task": false,
  "last_updated_time_usecs": "2024-07-27T20:28:38.178540Z",
  "local_root_task_uuid": "9f64b10e-d4c2-4b51-639f-78347526515a",
  "logical_timestamp": 4,
  "message": "",
  "operation_type": "AppDeployment",
  "parent_task_uuid": "7a496be7-7383-4179-6c5f-199f4554032d",
  "percentage_complete": 70,
  "requested_state_transition": "kNone",
  "sequence_id": 3,
  "start_time_usecs": "2024-07-27T20:04:58.272289Z",
  "status": "kRunning",
  "subtask_uuid_list": [
    "74eab9c1-9382-438f-6f26-e0b481434f4b",
    "a43c4b85-618c-4cad-4406-c62b100ba8ac",
    "d23cfcb4-0615-414e-58aa-da75bc8c08f5",
    "ffbe6947-c6cf-4234-5b36-77c49a09272f"
  ],
  "uuid": "d82346d4-46c1-417d-4b40-d1683e8346b9",
  "weight": 600
}
<ergon> task.get 7a496be7-7383-4179-6c5f-199f4554032d
{
  "canceled": false,
  "cluster_uuid": "00061e3f-0447-9bc4-3a79-000c29952976",
  "complete_time_usecs": "2024-07-27T20:32:43.658021Z",
  "component": "infra",
  "create_time_usecs": "2024-07-27T19:43:52.999907Z",
  "deleted": false,
  "display_name": "Prism Central Deployment",
  "entity_list": [
    {
      "entity_id": "00061e3f-0447-9bc4-3a79-000c29952976",
      "entity_type": "kCluster"
    }
  ],
  "ext_id": "ZXJnb24=:7a496be7-7383-4179-6c5f-199f4554032d",
  "internal_opaque": "(dp1\nS'app_deployment_task_uuid'\np2\nS'\\xd8#F\\xd4F\\xc1A}K@\\xd1h>\\x83F\\xb9'\np3\ns.",
  "internal_task": false,
  "last_updated_time_usecs": "2024-07-27T20:32:43.658020Z",
  "local_root_task_uuid": "9f64b10e-d4c2-4b51-639f-78347526515a",
  "logical_timestamp": 9,
  "message": "PC Deployment completed",
  "operation_type": "Prism Central Deployment",
  "parent_task_uuid": "9f64b10e-d4c2-4b51-639f-78347526515a",
  "percentage_complete": 100,
  "requested_state_transition": "kNone",
  "sequence_id": 1,
  "start_time_usecs": "2024-07-27T19:53:17.677133Z",
  "status": "kSucceeded",
  "subtask_uuid_list": [
    "562e9406-1c4c-4d55-6777-9a2c144377df",
    "d82346d4-46c1-417d-4b40-d1683e8346b9"
  ],
  "uuid": "7a496be7-7383-4179-6c5f-199f4554032d",
  "weight": 1000
}
<ergon>
<ergon>
<ergon> task.list
Task UUID                             Parent Task UUID                      Component       Sequence-id  Type                                                       Status
12d6c4aa-17ea-45ed-a843-bbb9d78a39c4  9d7d93db-43ce-447d-af59-734df493c8bf  Acropolis       24           kVmSetPowerState                                           kSucceeded
a0dce090-c0fa-53e3-9b25-ab72ff8a17f7                                        anduril         2            VmSetPowerState                                            kSucceeded
9d7d93db-43ce-447d-af59-734df493c8bf  74eab9c1-9382-438f-6f26-e0b481434f4b  Uhura           2            VmChangePowerState                                         kSucceeded
1e2c1a89-6349-46ac-b20b-5bbd97ed5b11  a49778de-0a74-4e22-a2db-d155b0df42fc  Acropolis       23           kVmCreate                                                  kSucceeded
181cf44a-8a84-53b4-8d75-30d947ecec75                                        anduril         1            VmCreate                                                   kSucceeded
a49778de-0a74-4e22-a2db-d155b0df42fc  74eab9c1-9382-438f-6f26-e0b481434f4b  Uhura           1            VmCreate                                                   kSucceeded
d23cfcb4-0615-414e-58aa-da75bc8c08f5  d82346d4-46c1-417d-4b40-d1683e8346b9  kCluster        4            Post Deployment Steps                                      kSucceeded
ffbe6947-c6cf-4234-5b36-77c49a09272f  d82346d4-46c1-417d-4b40-d1683e8346b9  kCluster        3            Cluster Creation                                           kSucceeded
74eab9c1-9382-438f-6f26-e0b481434f4b  d82346d4-46c1-417d-4b40-d1683e8346b9  kCluster        2            VM Deployment                                              kSucceeded
a43c4b85-618c-4cad-4406-c62b100ba8ac  d82346d4-46c1-417d-4b40-d1683e8346b9  kCluster        1            Setup State Machine                                        kSucceeded
d82346d4-46c1-417d-4b40-d1683e8346b9  7a496be7-7383-4179-6c5f-199f4554032d  infra           3            AppDeployment                                              kSucceeded
562e9406-1c4c-4d55-6777-9a2c144377df  7a496be7-7383-4179-6c5f-199f4554032d  infra           2            Tarball Extraction                                         kSucceeded
7a496be7-7383-4179-6c5f-199f4554032d  9f64b10e-d4c2-4b51-639f-78347526515a  infra           1            Prism Central Deployment                                   kSucceeded
efb39708-6f3b-49bb-7e8d-05228d4936e3  9f64b10e-d4c2-4b51-639f-78347526515a  cluster_config  2            kDownload                                                  kSucceeded
9f64b10e-d4c2-4b51-639f-78347526515a                                        cluster_config  1            kPrismCentralDeploymentRequest                             kSucceeded
f0ab25e4-0dba-4084-8b98-b906c956d065                                        Acropolis       22           kHandleRf1VmAfterAosMaintenance                            kSucceeded
5c20679b-081a-48f3-af8a-f0db71d25765                                        Acropolis       21           kHandleRf1VmAfterAosMaintenance                            kSucceeded
eb1bea00-a1cf-412c-9fc8-213a8f27b38e                                        Acropolis       20           kHandleRf1VmAfterAosMaintenance                            kSucceeded
938af5d7-b11a-4c2d-b3ce-dfedf669aa37                                        Acropolis       19           kHostRestoreVmLocality                                     kSucceeded
c3b69572-dd91-4f8e-bd78-88294c5884bf                                        Acropolis       18           kHostSwapAttach                                            kSucceeded
823b4901-274e-44bd-805c-8b80d74419f8                                        Acropolis       17           kHostRestoreVmLocality                                     kSucceeded
1e374a5a-44a3-4728-97a1-9365190f3fa4                                        Acropolis       16           kHostSwapAttach                                            kSucceeded
effc5d50-4548-468c-895e-6e25c549b3ff                                        Acropolis       15           kHostRestoreVmLocality                                     kSucceeded
27d7b8a1-7c1c-4800-bdfd-61987e151616                                        Acropolis       14           kHostSwapAttach                                            kSucceeded
22327f7f-57aa-4f91-5af3-9daa0a919b6e  b752f94b-211b-4ce8-bf7c-b3fa85a28a18  NCC             4            HealthCheck                                                kSucceeded
180d3f26-28b0-49ea-42f3-a5fa4bb33f50  b752f94b-211b-4ce8-bf7c-b3fa85a28a18  NCC             3            HealthCheck                                                kSucceeded
e024d6f6-519f-45c8-7b39-c56820534e9d  b752f94b-211b-4ce8-bf7c-b3fa85a28a18  NCC             2            HealthCheck                                                kSucceeded
b752f94b-211b-4ce8-bf7c-b3fa85a28a18                                        NCC             1            HealthCheck                                                kSucceeded
21a01af4-3254-4437-9579-74528c3e7731                                        Acropolis       13           kNetworkCreate                                             kSucceeded
cf27ce2e-dec9-49ea-908d-3154205b7154                                        Acropolis       12           kHandleRf1VmAfterAosMaintenance                            kSucceeded
6c05a1e3-30cb-46b2-5ebe-d5b106692a2c  71058499-9a80-4980-7a11-bc87b54f6158  cluster_sync    4            Password sync on 192.168.0.36                              kSucceeded
92706fa5-aa25-41bb-7e3c-aaa8607d93e4  71058499-9a80-4980-7a11-bc87b54f6158  cluster_sync    3            Password sync on 192.168.0.35                              kSucceeded
aa6ee7db-ae6c-4d95-71e5-4eb8600d4089  71058499-9a80-4980-7a11-bc87b54f6158  cluster_sync    2            Password sync on 192.168.0.34 (master)                     kSucceeded
71058499-9a80-4980-7a11-bc87b54f6158                                        cluster_sync    1            Password sync: Password changed for admin or nutanix user  kSucceeded
ffd3b4f7-e55f-437c-99bc-83a2280db989                                        Acropolis       11           kHostRestoreVmLocality                                     kSucceeded
c129140a-4569-4ed0-8e64-296733229244                                        Acropolis       10           kHostRestoreVmLocality                                     kSucceeded
e15d72e0-5d0c-41e9-80d3-b10169cfa7c8                                        Acropolis       9            kHostRestoreVmLocality                                     kSucceeded
ecf930b5-26f8-4283-b3e2-6237db5cb904                                        Acropolis       8            kHandleRf1VmAfterAosMaintenance                            kSucceeded
9455f1c5-5015-49e5-9276-4247bae39fb3                                        Acropolis       7            kHandleRf1VmAfterAosMaintenance                            kSucceeded
f3de6a3c-4517-47a9-94b9-222d85c056bc                                        Acropolis       6            kHostRestoreVmLocality                                     kSucceeded

nutanix@NTNX-402415f8-A-CVM:192.168.0.34:~$ ssh 192.168.0.38
FIPS mode initialized
Warning: Permanently added '192.168.0.38' (ECDSA) to the list of known hosts.
Prism Central VM
nutanix@192.168.0.38's password:
Last login: Sat Jul 27 04:40:49 PDT 2024 from 192.168.0.38 on ssh
Last login: Sat Jul 27 04:42:29 2024 from 192.168.0.34

Nutanix Prism Central VM (PC-VM) is a virtual management appliance.


nutanix@NTNX-192-168-0-38-A-PCVM:~$ df -m
Filesystem     1M-blocks  Used Available Use% Mounted on
devtmpfs           13029     0     13029   0% /dev
tmpfs              13046     1     13046   1% /dev/shm
tmpfs              13046     3     13044   1% /run
tmpfs              13046     0     13046   0% /sys/fs/cgroup
/dev/sdb1           9951  6824      3009  70% /
/dev/sdb3          50268  6034     43706  13% /home
/dev/sdc1         502941   134    497671   1% /home/nutanix/data/stargate-storage/disks/NFS_3_0_367_00a19e13_b0c6_45c0_b9b4_7c0db1ccdfb8
tmpfs               2610     0      2610   0% /run/user/1000

PCをマルチノードでデプロイはできたが、VMを載せる余裕がほぼないのでやる意味は無いです🫣


PCをデプロイしているときのホストリソース 1台しかないのに部屋の温度が高くなって大変でした

Discussion