【Cloud GPU】How to use the Vast.ai

1. What is the Vast.ai?

Vast.ai is one of the cloud GPU services. We can rent the high-performance GPU at a low price.
Specifically, this is a service that allows individuals to lend and borrow GPUs.
https://vast.ai/

2. How to use

Here are the steps to start to use.

1. Create an account
2. Charge the money
3. Select the docker image
4. Choose the GPU(rent button)
5. Connect with ssh or jupyterlab

3. How to choose the GPU

3.1 Performance

You can filter the GPU by using the left side slide-bar and also can set the storage size.

Mainly performance of the GPU is shown in the middle of the model cards, so please choose the best GPU for you.

3.2 Fee

You can see the fee to rent the GPU at the right-top on GPU cards.
Please note that the download and upload are costed by that size　in addition to the regular price, you can see the full price by placing your cursor over the rent button.

For example, this GPU requires about 32$ to upload 1000GB(1TB).

Note:
Even if you stop using the GPU, you will continue to be charged a storage fee. If you are finished using it, be sure to discard the GPU using the trash button.

3.3 SSH

※Before rent actually, set the ssh public key from ACCOUNT tab.

You can also use ed25519, but if you leave the comment at the end blank it will be rejected, so if you don't want your username@hostname to be included, use the -C option and enter an comment.

3.4 Rent actually

First, you can choose the docker image from "EDIT IMAGE & CONFIG".

Next, choose the GPU, click the rent button and go to the instance page.

You can see the model card like this:

4. Summary

You can get the great GPU power without purchasing expensive GPU. Please enjoy the GPU life.

5. References

[1] https://notai.jp/howto-vast-ai/
[2] https://recruit.gmo.jp/engineer/jisedai/blog/vast-ai-gpu/