iTranslated by AI
Choosing and Finally Buying a PC for Generative AI [2023]
Introduction
It's been a month since I encountered OpenInterpreter. I've completely fallen for Generative AI.
As a macOS lover, I regularly use an iMac and a MacBook Pro.
BUT!!!
In conclusion, I realized that for running Generative AI locally, a Mac just won't cut it.
However, you can run it using a cloud environment on a Mac.
I tried running AI with Amazon Bedrock, but charges were incurred every time I generated something. (It was nerve-wracking!)
If I run it on a local PC, I can generate as much as I want!!!
I researched what kind of PC is suitable for Generative AI and finally bought one!
By the way, my budget was 250,000 yen.
I Decided on the NVIDIA GeForce RTX 4080
To cut to the chase, I bought a PC with the following specs:
It's a high-spec configuration considering the 250,000 yen budget. (The actual purchase price was 230,000 yen.)
GPU: ZOTAC NVIDIA GeForce RTX 4080 (GDDR6X-16GB)
When I looked up this graphics card—while not the exact same model—the NVIDIA GeForce RTX 4080 was ¥223,806 (tax included) on the official website.
Yes, for a Generative AI PC, the graphics card is the most important and expensive part.
I've organized the points to consider when choosing.
Choosing Based on the Graphics Card
Let's decide on a graphics card that fits the budget.
One of my goals is to try image generation by running Stable Diffusion models on a local PC, so I'll base this on the criteria provided by Stable Diffusion.
We plan to release optimized versions of this model in the future, along with other variations and architectures with improved performance and quality. We also plan to release versions optimized to run on AMD, MacBook M1/M2, and other chipsets. Currently, NVIDIA chips are recommended.
https://stability.ai/blog/stable-diffusion-public-release
Since image generation models are built to match graphics cards from the semiconductor manufacturer NVIDIA, NVIDIA became the only choice for the graphics card.
There's an announcement that optimization for AMD and Mac is planned for the future, which is exciting!
However, honestly, I can't wait because I don't know when they will be released.
Let's just buy NVIDIA.
It's Good to Use Gaming Desktop PCs as a Reference
In conclusion, you can't go wrong with a PC configured for gaming!
The following comparison table was very helpful:
I narrowed down the graphics card to the range of NVIDIA GeForce RTX 4060 - 4090.
I Want a PC with a Stylish Exterior, Not Just an Off-the-Shelf One
I did a lot of surfing the web and researching, but I was quite torn because even though I was spending 250,000 yen, the exteriors weren't appealing at all (hey!).
Even though I know the most important thing is the graphics card specs, I find myself looking up stylish PC cases.
However, I don't have the knowledge to pick parts for a custom-built PC, nor the time to go to Osu, Nagoya to buy them. It's sad.
A new constraint was added: it must be a PC that I can order online and use immediately upon arrival.
Since the iMac I'm currently using cost exactly 200,000 yen, even if the purpose is different, I want a level of satisfaction that matches that price.
Consequently, I decided on a used custom-built PC!
Did you think, "Oh, it's used~"? (lol) While I think everyone has their own preferences when it comes to choosing used items, the iMac I'm currently using is an Amazon Renewed product, and my MacBook Pro is an Apple Refurbished product.
Since I've been able to use them without any issues until now, I have a positive impression of used products.
To satisfy the following constraints, a used custom-built PC assembled by someone else was the optimal solution.
Rakuten has many stores that carry used PCs, so I bought one when the Rakuten Super Sale started. It matched my selection constraints perfectly!
# PC that perfectly matched my selection constraints
- NVIDIA GeForce RTX 4080
- 230,000 yen
- Windows 11 Pro 64-bit
- Can be used immediately after buying on Rakuten
- White and glass case!
Bonus: I also bought a monitor and keyboard
Since this is my first Windows desktop PC, I needed to buy both a monitor and a keyboard.
The monitor is a type with USB-C
The monitor I use at work is the type that can be connected with a single USB-C cable, so I chose a 27-inch model of the same type. I connect the Mac via USB-C and the Windows PC via HDMI.
LG Monitor Display 27UP550N-W 27-inch
The keyboard is the gaming type I've always wanted
While researching gaming PCs, I found myself wanting gaming peripherals as well. I decided on this keyboard because it was affordable and looked cool.
ROCCAT Magma Membrane RGB Gaming Keyboard JP Japanese Layout
It arrived!
It's cooler and more "rainbow" than I imagined, Windows boots up in 3 seconds, and it's the best setup ever!
However, at first, I plugged the monitor cable into the motherboard, and I panicked when it said "No Signal."
When I connected it to the graphics card terminal, voila, it worked! (Of course.)
I finally got my Generative AI PC!!!! I'm so thrilled!!!!
Summary
For those who feel that building your own PC for Generative AI is too high a hurdle, I felt that getting a used custom-built PC assembled by someone else is a viable option!
From now on, I'm going to run Generative AI on this PC like crazy! First, I'll do my best to set up the environment!
Discussion