A User Installed an AI Accelerator Inside the RTX 4080
A user managed to run 27B language models by modifying the NVIDIA Tesla V100 graphics card into a gaming computer. Details are in our news.
Running high-quality language models requires the graphics card to have a large display memory (VRAM). An RTX 4080 owner realized that his system, which can easily play modern games, was insufficient for large language models (LLM) and made a different modification.
The user managed to achieve both gaming and artificial intelligence performance by integrating the NVIDIA Tesla V100 graphics card into his gaming computer. The technical difficulties encountered in this process were overcome with special adapters and cooling solutions.
32GB VRAM Capacity Reached with Tesla V100
Connecting the Tesla V100 board to a standard desktop motherboard required the use of an SXM2-PCIe converter adapter. This system, which costs approximately $266 in total, enabled the card with 16GB HBM2 memory to be included in the system.
Tesla V100 stands out with its 5,120 CUDA cores and 4,096-bit data path offering 900GB/s bandwidth. The fact that the card does not have an image output or standard PCIe power connection required additional effort for the modder at the installation stage.
The high noise level of 82dB produced by the cooling system was controlled by using a 9V battery and PWM jumper. The fan speed was reduced to 10 percent of the brand new maximum value, ensuring quieter operation of the system.
Low-Cost AI Experience at Home
The 32GB total VRAM added to the system provided the necessary space to run models such as Qwen3.6 27B. The model, which occupies 19GB at the Q5_K_M quantization level, can be run at a speed of 32 tokens per second with a context size of 128K tokens.
The transaction processing rate varies between 133 and 160 tokens per second. This system offers a local artificial intelligence work environment that does not require internet connection at a cost of less than $ 300.
The use of old generation server-oriented graphics cards in such residential projects creates new opportunities for enthusiast hardware. Do you think it is a reasonable investment to use old generation professional graphics cards in residential systems?
