F5F Stay Refreshed Hardware Desktop Modern GPU on older motherboard

Modern GPU on older motherboard

Modern GPU on older motherboard

X
xFontes_
Junior Member
17
11-13-2021, 08:58 AM
#1
Hello everyone!
I'm working with an old server from 2013 that features a tesla m40 gpu. I'm attempting to run large language models locally using ollama, but it hasn't worked well so far. I understand it's not officially supported because its compute power is only 3.5, yet even a modified ollama version still falls back to the CPU.
I've decided to upgrade to a newer GPU. My budget is about $500, and I'm considering an RTX 3060 with 12 GB of VRAM. I'm concerned that since my motherboard supports PCIe 3.0 while the GPU uses PCIe 4.0, it might be significantly throttled.
Additionally, I'd appreciate any other better GPU options, preferably new ones, not second-hand.
Thanks in advance!
X
xFontes_
11-13-2021, 08:58 AM #1

Hello everyone!
I'm working with an old server from 2013 that features a tesla m40 gpu. I'm attempting to run large language models locally using ollama, but it hasn't worked well so far. I understand it's not officially supported because its compute power is only 3.5, yet even a modified ollama version still falls back to the CPU.
I've decided to upgrade to a newer GPU. My budget is about $500, and I'm considering an RTX 3060 with 12 GB of VRAM. I'm concerned that since my motherboard supports PCIe 3.0 while the GPU uses PCIe 4.0, it might be significantly throttled.
Additionally, I'd appreciate any other better GPU options, preferably new ones, not second-hand.
Thanks in advance!

K
KiNG_R3X
Member
185
11-13-2021, 09:43 AM
#2
Which server model are you currently operating with?
K
KiNG_R3X
11-13-2021, 09:43 AM #2

Which server model are you currently operating with?

A
aguzz123123
Senior Member
599
11-13-2021, 11:36 AM
#3
HP Z820 Workstation equipped with Xeon E5-2667 processor, 64 GB DDR3 memory, operating on Arch Linux.
A
aguzz123123
11-13-2021, 11:36 AM #3

HP Z820 Workstation equipped with Xeon E5-2667 processor, 64 GB DDR3 memory, operating on Arch Linux.

W
Windmill45
Junior Member
6
11-18-2021, 02:26 PM
#4
The 3060 functions adequately within that environment and appears to deliver solid performance when using Ollama, as indicated by a brief review.
W
Windmill45
11-18-2021, 02:26 PM #4

The 3060 functions adequately within that environment and appears to deliver solid performance when using Ollama, as indicated by a brief review.