Getting back into the loop - Need assistance with a Linux build
Getting back into the loop - Need assistance with a Linux build
Hi All,
My background is in technology with a minor in Computer Science. Around 20 years ago, I was deeply involved in programming. I possess strong understanding of relational databases such as Oracle and spent considerable time managing Linux servers, though only in a user role—not an admin position. I was skilled at crafting complex shell scripts and had advanced knowledge of C++ at that stage. I once built my own system, although that project was quite distant.
In the last 15 years, I haven’t remained actively involved with technology or kept up with recent trends in hardware, software, and modern tools. Much of what I knew has faded, but I think I could regain it with some effort. My previous experience was mostly within environments already equipped with safeguards, so I didn’t have full access to server administration tasks.
Now, I’m eager to re-enter the tech scene through personal projects as a hobby. My focus is on learning and experimenting with topics like Linux server management, Python, and basic network administration.
Current setup:
I use a Raspberry Pi 3 running Home Assistant for smart home automation, which is still new territory for me. I also have a work laptop, but it’s heavily restricted, so I can’t install software on it.
Goals:
I aim to engage in personal projects for three reasons:
a) To revive my passion for technology.
b) To acquire new skills.
c) To develop practical solutions for my home and daily life.
Ideas I’m considering:
- Setting up a personal Linux server, possibly as a file or media server.
- Connecting the server with my Home Assistant on the Raspberry Pi.
- Exploring a Local AI Server (most appealing)
- I’d like to run a private, local AI system that can:
- Use Stable Diffusion for image generation locally.
- Implement a retrieval-augmented generation (RAG) setup to securely access my personal data (documents, notes, etc.).
I came across a video where someone built a powerful AI server for similar purposes. Their configuration included:
- Case: Lian Li
- Motherboard: ASUS X670E-CREATOR PROART WIFI
- CPU: AMD Ryzen 9 7950X3D 16-core
- GPU: MSI GeForce RTX 4090 SUPRIM LIQUID X 24GB
- RAM: G.Skill Trident Z5 Neo RGB 64GB (2x32GB)
- Storage: Samsung 990 PRO 2TB SSD
- Power Supply: Corsair AX1600i 1600W
- Cooling: Lian Li Galahad II LCD-SL Infinity 360mm AIO
While impressive, it seems excessive—especially since I’m seeking a more balanced approach. I’m looking for guidance on achieving similar results with appropriately sized hardware.
Budget:
- No fixed budget in mind; I’m flexible.
- My aim is to avoid overbuilding, yet not compromise quality. I sometimes overthink this and end up purchasing what I originally wanted. I need advice on where to draw the line between ideal performance and a sustainable setup.
Community Questions:
Hardware Suggestions:
- What CPU, GPU, motherboard, and case would suit these AI tasks best?
Storage Options:
- Should I use HDDs for storage and a smaller SSD for the OS, or another configuration?
OS & Setup:
- Will I be using a Linux distro like Ubuntu Server? Are there alternatives better suited for AI and server roles?
Looking forward to your thoughts!
Advice on stylizing your thread with requested information
When seeking guidance on new builds or upgrades, it’s important to acknowledge the appropriate boundaries. This adaptation draws from the original *How To Ask For New Build Advice* post. I developed it due to frequent requests for upgrade suggestions across forums and CPU discussions. We should consider the guidelines here and on the CPU forums. It’s essential to have a budget in place to stay within reasonable limits, otherwise we risk spending excessively or not at all. Most of the components mentioned can be adjusted to fit a more practical budget, but a budget is necessary. I’d explore a smaller NVMe SSD for your operating system and apps, while keeping image files on a mechanical hard drive.