More information in the Wiki of this repository

Build a AI Home Server (Similar to gaming Spec)

This might help folks setting up or building AI Home Desktop workstations

Recommended is:

Motherboard:

• AM4/5

CPU:

• AMD Ryzen 7 5800 min Spec
• upto
• AMD Ryzen 9 7950x or 7950x3d

RAM:

• 128GB 3600Mhz
• upto
• 128GB 8000Mhz

SSD:

• NVMe 2TB min a Gen 4 with 7000MB/s
• or higher
• ie 8TB Gen 5 with 7000MB/s

GPU:

• Nvidia GPU's 12GB or higher 24GB is the best. But set yourself a budget and stay within your budget
• ie:
• MSI GeForce RTX 4060 Ti GAMING X 16G Graphics Card 16GB
• MSI GeForce RTX 3060 VENTUS 2X 12G OC Gaming Graphics Card 12GB
• Gigabyte GeForce RTX 4070 WINDFORCE OC 12GB Graphics Card
• Gigabyte GeForce RTX 3090 GAMING OC 24GB GDDR6X Graphics Card
• Nvidia GeForce RTX 3090 Founders Edition Graphics Card (older Card)
• PNY VCNRTXA6000-SB NVIDIA RTX A6000 Graphics Card 48GB GDDR6 (£4,377.78 on Amazon)
• PNY NVIDIA RTX A6000 Professional Graphic Card 48GB GDDR6
• ASUS ROG Strix GeForce RTX 4090 24GB (£2069)
• MSI GeForce RTX 4090 SUPRIM LIQUID X 24G (£1834.99)

PSU:

• Power supllies are key. Depending on the power consumption of the Parts you buy that ultimatly state your watts
• Best is the modular PSU
• Corsair RM850e (2023) Fully Modular Low-Noise for lower end of the scale builds
• GIGABYTE UD850GM Power Supply Unit - 850W
• Corsair HX1500i Fully Modular Ultra-Low Noise - 1500W (£300)

This is to make you think and for your to investigate:

FOR AI

Ollam https://ollama.com/ OpenWeb-UI https://docs.openwebui.com/ Verba for RAG https://github.com/weaviate/Verba/tree/main?tab=readme-ov-file AnythingLLM for RAG https://useanything.com/download crewAI for Agents https://www.crewai.com/