How to Install DeepSeek V4 Flash Locally on a DGX Spark | Step-by-Step Guide

Published 26/05/2026

Description

In this video, I show you how to install and run DeepSeek V4 Flash locally on a NVIDIA DGX Spark, step by step. If you’ve seen people say that DeepSeek V4 Flash runs locally but haven’t found a real walkthrough, this guide covers the full process: downloading the model from Hugging Face, building the DS4 project, testing the model in interactive mode, exposing it as a local server, and configuring it as a systemd service on Ubuntu. Contents: 0:00 - Introduction 0:14 - Description 1:49 - Download Model 3:29 - GitHub Repo ds4 9:22 - GitHub Repo llama.cpp for deepseek v4 flash 13:24 - Conclusion I also look at the custom llama.cpp DeepSeek V4 Flash fork, explain why the original build may crash on DGX Spark, and show the working alternative fork. This is a practical local AI tutorial for anyone interested in self-hosting large language models, running quantized DeepSeek models, and building a private inference setup without cloud token costs. What you’ll see in this video: Downloading the DeepSeek V4 Flash Q2 model. Building and running DS4 with CUDA on DGX Spark. Testing chat and code generation locally. Running DeepSeek as an OpenAI-compatible API server. Creating a persistent Ubuntu systemd user service. Testing the custom llama.cpp DeepSeek V4 Flash implementation. Fixing the crash by using a working fork. If you found this tutorial useful, please like the video, subscribe, and leave a comment with your results or questions. #DeepSeekV4Flash #DGXSpark #LocalAI Github: https://l.samayas.eu/aipdaS91Bb Follow me on X: https://l.samayas.eu/jo3eaYEf3E?P=YT&V=131 Buy me a Coffee : https://l.samayas.eu/jX6xL7EWhd?P=YT&V=131 Studio Equipment Camera Sony Alpha ZV-E10 II: https://l.samayas.eu/k7y95TREl0?P=YT&V=131 Secondary Camera Obsbot Tail Air: https://l.samayas.eu/iFQu9WfmCw?P=YT&V=131 Elgato Prompter: https://l.samayas.eu/fHVrqqXtSc?P=YT&V=131 Microphone Rode Wireless GO II: https://l.samayas.eu/afBINjiBXN?P=YT&V=131