Local AI Assistant
A privacy-first desktop AI interface running quantized open-source models completely offline.
01. Overview & Description
An intelligent AI coding assistant that operates reliably during travel or network outages without sending proprietary code snippets over public web networks.
02. System Architecture Diagram
React 18 Dashboard -> FastAPI SSE Proxy -> Ollama GGUF Engine -> Memory Buffer -> Streaming Response
Click any node below to inspect its operational role in the pipeline.
Handles user prompt input, interval charts, SSE streaming data rendering, and dark-theme state management.
03. Database Schema & API Specifications
SQLite local database storing encrypted user conversation histories, parameter configs, and custom system prompts.
- • POST /api/chat (SSE Streamed tokens)
- • GET /api/models
- • POST /api/embeddings
04. Codebase Folder Structure
local-ai-assistant/
├── backend/
│ ├── app/main.py (FastAPI SSE router)
│ ├── app/ollama.py (Local process IPC client)
│ └── app/database.py (SQLite Session store)
├── frontend/
│ └── src/components/ChatStream.tsx
└── README.md05. Visual Evidence & Artifacts
$ local-ai-assistant --status active
[OK] System pipeline initialized
Real-time streaming text generation from quantized LLaMA model
$ local-ai-assistant --status active
[OK] System pipeline initialized
RAM usage holding steadily at ~4.7GB during continuous inference
06. Engineering Challenges
07. Key Lessons Learned
Technologies Used
Explore Related Engineering Context
Recommended Projects, Articles & Credentials