Road Map — Completed
- Windows 11 PC configured and operational
- Completed July 3
- Ollama model manager installed — release notes
- Completed July 5
- Open WebUI installed
- Completed July 5
- Qwen AI Model Installed — about
- Added mobile phone access to the LLM
- Latency (slowness) Issue Solved – by disabling Open WebUI's ancillary API calls
- Configured the LLM server to be Always-On
- Enabled RAG (Retrieval Augmented Generation) for the Qwen model
- Functional correctness validated using very basic test
- Captured baseline performance numbers (test 23)
- Improved Qwen
- Added Deep Seek as a selectable lab model
- Added web search to Deep Seek
- Web search uses the Brave Search API — about
Road Map — Planned
- Persistent Context – Create a method that will allow the LLM to never forget things
- MCP (Model Context Protocol) — about
- Agentic AI
- Personal AI Assistant
Lab Command Table
| Test Channel | Command | Note |
|---|---|---|
| ssh to lab pc 2 | /loop 10m do an adhoc | Set frequency of adhoc tests to 10 min |
Marmalade
Marmalade is the name of the low tech protocol used by Claude Code models on the two Windows PCs to talk with each other by sending messages over a shared network folder. The name of the folder is cc-sync.
When CC1 wants to send a message to CC2, he writes the message into a text file and then drops the file into the shared folder.
At regular intervals, CC2 scans the sync folder looking for new files. When he finds a new file CC2 reads the contents and prepares to act. The human operator gives the go-ahead and CC2 performs the instructions from CC1.
Retrieval-Augmented-Generation
Retrieval-Augmented-Generation is the name of a technique that gives LLMs access to data stored in local files. If the LLM is asked a question of a topic that wasn't part of training, the LLM can get answers from the RAG pipeline.
A program to capture message start and stop times was inserted between Open WebUI and Ollama. The program known as a capture proxy captures data used to isolate lab performance problems.