BitNet-Stack

Run a small BitNet model on local machine with one Docker command, and chat in browser.

Features

• Start the LLM server with a single command
• Web UI to chat and continue conversations
• Chat history saved in browser (persists on reload)
• One-click option to clear chats
• Context-aware responses for better follow-ups
• Streaming output (see responses word by word in real-time)

Working example

Checkout the documentation for more working examples.

Prerequisites

• Docker (with Docker Compose)

Quick start

1. Clone the repository

git clone https://github.com/stackblogger/BitNet-Stack.git
cd BitNet-Stack

2. Start the server

docker compose up --build -d

This builds the LLM image and starts one container. The model is downloaded during the image build (first time can take a while).

3. Open the chat UI

In your browser go to:

http://localhost:5001

(Port 5001 is mapped to the app inside the container on 5000; change it in docker-compose.yml if you need another port.)

License

This project is licensed under the MIT License. See the LICENSE file for details.