Web-RWKV-RealWeb

Run the RWKV model locally in browser on your GPU. This demo is built upon the web-rwkv inference engine.

Check the live demo!

Development

File structure

.
├── assets # static files
├── node_modules
├── src # ts code for web
├── index.html # web entry point
└── web-rwkv-realweb # rust code
    └── src

rust and wasm-pack setup

To install wasm-pack, use

cd web-rwkv-wasm
cargo install wasm-pack

Project setup

We use pnpm to manage the node packages. To install the project dependencies, use:

pnpm install

Run & Build

To run the development server, use:

pnpm run dev

To build wasm package only, use:

pnpm run wasm:build

To build the project, use:

pnpm run build
pnpm run preview

Available Models

You can find the available models on cryscan's huggingface page. The model files name should end in .st.