Linux Installation
Izwi runs on most modern Linux distributions with optional CUDA support for NVIDIA GPUs.
Requirements
- Ubuntu 20.04+, Debian 11+, Fedora 36+, or similar
- 8 GB RAM minimum (16 GB recommended)
- 10 GB free disk space (more for models)
- NVIDIA GPU (optional, for CUDA acceleration)
Install from .deb Package (Debian/Ubuntu)
Step 1: Download
wget https://github.com/agentem-ai/izwi/releases/latest/download/izwi_amd64.debStep 2: Install
sudo dpkg -i izwi_amd64.debIf you encounter dependency errors:
sudo apt-get install -fStep 3: Verify
izwi --version izwi statusInstall from Source
Prerequisites
# Ubuntu/Debian sudo apt update sudo apt install -y build-essential curl git pkg-config libssl-dev # Fedora sudo dnf install -y gcc gcc-c++ make curl git openssl-devel # Arch Linux sudo pacman -S base-devel curl git opensslInstall Rust
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh source "$HOME/.cargo/env" rustup update stableBuild Izwi
# Clone the repository git clone https://github.com/agentem-ai/izwi.git cd izwi # Build release binaries cargo build --release # Install CLI tools ./scripts/install-cli.shCUDA Support (NVIDIA GPUs)
For NVIDIA GPU acceleration:
Step 1: Install CUDA Toolkit
# Ubuntu 22.04 wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/cuda-keyring_1.1-1_all.deb sudo dpkg -i cuda-keyring_1.1-1_all.deb sudo apt update sudo apt install -y cuda-toolkit-12-4Step 2: Build with CUDA
cargo build --release --features cudaStep 3: Verify CUDA
izwi status --detailedLook for "CUDA: available" in the output.
Data Locations
| Data | Location |
|---|---|
| Models | ~/.local/share/izwi/models/ |
| Config | ~/.config/izwi/config.toml |
| Logs | ~/.local/share/izwi/logs/ |
| Binaries | /usr/bin/ (deb) or ~/.local/bin/ (source) |
Running as a Service
Create a systemd service for automatic startup:
sudo tee /etc/systemd/system/izwi.service << 'EOF' [Unit] Description=Izwi Audio Inference Server After=network.target [Service] Type=simple User=YOUR_USERNAME ExecStart=/usr/bin/izwi serve --host 0.0.0.0 --port 8080 Restart=on-failure RestartSec=5 [Install] WantedBy=multi-user.target EOFReplace YOUR_USERNAME with your actual username, then:
sudo systemctl daemon-reload sudo systemctl enable izwi sudo systemctl start izwiCheck status:
sudo systemctl status izwiUninstall
From .deb Package
sudo dpkg -r izwiFrom Source
rm -f ~/.local/bin/izwi ~/.local/bin/izwi-server ~/.local/bin/izwi-desktopRemove Data (Optional)
rm -rf ~/.local/share/izwi rm -rf ~/.config/izwiTroubleshooting
Permission denied when binding to port 8080
Either use a higher port or run with elevated privileges:
# Use a different port izwi serve --port 8888 # Or allow binding to privileged ports (not recommended) sudo setcap 'cap_net_bind_service=+ep' $(which izwi-server)CUDA not detected
- Verify NVIDIA drivers are installed:
nvidia-smi - Ensure CUDA toolkit is in your PATH:
export PATH=/usr/local/cuda/bin:$PATH export LD_LIBRARY_PATH=/usr/local/cuda/lib64:$LD_LIBRARY_PATH - Rebuild with CUDA feature:
cargo build --release --features cuda
Audio playback not working
Install audio libraries:
# Ubuntu/Debian sudo apt install -y libasound2-dev # Fedora sudo dnf install -y alsa-lib-devel