AMD's Lemonade SDK 10.3 Now 10x Smaller By Getting Rid Of Electron
Lemonade as the open-source local AI server backed by AMD and supported across AMD CPUs / GPUs / NPUs on Windows and Linux is out with a big update.
Lemonade 10.3 shipped with a number of enhancements today, including OmniRouter to unify the best back-end engines for a "true omni-modal" LLM experience. Using this router aims to make it a much more natural and seamless experience interacting with Lemonade.
On a low-level and something that many Phoronix readers will be excited for is Lemonade has gotten rid of its Electron dependency. Tauri is an alternative cross-platform, open-source framework for building desktop and mobile apps using web technologies while leveraging Rust on the back-end. In replacing Electron with Tauri, the Lemonade SDK is now "10x smaller" than before. The pre-built macOS and Windows binaries for example were 101~107 MB with Lemonade 10.2 and are now 7~9 MB with Lemonade 10.3.
Lemonade 10.3 also now allows easily updating to specified Llama.cpp versions or even auto-updating. Lemonade also now allows switching between ROCm 7.2 stable, ROCm 7.12 preview builds, and TheRock nightly builds of ROCm. ROCM 7.12 preview is being used by default with Lemonade 10.3.
Unfortunately, trying out the Linux (AppImage) build of Lemonade 10.3 on Ubuntu 26.04 LTS I didn't get very far after first hitting Wayland issues:
Downloads and more details on the Lemonade 10.3 release via GitHub.
Lemonade 10.3 shipped with a number of enhancements today, including OmniRouter to unify the best back-end engines for a "true omni-modal" LLM experience. Using this router aims to make it a much more natural and seamless experience interacting with Lemonade.
On a low-level and something that many Phoronix readers will be excited for is Lemonade has gotten rid of its Electron dependency. Tauri is an alternative cross-platform, open-source framework for building desktop and mobile apps using web technologies while leveraging Rust on the back-end. In replacing Electron with Tauri, the Lemonade SDK is now "10x smaller" than before. The pre-built macOS and Windows binaries for example were 101~107 MB with Lemonade 10.2 and are now 7~9 MB with Lemonade 10.3.
Lemonade 10.3 also now allows easily updating to specified Llama.cpp versions or even auto-updating. Lemonade also now allows switching between ROCm 7.2 stable, ROCm 7.12 preview builds, and TheRock nightly builds of ROCm. ROCM 7.12 preview is being used by default with Lemonade 10.3.
Unfortunately, trying out the Linux (AppImage) build of Lemonade 10.3 on Ubuntu 26.04 LTS I didn't get very far after first hitting Wayland issues:
Downloads and more details on the Lemonade 10.3 release via GitHub.