Local LLM

Lately, there is a need of private chatbot service as a complete alternative to OpenAI’s ChatGPT. So, I decide to implement one at home and make it accessible to everyone in my household alongside with my network printer and NAS (OpenMediaVault). In the past, I used to recommend people using Llama series for English tasks and Qwen series for Chinese tasks. There was no open-source model that’s strong enough in multilingual tasks comparing to proprietary ones (GPT/Claude)....

the “Open Source AI Manifesto” Mark Zuckerberg has been hated by Richard Stallman for decades and he is the only person who appears on both cover image of the video essays: How the Internet was Stolen and How AI was Stolen by Then & Now. However, things has changed recently after his adoption of the Fediverse and open-sourcing of Llama continuously. In Zuckerberg’s latest “Open Source AI Manifesto”, he stated 5 needs of open-source:...