Self-hosting Local LLMs (DeepSeek-R1) Easily with Harbor (Ollama+Open-WebUI+SearXNG)

Lately, there is a need of private chatbot service as a complete alternative to OpenAI’s ChatGPT. So, I decide to implement one at home and make it accessible to everyone in my household alongside with my network printer and NAS (OpenMediaVault). In the past, I used to recommend people using Llama series for English tasks and Qwen series for Chinese tasks. There was no open-source model that’s strong enough in multilingual tasks comparing to proprietary ones (GPT/Claude). ...

January 26, 2025 · 5 min · Jun

Ethics of Local LLMs: A Response to Zuckerberg's ''Open Source AI Manifesto''

the “Open Source AI Manifesto” Mark Zuckerberg has been hated by Richard Stallman for decades and he is the only person who appears on both cover image of the video essays: How the Internet was Stolen and How AI was Stolen by Then & Now. However, things has changed recently after his adoption of the Fediverse and open-sourcing of Llama continuously. In Zuckerberg’s latest “Open Source AI Manifesto”, he stated 5 needs of open-source: We need to train, fine-tune, and distill our own models. We need to control our own destiny and not get locked into a closed vendor. We need to protect our data. We need a model that is efficient and affordable to run. We want to invest in the ecosystem that’s going to be the standard for the long term. That describes the needs of tech individuals and small businesses accurately. ...

July 25, 2024 · 9 min · Jun

Setting up a Wisper Server with GUI using Generate-subtitles

I use Generate-subtitles as an alternative or substitute to YouTube closed captions (CC) since it does not always work as expected. When creating video contents, it comes very handy to have a high quality generated transcripts to start with. My favorite tools are Subtitle Edit and Aegisub. SE provides a great online version and works with .SRT format which fits great into my Adobe Premiere Pro workflow. It also has built-in Auto Translation and Whisper support. Aegisub works with .ASS format which fits into NixieVideoKit automated workflow. ...

June 10, 2023 · 3 min · Jun

AI CyberSecurity, ChatGPT and Post-humanism

This is the text for a lecture I’m going to give recently. Thanks for Daniela Baron’s guide which helped me tremendously for creating the slides with RevealJS. Hey everyone. Well, first, I have to confess and apologize that I could not prepare this enough. Because I have to working on my dissertation, which also discusses about AI augmented APT attack such as using ChatGPT to create phishing email and ransomware code. I don’t know if anyone is interested in that direction, but I digressed, let’s get to start. ...

April 6, 2023 · 17 min · Jun

Cheapskate's Stable Diffusion Server

No DALL-E, No Midjourney and No Colab This is a guide showing how to build your own stable diffusion server on what you already have or cheap used hardwares. It may not satisfy for a serious production use but pretty viable for learning, testing or casual use. Before we start, here’s some comments on OpenAI: The history of ChatGPT creator OpenAI, which Elon Musk helped found before parting ways and criticizing OpenAI Is Now Everything It Promised Not to Be: Corporate, Closed-Source, and For-Profit Will ChatGPT be open source? ChatGPT, how did you get here? It was a long journey through open source AI When big AI labs refuse to open source their models, the community steps in Artificial Intelligence: Last Week Tonight with John Oliver (HBO) The TRUTH about OpenAI I have been using ChatGPT and its API regulary. Since my last post, the API has been upgraded to gpt-3.5-turbo which broke my program and gpt-4 seems coming up soon. Therefore, I may not fix my code proactively. ...

March 28, 2023 · 10 min · Jun