This is the server I build back in 2023, based on a moded Dell Optiplex 3010 SFF motherboard with i5-2300 and Tesla M40. I wasn’t planning to put an Xeon E3 back then but something happened which changed my mind. After approximately 1.5 years of 24/7 running, my CPU power extension cable melted. This is just like the PCIe to EPS adapter situation last time, so I have to replace it with a heavier gauge (something better than the cheapest like above). ...
Lately, there is a need of private chatbot service as a complete alternative to OpenAI’s ChatGPT. So, I decide to implement one at home and make it accessible to everyone in my household alongside with my network printer and NAS (OpenMediaVault). In the past, I used to recommend people using Llama series for English tasks and Qwen series for Chinese tasks. There was no open-source model that’s strong enough in multilingual tasks comparing to proprietary ones (GPT/Claude). ...
Recently, I encountered a scrolling problem on ChatGPT web like this. I don’t use any userscript or extensions for OpenAI’s products and this problem occors in my unhardened Chrome based browser which I do not want to switch from. Based on the workaround in the threads, I made an userscript out of it which solves the problem by running in tampermonkey. (function () { document.querySelectorAll('html *').forEach(function(node) { var s = getComputedStyle(node); if (s['overflow'] === 'hidden') { node.style['overflow'] = 'visible'; } }); })(); However, this script stopped working just a few days after, and I couldn’t fix it since something in the server-end must have changed. ...
the “Open Source AI Manifesto” Mark Zuckerberg has been hated by Richard Stallman for decades and he is the only person who appears on both cover image of the video essays: How the Internet was Stolen and How AI was Stolen by Then & Now. However, things has changed recently after his adoption of the Fediverse and open-sourcing of Llama continuously. In Zuckerberg’s latest “Open Source AI Manifesto”, he stated 5 needs of open-source: We need to train, fine-tune, and distill our own models. We need to control our own destiny and not get locked into a closed vendor. We need to protect our data. We need a model that is efficient and affordable to run. We want to invest in the ecosystem that’s going to be the standard for the long term. That describes the needs of tech individuals and small businesses accurately. ...
AI-Generated content can be fun or “slop” according to Simon Willison, but also can be malevolent due to its abuse in phishing attacks. Some of my readers may have already known that recently I’m working on a side project , which based onchatgpt-html and uses LLMs to detect phishing emails. I think at some point, the tool should be able to detect phishing attempt from video content too. Because deepfake technology is so accessible nowadays and its generated content can be quite convincing. ...