Irdial

I’ve got an M4 Mac mini with 32 GB of unified memory, so I can run MoE models in the <40B parameter range quite comfortably. I use LM Studio as the backend with Hermes as the frontend. Works great for everyday chat, web search, and RAG.

I am not in the AI==bad camp because I believe in nuance. I see a lot of people shit on Firefox for integrating LLM-related features. What the blog post points out and people fail to recognize is that if Mozilla stopped maintaining Firefox, almost all of its forks would die. People make similar arguments about Canonical and Ubuntu. Would these people pay Mozilla or Canonical for their work? The corporate investors do. I’m not saying I agree with it all, but that’s how it works.

Well isn’t that just so fucking lovely

People love to shit on Ubuntu, but I do think it’s important to remember that their primary customers are enterprises. That’s what pays the bills, and it’s also the reason that it’s so well-supported. And since it’s still Linux, you can disable or remove anything you disagree with, or go with a fork that’s done that heavy lifting for you. Some companies (and individuals) will want the best-in-class Linux support for AI inference. Get over it.

It’s not that there aren’t some risks to LLMs that produce illicit output, but the training data that made such output possible is openly available online already. As far as the risks of flooding the web with misinformation and propaganda, well…

Personally, I could do without Google Wallet. I usually carry my credit card and ID around with me. However, Chicago’s CTA system has a pretty good mobile app and it’s easier to manage your passes and fare that way.

You will not be able to use NFC for payments. In my case, it didn’t work for public transit cards either. That’s the only thing stopping me from switching.

I have experimented with microblog.pub in the past. It’s easy to set up, and federation worked just fine for me.