pull down to refresh

Bigger argument for local is not leaking data, if hardware gets reasonable again that'll favor open-weights again.

Yep. You're right about cost. Hard to justify just on basis of token pricing.

I got my rig (AMD AI 390) mid-2025 when prices were reasonable, so $1900 for 96GB RAM, don't think its worth it at double or triple the price.

But like you said, the big benefit is privacy. I've moved my accounting setup to be all "beancount" based (python text based accounting program).

So I can drop CSV files from my bank into my local LLM and have it transpose all the entries into beancount format.

14 sats \ 1 reply \ @optimism 1 Sep
So I can drop CSV files from my bank into my local LLM and have it transpose all the entries into beancount format.

Wait, these formats are so poorly defined that you can't do it programmatically?

reply
141 sats \ 0 replies \ @freetx 1 Sep

Absolutely you can do it programmatically - and that is in fact what my LLM does for me: (a) when new CSV format is encountered it writes a beancount importer to handle that specific file format, and (b) intelligently understands the descriptions to categorize the entry and update that rule in the categorize.py script if it doesn't exist (so PHO/GRILL it understands is a restaurant, etc)

Those are generally one-time task. However the real use is being able to chat with the LLM about hypotheticals....ways to become more tax-efficient, etc.

reply