AI test box is a success. InvokeAI is a fun little picture maker. OpenWebUi however has been genuinely handy for coding samples. Need a bunch of boilerplate for argparse? Easy. Some boto handling? Sure.
Big stuff though, forget it. I’ve experimented with ‘turn this shell script into equivalent <other language>’ — usually it’s 30% useful, 70% absolute garbage.
That’s ok though, I can tell the difference. Some of the examples are almost as useful as stackoverflow. Some show me different ways of coding to the same end. Not bad.
As a result, time to give this machine a bigger GPU. 12GB isn’t really enough video memory. So I’m swapping my Nvidia 3080 for a Radeon 7900XTX, which should give me 24 GB of video memory.
Rocm isn’t as mature as Cuda from my understanding, but all of the tools i want to use in this machine will run on either – and that’s all I need.