• 10 Posts
  • 572 Comments
Joined 3 years ago
cake
Cake day: March 19th, 2024

help-circle
  • Radeon RX 7600, but yes, you’re right, it’s relative. It’s good enough for any gaming I do, which is not an awful lot. I think it’s considered mid-range for its generation, I guess I was just thinking of the GPUs I see people mention they have which seem much beefier than mine lol.

    I’m no AI expert but when I looked into it, it seemed that VRAM was the biggest factor being mentioned in discussions of GPUs, hence why I mentioned it.


  • Not much, but you can use it for basically anything people use frontier models for, it’ll just be somewhat dumber. I occasionally run LLMs for proof-reading important things that I’ve already hand-written and edited. Sometimes for bouncing off ideas. Sometimes for the kinds of questions I’d normally chuck at a forum but I can get a quicker answer if I ask an LLM. No, I don’t “trust” the answers; anything where I can’t just use my own judgement, the LLM will have given me enough to perform my own research to fact-check it.




  • desire to keep out of commercial cloud providers

    I’m afraid that GitHub is run by Microsoft and I would consider it pretty thoroughly corporate these days.

    Fair enough if you want to get more familiar with git (although using it as a cloud service is basically just gonna be add all and then commit, surely? you’re not practising any other git operations if only using as cloud storage?), but people normally do this with programming projects, which you should have no shortage of as a CS major.



  • Divinity: Original Sin 2. Combat system isn’t perfect (my main criticism is that you can unchain your characters to set your party members up in advantageous positions and then trigger combat, which feels cheaty) but it has some cool mechanics. A lot of elemental interactions, interactions with and creation of different surfaces, factoring in high ground for an advantage, etc. I know BG3 is highly acclaimed also by Larian but I haven’t played it so can’t attest to that combat system.





  • Yes, I don’t have a very beefy graphics card but I can run LLMs locally. I use them for things like proof-reading. Look into llama.cpp. If you have an Nvidia card then look into using CUDA so your LLMs don’t run slow as fuck using only your CPU.

    Check how much VRAM you have and then do some research into the open-weight models. The best models require quite a bit of VRAM, but there are models that work well on cards with less VRAM.

    It’s energy-intensive, but on a level that most people already find acceptable. I’d say it’s comparable to playing a AAA video game for a few minutes to generate an answer.

    Local LLMs aren’t slower if you pick a model well-suited for your GPU, but they are dumber. But that doesn’t make a difference for me as I wouldn’t use LLMs for any particularly cerebral tasks e.g. programming. They can work fine for things like bouncing off ideas, proof-reading, making suggestions for things like writing and debugging, etc, the kind of thing where you can read their response and just discard it if it’s stupid. Whether or not that’s “useful enough” for you is down to you. You can just give it a go and uninstall things if you don’t find them useful.




  • What kind of data is it? If it can be printed, you can just print it and store it somewhere safe, or print multiple copies and distribute it around. Plenty of 80 year old books are perfectly readable. That’d only be books printed in 1946 so nothing crazy. You can pay for professional printing so they can do it on good quality paper and so on.