• 0 Posts
  • 1.23K Comments
Joined 3 years ago
cake
Cake day: June 30th, 2023

help-circle




  • Even if you need to collate a bunch of data, don’t use an LLM for that, use a script, spreadsheet, matlab, or a compiled program that does real data analysis. Hell, even training a different NN on it would give more reliable results more efficiently.

    LLMs are best when the stakes are low or for tasks where even if they give the worst possible response, it won’t affect anything.



  • Yeah, as the other commenter mentioned, git is a distributed source control system, so all clones have the full history (though you can bump up the “starting point” to reduce the overhead of storing all previous commits).

    Hosts like github can add more features on top of that, which would have to be backed up separately, but you can automate the repository itself using a single command, which is the same command used to make a clone in the first place.



  • IMO everyone should have a local backup of everything they can get related to the repo. Like I know with git itself, anytime you clone the repo you get everything, but also the supporting stuff that is in the layer outside of git. IMO the host should mainly be the hub where everyone gets and interacts with the project, while everything else is already good to go in a new location, should the host either screw up in good faith, get corrupted by outside influences, or gets overrun by local or remote powers.

    This makes me a bit curious about whether the overall risk to projects is higher from individual local device failure or politics around who controls remote hosting services and the nature of the project.



  • The whole idea of ads being added to AI chatbots make them seem even more useless and unreliable to me. They already predict shit that can be called “outright lie” without adding even more lies in the form of advertisements.

    Especially where they are being used for productivity, which kinda reeks of them eventually charging even more so that your email summary doesn’t include a blurb about whether you should crave the same brawno that plants do (unless it’s there because the AI used to write the email was the one that inserted the ad) or to prevent your vibecoded mess from getting stuck in a taco bell-sponsored spam loop.



  • I like digital games on PC, not gonna lie.

    But the only money I’m spending on the consoles I have is on used games. That’s what makes them worthwhile for me. I spent stupid money on the ps5 and psvr2 because my library of games could be built at a discount, and maybe every now and then I’ll get a new game that looks interesting because I have the system already. I bought the disc version of the ps5 specifically, not right at launch but close enough to it that I had to look around to find one (and said no thanks to the driveless ones that were available). Can’t remember if it was for the ps5 or psvr2 but for one of them I even held my nose and got it from walmart, which I try to avoid when possible.

    Though the writing is already on the wall with these things. So many games are already just download codes even if they are on a disc or card, which means they require active support just to install and once that’s gone (either by Sony or publisher’s choice), then that game is gone. And I know you assholes think that’s a good thing because it means someone who would otherwise be playing that game needs to find something else to do and that something else might be buying another new game. So ultimately it doesn’t really matter if you (Sony) use discs or not, since removing them entirely is really just slamming that final nail in the coffin, but it’s already there just waiting for the hammer. I probably won’t get the next PlayStation either way.







  • Not sure how well that without work even if you could bridge them properly to share their vram, as the latency from the other gpu will be pretty high compared to the local vram. Frame times won’t be that great is my prediction. It works ok for LLMs because they aren’t a realtime compute task like gaming graphics is. If an LLM takes an extra 0.12s to compute its result, you don’t notice, but if a gpu misses a frame deadline by 0.12s, that’s a stutter that represents less than 10 fps.

    I believe that’s why earlier attempts at dual gpu systems mostly fizzled out (plus cost concerns). You can get some pure acceleration if you can fit the entire working memory onto both GPUs’ vram (so your total vram is effectively min( GPUA_VRAM, GPUB_VRAM ) rather than GPUA_VRAM + GPUB_VRAM, though that also requires all pixels to be independent of anything calculated on the other GPU, other than maybe post processing effects that could be handled on whichever GPU is handling the display.

    That’s not to say that you can’t get extra performance out of multi-gpu setups that don’t just mirror their RAM, but it’s more complicated than “sum of the capabilities of each GPU”.