I’d say that “struggles” is a bit too much. And it’s still 5x to 10x cheaper than the models they compared to in benchmarks, let’s see by how much they’re increasing that cost.

yeah, swap is definitely still useful and it gets used by the kernel well before the main memory is full

Rideshare “Stimulator” sounds like a softcore porn game

it’s not, because it takes swap usage into account, so you can benefit from swap without risking a frozen system

direct link to the policy

https://forge.rust-lang.org/policies/llm-usage.html

the only times I had OOM killer kick in, the machine was already frozen for a long time trying to swap things in and out and whatnot. So I started using earlyoom - it’ll just nuke that memory hogging process out of existence before it takes the whole machine down.

good tooling, though pylance can be mostly replaced by pyrefly or ty today - both of which are much faster and don’t enter “analyzing files” loop like I’d always have with pylance, or the CPU being pegged at 100%

these 1681 kids

This is so annoying and exhausting. Today I gave up linking a bank account with a broker via plaid because they wanted access to all my transactions.

I’m not in this area, but from what I remember from undergrad, real world systems have too many variables to simulate. It quickly becomes a combinatorial problem, not a reasoning one.

I felt with a lot more rights in the old country tbh, I came for the money and experience, definitely not more rights or social benefits

and it’ll only get worse. This administration is making the US really unattractive to consider as an international student, and perhaps the majority of grad students has been from abroad. With the grant cuts it’s almost a certainty that scientific output will drop sharply in the next few years.

Spotify has too many users and control over the industry, nothing good can come from that. Do your part and stop using it.

deleted by creator

for inference you’re only counting active parameters towards VRAM, and some labs / models don’t train at 32b precision, or even use the same precision for different parts of the network

to me and probably to over 2B people

free to make numbers up

no other platform even compares

if $1 is not installed after that, wipe your hard drive and start over