• 0 Posts
  • 465 Comments
Joined 3 years ago
cake
Cake day: July 29th, 2023

help-circle
  • In a way it has actually.

    Deepseek was big because not only did they publish the full model for everyone to use, but the MoE structure significantly brought down the hardware requirements in terms of processing power. As long as you have enough VRAM, you can run it on older hardware with no need for the latest Nvidia stuff.

    Now they got v4 which many have found to be within a 10% margin of Claude and ChatGPT.

    On top of that, China has cheapo VRAM GPUs available or soon to be released, like the MTT S80. Yeah it sucks as a Graphics card because the chip is behind, but you get 16Gb of GDDR6 for much cheaper than anything else.

    But its not a conspiracy to fight China. The infinite scaling was just Nvidia solidifying themselves as the monopoly because they want all AI infrastructure to be dependent on them, which is why they still illegally export to China, despite an export ban attempting to reduce their potential competition.

    Moore Threads (MTT) already has their own CUDA like system called MUSA, and I’m sure they’ll be happy to put in proper hardware support for new stuff like Bf16 and FP8/4. It’ll take a few years, but eventually China will catch up to the point where Nvidia gets shanked by cheaper hardware.


  • Lol please. America already gutted its entire industrial base to the point where there’s a permanent shortage of blue collar jobs, and most people are working crappy wages in a service role for whichever megacorp owns the entire market.

    AI could take over tomorrow and there wouldn’t be enough people to care, despite getting utterly screwed over.

    It might only get ugly if purchasing power collapses and causes solvency. Otherwise it’ll just continue to degrade into an infinite debt economy which is basically just generational slavery like a significant portion of exploited labor and human trafficking already is.

    Don’t worry though, there’s a million other problems that’ll probably pop the bubble first anyway lol.



  • mlg@lemmy.worldtoLinux@lemmy.mlDo you use vim?
    link
    fedilink
    English
    arrow-up
    1
    ·
    17 hours ago

    I’m at the point where I’m considering moving to vim because I’m sick of the lack of good defaults on Nano and Micro for quick edits, and I’m also tired of IDEs breaking my flow with poor defaults that pop open UI components which must be navigated differently depending on what it is, or just switching back to the mouse every couple seconds.

    Just haven’t made the jump yet because I want to sit down and go through all the hot keys in one go, including for global stuff like tmux, the DE, etc.








  • GitHub gets autoscanned by thousands of malicious actors for keys and credentials on every commit, including the comments lol.

    The fact that CISA themselves never saw an automated breach attempt only minutes after pushing to github is the more interesting story here.

    Either the contractor is so incompetent that they didn’t have any logging set up and the breach went completely unnoticed for 6 months.

    Or this really is some fat honeypot that they won’t admit is a honeypot because they’ve been using it to watch or bait APTs.

    Currently, there is no indication that any sensitive data was compromised as a result of this incident

    This is literally impossible unless it really was a honeypot. You can demo this yourself in real time. Make a throwaway cloud account on your favorite provider, commit the cloud auth token into a repo, and you will see an automated bot login within minutes.

    Commiting any secrets to a public repo should just be considered auto compromised because of how potent it is.

    That stuff ususlly gets exposed via poor CI/CD permissions where credentials are required, but straight up file commit is like publicly announcing exactly where you left your house keys lol.





    • Anything that you can shove hardware into (CPU, RAM, HDDs, maybe a PCI slot), so any used workstation is a great start, and don’t bother splurging initially, just follow the quality tool rule and only buy when something becomes inadequate. If you want to jump straight into loud and noisy severs, you can pick up used servers for cheap like R730s which there’s a ton of out there. Just avoid 2.5" drive bays because 3.5" HDDS are way cheaper per Gb.

    • Would recommend podman over docker as its matured to the point where it has a lot of better features like rootless, quadlets, etc that you might want to take advantage of in the future. OS is whatever linux you prefer, but I recommend you stay away from Ubuntu. If you want something RedHat but not as cutting edge as Fedora, I’ve heard OpenSUSE is pretty nice.

    For apps, If you want to do HTTPS via GUI then npmplus is nice option, Otherwise caddy can do the same with text config. Rest is whatever you want to try out :)

    EDIT: If you start making an *arr stack, I would recommend recyclarr to handle the quite expansive content filter settings for sonarr and radarr.


  • I hate to break the news but the issue with Bitwarden is that the client sucks total ass, and there are no drop in 3rd party replacements for the browser plugin.

    Been running Vaultwarden for a while now and even though the sync implementation is nice and clean, it’s just not worth the end user experience.

    This is really dumb when compared to literally every other password manager, open source and enterprise which does a much better job of actually being a password manager and not a glorified encrypted text file.

    I’m eventually going to switch back to KeePassXC and just suggest setting a master password with Firefox’s builtin password manager for everyone else who just wants a painless user experience and not have to deal with syncing vaults.



  • NIMBY is usually more to do with perceived loss in value though no?

    People don’t want AI datacenters because they are directly offloading energy costs to neighborhoods via substantially higher power bills. Which is happening because the demand is so high, they can’t compensate by building more power sources in the same time frame.

    That and the poor reception to the AI market, which is wrecking jobs, the economy, etc.

    Otherwise, datacenters were pretty well known for being built with very little resistance before this, especially since lots of providers, like Google, would fund geopower sources to power their datacenters which would add power to the grid with surplus.


  • mlg@lemmy.worldtoLemmy Shitpost@lemmy.worldJust say no
    link
    fedilink
    English
    arrow-up
    16
    ·
    7 days ago

    Reminds me of some funny old posts on r/sysadmin of greybeards who had essentially automated their entire jobs and life in perl lol.

    Best one was a script that would auto text message his wife he would be coming home late if he still had an active terminal session.

    There was a recent post around here or reddit that was about management trying to gauge performance via AI use, and how they had caught on to the token spending tricks people were using, but honestly it doesn’t seem that hard to fake around it if it ever came up.

    Just throw some agent work at it like codex and watch it burn tokens running grep lol.