These companies should be criminally liable for training their models on child porn.

  • Snowclone@lemmy.world
    link
    fedilink
    English
    arrow-up
    36
    ·
    18 hours ago

    https://tsjournal.org/index.php/jots/article/view/29

    exposure to csam, through self reporting, increases the risk the viewer will seek contact with children, in case you need more arguments against csam. I’ve heard the argument that AI generated images may be a harm reduction situation. it’s not. it’s incredibly damaging to the viewer if they are seeking it out, it makes them more likely to abuse, if they are exposed to it as victims it can cause lasting damage, much of it is just remixed images of actual child abuse victims, and that revictimizes them, and causes serious damage as well. We really need to stop pretending the companies that make this software aren’t responsible for this software.

    • Allero@lemmy.today
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 hours ago

      Thanks for sharing this!

      I do wonder though if it actually translates to AI-generated CSAM. People who go for the real CSAM already get to accept harm caused to real children, while AI-generated one doesn’t necessarily feed off real CSAM - or at least not all people expect it to.

      There’s also a matter of legality - stepping into the criminal side by watching/storing/distributing real CSAM may embolden people to do further criminal acts.

      Finally, AI-generated CSAM can take various shapes. Do realistic depictions affect pedophiles the same way more cartoonish depictions are? This is not obvious.

      I’m not saying your conclusion is wrong, it could be completely right, but we have criminally little data on the topic. We NEED better research ASAP, because what we have now in terms of policy is still very much vibes-based, and it shouldn’t be like that. We need to know what we’re stepping in here, and what really needs to be done.

      • Allero@lemmy.today
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        3 hours ago

        I think it’s relation to the content. Violent games are widespread and often played by individuals who don’t dream of bringing a rifle and shooting everybody.

        CSAM, however, is primarily watched by individuals who are already mentally inclined towards child abuse. They would want to have sexual/romantic interaction with children IRL, and they either already do it or are stopped by morality, legality and other factors while still having the urge.

        • Lumisal@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          3 hours ago

          Oh boy, do you show how young you are.

          Violent video games were definitely not widespread before, and there definitely were plenty of people saying this back then even in the 90s. I remember seeing a CSPAN coverage where American Republicans were specifically saying only the sick and twisted would want to play Mortal Kombat.

          Yes, the first one, which at the time looked like this:

          They weren’t calling for regulations or research, but a ban. And yes, there were “studies” of small sample sizes they presented too.

          It’s especially important to stay level headed and rational when it comes to what we may instinctively find disgust in, because you don’t fix societal issues with pure demonization. Currently the way most treat pedophilia is the same way I saw people treated those who had HIV.

          What we should be doing is figuring out why some people have these pedophilic tendencies, and trying to cure it. We still need to keep the legal punishments for committing actual rapes of course, but if you make the existence of a pedophile itself essentially illegal, then you won’t see them coming out to seek help before they potentially do something heinous, much like an addict does not necessarily start out as a thief to get their next fix. And that’ll make it harder to fix the roots of the issue.

          Instead, you’ll see it used as a cudgel by the corrupt who are above the law anyway used to oppress the general population and get rid of anyone they dislike, much like they’ve done in the past with drugs (crack cocaine), political ideology (communism’s red scare), and even homosexuality before that (see what happened to Turing).

          • Allero@lemmy.today
            link
            fedilink
            English
            arrow-up
            1
            ·
            edit-2
            2 hours ago

            Indeed, I agree with the last part. We should tread carefully with policy here, for two main reasons:

            1. We still have exceptionally little evidence one way or another, which is honestly insane given the topic’s importance
            2. “Protect the children” narrative is commonly abused for tyrannical laws that trample otherwise unrelated freedoms. I can easily see how this narrative can transform in broader AI oversight in a way that tramples democracy and fair access to information.

            I merely addressed the “why is this different” issue. You’re unlikely to even want to watch any form of CSAM unless you’re into this, i.e. unless you’re a pedophile. You don’t have to be a sadistic psychopath to enjoy wreaking havoc in GTA or beating the hell out of your opponent in Mortal Kombat.

            CSAM attracts a very specific demographic, and we need to make sure we understand how AI-generated CSAM affects this demographic and whether it induces real life abusive behaviors, or maybe represses them. And yes, it is also important to understand how it affects children, how likely they are to find such materials, and how it affects their sexual development. But this part is exceptionally hard to study, because you can’t just take children and expose them to CSAM to see how it’s going.

      • Le_Mon2@lemmy.zip
        link
        fedilink
        English
        arrow-up
        2
        ·
        9 hours ago

        Well it’s different because video games aren’t created by comsuming and averaging out every piece of footage of children being raped that grok can find on the internet. Hope this helps.

      • Snowclone@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        11 hours ago

        why would watching children be abused from real or stimulated sources be the same as playing a violent video game?

        • Lumisal@lemmy.world
          link
          fedilink
          English
          arrow-up
          17
          ·
          edit-2
          9 hours ago

          You’re right. A video game is far more interactive. Heck these days you can even put on a headset and really simulate the action of murdering people. Grand Theft Auto is a whole detailed simulation on muder, theft, and more. Wayyy more immersive than just plain video.

          Clearly then, by your own logic and the study’s conclusion, watching simulated sources make people more likely to do the thing after all. I mean, what sick person fantasizes about murdering strangers?

          Obviously we must ban the existence of violent video games or crime in society will spiral out of control.

          Edit: for the younger lemmings, this is sarcasm. “Fake X causes more real X” is really old propaganda, and its usually used on something most of the population already finds morally objectable + is harmful to society to advance some ulterior motive.

          In this case, probably government spying and the erosion of privacy, as usual.

          • Snowclone@lemmy.world
            link
            fedilink
            English
            arrow-up
            4
            ·
            edit-2
            10 hours ago

            your doing A LOT here, friend. I’m not sure I can unpack this… I’m not suggesting playing Grand Theft Auto is going to make anyone more likely to commit violent crimes. I don’t see the connection with csam. I don’t think the effects of viewing csam is equivalent or similar to playing a video game. I’ve played GTA, it’s really not an instruction manual or stimulation of detailed murder or violence, honestly, it’s a bit silly and while modern versions of the game are more detailed than the early versions of the game that were graphically more similar to Frogger than anything else, it’s still not very detailed. if you needed a murder equivalent to csam I think gore and ‘faces of death’ type of videos would be more comparable, video games are marketed to be fun and are rated and regulated pretty heavily in most areas of the world, AI generated csam isn’t being caught up in that same process of regulation or review, multiple corporations have made software that is producing AI generated csam and no one is really holding them accountable like you or me would be if we personally increased the reported rates of csam by huge orders of magnitude. we’d be in prison. the software isn’t free from the corporations that made it. they made it, they should be held accountable.

            • Lumisal@lemmy.world
              link
              fedilink
              English
              arrow-up
              14
              ·
              9 hours ago

              And you’re too young to remember back when the same talking points were used against video games to try to ban them or against movies and books “promoting” drugs. This isn’t a new thing. “Fake X causes more of Real X to happen!” Has being going on for decades if not over a century and has always been used for an ulterior motives.

              Making up statistics to find yet another way for governments to justify eliminating privacy isn’t going to save children or stop pedophilia, much like banning video games wouldn’t reduce gun deaths and banning drugs doesn’t really reduce drug use. The root cause is elsewhere.

              But you go ahead thinking your virtue signaling makes things better. I’m sure your name calling tactic will totally make a difference.

              • Snowclone@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                edit-2
                1 hour ago

                I think perhaps, child sexual abuse material can be treated differently than video games. certainly it’s not related to anything I was talking about. it’s pretty absurd to connect ‘hay these AI companies released software that’s creating csam, let’s stop this and hold them accounting’ to ‘let’s stop video games.’ these are very distinctly different things. I’m not suggesting thought crime laws or laws to prevent anyone from buying or consuming video games or anything related to that, that world is already rated and regulated. AI software creating scam is not. that’s the problem. not video games. why do you even think this is related, it’s absurd.

      • MaggiWuerze@feddit.org
        link
        fedilink
        English
        arrow-up
        4
        ·
        15 hours ago

        I would argue, that in both cases it only (or at least only meaningfully) affects people who already have a leaning towards the specific issue.

    • it_depends_man@lemmy.world
      link
      fedilink
      English
      arrow-up
      38
      ·
      17 hours ago

      This study explores a sample of 1,546 anonymous individuals

      I have a study of 23023012301230123050503450 anonymous individuals, of which 78% agreed that you smell like doo doo. Yep. True story. If you disagree, you hate science. How could you do this?

      I shouldn’t be this sarcastic, the journal is called " Journal of Online Trust and Safety (JOTS) " with a name like that, how could I ever be so arrogant to not believe 1546 anonymous individuals on the internet? Shame on me, really.

      • Virtvirt588@lemmy.world
        link
        fedilink
        English
        arrow-up
        14
        ·
        15 hours ago

        Agreed, studies on this topic are always what someone on the other end wants to hear. The premise is inconsistent and the conclusion doesnt hold. If this study was done about something less “taboo” it would’ve been lost and forgotten.

            • it_depends_man@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              ·
              2 hours ago

              If my critique is directed at the quality of their output, their degree, occupation, education, etc. don’t matter. The output is still bad. Whether or not I or they have a degree is irrelevant.

              run by academics

              So what? They can’t make mistakes?

      • howdy@lemmy.ml
        link
        fedilink
        English
        arrow-up
        7
        ·
        16 hours ago

        reddit moment…

        you can’t just dismiss an argument because the study is small. Sure it’s small, but it’s not easy to get large data on this subject.

        The concept of csam exposure influencing behaviour is highly plausible.

        • howdy@lemmy.ml
          link
          fedilink
          English
          arrow-up
          2
          ·
          5 hours ago

          Nice to see my comment get destroyed. I agree with all of you on the importance of being rigorous in science, and that self reporting surveys are not reliable.

          The reasoning that made me comment was: I think original commenter is making an argument in good faith. You can dismiss the study, but then at least argue the point? Surely everyone agrees that the opposite view – that AI generated csam could reduce harm – is insane???

        • Senal@programming.dev
          link
          fedilink
          English
          arrow-up
          6
          ·
          edit-2
          11 hours ago

          Aside from the other good replies you have around the subject, i’ll address something more fundamental to your argument.

          you can’t just dismiss an argument because the study is small.

          You absolutely can dismiss a study for being too small. In some cases you really should.

          If you can’t procure and retain a meaningful sample size, then you shouldn’t be running the experiment (or more usefully, designing an experiment that works with smaller sample sizes, or one that uses a demographic where you can get adequate sample sizes).

          It’s one of the reasons why participant gathering is usually done up front.

          • frongt@lemmy.zip
            link
            fedilink
            English
            arrow-up
            3
            ·
            12 hours ago

            True. But over 1500 responses is a massive sample size for a survey like this.

            I haven’t read the actual study yet, but I would assume they filtered out things like one person submitting a thousand responses.

            • Senal@programming.dev
              link
              fedilink
              English
              arrow-up
              3
              ·
              edit-2
              11 hours ago

              True. But over 1500 responses is a massive sample size for a survey like this.

              Genuine question, based on what?

              Like, I’m just seeing a number, I’ve no idea if it’s big or small in the context of this area of study.

              I’d be interested to know why that’s considered a good result.

              I haven’t read the actual study yet, but I would assume they filtered out things like one person submitting a thousand responses.

              Agreed, I’d assume a basic level of scientific rigour.

        • WhatAmLemmy@lemmy.world
          link
          fedilink
          English
          arrow-up
          17
          ·
          15 hours ago

          I agree with the plausibility of the concept, but anonymous surveys aren’t really something we should be calling a “study”. They’re barely considered evidence as they’re open to extreme errors, bias, and manipulation; especially by respondents.

        • it_depends_man@lemmy.world
          link
          fedilink
          English
          arrow-up
          20
          ·
          edit-2
          16 hours ago

          The concept of csam exposure influencing behaviour is highly plausible.

          The entire scientific community and publishing industry is a minefield. So is CSAM and the call for more restrictive governing of the internet.

          The thing I know for sure is that there are people on this planet who have a political and a financial motive to lie and fabricate studies to justify their politics.

          The thing I’m mostly skeptical on is the scientific process. Not because it can’t work, but because that entire field too, has bad incentives. “Reputation” is held up, frankly, by boomers who have trouble operating a printer, but did some important theoretical work before the internet was made public and by politics and a disinterested public that doesn’t apply scrutiny to what their “intellectual elite” is actually doing.

          The internet is a KNOWN source of bad information. Those 1546 “anonymous individuals” could be one bored 4chan user, or one chinese/russian/us spy agency worker justifying the next expansion of their budget.

          is highly plausible.

          Is not science. It’s guesswork.

          I appreciate that it is difficult to collect good information on this subject, but that’s just how it is. Tough luck. As a scientist, a proper scientist, you don’t get to publish “it’s plausible” from a source you can’t verify as fact.

          Second guessing science isn’t anti-science.

          • Snowclone@lemmy.world
            link
            fedilink
            English
            arrow-up
            3
            ·
            edit-2
            11 hours ago

            wow it sounds like you hate surveys and science. sorry about that.

            my comment on an internet news article was that child sexual abuse material even if generated by AI isn’t a harm reduction, as it is shown to cause harm in multiple ways. if you want to argue that being exposed to csam as a viewer isn’t harmful to the viewer or doesn’t make them feel more inclined to abuse children in real life, that’s fine, you can do that AND hate science. it’s OK, man.

            I’m not trying to get you to agree surveys and science as a whole are valid.

            • Senal@programming.dev
              link
              fedilink
              English
              arrow-up
              6
              ·
              11 hours ago

              Questioning the validity of methodologies and results is a core part of the scientific method.

              “It has surveys, so it must be legit” is not.

                • Senal@programming.dev
                  link
                  fedilink
                  English
                  arrow-up
                  5
                  ·
                  10 hours ago

                  where did I make that claim?

                  wow it sounds like you hate surveys and science. sorry about that.

                  implying the points raised don’t have merit and are just the ramblings of a science (and survey) hater.

                  I’m not trying to get you to agree surveys and science as a whole are valid.

                  again, implying that somehow the points raised are only due to disagreeing with science (and again surveys for some reason)

                  especially when the rest of your reply is just restating your original claim and not responding to any of the raised points.


                  “this person must hate science and surveys” is the contextual equivalent of someone saying “hey perhaps we should not allow children to work 12 hour days in factories” and you replying with “this person must hate freedom”.

                  It’s completely ignoring the point and claiming victory anyway.

                  • Snowclone@lemmy.world
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    edit-2
                    9 hours ago

                    what point? they said they thought science as a whole is corrupt and unreliable. they wrote a whole paragraph about it. what do you want me to dispute? that they think science as a whole is corrupt and surveys are made up? what’s the rebuttal possible? ‘well sir, surveys are possibly valid and not entirely made up.’ what do you want? there’s no substance to any of their claims beyond ‘I think it’s all made up and science is corrupt and therefore meaningless’. my counter argument is '‘OK, I don’t care if you feel that way, you’re allowed, good day’ and your coming at me like an obvious sock puppet that’s only interested in arguing nonsense instead of having ANY point about the subject at hand. good job. I totally agree with you and your correct on all points.

        • ohulancutash@feddit.uk
          link
          fedilink
          English
          arrow-up
          9
          ·
          edit-2
          14 hours ago

          Maybe not dismiss, but you can think twice before giving it much credit.

          The government is currently looking at making anti-semitism a zero-tolerance offence in schools, in the wake of the Bell Review, which showed that 41% of Jewish pupils had suffered anti-semitic abuse at school. These are indeed troubling numbers, but baffling as 70% of British Jewish pupils are in Jewish schools. Are nearly 20% of anti-semitic incidents really occurring in Jewish schools? Or is it a flaw in the study, which had a sample size of 92 children of which 70 responded?

          If we just need to be plausible, then why bother with the time and expense of studies at all? Sure, its plausible that antisemitism is on the rise in schools, but so are exclusions to a truly troubling all-time high. Is it really wise to add greatly to that number based on the experience of 29 study respondants? That isn’t even a classroom’s worth.

          Small data sets can severely distort results and need to be taken with that firmly in mind.