• BilSabab@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    1 day ago

    i was shocked when my article on Adorno and Scruton comparison got rejected because “it reeked AI” even though AI sucks VERY-VERY HARD at analyzing and interpreting philosophy beyond NotebookLM literally retelling the uploaded book. it is so bad there is basically an entire subgenre of philosophy writing analyzing how various AI get it wrong

  • willeypete23@reddthat.com
    link
    fedilink
    arrow-up
    5
    ·
    2 days ago

    Emagine being in an academic filed, and AI being trained off your research papers, so it has the same writing style as you. Give me my em dashes back.

        • yeahiknow3@lemmy.dbzer0.com
          link
          fedilink
          arrow-up
          27
          arrow-down
          3
          ·
          edit-2
          3 days ago

          Worst performance for GPTZero is technical medical papers with a 10% false positive rate. Here’s the study from S. Korea.

          Scientific scholarly writing: <4% false positive.

          Creative writing is orders of magnitude easier to detect. The biggest problem for AI writing detection tools is the use of translation — so generating text, translating it into another language, and translating it back — but this ends up as a false-negative issue. False positives are very rare.

          More importantly, we don’t need GPTZero to detect AI writing because professionals can identify it on sight. Add context clues (students are dumb) and suddenly it’s trivial.

          EDIT: I need you to understand that college students are terrible writers. In all my decades and literally thousands of students, I’ve met maybe three undergrads whose writing was more than proficient, and that’s in an environment where the average SAT scores are over 1550. The idea I’m going to mistake your writing for AI (which sounds horrible and robotic, btw) because of its “high quality” is simply unfathomable.

          • nfh@lemmy.world
            link
            fedilink
            arrow-up
            24
            arrow-down
            1
            ·
            3 days ago

            Props for responding constructively.

            The false positive rate is pretty low, but a false negative of 35% is pretty concerning in terms of whether they’re fit for purpose. Like it’ll rarely misclassify human writing as AI generated, but it’s somewhat closer to a coin flip in correctly identifying AI generated language. It’s a signal, but I imagine it’s a poor substitute for the judgement of a person who has spent time teaching teenagers / young adults to write.

            Which to the original point isn’t totally snake oil, but it’s maybe not a great tool for the professionals who it’s targeting.

            • yeahiknow3@lemmy.dbzer0.com
              link
              fedilink
              arrow-up
              2
              arrow-down
              1
              ·
              edit-2
              2 days ago

              The false negative rate for creative writing is exceedingly low as well, sub 1%. False negatives aren’t the critique of this meme, and the examples I gave for GPTZero were worst case scenarios for very specific types of technical writing.

          • ayyy@sh.itjust.works
            link
            fedilink
            arrow-up
            6
            arrow-down
            1
            ·
            3 days ago

            Thank you for linking me to that study! Unfortunately google is a piece of shit and they’re calling me a bot and refusing to talk to me even though I’m on a standard residential internet connection. Could you tell me the title/authors so I can look for it elsewhere?

            I’m particularly interested in seeing what the actual false positive rates are beyond a colloquial “1%”. Because 1% is, in the context of accusing academic cheating, absolutely unacceptable dog shit.

            Take a basic example intro class with 350 students, with only two tests per semester. With “only” a 1% false positive rates you will be destroying the lives of more than a dozen innocent kids every school year. And thats only for one class, students are taking many classes per semester.

        • 5318008@lemmy.ml
          link
          fedilink
          arrow-up
          7
          arrow-down
          1
          ·
          3 days ago

          It’s literally from a Chick Tract. It’s an ancient meme… circulating for the past 10 years or so.

          KYM

          Whether the person posting it is right or wrong, it’s not really an endorsement of religion. It’s like “scapegoat”, or “omg”.

            • qualia@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              1
              ·
              1 day ago

              Just wanted to chime in as a reader. This Reddit-style of talking down to others unfortunately is what makes me disagree with those I’d normally agree with. How it’s delivered matters at least as much as the message’s content.

    • VitoRobles@lemmy.today
      link
      fedilink
      English
      arrow-up
      8
      ·
      3 days ago

      At a art exhibit, this poor artist with over 20 years of work had to put a “Not AI” sticker. He was sick of all the dick heads.

  • CultLeader4Hire@lemmy.world
    link
    fedilink
    arrow-up
    21
    ·
    3 days ago

    I’ve gotten this a lot. I was also on early Reddit a lot so I guess AI probably just writes like I do, not the other way around

    • BarneyPiccolo@lemmy.today
      link
      fedilink
      arrow-up
      7
      arrow-down
      1
      ·
      3 days ago

      That’s interesting. I was permabanned in the Inauguration Bloodbath after 12 years, and a million karma. I was VERY active, back when nobody had really heard of Reddit. Because my end was sudden, I never had the chance to delete anything, so they got it all.

    • Crackhappy@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 days ago

      Oh my, that’s certainly something that could have happened to me. When I deleted my account I nuked all of my posts and comments with overwriting though.

  • SpaceCowboy@lemmy.ca
    link
    fedilink
    arrow-up
    14
    arrow-down
    2
    ·
    3 days ago

    There are ways of telling whether she is an AI.

    What are AIs mode out of?

    Silicon!

    What else is made out of silicon?

    Breast implants!

    So logically if she weighs the same as a breast implant…

    • qualia@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 day ago

      I was gonna say they’re: “Spelled differently (true) and are distinct, unrelated materials (false!)”. So I ended up correcting myself.

      Silicone is literally made from silicon. Manufacturing starts with silica (SiO₂, found in sand/quartz), which is reduced to elemental silicon, then reacted with methyl chloride to form methylchlorosilanes, which are then polymerized into silicone.

      The name “silicone” was actually coined in 1901 by English chemist Frederick Kipling, who thought the compounds R₂SiO resembled ketones (hence “-one” suffix) — the naming turns out to be a bit of a misnomer chemically, but it stuck.

        • Catoblepas@lemmy.blahaj.zone
          link
          fedilink
          arrow-up
          7
          ·
          3 days ago

          It’s fine, I use em dashes all the time in papers. If you do it correctly—to add more information or commentary to your overall point—instead of at random and without proper syntax you’re not going to get accused.

        • nfh@lemmy.world
          link
          fedilink
          arrow-up
          6
          arrow-down
          1
          ·
          3 days ago

          Don’t let LLMs take your em dashes; flattening your language to the lowest common denominator to avoid doing anything too distinctive less you be accused of non-authorship… that’s a real harm to you and your reader. If you know how to use them, and enjoy using them, use them fearlessly.

    • yeahiknow3@lemmy.dbzer0.com
      link
      fedilink
      arrow-up
      9
      arrow-down
      1
      ·
      3 days ago

      It’s actually the opposite. AI writing sounds like corpo-speak. It’s soulless, ugly, and extremely obvious.

      I’ve spent about 30,000 hours reading in my life. If you think I can’t tell you’re using a token predictor for your “essay,” you’re fucking insane.

      • collapse_already@lemmy.ml
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        2 days ago

        As someone who has retired from the practice of law and billed clients more than 30,000 hours for legal research over the years, I can assure you that soulless corpo-speech has been around far longer than AI and used to be created organically by depressed human drones and sociopaths. Where do you think the AIs learned to write that way?

  • minty@aussie.zone
    link
    fedilink
    arrow-up
    36
    arrow-down
    1
    ·
    3 days ago

    Might be doing a masters next year and god I hope that isnt a problem. Im sure it will be, but one can hope

    • Secret_Music@piefed.blahaj.zone
      link
      fedilink
      English
      arrow-up
      40
      arrow-down
      2
      ·
      3 days ago

      Personally, if I had that shit pulled on me, I would probably demand to know their process of grading papers. Because from what I’ve been reading, a lot of teachers and lecturers are starting to use AI tools to assist them.

      And as far as I’m concerned, if I have paid an absolute fucking fortune to be there and be taught by human beings, I’m expecting them to actually do their fucking jobs and not hand it off to Elon Musk’s plagiarist CP machine. Especially if they’re going to be going around accusing students of using AI.

      • WillFord27@lemmy.world
        link
        fedilink
        arrow-up
        11
        ·
        3 days ago

        My mother is a professor and hates AI. She works at a community college and the amount of shit she has to go through is unbelievable. Her college actively pushes her to use AI but she doesn’t whenever possible. She’s struggling with AI more than any other person I know of.

        Teachers are rarely the problem.

    • BenVimes@lemmy.ca
      link
      fedilink
      arrow-up
      4
      ·
      3 days ago

      I’m starting a master’s in a few weeks, and because most of the courses involve group work, I’m concerned about someone in my group sinking a project for everyone else by using an LLM for their portion.

      And given the program, I wouldn’t be surprised if there are more than a few AI boosters in the courses who will try it, above the normal number of such people you might find in postgrad studies.

    • PlzGibHugs@piefed.ca
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 days ago

      I never had a problem with ratings over 50%. My writing seems to be especially prone to false positives, but I still didn’t receive higher than 20-30%. Unfortunately, at my school, anything over 0% was considered suspect, so I was still penalised even if it was clearly human-written with full APA sourcing.

    • Catoblepas@lemmy.blahaj.zone
      link
      fedilink
      arrow-up
      2
      ·
      3 days ago

      I was worried about this as well, but I’m in undergrad and have run into zero issues. When teachers allow us to see the percentage similarity to AI text I’ve always had under 10%, usually under 5% if you omit direct quotations. I can’t imagine it gets more likely you’ll get dinged as your subject gets more arcane. The only time I’ve seen people in trouble for it are for really obvious plagiarism or AI use.

  • yeahiknow3@lemmy.dbzer0.com
    link
    fedilink
    arrow-up
    22
    arrow-down
    1
    ·
    edit-2
    3 days ago

    Nobody who reads or writes for a living thinks AI slop sounds good. It has a hideous corpo-speak prosody that’s like nails on a chalkboard to professionals.

    People think because they can’t tell it’s not written by a human, someone who has read literally tens of thousands of essays (not to mention millions of fucking book pages) can’t tell either.

    Absolutely bonkers.

    Students who use AI are like little kids standing on each others shoulders in a trench coat and trying to order alcohol.

    • Zink@programming.dev
      link
      fedilink
      arrow-up
      5
      ·
      3 days ago

      The clankers will never sway me from my em dashes, my oxford commas, and my semicolons; they are my precious.

  • daniskarma@lemmy.dbzer0.com
    link
    fedilink
    arrow-up
    17
    arrow-down
    1
    ·
    3 days ago

    The old witchcraft trial.

    If the paper is so badly written that it fails then it will be declared AI-free. (If she drowns then she wasn’t a witch)

    • VitoRobles@lemmy.today
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 days ago

      I joined a counterstrike server for newbs to practice with bots. Apparently people thought I was a bot because I sucked so badly.