• David Gerard@awful.systems
      shield
      OPM
      link
      fedilink
      English
      arrow-up
      0
      ·
      14 days ago

      this user has been removed for commenting without reading the article

      being from programming dot dev is just the turd on top

    • blakestacey@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      14 days ago

      Paragraph 2:

      METR funded 16 experienced open-source developers with “moderate AI experience” to do what they do.

      • HedyL@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        14 days ago

        … and just a few paragraphs further down:

        The number of people tested in the study was n=16. That’s a small number. But it’s a lot better than the usual AI coding promotion, where n=1 ’cos it’s just one guy saying “I’m so much faster now, trust me bro. No, I didn’t measure it.”

        I wouldn’t call that “burying information”.

    • Feyd@programming.dev
      link
      fedilink
      English
      arrow-up
      0
      ·
      14 days ago

      You’re acting like this is a gotcha when it’s actually probably the most rigorous study of AI tool productivity change to date.