Ignacio@lemmy.ml to Technology@lemmy.ml · 2 years agoDisallow GPTBot to access your siteplatform.openai.comexternal-linkmessage-square10fedilinkarrow-up11arrow-down10cross-posted to: privacyguides@lemmy.one
arrow-up11arrow-down1external-linkDisallow GPTBot to access your siteplatform.openai.comIgnacio@lemmy.ml to Technology@lemmy.ml · 2 years agomessage-square10fedilinkcross-posted to: privacyguides@lemmy.one
minus-squareEager Eagle@lemmy.worldlinkfedilinkEnglisharrow-up1·2 years agoOr don’t do anything. There are plenty of crawlers out there and disallowing won’t stop the unethical ones.
minus-squareZikeji@programming.devlinkfedilinkEnglisharrow-up1·2 years agoJust because some people might break into my house doesn’t mean I’ll stop locking my doors.
minus-squareEager Eagle@lemmy.worldlinkfedilinkEnglisharrow-up1·2 years agothat doesn’t lock anything, it’s not a security feature.
minus-squareArakwar@kbin.sociallinkfedilinkarrow-up1·2 years agoA house door lock isn’t that much about security either.
minus-squareZikeji@programming.devlinkfedilinkEnglisharrow-up1·2 years agoIt’s a deterrent. Which is a pretty apt comparison for robots.txt and user agent blocking.
Or don’t do anything. There are plenty of crawlers out there and disallowing won’t stop the unethical ones.
Just because some people might break into my house doesn’t mean I’ll stop locking my doors.
that doesn’t lock anything, it’s not a security feature.
A house door lock isn’t that much about security either.
It’s a deterrent. Which is a pretty apt comparison for robots.txt and user agent blocking.