UngodlyAudrey🏳️⚧️@beehaw.org to Technology@beehaw.org · 2 年前Sites scramble to block ChatGPT web crawler after instructions emergearstechnica.comexternal-linkmessage-square37fedilinkarrow-up1177arrow-down10
arrow-up1177arrow-down1external-linkSites scramble to block ChatGPT web crawler after instructions emergearstechnica.comUngodlyAudrey🏳️⚧️@beehaw.org to Technology@beehaw.org · 2 年前message-square37fedilink
minus-squareThe Doctor@beehaw.orglinkfedilinkEnglisharrow-up2·2 年前If you look in the server logs, you can see what their spiders are grabbing.
If you look in the server logs, you can see what their spiders are grabbing.