Pro@programming.dev to Technology@programming.devEnglish · edit-24 months agoCodeberg: army of AI crawlers are extremely slowing us; AI crawlers learned how to solve the Anubis challenges.i.imgur.comimagemessage-square114linkfedilinkarrow-up1707file-textcross-posted to: [email protected]
arrow-up1707imageCodeberg: army of AI crawlers are extremely slowing us; AI crawlers learned how to solve the Anubis challenges.i.imgur.comPro@programming.dev to Technology@programming.devEnglish · edit-24 months agomessage-square114linkfedilinkfile-textcross-posted to: [email protected]
minus-squareF/15/[email protected]@sh.itjust.workslinkfedilinkEnglisharrow-up6·edit-24 months agoSeems like an api request would be preferable for the site you’re checking. I don’t imagine they’re unhappy with the traffic if they haven’t blocked it yet
minus-squareJPAKx4@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up2·4 months agoI mean if it’s cms site there may not be an api, this would be the only solution in that case
Seems like an api request would be preferable for the site you’re checking. I don’t imagine they’re unhappy with the traffic if they haven’t blocked it yet
I mean if it’s cms site there may not be an api, this would be the only solution in that case