Tony Bark@pawb.social to Technology@lemmy.worldEnglish · 5 days agoGoogle Using Generic & Undocumented Google Crawlerwww.seroundtable.comexternal-linkmessage-square4linkfedilinkarrow-up193arrow-down13
arrow-up190arrow-down1external-linkGoogle Using Generic & Undocumented Google Crawlerwww.seroundtable.comTony Bark@pawb.social to Technology@lemmy.worldEnglish · 5 days agomessage-square4linkfedilink
minus-squareKairos@lemmy.todaylinkfedilinkEnglisharrow-up29·5 days ago The crawler user agent is just named “Google,”
Very sneaky.