Page 1 of 1

google bot

Posted: Tue Feb 27, 2018 10:06 am
by Rivermanfan
Hey, kinda a random question. When I look down at the list of who's on this site, oftentimes "googlebot" is listed as a user. I'm guessing that is not a real user name. How does a bot get an account? Just curious.

Re: google bot

Posted: Tue Feb 27, 2018 10:52 am
by JMC-STL
I don't believe the bot owners/services have an account per se; they are simply allowed access according to the control settings established by the webpage owner. The owner of a webpage/site can control which bots (including Googlebot) can access the owner's content and restrict the extent of the bots' intrusion. Webpage owners benefit from allowing bot access by generation of increased e-traffic for their site; this benefit is provided by the bots creating indexes of webpage content that are then searched by internet users.

Re: google bot

Posted: Thu Mar 01, 2018 7:37 am
by T.C.
yeah, google's indexing spider. forum software has profiles of most known indexing engines and displays them. and yes, i could block certain ones or all of them if i wanted to.