Author Topic: [Bots]?  (Read 510 times)

SSY

  • Pretty Sure the Black Cat Isn't in the Dark Room
  • ****
  • Posts: 1181
[Bots]?
« on: March 01, 2009, 05:29:05 AM »
On the active users panel at the bottom of the forum, I often see things like Yahoo [Bot] and MSN [Bot], what are these?

Are they do to with increasing a pages search rank? Are the cataloguing the site for their cached database? Whenever I see bot, I autmatically think "Spambot", but this is obviously not the case here.

All help appreciated.
Quote from: "Godschild"
SSY: You are fairly smart and to think I thought you were a few fries short of a happy meal.
Quote from: "Godschild"
explain to them how and why you decided to be athiest and take the consequences that come along with it
Quote from: "Aedus"
Unlike atheists, I'm not an angry prick

Tom62

  • Global Moderator
  • Blessing Her Holy Hooves
  • *****
  • Posts: 4213
  • Gender: Male
Re: [Bots]?
« Reply #1 on: March 01, 2009, 08:40:23 AM »
I think that they are part of of Christian conspiracy against atheist.  They are keeping an eye on us  :evil:
The universe never did make sense; I suspect it was built on government contract.
Robert A. Heinlein

Whitney

  • Global Moderator
  • Don't Pray in My School, and I Won't Think in Your Church
  • *****
  • Posts: 7358
  • Gender: Female
  • Mysteriously Absent - Like God
    • http://fellowshipoffreethought.org
Re: [Bots]?
« Reply #2 on: March 01, 2009, 06:07:37 PM »
Search engines send out web crawlers (bots) which crawl web sites in search of either relevant content for ads or search result listings.

PHPBB3 has it set up by default to list these bots in the who's online list.  Each known bot has permissions similar to other users.  This allows me to keep them from crawling private areas of the site.  My guess is that when I edit the bot  permission settings it automatically edits the robot.txt file for the site (a file typically used to inform web crawlers what they should and should not look at).

SSY

  • Pretty Sure the Black Cat Isn't in the Dark Room
  • ****
  • Posts: 1181
Re: [Bots]?
« Reply #3 on: March 02, 2009, 01:15:43 AM »
Much clearer now, thanks.

Also, one of the ads I got the other day was for an exlcusivley Muslim Matrimonial website, those guys don't mess about when it comes to love!
Quote from: "Godschild"
SSY: You are fairly smart and to think I thought you were a few fries short of a happy meal.
Quote from: "Godschild"
explain to them how and why you decided to be athiest and take the consequences that come along with it
Quote from: "Aedus"
Unlike atheists, I'm not an angry prick