Sponsor for PC Pals Forum

Author Topic: GoogleCrawler  (Read 450 times)

Offline Reno

  • Established Member
  • ****
  • Posts: 1294
  • bob
« on: April 30, 2004, 05:50 »
I installed a new integration in my php board to allow me to crosscheck ips with members list. I was getting curious about the strange amount of guest coming to the gm. When i first looked at a couple of the guest one was a member that hadn't logged in yet and the other was called [ crawler3.googlebot.com ] [ crawler4.googlebot.com ]

I did a google search and found that other people had recorded getting this ip on their site. Is this a tactic google uses to find new sites? Or something altogether different and something to worry about?


  • Guest
« Reply #1 on: April 30, 2004, 07:05 »
It's nothing to worry about Bob. We often see search engines crawling PC-Pals.

As I understand it, Google has many many servers crawling the net at any one time. It is not unusual for a few of these to hit your site at the same time, hence the multiple gooblebot IP addresses.

Show unread posts since last visit.
Sponsor for PC Pals Forum