Bots and Spiders?

Post Reply
User avatar
Pete
Power User
Power User
Posts: 1599
Joined: Mon Jun 11, 2007 7:26 am
Location: Navarre - Hidden Creek Estates

Mon Nov 07, 2016 9:10 am

Someone with more knowledge? - Am online and signed in - noted at the bottom the "users" statistics, as per:
Who is online
In total there are 23 users online :: 5 registered, 0 hidden and 18 guests (based on users active over the past 5 minutes)
Most users ever online was 152 on Sat May 23, 2009 6:32 am

Registered users: Baidu [Spider], Bing [Bot], Google Adsense [Bot], Pete, Yahoo [Bot]
Legend: Administrators, Global moderators
Spiders and Bots (not sure the difference?) - as "registered users"??? Hope not a threat.
Cheers, Pete
Go Vikings!
User avatar
AngelGirl
Power User
Power User
Posts: 7079
Joined: Sun Aug 27, 2006 5:12 pm
Location: The Rose Capital of the USA

Mon Nov 07, 2016 2:37 pm

Pete, as I understand it ... and I'm WAAAY not the professional here (so, probably BJ will be able to answer more succinctly than I) but maybe to assuage your concern ... these are like "search engines" for various stuff like "google", etc., for gathering the stats we see attributed to them or other search engines. Anyway, they are there all the time but I only just noticed them about 18 months ago.

LOL
AngelGirl
Navarre Beach Life Moderator
Image

Once again, Jesus spoke to the people and said, "I am the light of the world. Whoever follows Me will never walk in the darkness, but will have the light of life." John 8:12 BSB
User avatar
Kenny Wilder
Power User
Power User
Posts: 6976
Joined: Thu Aug 24, 2006 3:52 pm
Location: Navarre, Florida
Contact:

Mon Nov 07, 2016 3:17 pm

Pete wrote:Someone with more knowledge? - Am online and signed in - noted at the bottom the "users" statistics, as per:
Who is online
In total there are 23 users online :: 5 registered, 0 hidden and 18 guests (based on users active over the past 5 minutes)
Most users ever online was 152 on Sat May 23, 2009 6:32 am

Registered users: Baidu [Spider], Bing [Bot], Google Adsense [Bot], Pete, Yahoo [Bot]
Legend: Administrators, Global moderators
Spiders and Bots (not sure the difference?) - as "registered users"??? Hope not a threat.
Just normal search engines indexing my website 24/7.
Kenny Wilder
NavarreBeachLife.com ~ Owner/Administrator
Constitutional Conservative
Florida Master Naturalist ~ Coastal Systems and Wetlands
Forum Rules and Regulations (Terms of Service)
Are You Going to Heaven?
User avatar
bjrichus
Power User
Power User
Posts: 2293
Joined: Thu Jun 14, 2012 12:28 pm
Location: Looking forward to the next trip to Navarre Beach! WOO HOO!

Mon Nov 07, 2016 9:29 pm

Kenny Wilder wrote:
Pete wrote:Someone with more knowledge? - Am online and signed in - noted at the bottom the "users" statistics, as per:
Who is online
In total there are 23 users online :: 5 registered, 0 hidden and 18 guests (based on users active over the past 5 minutes)
Most users ever online was 152 on Sat May 23, 2009 6:32 am

Registered users: Baidu [Spider], Bing [Bot], Google Adsense [Bot], Pete, Yahoo [Bot]
Legend: Administrators, Global moderators
Spiders and Bots (not sure the difference?) - as "registered users"??? Hope not a threat.
Just normal search engines indexing my website 24/7.
To quote: http://whatis.techtarget.com/definition/spider

"A spider is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. The major search engines on the Web all have such a program, which is also known as a "crawler" or a "bot." Spiders are typically programmed to visit sites that have been submitted by their owners as new or updated. Entire sites or specific pages can be selectively visited and indexed. Spiders are called spiders because they usually visit many sites in parallel at the same time, their "legs" spanning a large area of the "web." Spiders can crawl through a site's pages in several ways. One way is to follow all the hypertext links in each page until all the pages have been read.

The spider for the AltaVista search engine and its Web site is called Scooter . Scooter adheres to the rules of politeness for Web spiders that are specified in the Standard for Robot Exclusion (SRE). It asks each server which files should be excluded from being indexed. It does not (or can not) go through firewalls. And it uses a special algorithm for waiting between successive server requests so that it doesn't affect response time for other users."

If you ever read about something called "Search Engine Optimization" (or SEO), it is all about making the spider programs think your particular web page or site is the best thing possible in a particular subject area (adding meaningful and relevant keywords for example), so that it rises in the listings and appears higher up, so you the user sees it first and is more likely to click on the links to it. Of course, if you pay, you can get the much desired top few spots on the first page of results that the likes of Google display... They are supposed to put them up with a grey background to them. Its all a big business.
bjrichus (also known as Brian)
NavarreBeachLife.com Moderator
User avatar
Pete
Power User
Power User
Posts: 1599
Joined: Mon Jun 11, 2007 7:26 am
Location: Navarre - Hidden Creek Estates

Tue Nov 08, 2016 7:04 am

Thanks - all!
Cheers, Pete
Go Vikings!
Post Reply

Return to “Administrator Announcements”