Forum Moderators: open
*****************************
Scooter (AltaVista)
Hits------- 343 + 14 in may
Bandwidth---2.13 MB + 201.75 KB in may
Last visit--10 Jun 2003 - 03:57
************************
Googlebot (Google)
Hits------- 141 + 431 in may
Bandwidth---876.26 KB + 3.15 MB in may
Last visit--09 Jun 2003 - 20:17 + 201.75 KB
***************************
Unknown robot ('crawl')
Hits------- 23 + 24
Bandwidth---450.71 KB + 450.71 KB
Last visit--13 Jun 2003 - 01:52
***************************
Alexa (IA Archiver)
Hits------- 10
Bandwidth---117.89 KB
Last visit--11 Jun 2003 - 04:12
***************************
Voila
Hits------- 6
Bandwidth---133.67 KB
Last visit--11 Jun 2003 - 13:59
***************************
Unknown robot ('robot')
Hits------- 1
Bandwidth---3.10 KB
Last visit--09 Jun 2003 - 08:55
***************************
Then i have these just below that
...#reqs..#pages..
03: 1452: 1368: Scooter
..: 1452: 1368: Scooter/3
06: 483: 483: InternetSeer.com
07: 876: 266: Googlebot
..: 876: 266: Googlebot/2
10: 91: 91: lwp-trivial
..: 91: 91: lwp-trivial/1
11: 97: 77: Marvin v0.3
12: 82: 74: libwww-perl
..: 82: 74: libwww-perl/5
14: 51: 51: Scrubby
..: 51: 51: Scrubby/2
17: 27: 27: SurveyBot
..: 27: 27: SurveyBot/2
some of the above crawlers i cannot get any info
[edited by: sajjid at 10:31 pm (utc) on June 14, 2003]
We'll need a little more info to try to help.
How long has the site been online?
Are you listed in AV at this time? You say "no listings in the search engines". If the site is brand new it might not be listed yet but will be soon... there are bots finding you.
>i had quite a few listing in google but now they all disappeared
How long have you been in Google?
>by the way i am linked to any link farms
Sorry, does this mean you are linked to link farms, or, that you are not?
[edited by: sajjid at 10:46 pm (utc) on June 14, 2003]
>Sorry, does this mean you are linked to link farms, or, that you are not?
i meant to say i am not linked to any link farms
also can can somoone please verify is this how many people i had from these sites or something else
Listing the top 30 referring sites by the number of requests, sorted by the number of requests.
#reqs: ---------site:
2035402: www.google.com/
2866: search.yahoo.com/
1634: www.google.de/
1591: www.google.fr/
1274: www.google.it/
861: www.google.ca/
803: www.google.com.au/
784: www.google.nl/
636: 216.239.37.104/
598: www.vbulletin.org/
568: www.google.co.uk/
543: www.google.com.br/
i took out few sites from above list because they were warez sites
[edited by: pageoneresults at 2:10 am (utc) on June 15, 2003]
[edit reason] Delinked Examples [/edit]
Google found your site with what is called the freshbot. It is a temporary listing usually, it will show you in the results for a while then drop you, but Google has your site and will eventually put you in the permanent index. There is a lot of info on the freshbot here that you can find by using the site search at the top of this page. For now, with both Google and AV, you will have to be patient. You will show up in them all the time after a while... be glad right now that you've been found :-)
You might want to submit to the Open Directory Project too, www.dmoz.org It can help you to get found by the other SE's.
>2035402: [google.com...]
I'm not sure that this is hits... maybe, but over 2 million... if you got that from your temporary listing in Google, it's amazing.
Hope this helps, and remember to use the site search here; answers to many of your questions will be found by using it.
ADDED: Yeah, no URL's should be posted. You should have a read of the charter for the forum. It's all very civilized. :-)
Cheers
Stefan
that sound really bad even to me what i meant was i have forums and site which is in php formatt as you know forum urls get very very long so its hard for indexers and crawlers to index these urls what i did is shorten these urls even though the urls on the site and forums are there but they dont get indexed i turned those urls into html to make them look shorter and results are good i had this problem on my preious doamin so i tried this idea and it works great.
by the way i am not cheating in any way just trying to help indexers by optimizing my site for them which in turn helps me by being listed in the search engines