Welcome to WebmasterWorld Guest from 54.226.60.235

Forum Moderators: mademetop

Message Too Old, No Replies

Can anyone tell me the quickest way to get spidered

     

hpops

8:40 am on Nov 17, 2004 (gmt 0)

10+ Year Member



Sorry to ask such a basic question but I'm just starting out and haven't a clue how to get started!

Thankyou

jaffstar

9:44 am on Nov 17, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi, Welcome to Webmasterworld.

Have you added your site to Google?

[google.com...]

instinct

10:27 am on Nov 17, 2004 (gmt 0)

10+ Year Member



Get tons of incomming links to your site as well.

jaffstar

11:01 am on Nov 17, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The list goes on....

Add robots.txt, make pages are html and not dynamic, include a sitemap.

hpops

11:50 am on Nov 17, 2004 (gmt 0)

10+ Year Member



thanx for the tips - what does add robot.txt mean?

Old Welsh Guy

4:21 pm on Nov 17, 2004 (gmt 0)

Accelerator

8:49 pm on Nov 18, 2004 (gmt 0)

10+ Year Member



The quickest way to get spidered by Google is by getting a link to your site from another site that is already indexed by Google.

You can tell whether a site is indexed by Google by installing the free Google toolbar from Google (an invaluable tool for those involved in site promotion as it shows Google Page Rank values!)

I_Brian

9:06 pm on Nov 18, 2004 (gmt 0)

10+ Year Member



Get listed in a ton of SE friendly directories - there's a good compilation of resources here at the SEW forums:

[snip]

That should help get your started. :)

[edited by: pageoneresults at 5:31 pm (utc) on Nov. 21, 2004]
[edit reason] Removed URI Reference - Please Refer to TOS [/edit]

httpwebwitch

4:46 am on Nov 21, 2004 (gmt 0)

WebmasterWorld Administrator httpwebwitch is a WebmasterWorld Top Contributor of All Time 10+ Year Member



nope.

the fastest way to get spidered is to throw a couple of free adsense ads on your page.

G needs to index your page in order to show relevant ads. The first time you load the ads, you'll see a PSA. Then you can expect G will send a secret agent over to check you out pronto - sometimes within seconds.

 

Featured Threads

Hot Threads This Week

Hot Threads This Month