Forum Moderators: open
I have a couple quick questions on how the spider works on a site.
Let's say I go to google and enter
www.mydomain.com/page.htm instead of
www.mydomain.com
Is this ok or is it better to do just domain.com?
If I do the page.htm way and it locates say page2,3,etc will it give the best ranking to the page I submitted or circumvent that and just do domain.com?
Or does it matter? Some concern of mine are with e-commerce sites where you have the index page that is dynamic and not of much SE value put pages within the site are. Since google only wants the main url, I am wondering if I should give them domain.com which is no good or page1.htm which interlinks with the whole shabang :)
Oh, 1 last thing. Inktomi pay for spider. Does the spider hit 1 page only? I was told it will spider off into the links as well.
Thanks and glad I found this board.
I'll try to answer the first one. If you are talking about getting Google to spider your site completely so it is in the Google database, it is actually better to find other sites which are linked to your site and submit them to Google. Spiders like to find sites.
So let's say my site has a link to your site. Let's say my site is www.grnidone.com and there is a link on it to your site: www.infopub-is-cool.com. You would take the grnidone.com domain and submit it to Google so Google could find the link to your site and index your site.
Make sense?
Spidering engines like Google and AV will list all the pages they find when they crawl.
So let up say it spiders a site and finds a link to me. Is it better if it finds:
me.com
OR
me.com/page.htm (where page is of course a key phrase)
?
Also, anything wrong about submitting someone else's site? I mean what if they just submitted their site hours ago.
Thanks again. Learning alot these past weeks. Bookmarking everything on SEO I can find.
This is true of Google, but AV hasn't been very good about spidering sites for quite some time. There were some threads on this in the AV forum last year. I'd suggest that for AV and Inktomi, you first get an ODP listing, give it time to get spidered, say 30 days or so, and then submit each of the pages you'd like indexed to AV and to Inktomi... less than 5 or so a day. My experience shows that these pages get indexed well before, if ever, any pages found by spidering appear.
If you're listed in ODP, Google will find you... it's not necessary to submit.
There have been a bunch of threads about submitting someone else's site. I feel that it should be done very carefully... I'll generally only submit a site that I see already indexed, and then I'll submit the specific page that links to me.