Forum Moderators: open

Message Too Old, No Replies

Crawling

crawl website google

         

mfuursted

12:16 pm on May 30, 2004 (gmt 0)

10+ Year Member



Hey, Everybody at Webmasterworld. This is no doubt the coolest place in the world. I'm from Denmark and I'm new in the SEO world :-)

I have a website which is in Google (not a good ranking yet), but it's only the main page. None of the other sites are to be found in google. Why is that?

I also have a question about linkpopularity. Should incomming link be directed to the main page or to any of the other pages, depending on the keyword?

Marcel

PS. Sorry if it's dificult to read. But as I said; I'm dansih :-)

shady

2:19 pm on May 30, 2004 (gmt 0)

10+ Year Member



Your English is great but I think that you being "dansih" may be a little confusing ;-)

Assuming you have a good link structure to your site, links coming in to subpages is fine in my opinion because ranking will pass up to your homepage from these pages and these pages should be more specific to the traffic coming in.

None of the other sites are to be found in google

Do these have inward links to them? Has google crawled them yet? How old are they?

Regards
Shady

<edited>for spelling!</editing>

mfuursted

2:53 pm on May 30, 2004 (gmt 0)

10+ Year Member



Hey Shady, and thanks for your reply.

The only inward links are form the mainpage... No others... I have no idea how to see if any bots have crawled the subpages. I can only see that it have crawlet my domain, I'm affraid. It's just wird that it only takes the mainpage.

Hehe... I meant danish, but you propably figured that out ;-)

shady

3:09 pm on May 30, 2004 (gmt 0)

10+ Year Member



I am a little confused!

You have a website in google and you have other sites which are not. Are you saying that you are linking to the homepage of the other sites from the site which is listed in google?

You need to look at the raw logs. Do you have a cpanel account or a different kind?

mfuursted

3:20 pm on May 30, 2004 (gmt 0)

10+ Year Member



Hehe... I can understand why you're confused. I'm pretty confused my self...

This has only to do with ONE page. This page has several subpages (www.mydoman.com/subpage1.html) and it is these pages which is not crawlet by google... The mainpage (www.mydoman.com) links to these other pages, and vice versa (or how to spell it :-) )... Is this normal?

mfuursted

3:20 pm on May 30, 2004 (gmt 0)

10+ Year Member



both places it was to be spelled as mydomain.com :-)

DerekH

4:25 pm on May 30, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Welcome to WebmasterWorld mfuursted

Google tends to crawl a site from the top down. The deeper into a site, the less links there will usually be to the page...
The homepage for example, will have links from outside the site, and may well have links from many of the interior pages too.
Some of the interior pages, by contrast, may only be accessible from other interior pages.

All this combines to make it the case that Google will generally crawl your homepage much more frequently (at least initially) than any of the pages in your site. Gradually, though, the other pages will be picked up.

Many webmasters - myself included - use a "What's New" page, readily accessible from the home page - to list interior pages as they are added.
One of my sites has a home page that is crawled virtually every day. The What's New is crawled several times a week. New pages can then be picked up fairly quickly.
New pages that I add that I *don't* put on the What's New (for example because they are simply extra information about some obscure article deep in the website) can take a couple of months to be indexed.

RIght now, make your site more easy to find by Google, and more of it will be visited more often...
DerekH

kwasher

5:15 pm on May 30, 2004 (gmt 0)

10+ Year Member



Welcome! Long live the Dansih! (smile... I didnt even notice until someone pointed it out... I must read dyslexic-like)

Anyway, If its a new site, search the forums on the word 'sandbox' .