Forum Moderators: open

Message Too Old, No Replies

Googles Deep Crawl?

         

CodeXXX

1:21 pm on May 28, 2003 (gmt 0)

10+ Year Member



Can I ask what more I can do to improve my website so google will deep crawl and look over my entire site.

I have fixed URL's so they are www.example.com/page/news
Each page is like that and contains lots of content regarding the subject; I have also included this statement in the Meta tags

<META NAME="revisit-after" CONTENT="4 days">
<META NAME="robots" CONTENT="FOLLOW,INDEX">

What else might I do? My site has been up for 6 months and still reads in googles index.

ps. apologies for posting my websites link before.

Matti

1:45 pm on May 28, 2003 (gmt 0)

10+ Year Member



"What else might I do?"

Read the forum charter, read the FAQ and then read some of the thousands of posts that have been written here about the subject. Use the search function when you are wondering about something that isn't included in the FAQ - chances are high that your question has already been answered in a previous thread. :)

A good place to start when you've read the FAQ is this terrific thread started by Brett:
[webmasterworld.com...]

CodeXXX

1:50 pm on May 28, 2003 (gmt 0)

10+ Year Member



Thanks, but before I even signed up to this forum I have read posts for at least 2months trying to fix my website so google will index it, I have achieved a lot but still out of luck.

jimbeetle

1:51 pm on May 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



You can get rid of the meta tags, the first is mostly ignored and the second is unnecessary.

The most important thing for a bot to crawl your entire site is providing spiderable links to your interior pages.

Any links in on-page Javascript, such as for rollover menus, can give googlebot problems (though it is supposed to be getting better at following these). And G-bot will not follow any links in external Javascript files.

A good site map is one way to be sure spiders can find all of your pages. Link to it at least from the main page or in a footer or header common to all pages. Depending on the size of the site you might want to split it into multiple pages (categories, locations, etc) to make it easy for visitors to use.

Jim

CodeXXX

1:59 pm on May 28, 2003 (gmt 0)

10+ Year Member



Thanks for the tips; my main linkage is an image with heaps of mapping. But the mapping is all at the bottom of the html, would it be ok if I posted a link to my html, since my only space on the web is my website "I don’t want my topic removed as before so please tell me if its a no no to make my link visible"

Thank you.

Macguru

2:10 pm on May 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I just want to confirm Googlebot can follow links in any rollover scripts since I do this job. Writing relevant ALT and Title tags in rollover JS can help both the page and target pages. What GB cannot follow is JS drop down menus not using on page layers.

I will add 3 things :

Get more links from outside.
Add new content every day.
Try to keep your all your pages inside a max. of 3 folder deep structure.

<added> We try to avoid specifics as much as possible. more on image maps later...</added>

Macguru

2:46 pm on May 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Found a good one about image maps :

[webmasterworld.com...]

GB wont have problems crawling it. You can improve link text using Title = keyword in the <a> tag. But, as far as I know, this wont improve deep "crawlability".