Welcome to WebmasterWorld Guest from 107.20.104.161

Forum Moderators: open

Message Too Old, No Replies

multilingual websites on ATW

only indexing first page of each language

     

a2ztranslate

10:33 pm on Sep 9, 2003 (gmt 0)

10+ Year Member



hello all

have been working on a website that is in twelve different languages.

users enter site and select language to view from textual links at top of screen (no drop down menus etc.)

each language has 8 pages. url goes www.domain/language/index

site is all static html, minimal graphics, lots and lots of content on each screen

when search on ATW for indexed urls, all the english screens are there, but only the first (/language/index) of other languages is there.

any ideas?

Rumbas

5:47 am on Sep 10, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



Hi a2ztranslate, welcome to WebmasterWorld

How old is the site? Give it at least a coule of months to get indexed.
Inbound links? Do you have 'em? At least a couple would do you good.

In general it takes time for a new site or new pages on an old site, to get in.

Have patience - good luck! :)

a2ztranslate

6:50 am on Sep 10, 2003 (gmt 0)

10+ Year Member



site has been up since Feb 2003, and have a few inbound links, but mostly from english pages. i wonder if this could eb the problem?

Rumbas

7:10 am on Sep 10, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



>few inbound links, but mostly from english pages. i wonder if this could eb the problem?

Probably not. A link is a link and should get the spider to crawl your site.

Linking struckture is valid? Eg. links are in href format (no javascript etc.?)

Try checking it with the Sim SPider: [searchengineworld.com...]

vitaplease

7:41 am on Sep 10, 2003 (gmt 0)

WebmasterWorld Senior Member vitaplease is a WebmasterWorld Top Contributor of All Time 10+ Year Member



a2ztranslate,

I have a similar multilingual setup, without indexing problems.
(other than Alltheweb exagerating the number of pages on my site)

If what Rumbas suggests does not help, try contacting Alltheweb. They can be very quick in helping.

a2ztranslate

9:49 am on Sep 10, 2003 (gmt 0)

10+ Year Member



thanks everyone for the advice

tried the spider suggestion, and when it goes to spider one of the lead language pages www.domain/language/index returns error code 500, meaning a timeout. sure enough, it cannot spider beyond the index page of each language. whta it does do is misread the url: instead of www.domain/language/index, it produces www.language/index.

there is no java or anything else in the site, just straight static html. got me stumped. any advice much appreciated.

Rumbas

11:26 am on Sep 10, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



>instead of www.domain/language/index, it produces www.language/index

Are you using absolute URL's http://www.domain.com/language/page.html or just relative /language/page.html in your HTML?

You should be using absolute or at least insert a base href link:

<base href="http://www.domain.com/">
to tell the spider the root domain.

Try that and put the Sim Spider on it again.

heini

11:51 am on Sep 10, 2003 (gmt 0)

WebmasterWorld Senior Member heini is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Wonder if other engines were able to spider the pages? It certainly sounds like an error in the code though.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month