Forum Moderators: Robert Charlton & goodroi
For the last few years I have only dealt with static html pages and in the last few months have regularly put new sites up that get all their pages indexed after a few days. The pattern is usually as follows:
1) 50 page site uploaded
2) 3 or 4 low pr links in from directories.
3) 2-3 days later home page is indexed
4) 3- 7 days later all pages indexed.
8 weeks ago I put up a new site which is all asp pages, about 20 in all. I figured perhaps pr would need to be higher so that the spider would go deeper, so I have gradually added a few more links over the weeks, with a few pr5 on theme links going in recently. The pages urls are [sitename.com...] etc. with no?id=. No effect. So I changed some of the pages to .html ones with the asp content feeding in server side. No effect. I still only have the home and one other page indexed. I introduced an include file to prevent non www pages loading and turned them into www pages (as someone linked without using the www.).... still no indexing of deeper pages.
There is a simple path for the spider to follow with hard links. The pages load reasonably fast, about 6 seconds. Some of the titles are identical but not all. There is unique content in good volume on each page.
Anybody else had experience of getting an asp site indexed quickly or had problems?
Some of the titles are identical but not all.
Are you sure the missing pages haven't just been omitted from the site: command list?
page.asp?id=123
page.asp?id=123&page=2
But NOT:
page.asp?page=2&id=123
page.asp?sid=dsh57fjhre934rkf9kj49fkg40fr4ty4tt
page.asp?id=dsh57fjhre934rkf9kj49fkg40fr4ty4tt
page.asp?sid=123
What you are missing is more back links. The more page you have on the site the more back links that are needed to support it.
Also link to all your new pages from a top level page like from the homepage is best.
good luck.
petehall
Home page shows with one other kicking in as omitted.
Johan007
>No need to change to .html.
I agree, I was just desperately fiddling!
>What you are missing is more back links.
Possibly, but I am sure if I had put up a static site the spider would have taken all the pages by now. Once an asp site has been indexed with acceptable url strings then it can compete with any site. But could the initial indexing of an asp site require a significantly higher or better quality links?
>Also link to all your new pages from a top level page like from the homepage is best.
There are 10 links from the home page and only one has been indexed. 5 of these have the same title (name of site), 5 have unique titles. All have very unique content.
[webmasterworld.com...]
I was thinking about that. It seems to do no harm so I will give it a go..... thanks.
I just set up 'sitemaps' and suddenly I have 10 pages listed!
Probably coincidence but 10 minutes earlier I had 2.
Spooky coincidence?
I usually do very simple static sites, but asp presented some problems which I think I addressed....
1) Default.htm and index.htm both present, so I changed all internal links to point to www.domain.com/ which is in keeping with all other external links. There is no index.htm just default.htm on the server.
2) Made sure the urls had no id? stuff. I suspect you need high pr before a spider will go down this path.
3) Threw in a few static .htm pages to create more links to deeper asp pages.
4) Gradual increase of links and made sure content was unique.
5) Only let the spider access a small amount of pages. I did not deny the spider access, just made only a few links visible for it to follow. I can now increase the number of links and thus let the site grow slowly.
No idea if all this was good or pointless... but things are finally moving forward.
I'm also cleaning up default.asp from my asp site links as well from sitemap.xml leaving only clean dir structure.
Everything will soon be transferred to CMS which will use same dir structure so no loss there.
Don't normally do 1) (never have more than 1 type of default page), already done 2), might try 3)+ 4). As for 5), I deliberately set up some direct links to the search results pages, one of which has been picked up by G but as url-only. Only 2 other pages indexed - index.asp and another page which is mainly text. There are also a few links direct to property pages (it's a vacation property site) but so far ignored. Site's been around for about a year. Luckily the owner isn't too bothered that the "natural" traffic is low for the moment, but she's also using Google sponsored links.
Must be a backlink PR thing. I recently revamped a site from a 2-page Flash site to a 100-page ASP.net site and G swallowed the lot almost immediately. Their backlinks were(are) better quality I think.
I suspect you need high pr before a spider will go down this path.
Yes that maybe true in my experience too, however anything over PR4 would be just fine.
