homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / UK Search and Internet Marketing News
Forum Library, Charter, Moderators: IanTurner & engine

UK Search and Internet Marketing News Forum

What SEs can now index dynamic sites

 4:16 pm on Jun 25, 2002 (gmt 0)

Many search engines currently cannot index the complicated URL strings that a database can produce, which contain symbols such as & and ?.

Does anyone know which Search Engines can register such pages.



 7:49 am on Jun 26, 2002 (gmt 0)

To my knowledge only Google and AllTheWeb/FAST/Lycos have the ability to index dynamic websites.

Oh Yeah! A possibly GigaBlast



 8:08 am on Jun 26, 2002 (gmt 0)

altavista can as well. i manually submitted some 100 or so dynamic URLs through the ransom note submission and all pages got listed. prior to these manual submissions, only static URLs for that site were listed.

don't forget that if you are on *nix server, you may be able to use mod_rewrite to convert dynamic URLs to static URLs.

plenty more threads in the forum where that came from.


 8:15 am on Jun 26, 2002 (gmt 0)

Crazy_Fool, how many parameters were there in the URL? Way back when, I'd heard Alta Vista would take them with two if hand submitted, so I tried it and they did. Did you find that limit, or were they longer?


 9:13 pm on Jun 26, 2002 (gmt 0)
marcia - urls with 1, 2 and 3 parameters were submitted back in september. the longest URL submitted would have been around 82 chars including http://. i have no idea when the URLs were first listed, but they were in the index around christmas.

i've just gone back to check altavista and most have dropped out with the recent update (last week?). i don't know if this is a respidering problem or a change of policy or something, but the altavista update seems to have screwed up a lot of listings on a lot of my domains. i'm not too worried as i wasnt getting much traffic from there anyway.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / UK Search and Internet Marketing News
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved