Forum Moderators: phranque
I have an rss.xml file that is dynamically generated the same way.
I noticed that my archives were not being indexed. The archive link was http://www.example.com/stories.html?s=74 where 74 is the rowid and varies.
Google only had a link to the content on the front page and in the rss.xml file.
I read that dynamic content is not indexed as well as straight directories and that using a mod_rewrite is better because you can create a directory structure that is search engine friendly. So I worked out a redirect that allows the urls to be http://www.example.com/stories/74/ in the hopes that the posts would be indexed in search engines.
I have noticed that new posts now show up at http://www.example.com/ but do not show up in http://www.example.com/stories/##/.
My concern is that the work that I have done will make no difference and that the articles that fall off the front page and the xml file will not be indexed.
At the bottom of each post on the front page, I have added a link that says 'permanent link: article name' with a link to the permanent link (http://www.example.com/stories/88/) in the hopes that will attract the engine.
Additionally, I am using guid in the xml file.
This work has all been done in the last 6 days. Am I just being impatient? Help me before I obsess my head off!
[edited by: pageoneresults at 10:33 pm (utc) on April 10, 2006]
[edit reason] Examplified URI References [/edit]
Are older articles linked to from anywhere on the site after they leave the homepage? It might be a good idea to setup a sitemap or archive page, that will like to all your old articles. Another way to ensure that the URLs get noticed would be to submit a Google sitemap, although that would only work for Google.
Chad
Are older articles linked to from anywhere on the site after they leave the homepage? It might be a good idea to setup a sitemap or archive page, that will like to all your old articles.
Yes. There is an archive page that lists every post by month. There are about 60 links.
Another way to ensure that the URLs get noticed would be to submit a Google sitemap, although that would only work for Google.
Although I had submitted a sitemap to google, I had an error in it for about 2 weeks. I updated the sitemap correctly about 5 days ago. Once it was correct I submitted a texturl to yahoo.
The last step is tricky -- you have to use the {THE_REQUEST} variable in a mod_rewrite RewriteCond to avoid an 'infinite loop' with the code for step 2. Several examples are posted in threads in this forum.
Then wait at least 30 days for results in big G.
Jim
Change *all* links on the site to the static /stories/74/ format (edit the links or modify the script that generates them).
done!
Internally rewrite (not redirect) incoming requests for those static URLs to the proper dynamic format needed by your script.
If I understand you correctly, this is done also. My understanding would be that the server returns the information to the browser without telling the browser to go to another location. This means that stories/74 doesn't get redirected to stories/therealfiles/showfile.php?s=74 or something. Instead, the server rewrites and sends the information without the redirect. Sound about write?
Externally redirect any direct client requests for the dynamic URLs to the static equivalent.
This is to say that if someone is still going to the old [domain.com...] I respond to that by redirecting them to [domain.com...]
The last step is tricky -- you have to use the {THE_REQUEST} variable in a mod_rewrite RewriteCond to avoid an 'infinite loop' with the code for step 2. Several examples are posted in threads in this forum.
Done with no infinite loops.
Then wait at least 30 days for results in big G.
Aye, there's the rub. Apparently it is the wait part that I can't handle. I need to leave all this stuff alone is what I am hearing, and see how it looks end of May?
Of course, you could add:
127.0.0.1 google.com
Since you've got a while to wait, do invest the time in thorough testing, so you don't end up having to fix some bug and start the 30-day clock over again...
Jim