Page is a not externally linkable
- Local
-- Foo
---- Attack of the Robots, Spiders, Crawlers.etc


keno - 6:49 am on Nov 30, 2005 (gmt 0)


It is now very frustrating that I must look for answers to technical questions outside of Webmasterworld, and I can’t find stuff that I know is here somewhere. I can post a redundant question on the board, but I don’t like waiting around for an answer, which I may never get, so I like to go searching instead. Oh – and I do post per WW guidelines.

While I have all your attention, I would like to search the supporters’ forum too. It is a huge waste of resource just sitting there, and it doesn’t make any sense to me.

The main reason for my post is that while paging back through this thread there was mention of 2K page views per user per day in some cases.

Then someone said turn off the auto-page-loader thingy, which I suppose is the click I hear every few minutes from the browser.

So, I’m wondering if the auto-page-loader is on, and people really don’t have 2k page views per day, does this mean that the user search statistics might be wrong too?

It was mentioned that 1 in 1000 views, or visits, or users used the Google/Yahoo search function.( I can’t find that post anymore). But this number seems awfully low to me. Now I am only emphasizing the need for a SEARCH utility in this post because:

1.It doesn’t matter to me whether WW is plugged into Google or Yahoo. As a newb I searched for resources all over the Web and found plenty of them before I found WW in August 2005. I found SearchEngineWorld about 20 times before I found WW. And SearchEngineWorld does not have “the rest of the story”. Not even a link to Webmasterworld, and I don’t click on banner ads since 1996. So, WW was downright difficult to find anyway. It seems if you are searching for Javascript or CSS you might get here more easily.

2.Could we not maintain a Webmasterworld presence with several hundred pages, like the WW library, on the front-end. The search engines would still be able to find WW, and the junk-bots probably would not bring down a few hundred pages.

3.Build an internal search function on a mirror site that is 24 hours old or whatever. I don’t know how much resource this might cost, but that’s all I got as a suggestion given the situation.

Maybe this is the plan of action already, I don’t know. I followed the thread to a certain point and skimped over the last 10 pages or so…if there’s gold here, I need a spade.

If this wasn’t such a great site, I wouldn’t be writing this “high quality” post for the last hour…good luck with the solution, whatever it may be!


Thread source:: http://www.webmasterworld.com/foo/9618.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com