Welcome to WebmasterWorld Guest from

Forum Moderators: martinibuster

Message Too Old, No Replies

A question of hubs

Bringing posts together and answering questions...

6:11 pm on Jun 13, 2001 (gmt 0)

In response to the email I get from my posts on hubs Iím starting this discussion to bring them together and answer some of the terrific questions I receive that I feel will benefit anyone interested. Iím also really hoping that others of you with experience on these issues will jump in and share your views, experiences and ideas with the group. All technical support available will truly be appreciated.

A disclaimer right up front. I do not want to turn this into a promotional list of products people use to make this happen but I do encourage participation from companies with products. There are rules governing this so read them first before posting. Be sure that if you do join in your URL is in your profile. Also, sticky mail and email are great but Iím hoping we can keep much of the information in front of the public with this discussion. If you are gameÖ here goes.

To even begin I suggest you become familiar with previous posts that Iíve participated in that relate to this topic.

Themes part 1
Themes part 2
Discussions on canonicals and links
DMOZ Clones

Iím sure there some here that Iíve missed so if you find one that should be included, please post.

After you read through these youíll see that I use ODP for my search and creating my directory although I do customize the results. To find out more about using ODP for this must-reads include:

Many of the questions I get revolve around using ODP and technical issues. I am not a technical guru but I do have access to one professional and he is worth every penny. If you purchase a product make sure they have great technical support. Here are random answers to questions Iíve received.

It appears to be a googlebot thing as I've seen it now on different hubs I've created, on different servers, using different scripts. It appears that Googlebot leaves a cache behind with every hit. I have never seen anyone anywhere talk about this. Last spider I was getting hit with 25,000 to 38,000 hits a day from googlebot. This can be a huge problem. Through Anaconda and with technical support we were able to set up a purge so I can click a link and purge the cache left by googlebot. Not knowing this can cause severe memory problems on your server. Googlebot hits me nearly every day. Last month there were only four days I wasn't visited by googlebot. I found my sister site was also receiving more googlebot visits than others appeared to be. This appears to be a good thing.

I've created two hubs now using dmoz. My present hub has 43,700 pages indexed and nearly all of those pages are due to the dmoz info. I think it's perfect because you can recreate your own directory to point to related categories but they appear to be your own. I have dynamic URLís for the search function but we were able to modify the categories to include cgi but no Ď?í.

To prevent unrelated oddball searches coming up in the log files we have been narrowing the search options we offer using the dmoz info. This is important if we want to stay on theme. I would rather have 4,000 pages of the hub on Google that are on theme than the 40,000 plus with many unrelated. This is an area I am still working on and welcome any technical support from people experienced with this.

I do not actually store the dump on my server. That's what Anaconda is about or any of the POD or ODP++ scripts. I'm unfortunately not as techie as I would like to be. Here are a few more resources you can check out for this:

Upload_Tools [dmoz.org]

I tried to go through my email and collect answers to most of the common questions I receive. I hope this helps and we can continue to discuss this. I am not an expert on this but I have over a year of experience now with research into development. There are experts among us and I certainly hope they jump in.

5:34 pm on Jan 28, 2002 (gmt 0)

Can someone share a site with a good hub? I am a little confused about how a hub works.
11:41 pm on Jan 30, 2002 (gmt 0)

I think this
is a very good example of a hub. It's educational so I don't think it will hurt to share it. It does not use canonicals. It does have a fairly good structure, nice search features, tons of great resources and references, good content rich descriptions for the website references.

Nice topical hub, themed for the subject. Good search feature in the products section, lots of resources and references for cycling enthusiasts. I would have set this one up with canonicals if it were mine. With canonicals it would theme really well and the added linking possibilities in my humble estimation would be amazing.

There are so many great hubs. Iíve been asked for examples and Brett said it was up to my discretion so I selected these. I have another that I hope to share in a few weeks that utilize canonicals. I hope that will serve then as a good example of a themed canonical hub. Until then I hope these two examples help.

1:09 am on Jan 31, 2002 (gmt 0)

10+ Year Member

Thanks, paynt! Nothing works better than good examples.
This 33 message thread spans 2 pages: 33

Featured Threads

Hot Threads This Week

Hot Threads This Month