Welcome to WebmasterWorld Guest from

Forum Moderators: phranque

Message Too Old, No Replies

How can I make blog spiders think my site is a blog?

Any way to spoof them?



4:13 am on Jun 27, 2005 (gmt 0)

10+ Year Member

About a year ago I set up some blog software on one of my sites, but I later decided that it wasn't going to fit into the site.

I'm still getting hits from "rojo" at the location where that software was installed; despite the fact that it gets a 404 every time that doesn't seem to deter it.

How can I get these blog spiders to hit my site without installing moveable type / blogger api / typepad? My site is essentially a blog, but I couldn't find any packages that gave me what I wanted without a whole bunch of other stuff. I found it easier to make my own barebones CMS/blog.

Are these spiders looking at XML or are they looking at everything on the page? If I put up a 301 from the 404 they're hitting, is it possible that they would index my site?

Any other tips on how to get a custom-designed "blog" into all those blog directories?


10:39 pm on Jun 28, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

I don't know exactly but I'd think that you need an RSS feed and then you could tell all of the major sites that have blog crawlers the location of it. This is just a guess really though... any bloggers care to comment?


4:41 am on Jul 1, 2005 (gmt 0)

10+ Year Member

You need a single page with a consistent and repeating layout, e.g,


and you need an entire new section every day. Eventually you'll even get Google spidering your site every day.


Featured Threads

Hot Threads This Week

Hot Threads This Month