Welcome to WebmasterWorld Guest from

Forum Moderators: phranque

Message Too Old, No Replies

How can I make blog spiders think my site is a blog?

Any way to spoof them?

4:13 am on Jun 27, 2005 (gmt 0)

Full Member

10+ Year Member

joined:Apr 21, 2004
votes: 0

About a year ago I set up some blog software on one of my sites, but I later decided that it wasn't going to fit into the site.

I'm still getting hits from "rojo" at the location where that software was installed; despite the fact that it gets a 404 every time that doesn't seem to deter it.

How can I get these blog spiders to hit my site without installing moveable type / blogger api / typepad? My site is essentially a blog, but I couldn't find any packages that gave me what I wanted without a whole bunch of other stuff. I found it easier to make my own barebones CMS/blog.

Are these spiders looking at XML or are they looking at everything on the page? If I put up a 301 from the 404 they're hitting, is it possible that they would index my site?

Any other tips on how to get a custom-designed "blog" into all those blog directories?

10:39 pm on June 28, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 27, 2001
votes: 0

I don't know exactly but I'd think that you need an RSS feed and then you could tell all of the major sites that have blog crawlers the location of it. This is just a guess really though... any bloggers care to comment?
4:41 am on July 1, 2005 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 1, 2004
votes: 0

You need a single page with a consistent and repeating layout, e.g,


and you need an entire new section every day. Eventually you'll even get Google spidering your site every day.