Welcome to WebmasterWorld Guest from

Forum Moderators: brotherhood of lan & mack

Message Too Old, No Replies

Can't get indexed by Google

I've tried everything I know but can't get properly indexed & spidered



8:44 pm on Dec 11, 2003 (gmt 0)

10+ Year Member

I've tried everything I know & read but I can't seem to get my site indexed & spidered by Google. I'm not after page rank yet, just getting spidered would be a start.

I moved my domain to a new host, and submitted manually to google. My home page got registered in a couple of days (eg: when I typed "Directives Enterprises" in google, it appeared), but it didn't seem to get spidered as no other pages ever showed up. Now even this search fails to show up anything.

My only suspicion is that the host I use [snip] makes me put my html files under a subdirectory (/mainwebsite_html) and perhaps the spider is not finding my files.

I'd tear my hair out if I actually had any :)

[edited by: JamesR at 9:06 pm (utc) on Dec. 11, 2003]
[edit reason] please, no URLs per TOS [/edit]


8:58 pm on Dec 11, 2003 (gmt 0)

10+ Year Member

if you do search for your website on google it shows your topic and description which means google knows you.

it takes time to get into google. especially after florida update they are strange things going on in google world. be patient and try submitting your website to some other directories and search engines

also welcome to webmaster world :)


9:09 pm on Dec 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

Hi direct one, welcome to WebmasterWorld

Please take a look through the Google forum [webmasterworld.com] for help on your question. There is a lot of good help in there.


9:10 pm on Dec 11, 2003 (gmt 0)

10+ Year Member

What search terms did you use to find my site. I can't see it in google at all


9:17 pm on Dec 11, 2003 (gmt 0)

10+ Year Member

As Nermin said it takes a bit of time, but I'd guess your best bet is to get a few deep links (to your content pages rather than just the home page) on pages that a frequently visited by google, put up a simple HTML site map accessible from your home page to make sure all your pages are found. It's also quite common for a site to pop up and then disappear for a couple of days, I've got one I've just launched that I'm waiting to re-appear!

Perhaps it's also worth running a spider simulator on your site to make sure a spider can pick up your site navigation - there's one on this sites sister site www.searchengineworld.com.

Hope that's of some help, and welcome to WebMasterWorld!

[edited by: mcavill at 9:18 pm (utc) on Dec. 11, 2003]


9:17 pm on Dec 11, 2003 (gmt 0)

10+ Year Member


this one will give you a good idea as well



9:57 pm on Dec 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

Hi direct_one - welcome to WebmasterWorld.

I would just encourage you to be patient. I also just opened a web site for our home-based business (my "night" job) :), and the home page appears in Google one day ... and is gone the next. There's no rhyme or reason to it. Google just seems to be doing a lot of maintenance under the hood these days.....when things settle down, I hope my site (and yours) would be in there permanently.

Good luck.


10:15 pm on Dec 11, 2003 (gmt 0)

10+ Year Member

So I went and tried the spider simulator. Interesting. It works it's way thru my site and finds all the pages.
<but> it reports each page's url without the site's name (ie: just http:// followed by the file name pr_dtb.html/) so if I actually click on these links, they fail.

If I use the spider simulator on a regular site (eg searchengineworld) each page returned includes has a fully realised URL.

Shannon Moore

1:31 am on Dec 12, 2003 (gmt 0)

10+ Year Member

Seems fine to me...assuming I looked and sim-spidered the correct site (you in Australia?)

I'd pursue the deep links that were suggested above and focus on ensuring there's good, useful content available when the spiders come crawling. Spiders like fresh food, best. :)


Featured Threads

Hot Threads This Week

Hot Threads This Month