homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / WebmasterWorld / New To Web Development
Forum Library, Charter, Moderators: brotherhood of lan & mack

New To Web Development Forum

Can't get indexed by Google
I've tried everything I know but can't get properly indexed & spidered

 8:44 pm on Dec 11, 2003 (gmt 0)

I've tried everything I know & read but I can't seem to get my site indexed & spidered by Google. I'm not after page rank yet, just getting spidered would be a start.

I moved my domain to a new host, and submitted manually to google. My home page got registered in a couple of days (eg: when I typed "Directives Enterprises" in google, it appeared), but it didn't seem to get spidered as no other pages ever showed up. Now even this search fails to show up anything.

My only suspicion is that the host I use [snip] makes me put my html files under a subdirectory (/mainwebsite_html) and perhaps the spider is not finding my files.

I'd tear my hair out if I actually had any :)

[edited by: JamesR at 9:06 pm (utc) on Dec. 11, 2003]
[edit reason] please, no URLs per TOS [/edit]



 8:58 pm on Dec 11, 2003 (gmt 0)

if you do search for your website on google it shows your topic and description which means google knows you.

it takes time to get into google. especially after florida update they are strange things going on in google world. be patient and try submitting your website to some other directories and search engines

also welcome to webmaster world :)


 9:09 pm on Dec 11, 2003 (gmt 0)

Hi direct one, welcome to WebmasterWorld

Please take a look through the Google forum [webmasterworld.com] for help on your question. There is a lot of good help in there.


 9:10 pm on Dec 11, 2003 (gmt 0)

What search terms did you use to find my site. I can't see it in google at all


 9:17 pm on Dec 11, 2003 (gmt 0)

As Nermin said it takes a bit of time, but I'd guess your best bet is to get a few deep links (to your content pages rather than just the home page) on pages that a frequently visited by google, put up a simple HTML site map accessible from your home page to make sure all your pages are found. It's also quite common for a site to pop up and then disappear for a couple of days, I've got one I've just launched that I'm waiting to re-appear!

Perhaps it's also worth running a spider simulator on your site to make sure a spider can pick up your site navigation - there's one on this sites sister site www.searchengineworld.com.

Hope that's of some help, and welcome to WebMasterWorld!

[edited by: mcavill at 9:18 pm (utc) on Dec. 11, 2003]


 9:17 pm on Dec 11, 2003 (gmt 0)


this one will give you a good idea as well



 9:57 pm on Dec 11, 2003 (gmt 0)

Hi direct_one - welcome to WebmasterWorld.

I would just encourage you to be patient. I also just opened a web site for our home-based business (my "night" job) :), and the home page appears in Google one day ... and is gone the next. There's no rhyme or reason to it. Google just seems to be doing a lot of maintenance under the hood these days.....when things settle down, I hope my site (and yours) would be in there permanently.

Good luck.


 10:15 pm on Dec 11, 2003 (gmt 0)

So I went and tried the spider simulator. Interesting. It works it's way thru my site and finds all the pages.
<but> it reports each page's url without the site's name (ie: just http:// followed by the file name pr_dtb.html/) so if I actually click on these links, they fail.

If I use the spider simulator on a regular site (eg searchengineworld) each page returned includes has a fully realised URL.

Shannon Moore

 1:31 am on Dec 12, 2003 (gmt 0)

Seems fine to me...assuming I looked and sim-spidered the correct site (you in Australia?)

I'd pursue the deep links that were suggested above and focus on ensuring there's good, useful content available when the spiders come crawling. Spiders like fresh food, best. :)

Global Options:
 top home search open messages active posts  

Home / Forums Index / WebmasterWorld / New To Web Development
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved