Not listed

[Raymond]

I know I have to be patient if I want to get listed; I know I have to read up on many articles if I want to get listed; I know I have much more other work to do than just submitting my URL to google in order to get listed...

I have waited almost 4 months already. Googlebot only visited twice, first time it only visited robots.txt AND index.asp, then he left. Second time was not a crawl, he just took all my images away and he did not go into any .asp, .html...etc.

Trust me. I am a seasoned programmer and I do know what I am doing. I did no tricks to fool the bots. Every single text on my page is meant to be seen. All variables passed between forms are less 2 and there is no "id" in the variable names. I did not spam any keywords.

I seriously don't know what to do anymore. I am not talking about getting high PR and get listed in the front page in a search. My site is NOT even included when I search google using my URL except for the "Coming soon" page which I had a long time ago while I registered my domain.

Can someone share some ideas? What am I doing wrong?

Thank you.

Ray

[johnnydequino]

Ray - I have been hitting my head against the wall too, as have many here. I have about 30 pages on new content all nice and ready for google to no avail. But....

Inktomi picked up about 20 of those pages today, and I am all over MSN and soon all over Yahoo.

So I say......

Build your content, stick to the basics of good SEO and some engine will like you somewhere. =\

jd

[Raymond]

Thanks for your reply johnnydequino.

How long did it take you to get on Inktomi and MSN? Did you pay the fees for those submissions?

I am crossing my fingers on DMOZ. I submitted twice already and still no luck so far.

[webwoman]

What's your link situation? Do you have anyone linking to your site? Are you in the Yahoo directory? DMOZ?

[johnnydequino]

Raymond - I did not pay for Inktomi, they found me.

I am not listed in DMOZ either, but I have about 50-100 google PR5+ sites that are helping me with Inktomi.

Here are a few tips for better SEO that I have found helpfull - at least on Inktomi! Waiting for the next google dance to see on google:

- Only link to PR4+ sites and higher RELATED to your site.
- Use <h1> tags where possible.
- Descriptive <alt> and <title> tags.
- Content rich pages. This is the ultimate key.

Hope this helps.

jd

[Good_Vibes]

I'm having problems getting my site in as well.
Google seems to being getting weird since the May disaster.

[dnbjason]

My website went live May 15 and was being crawled within days. The key to being crawled and recrawled is incoming links, from high PR websites. (PR4 and PR5 websites will work). Plus if your website is index but is not getting recrawled (updated), then you diffently do not have enough links to your website. My website is getting crawled everyday but I also have over 3000 pages and about a couple hundred incoming links.

hope that help.

[TWhalen]

Get links from other sites, then submit those sites to Google.

Sometimes it helps to "tell Google" that others are linking to you.

[SlowMove]

Just get a lot of links pointing to your site. If you can somehow get 100 links from PR4 and PR5 pages, you will be indexed and may get crawled every day. Just don't do anything that you shouldn't do like link to "bad neighborhoods". That's about all there is to it. It's not rocket science, but getting good links is always a hassle.

[SlowMove]

After you get a few sites of your own, you can get other people asking you for links. At that point, you can automate the process and get on with the real work.

[kaled]

Sometimes the incredibly obvious gets overlooked, so I'm going to say it anyway. Use the backlink tools of Google and AllTheWeb to discover who is linking to your competitors sites. Look through these sites for some means of requesting a link.

I've used this strategy to achieve PR4 and PR5 pages in a matter of a few months. I don't have a huge number of backlinks, but most that I do have are from relevant, high-quality sites.

Kaled.

PS
Whilst submitting to directories such as DMOZ & Zeal, is a good idea, don't rely on it. You're not really in business with respect to back links until you have ~20 some of which need to be PR4 or better to really help you out. If you're in a competitive field, you may have to multiply that figure by 10.

[JoeHouse]

What's the deal with domoz? Been three 4 months and still nothing. Is there a way to speed this up?

[SlowMove]

What's the deal with domoz? Been three 4 months and still nothing. Is there a way to speed this up?

Don't worry about it. I'm there, but they don't send me much traffic. It's good for PR, but you may be able to find other links that send you 100 times as much traffic :)

[Radiolabs]

It seems like there is a problem with Google. I have the same thing happening on my website. I put the new one up on June 6th, Google came, grabbed my robots, came back, picked up the 1st page of my site and they never re-indexed.

My other site is getting crawled 2 or 3 times per day and all changes show up. Maybe they are not listing any new sites until they fix their 4.2 mil problem.

As far as that goes Inktomi hasn't picked me up either. I know Altavista picked me up in a couple of days and I had 20 crawls from them yesterday. I am listed with them. Scrubtheweb.com picked me up also. Just no inktomi and no google.....

Till then, I'll still be waiting.

Take Care,

Chris

[SlowMove]

their 4.2 mil problem

I wish I had a 4.2 mil problem. What is it?

[nippi]

Dmoz is moving house(so I am told) which si slowing things down, and also there are heaps of categories with no editor.

If you submit there, then nothing will happen.

You ened to track down and editor in a similar theme, and emial them and beg and plead.

[Radiolabs]

Well, finally listed in google, but only the first page. I can't figure out what is happening to googlebot. The bot comes to my site, gets the robots.txt file (which is basically a blank .txt, just didn't want a 404 error), gets the index page and doesn't come back.

If I type in my domain in Google it does come up with only the first page. For some reason it won't do a deep crawl. This has been happening for the last 2.5 months. It will come and pick up only robots.txt and the index.html then disappear.

Does anyone have any idea what's going on? My other website is fine. It is being deep crawled about every 2 days but this new site seems to be pretty invisible to Google.

I have been listed in Altavista for over a month now. I though Altavista was supposed to be the slow one to list your site..... seems google is taking that award.

Thanks for any responses or ideas anyone has.

Thanks

[johnnydequino]

Radiolabs - I am in the same exact situation as you.

Just like you, I have a website that gets crawled every two days.

I also have a new website that the home page only gets indexed - almost daily, but no deep crawls.

From what I have been reading on this subject, I have come to the conclusion that if you are an existing site before google 'broke' 4 months ago, you should be happy. If the site was created within 4 months of today, some webmasters are having this issue.

Heck, with my new site Inktomi has already picked up every page. And I thought google was king. =)

You are not alone - Johnny Dequino

[Radiolabs]

Thanks Johnny,

I know something is going on with google, just having a really hard time trying to understand what is the difference between the sites.

I have been thinking about a way to try and fix this problem by even forwarding the DNS number of the other (not so important) website to my "important" new website. I think this might cause problems in a forward though and cause me to get completely ignored all together. Probably not a good idea.

I do know that the other webpage works great with all the bots and they visit all the time. I wouldn't actually mind moving all of the content and turn the other website into a "sacrificial lamb" to at least get myself listed.

The first website was just to test a concept. It worked so I included these ideas into my new site.

Anyone have any ideas on forwarding an older website's DNS to a new server, just to get crawled?

Thanks,

Chris

[johnnydequino]

Radiolabs - My index page is getting cached everyday, I mean everyday, but no spidering at any other page. It's interesting.

jd

[xlcus]

I've noticed the same thing... A couple of new (less than 2 month old) sites have only had their root pages indexed, where as my well established sites are being crawled deeply.

[Radiolabs]

Well, did it again last night.... This is all that happens..

Host: xx.xxx.xxx.xx Url: / Http Code : 200
Date: Aug 12 21:14:29 Http Version: HTTP/1.0" Size in Bytes: 18153
Referer: - Agent: Googlebot/2.1 (+http://www.googlebot.com/bot.html)

Came and left like I wasn't even there! At least we aren't all in the same boat!

There's enough of us.... let's make a stand against the evil bot of doom..... We shall rebel and make a new bot, that doesn't discriminate, equal rights for all new webpages.... we shall overcome! ;)

[johnnydequino]

Ok - I think I have been found. Here is what I see in my logs last night:

All pages have been hit by a googlebot. (Page, page1, page2) I don't see any results on any data center, so what happened?

64.68.82.168 - - [12/Aug/2003:04:00:25 -0500] "GET / HTTP/1.0" 200 14820 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
64.68.82.136 - - [12/Aug/2003:09:03:53 -0500] "GET /robots.txt HTTP/1.0" 200 107 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
64.68.82.178 - - [12/Aug/2003:09:52:31 -0500] "GET /page.html HTTP/1.0" 200 17844 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
64.68.82.78 - - [12/Aug/2003:09:56:17 -0500] "GET /page2.html HTTP/1.0" 200 11890 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
64.68.82.25 - - [12/Aug/2003:10:12:30 -0500] "GET /page3.html HTTP/1.0" 200 12383 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

[GranPops]

Have patience while G sorts itself out.
Only been at this game for 85 days now, and the extremes for my bits and pieces are...
one site visited and indexed within 48 hours, and the very first site finally came up trumps last night, after 84 days, amd with a PR5.

[johnnydequino]

GranPops - easy for you to say - both of your sites are listed. =)

jd

[aurora]

Dear Raymond
After loosing postion on my professional site after the last update I decided to build another "hobby site" (just as a project) and followed Bretts suggestions of listing a site to the 'T' and was expecting to sit back and wait a good while . It was rather a rushed affair (couldn't wait really) but I finished it added a few links to high ranking sites and submitted to dmoz. It is not showing on dmoz as yet but it is listed on google and a lot of other main SE within the space of a FEW DAYS. I am quite amazed. I haven't paid anyone to be listed and believe me the site is quite basic although the search terms are extremely high. My main site is dropping by the day (to sites with error messages or non existant) although I have paid to be listed on "lots" of SE. Plus paying various companies who quarantee top results for search terms.
If I was selling my "hobby" I would be a rich man (woman)!

[GranPops]

johnnydequino

Maybe cos I am old, I forgot to mention that several sites are still nowhere to be seen.

[Radiolabs]

Granpops,

I was listed. In fact if I go to google and type in my specific targeted keyphrase I come up #1 on my homepage. In fact, if I type in the secondary keyphrase, it comes up #3. This is in a HUGE market also. So I guess I did my homework by SEO'ing my site. (if that's a real thing anymore)

However, my largest market is very difficult and this is where the real money is on my site. However, since google won't grab any other pages, this one just isn't found and my site shows up like #145 under that search term. I know that unless there is some deep crawl activity sometime in the near future I might as well throw my site in someone's closet and close the door. I know myself that if I can't find what I am looking for in the first 2 pages on google (or any other search engine, if that exists) I just go on, or re-phrase what I am looking for.

I wish Googleguy could comment on this and let us know if it's an actual problem that is happening, or if certain sites aren't deep-crawled for a specific reason. I have heard some people saying that they are still getting a deep crawl on a new site, and others that are having my same problem. Very strange....... I had a couple of 404 errors on this site due to missing spacer images so I took the entire website, made a fresh new template without errors and changed the site... completely... just to avoid any type of 404 errors.

[mallu]

Here is what I would suggest.

In the site which is getting crawled daily by google, show the headlines ( stories/posts or whatever ) from the other site via a RSS feed. Google will pick up the other site.

If you go to slashdot, you will see the latest of freshmeat on the sidebar. Everyone does this :)

[johnnydequino]

Mallu - What is slashdot or an RSS feed? Thanks.