homepage Welcome to WebmasterWorld Guest from 54.211.47.170
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Visit PubCon.com
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

This 588 message thread spans 20 pages: < < 588 ( 1 2 3 4 [5] 6 7 8 9 10 11 12 13 ... 20 > >     
Does Google Ban or Filter Web Directories?
moftary




msg:726185
 1:06 pm on Jul 28, 2005 (gmt 0)

I think the subject worth a thread itself. It's a suspision so far. Yet I don't see dmoz, yahoo nor any major web directory were banned/filter nor PRed zero as my web directory did. I tried to check it in Alexa (powered by google) and I see some results from my site. Appearently, Alexa brings old results from Google but something weird is that Alexa itself has PR0 now. But that's another story!

If you run a web directory, feel free to post your experience here.

 

The Contractor




msg:726305
 5:35 pm on Jul 29, 2005 (gmt 0)

Like I stated in my last sticky. You may be able to email google, block the others via robots.txt, beg forgiveness and ask for reinclusion, but it's doubtful. I haven't seen networks that were banned ever really recover.

zoltan




msg:726306
 5:48 pm on Jul 29, 2005 (gmt 0)

Is this the so called sandbox you call? Being banned without any chance to recover?

zoltan




msg:726307
 5:53 pm on Jul 29, 2005 (gmt 0)

And to get back to topic. On July 28 many sites were penalized, is there any chance that all of us are penalized because duplicate content? Do you also run similar sites?

The Contractor




msg:726308
 5:55 pm on Jul 29, 2005 (gmt 0)

Nope, sandbox is new domains. You have been hit for duplicate sites/content/network. Once a network is identified like yours and taken down in most cases they will never return. I know it may be a dumb question on my part, but why wouldn't you think these sites would be hit when you were building them?

It's easy enough for me to find them with whois/IP. What would make you think that SE's wouldn't find them? How does Yahoo treat them?

jgbmarc




msg:726309
 5:59 pm on Jul 29, 2005 (gmt 0)

hi everyone,

i have had a human-maintained niche directory site since 1999. always ranked well until recently. site is not gone from index.. just dropped several pages. i tend to think that Google is sincerely working to try and eliminate the made for adsense scrapers.. and in doing so some legit directories are getting filtered/banned. if this is the case, i have every confidence that legit directory sites will be back in the mix.

let's just be a little patient with them.

they most likely are doing something that is in all (honest and legit) webmaster's best interest.

GoogleGuy?

thank you

[edited by: jgbmarc at 6:05 pm (utc) on July 29, 2005]

Anat




msg:726310
 6:03 pm on Jul 29, 2005 (gmt 0)

If duplicate content were to blame, wouldn't all of the AWS sites be hit as well? None of my AWS sites seem to be hurt.

jayrrome




msg:726311
 6:19 pm on Jul 29, 2005 (gmt 0)

I thought it was just me! Since 10-2-96 I have been a Big Time Site. I have always been top of SERPs. Suddenly I was off at Yahoo and Google #1 for several weeks, I disappeared on Yahoo, started to reappear. The re appearance came with a surprising lift. I went from 976 to #19 now #18. Now I show PR/0 and all my pages gone from Google Serps. There is something strange. Is this some type of sifting of the SERPs. I must say it is of concern, with the introduction of my new product in 10 days and no Google SERPs, I look like a rookie.

jgbmarc




msg:726312
 6:21 pm on Jul 29, 2005 (gmt 0)

GoogleGuy? We need you buddy. chime in.

estaquieto




msg:726313
 6:25 pm on Jul 29, 2005 (gmt 0)

I own a directory for several years, each and every site hand-edited, hand-included by myself. No problems with Google so far. Perhaps Google is doing a bit of 'housecleaning', albeit to the detriment of legit directories mistaken for 'scrapers'. The idea of robots judging and banning sites is a big let-down for webmasters like us who toil on our sites night and day, day and night. Sadly reminds me of 'The Matrix'.

mahoogle




msg:726314
 6:34 pm on Jul 29, 2005 (gmt 0)

I have a directory as well that covers many topics, that was hit hard. For Terms we ranked in the top 10 are now buried and starting to be completely removed.

I'm getting a trickle of traffic from international google domains, but nothing from google.com. My site is starting to disappear completely from data centers. I see one set of ips that my site is still ranking well on. For the rest of you that had directories hit, do you still rank well on these ips 66.102.9.104/99

jgbmarc




msg:726315
 6:37 pm on Jul 29, 2005 (gmt 0)

mahoogle, yeah for me things look better at those IPs.. in fact rankings look exactly the same as they did for me two weeks back.

i wonder what's up with those DCs

mahoogle




msg:726316
 6:48 pm on Jul 29, 2005 (gmt 0)

I've been watching these Ips 66.102.9.104 for over a week. I've consistenly had decent rankings there, but not on any of the other dcs. I presume they are in rotation for some of the international sites, which accounts for the trickle of traffic. I've also noticed a hard google crawl on my site the last 2 days. I'd sure like to have my site return to July 20th levels. Our site first got hit that evening and has been down ever since.

night707




msg:726317
 7:33 pm on Jul 29, 2005 (gmt 0)

---- Google filter/ban any site that have the term "directory" in meta tags ---

at least in our case not true. Meta Tag contains directory and site is listed fairly on top of a www.google.com/alpha/Top directory with a PR above 4

jenkers




msg:726318
 8:17 pm on Jul 29, 2005 (gmt 0)

Hi, thought I'd chime in with my tuppence - for what its worth:

one of my sites is directory - each page is SEO'd (in a very minor kind of way - strictly white-hat) for the subject it represents. All sites are hand-reviewed with unique descriptions of sites linked - but --- it is possible that someone could look at it and think it is a scraper site (it isn't at all but you can't always tell what other people see).

So far had no problems - G referrals and placements all same as ever. A great number of the pages still come up top in SERPs for the terms I target. Meta tags on some pages contain the word directory - not seen any adverse effects (....so far). I use description, keywords etc meta tags.

Software is bespoke by me....All pages are static .html generated from a db when new links are approved.

I do run adsense on a large number of the pages.

Site has been up and running on current domain since '98 - was running on a different domain before this.

kdobson99




msg:726319
 8:19 pm on Jul 29, 2005 (gmt 0)

Regarding those two datacenters in question... On another thread I pointed out those datacenters as ones where I still rank well, although I was hit on the rest of the datacenters. However, what is interesting is that those people who were hit June 16th but returned on July 22nd (the date we were hit) don't rank well on those data centers...

There is no question of the following.
If you were in the bunch of sites hit hard on June 16th (or so) you again rank well on most datacenters but don't on the two referenced earlier.

If you were hit hard on July 22nd, you don't rank well right now except on those two datacenters where you still do fine.

I also note that in the current results on most datacenters that my pages now rank almost exactly where they did on June 16th. If a page didn't rank well on June 16th, it doesn't now either. If a page got indexed for the first time since June 16th or greatly improved its ranking since June 16th, it doesn't rank well right now, except for on those two datacenters.

Conclusion... some type of rollback to June 16th for all but the two datacenters mentioned in the earllier post.

mahoogle




msg:726320
 9:18 pm on Jul 29, 2005 (gmt 0)

I think you're right about a rollback to june 16th or something that turned the results very similar to that date.

Does anyone have a page that they created post june 16th that is ranking well?

moftary




msg:726321
 10:04 pm on Jul 29, 2005 (gmt 0)

---- Google filter/ban any site that have the term "directory" in meta tags ---
at least in our case not true. Meta Tag contains directory and site is listed fairly on top of a www.google.com/alpha/Top directory with a PR above 4

My wrong theory. Many major directories contains the term "directory" in their meta keywords tag and rank on top <snip>.

[edited by: lawman at 6:04 pm (utc) on July 31, 2005]
[edit reason] No URL Drops Please [/edit]

moftary




msg:726322
 10:10 pm on Jul 29, 2005 (gmt 0)

one of my sites is directory - each page is SEO'd (in a very minor kind of way - strictly white-hat) for the subject it represents. All sites are hand-reviewed with unique descriptions of sites linked - but --- it is possible that someone could look at it and think it is a scraper site (it isn't at all but you can't always tell what other people see).

So far had no problems - G referrals and placements all same as ever. A great number of the pages still come up top in SERPs for the terms I target. Meta tags on some pages contain the word directory - not seen any adverse effects (....so far). I use description, keywords etc meta tags.

Software is bespoke by me....All pages are static .html generated from a db when new links are approved.

I do run adsense on a large number of the pages.

Site has been up and running on current domain since '98 - was running on a different domain before this.

My nuked directory has the very same specification but it was founded march 2004. Please sticky me your website url.

CygnusX1




msg:726323
 11:30 pm on Jul 29, 2005 (gmt 0)

We also have a new directory, but haven't had the trouble some of you are having. We are steadly rising in visitors each month.

At least I hope tomorrow we are the same. :)

jd01




msg:726324
 11:41 pm on Jul 29, 2005 (gmt 0)

Does anyone have a page that they created post june 16th that is ranking well?

If you consider #6 out of 4.5mil on a competitive query ranking well, then, yes.

Justin

kdobson99




msg:726325
 1:02 am on Jul 30, 2005 (gmt 0)

mahoogle - Its not as simple as asking whether any pages created after June 16th rank well. Of course some will. For example if you search for anything that has happened since then (such as London Bombings) you will see pages created after June 16th that rank well. However, as I stated above.. there is some correlation between the fact that for some of us June 16th or so is a magic day.

Virtually everyone that was hurt on June 16th was back in full force on July 22nd. Virtually everyone who was hurt on July 22nd are back to their June 16th pages and serps. For those that weren't hurt either time, everything stayed the same. Thus, there was some type of "rollback" (for lack of a better word) for some of us which helped some and hurt some, but it obviously didn't apply to everyone.

jgbmarc




msg:726326
 1:19 am on Jul 30, 2005 (gmt 0)

ok i was hurt with who knows what update/dance around 2.5 - 3 months ago.. back full force better then ever on, or around, June 15th.. then crushed again dramatically on July 22nd..

BUT- the June 15th rankings that I was thrilled with are now back on the two datacenters with the same exact serps for me (and the sites around me) that mahoogle mentions in post #130 [66.102.9.104/99]...

there's no date or anything else associated with the link and snippet only for example:

LINK HERE
Snippet here...it.html - 27k - Cached - Similar pages

does that mean anything?

kdobson99




msg:726327
 2:53 am on Jul 30, 2005 (gmt 0)

Yes, those two datacenters you mention are the only two that are still showing good results for us that were hit on July 22nd. Those same datacenters show bad results for those hit on June 16th.

Regarding your snippet... there is nothing unusual about it as you would only see the date of the cache if it was last cahced within the past day or two. If you click on the cahced link you will see the date of your last cache. However, I can tell you that getting a fresh cache will not help you in this situation. I was hit July 22nd and the pages have been cached many times since with no help to the serps. But, for me and others hit on July 22nd, for the next few days after July 22nd, we all seemed to have reverted to vey old caches for a few days which have now corrected to current caches...

experienced




msg:726328
 5:16 am on Jul 30, 2005 (gmt 0)

my directory was 2 year old with PR 4 and today not indexed with PR0.There is no duplicate content. No spamming nothing,

alwaysthinking




msg:726329
 5:48 am on Jul 30, 2005 (gmt 0)

I don't want to curse myself... BUT it appears that Google has fully reinstated my Directory site back into their SERPs. Furthermore, it appears as the pages have all the excellent web presence (generally speaking) for the appropriate, relavent search terms.

THANK YOU GOOGLE for checking into the matter after I inquired about the situation with an email... no need to reply as I have seen that you have been fair and made adjustments accordingly... Who could ask for anything more?!

Now to answer all the questions that you may have as best I can.

No, I did not receive any email from them concerning this matter, other than the one from Google AdSense team saying the would foward my email to their Customer Support team.

Yes I DID make a rather major change, but have no idea if that was helped me get back into Google's SERPs, if in fact my site stays in. The reason I say this is that I made the change at around 11PM my time, and then at Midnight it seems that Google has it pre-programmed to reinsert my pages (and probably some other publisher's web sites too - check your sites!)

What did I change? I juct observed what the Google Rep was looking at when he/she came to my site apparently in response to my inquiry. After examining the pages they went through, I concluded that a few of my reciprocal link pages were problematic, so I just deleted the entire reciprocal link directory I had (next I will probably have problems because I did that, but at least I'm back in Google!)

The problem was that I was using an automated script that peopble could submit their links for free, provided that they gave a link back to my site - the standard affair. It was template based, and I made various categories and seeded many of them initially with links to some sites that I liked, then over time other's added their own links. The problem (I think) was there were a few categories that I made, which nobody had posted any links to so that they remain virtually empty (except for one "house link" that I have on every page) and displayed 2 blocks of Google AdSense ads & a vertical row of Adlinks. Even though it was UNintentional... technically it WAS a violation of TOS.

So instead of going through and placing a few links in the empty categories, I chose to just delete the entire script (one of those $99 of the shelf ones).

The reson why> It was more hassle than it was worth because I still had to email people to tell them were their link was because the scripts navigation & auto response emails were hard to understand. Furthermore, I was always the one giving away "link strength" as none of the many people that asked for links ever had better Alexa rankings than mine. I caught quite a few never following through and providing the link back like they said they would. What NERVE some lower forms of web designers have!

And finally, that stupid reciprocal link directory with about 900 pages (data base driven and writes to static HTML - that's why I liked it) only received minimal traffic and even earned less AdSense $$$. I imagine because it was trafficked mostly by people looking for links to their new or faultering web site.

I apologize if I deleted links to anyone site that may be reading this message, but ultimately we must look out for ourselves first, before we can help others,

In closing, I hope this info helps & gives hope to others...

"All is right with the world..." so now I can actually SLEEP tonight... with one eye on Google SERPs to make sure my site sticks in there!

steveb




msg:726330
 6:03 am on Jul 30, 2005 (gmt 0)

www.alexa.com is PR0. alexa.com is PR7. That is certainly a common phenomenon these days.

reseller




msg:726331
 6:22 am on Jul 30, 2005 (gmt 0)

Wish to ask those of you who were hit on 22nd July 2005.

Do you see your site back for the first time since 22nd July on other DCs ... in addition to the two DCs that mahoogle mentions in post #130 [66.102.9.104/99]

runboy




msg:726332
 9:18 am on Jul 30, 2005 (gmt 0)

Our site was hit as well.

Anybody have an estimate on when we will loose Adsense optimization? Our pages must still be indexed somehow since our adsense campaigns are relevant and not PSAs.
I am assuming that eventually we will loose that if Google stops spidering our page.

Petrocelli




msg:726333
 9:42 am on Jul 30, 2005 (gmt 0)

>> Anybody have an estimate on when we will loose Adsense optimization?

You'll probably loose a lot of visitors, but not Adsense optimization. The Adsense bot works independently from Googlebot.

runboy




msg:726334
 10:25 am on Jul 30, 2005 (gmt 0)

That is good to know. I don't get the majority of my traffic from Google. "Only" around 25% But I will loose a lot of money on 3rd party text links that will be next to worthless now.

JuniorOptimizer




msg:726335
 10:39 am on Jul 30, 2005 (gmt 0)

Google's automated response to me said that sites fall out of the index all the time.

"Our spiders regularly crawl the web to rebuild our index, but keeping tabs on eight billion pages is tough work, and they may miss a few". They go on to say that if your site is well-linked it should be picked back up.

This 588 message thread spans 20 pages: < < 588 ( 1 2 3 4 [5] 6 7 8 9 10 11 12 13 ... 20 > >
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved