Help I'm trying to get my site on search engines such as google

Forum Moderators: goodroi

Message Too Old, No Replies

Help I'm trying to get my site on search engines such as google

Help on how to get your site on search engines such as google

Mako3

12:34 am on Jan 24, 2005 (gmt 0)

My website is <snip> and I have entered this text as my meta tags for robots I dont know how to get it so people can get to my site from search engines such as google please help me.

<TITLE>TITLE GOES HERE</TITLE>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=windows-1252">
<META NAME="Description" CONTENT="DESCRIPTION GOES HERE">
<META NAME="Keywords" CONTENT="KEYWORDS GO HERE">
User-agent: *
Disallow:
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

Thanks,
Mako3

[edited by: Woz at 2:50 am (utc) on Jan. 24, 2005]
[edit reason] removed URL & specifics [/edit]

ncw164x

1:12 am on Jan 24, 2005 (gmt 0)

First and foremost welcome to webmasterworld Mako3

I don't know what you have done but if you type www.your url/robots.txt your site appears, it should just be a plain text file showing what spiders to disallow and not your site layout.

From the code above

User-agent: *
Disallow:
this is what should be in your robots.txt file and not on the web page, its saying all robots are allowed access to all of your site

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
This means that you don't want any bots to index your page and not to follow any of the link from each page, in other words you don't want your site to appear in the search engines

Now putting both of the above comment together, you are saying yes you can access my site but you cant index any of my pages so there is no way you will get your site indexed in a search engine

PS as per the TOS of this forum you are not allowed to post any urls especially to your own site, if you can still edit it then you best do so

Mako3

2:37 am on Jan 24, 2005 (gmt 0)

oh ok thanks so what should i put? Also so I need to make a robots.txt file for my site? Thanks for the welcoming and I dunno how to edit my post.

Thanks,
Mako3

ncw164x

3:12 am on Jan 24, 2005 (gmt 0)

example of what to put on a robots.txt file is on the link below
[searchengineworld.com...]

Open notepad to make the file and it must be called robots.txt and uploaded to the root of your webspace in ASCII mode, its the only place a bot will request the file.

<TITLE>TITLE GOES HERE</TITLE>
each of your pages need a different title so don't name all of your pages with the same wording.

<META NAME="Description" CONTENT="DESCRIPTION GOES HERE">
the description needs to relate to the text on each of your pages.

<META NAME="Keywords" CONTENT="KEYWORDS GO HERE">
Keywords are not used by google but are by other search engines so make sure you choose keywords what relate to the topic of each of your pages, dont use the same keywords throughout your site.

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
Remove this from your all of your sites pages, this is only used if you do NOT want pages indexing

this is just a comment tag which can also be removed, its not needed for your site.

read up on Brett's 26 steps to 15k a Day site and then read it again and again and it will get you started in the right direction
[searchengineworld.com...]

Mako3

5:21 am on Jan 24, 2005 (gmt 0)

ok thanks i uploaded the robots.txt file and this is what I have in it:
User-agent: *
Disallow:

<TITLE>Fraternicide-Clan Members</TITLE>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=windows-1252">
<META NAME="Description" CONTENT="A New Halo2 XBOX Live Clan that is well experienced and is only accepting people we think will be a great asset to the clan.">
<META NAME="Keywords" CONTENT="Clan, fraternicide, fraternicide clan, clan fraternicide, Halo, Halo2, Live, Xbox, Xbox Live, New, Games, Xbox Games, Xbox Live Clan, Live Clan, Xbox Clan, Halo2 Clan, Halo Clan, New Clan, New Xbox Live, experienced, accepting, great asset, clan members, forum, clan forum, gamertags, members gamertags, ect">
<META NAME="ROBOTS" CONTENT="INDEX,FOLLOW">

thanks,
Mako3

ncw164x

8:27 am on Jan 24, 2005 (gmt 0)

I take it I have read your reply correctly

This is what is in your robots.txt file
User-agent: *
Disallow:
thats all and nothing else

-------------------------------------------------------

below this line is "NOT" in the robots.txt file but in the head of your html document (web page)

This you do not need
<META NAME="ROBOTS" CONTENT="INDEX,FOLLOW">

go to google and do a search for html tutorials, there are lots of them explaining how to construct a site and what elements go where

Mako3

2:21 pm on Jan 24, 2005 (gmt 0)

oh ok thanks but y dont I need this: <META NAME="ROBOTS" CONTENT="INDEX,FOLLOW">? Doesnt that allow the robots to see my site?

Thanks,
Mako3

Mako3

8:10 am on Jan 30, 2005 (gmt 0)

can u please help me?

ncw164x

8:32 am on Jan 30, 2005 (gmt 0)

Its not needed now because of more advanced spidering methods being used by search engines, if you have not disallowed a search engine from accessing your site then its allowed to have access to all of your site.

Make sure you have good internal navigation using text links beween your pages.