Forum Moderators: open

Message Too Old, No Replies

How low can you go!

why are there pages on my site not being crawled

         

james gulliver

9:47 am on Feb 4, 2003 (gmt 0)

10+ Year Member



I have been optiumising a site to get maximum traffic using the old age technique of having good content.

One of the problems i have come across is developing a framework to hold all this information. I have added sections alongside my products section called product info, which basically talks about all aspects of the products hence producing good weighty content for spiders to munch through. This has worked well as i have opitmised th pages from the content not from a keyword list, explaning to my client that if you want to be ranked high for a particular word you need to be able to write a piece containing this word and for it to fit into the website, if he cant, then it isnt relevant.

Obviously not everthing fits nicely into a product info framework, so as another traffic driver medium i have developed a News interface.

This news interface contains stories about customers, new products and developments and is driven by a database. My client can add a new story through a web browser interface. The input form contains fields such as title, description, keywords, 10 alt tag spaces and the article itself. Once the client has added a story i can go into the interface and optimise for that particular story ensuring the right keywords have been used and the title and headline best describe what the story is about.

All of these stories are list in the news index with the headline being the link to the story. When the link is clicked it passes the unique variable for the story and opens the view template. All the fields are propogated with the information including alt tags and page title.

heres the snag

the search engines are not spidering these pages.

Why?

here are a few questions you might ask:

how deep are the pages?

Ans: they are on the same level as the product info pages.

Are the pages valid HTML?

Ans: yes i have checked

What are the pages?

Ans: they are PHP pages

How are you parsing the variable?

Like this ../news/view.php?id=37

caine

9:51 am on Feb 4, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



not really an area of mine, but i would look at dropping the PHP id? part and replacing it with .HTML and creating a static page, as the impression, and the way the SE's will parse the url, is of a dynamic nature, whether it is or is not.

May be worth asking in the PHP forum's, how you get around the .html question?