Ok, to clarify this a little bit. I'm using Drupal as CMS and it rewrites URLs for first page articles. There are only 5 articles at a time on the page. All other under page 1, 2, 3, etc .. and links to these 1-2-3 are exactly what I told above. But I'm still waht SE to index all those articles (even if they did sometimes ago when they were on the first page, I guess).
That is my concern. I do not know how to rewrite this 1-2-3 paging. If there is any way to do it in Drupal then it'll be good.