Sorry this site requires JavaScript to be enabled in your browser. See the following guide on How to enable JavaScript in Internet Explorer, Netscape, Firefox and Safari. Alternatively you may be blocking JavaScript with an advert-related or developer plugin. Please check your browser plugins.

"Google calculates PageRank on the total network of sites Google has in its index. From that point of view a non-indexed page can’t accumulate PageRank, because Google can’t determine the relative value the page. Or can it?"
Comments7 Comments  

Comments

Avatar
from MajesticSEO 1278 Days ago #
Votes: 2

Google has multiple indices - the one we all see is full-text final index, not every URL gets there, however they do have complete web-graph (also index) of the web used in PageRank calculations and other things. Any URL they find gets into web-graph and if has enough PR or it’s new domain (or whatever other rules are in place) it will be crawled, if successful and some outgoing links on that page are found then it MAY well pass PR without even being included into final full-text index.Chances are that the pages that don’t pass any PR are those that are penalised or had nofollow META tag in them or some other reasons.

Avatar
from eduardblacquiere 1277 Days ago #
Votes: -1

<div>You’re right, thanks for your comment! </div><div></div><div>There’s a definition problem with "non-indexed". Using Robots.txt or Meta robots to exclude pages from a search engine index DOESN’T keep Google from crawling the page and taking it into account with the PageRank calculation.</div>

Avatar
from ianmacfarlane 1277 Days ago #
Votes: 0

Robots.txt is a different situation from meta robots - if the page is excluded via robots.txt, then this prevents search engines from crawling it in the first place. Search engines cannot give any values to links they have never seen.

Avatar Moderator
from Sebastian 1277 Days ago #
Votes: 0

Ian, an URI never crawled by Google due to a robots.txt block can accumulate pageRank, and can get indexed.

Avatar
from eduardblacquiere 1277 Days ago #
Votes: 0

@IanI agree with Sebastian :)

Avatar
from MajesticSEO 1277 Days ago #
Votes: 1

I think Ian probably meant here that if page can’t be crawled then those outgoing links on it can’t be seen by search engines and thus the page can’t pass out PageRank or similiar algorithms.

Avatar
from ianmacfarlane 1050 Days ago #
Votes: 0

This article is completely wrong with regards to robots.txt

Upcoming Conferences

Search Marketing ExpoSearch Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.



Join us at an upcoming SMX event:

Upcoming Webcasts

Search Marketing Now Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include: