Sphinn Home » Google Searching
Avatar Went Hot: May 5, 2008 - 1:34 pm
Posted By: janecopland 75 days ago
Topic Type: News Story (Jump to http://ciarannorris.co.uk)
Category: Google Searching
It now seems that Google is ignoring its own advice, and the use of noindex, and is indexing search results pages. If you look at Computer Weekly’s robots.txt file, you’ll see their search pages are noindexed. And yet the pages have been indexed.
8 Comments     

Comments

from jdevalk 75 days ago #
Votes: 0 | Vote:
+ -

As commented on the site itself: 1. ciaran, and god knows I love you Ciaran, just doesn't get how robots.txt and robots meta tags interact (hint: they don't, the first blocks the latter), and doesn't ask the obvious question of which weird internal link scheme get's 105,000 internal serps indexed... 

from ciaran 75 days ago #
Votes: 1 | Vote:
+ -

And Joost, as commented on the site, we may have been naive, but there is no internal linking on the site. They're indexed because Google decided to start indexing them, and nothing anyone does will change that...

from incrediblehelp 75 days ago #
Votes: 0 | Vote:
+ -

joost even if they delete the robots.txt line and even change from get to post, do you think these pages will have a tough time falling out of the index since they have alredy been crawled-->indexed?

from maverick12210 75 days ago #
Votes: 0 | Vote:
+ -

Hi Jane http://ciarannorris.co.uk/2008/05/05/indexing-search-results-why-google-is-going-against-its-own-advice/

The URL of the story is now returning a 404 error

Please look into it

Thanks

Maverick

from annie7 75 days ago #
Votes: 0 | Vote:
+ -

@maverick12210 works with me...

from janecopland 74 days ago #
Votes: 0 | Vote:
+ -

@maverick12210 Ah, it's not 404ing for me... might want to ask the author about it? He commented second on this thread.

from greggorio 72 days ago #
Votes: 0 | Vote:
+ -

Jane, great post. It appears that not only do they do this organically, they also do this in the PPC world when  they recommend "non-quality score" methodologies for their adwords clients. Again, not practicing what they preach!

from Jill 71 days ago #
Votes: 0 | Vote:
+ -

That's the way Google has always shown partially indexed pages (PIPs).  They know they exist, but they're not fully indexed. In this case, they're not fully indexed because they are excluded via the robots.txt file.

Been this way forever with excluded URLs...nothing new here...


Log in to comment or register here.

Top 10 Most Sphunn
In What's New

  1. Google Loses $13 Billion Overnight…... (15)
  2. Matt Cutts on Spam [video] (15)
  3. Google To Test A Search Interface T... (14)
  4. Improving Your Skillset: Your Path ... (13)
  5. Insight into Google's Digg-like Soc... (13)
  6. 13 areas to evaluate your ecommerce... (12)
  7. 5 most effective ways to write a Bl... (12)
  8. Ultimate Guide to Search Marketing (12)
  9. Social Search Is the New Black (11)
  10. Top 5 SEO Blogs Ever (11)

Latest Comments

Search Marketing Expo

Save the date for:
• SMX Local & Mobile - San Francisco, CA (July 24-25) See the agenda, and register now!
• SMX Sao Paolo - Brazil - (Aug. 7-8)
• SMX China - September 23 & 24, 2008
• SMX Stockholm - September 23 & 24, 2008
• SMX East - NYC - (Oct. 6-8) Registration is now open.
• SMX London - November 4 & 5, 2008