News Source: http://searchengineland.com
Published: Sep 06, 2008 - 07:25 am
Story Found By: stephan 1358 Days ago
Category: SEO
11 Comments
Sorry this site requires JavaScript to be enabled in your browser. See the following guide on How to enable JavaScript in Internet Explorer, Netscape, Firefox and Safari. Alternatively you may be blocking JavaScript with an advert-related or developer plugin. Please check your browser plugins.
News Source: http://searchengineland.com
Published: Sep 06, 2008 - 07:25 am
Story Found By: stephan 1358 Days ago
Category: SEO
11 Comments
Upcoming Conferences
Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.
Join us at an upcoming SMX event:
- SMX Advanced Seattle - June 5-6, 2012
- SMX Paris - June 7-8 2012
- SMX Melbourne - Sept. 5-6, 2012
- SMX East - Oct. 2-4, 2012
- SMX Stockholm - Oct. 15-16, 2012
- SMX Social Media Marketing - Dec. 5-6, 2012
- SMX Munich - Apr. 9-10, 2013
- SMX West - March 2013
- SMX Toronto - April 2013
- SMX Sydney - May 2013
Latest News From Marketing Land
- Yahoo Shutters Livestand iPad “Living Magazine”
- Marketing Day: May 25, 2012
- Marketing Biz: Tracking Google’s Dune Strategy
- How Performance Marketing Is Influencing The Next Generation Of Internet Startups
- New Google+ Android App Adds Vivid Imagery & Additional Functionality
- - See more news at Marketing Land -
Upcoming Webcasts
Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include:
- Search, Social and Mobile: What Travel Marketers Must Know - June 26, 2012
Latest News From Search Engine Land
- Microsoft: Yes, We Do Send Takedown Requests To Bing, Too
- SearchCap: The Day In Search, May 25, 2012
- Search In Pics: SEO LEGO, Facebook Cooler & A Happy SEO
- Google Disapproved 134M Ads And Disabled More Than 800K AdWords Accounts In 2011
- Microsoft Integrates More Nokia “Infrastructure” (Traffic, Geocoding) Into Bing Maps
- - See more news at Search Engine Land -
Comments
had this problem previously &, interestingly, once got in touch with you, Stephan, to ask what you thought!After no-following, our traffic went down, but we kept it nofollowed anyway as our servers had been totally hammered by all the attribute-page crawling. Interestingly - though traffic reduced - revenue did not &, as a result, conversion % bumped up.
Great article. This issue seems to be related to Google’s pronouncements a while back (in late ’06? early ’07?) that it didn’t want to continue to index site search results in general, and sites allowing their site search results pages to be spidered might see some sort of bad rankings outcome; whether that would amount to a rankings hit to the non-search pages or just a hit to the search pages, I don’t recall. My understanding, however, is that nothing ever came of that, i.e., we *didn’t *see huge numbers of webmasters complaining that their sites had been penalized due to their indexed search results. (If I’m wrong about that, someone here will set me straight!)So how’s this scenario? A client has a B2C site as well as a third-party site search solution with attribute-based navigation built in. The B2C site’s web host automatically provides a sitemap.xml file just for the site pages, so Google’s getting ongoing sitemap data just for the "real" pages, not for the site search pages. Absent implementing a robots.text or nofollow attribute scheme for the site search pages, could the sitemap-only-for-site-pages impementation help by making sure the "money" site pages with order buttons are indexed, leaving the indexing of the site search pages more at the whim of Google?
I agree with Google’s mantra "build pages for users, not for search engines". I find it annoying when I’m searching, and keep getting old site search pages appearing in SERPs, meaning I never actually find the article I’m looking for. If it annoys me, it’s going to annoy customers.I took the step of applying meta noindex, follow tags on my site search result pages, reminding myself that I’m helping the user experience, by telling search engines to only include useful pages.Interestingly, traffic really wasn’t affected by this. However, the real improvement was in conversion. Give people what they are looking for, and they’ll take it.By default now, I make my site search result pages noindex, follow.
I agree if the results page is 100% identical that it can be problematic but what if your results pages are a more unique cross-section of the same catalog?Why wouldn’t I want my customers to go directly to a very specific attribute page if it’s an often sought after attribute?I don’t think there is any 100% answer to this problem, but moderation in which attribute searches get indexed would probably be advised.
"A combination of nofollows, meta noindexing and disallows strategies should be employed for this."You don’t want to combine disallow and meta noindex. If you disallow a URL, the META doesn’t get read.
What about using these ’duplicate’ pages to support the main categories. By programmatically altering the title-tags, descriptions and perhaps even some texts, these pages can look quite different. They can in turn gain some ranking weight and support the most important pages.The idea is not to battle this duplicate content problem, but to use it.
@IncrediBILL, That is a good point, which is why I always recommend starting with nofollows for the low value (from an SEO perspective) attributes first, like the price range breakdowns, since few folks are searching for "car stereos $0 to $50". Then you can experiment with more aggressive nofollowing.@Halfdeck, Thanks for mentioning that. We prefer meta robots noindex over robots.txt disallows because the robots.txt disallow doesn’t completely remove the listing from the SERPs, just leaves a snippetless, titleless listing in the SERPs that can still rank for keywords in anchor text pointing to that disallowed page. And in order for the meta tag to be read and obeyed by Google, the page must be allowed by robots.txt.@monchito, That’s the crux of it, that the pages need to "look quite different". If the page content isn’t significantly paraphrased/rewritten, then there will be too many shingles in common with the original page and it gets picked up as duplicate content.
I wonder what a slightly altered (e.g. titles, descriptions, short texts, maybe some extra links to the most important page and a different HTML template) page in combination with meta noindex,follow does in term of passing on internal pagerank
Just checking back re my previous question. So nobody has any insight into whether putting only the "real pages" in a sitemap.xml file would help "weight" them as more relevant vs. the search result pages in Google’s eyes?
@winooski - Google can’t tell the difference between one type of page or the other, a page is a page. However, if both types of pages return the exact same results, then it might notice. Other than that, as I have this exact situation, as long as the results are unique either type of page should rank just fine.
Still makes sense to keep the different URLs, though.Large Luxury wallets for menLarge Luxury wallets for womenI wouldn’t want either to sift through all the wallets. Maybe there should be a balance, or we need to make sure the faceted pages actually are optimized (i.e., obviously unique and persuasive to the people).