Sorry this site requires JavaScript to be enabled in your browser. See the following guide on How to enable JavaScript in Internet Explorer, Netscape, Firefox and Safari. Alternatively you may be blocking JavaScript with an advert-related or developer plugin. Please check your browser plugins.

Sometimes duplicate content problems are not at all easy to find and here’s a classic example. A group of recruitment websites leaking their staging server URLs into Google’s, Yahoo’s and Live’s index. In live’s case, the problem is quite severe with more than 6000 indexed URLs at the staging site hosting.hotlizard.co.uk.

Richard Baxter provides a fantastic example of what can happen when staging URLs are leaked, and provides a comprehensive list of checks and fixes to prevent this.
Comments5 Comments  

Comments

Avatar
from thejimgaudet 1295 Days ago #
Votes: 1

Great idea by <h3 class="comment_title">g1smd</h3>Addind PHP code to check the domain name and writing a noindex tag to the page. A nice easy fix I think.

Avatar
from g1smd 1295 Days ago #
Votes: 0

Glad it was useful.  Saved me a ton of work, and relieves me of one more thing that I don’t have to think about.I often like to design problems out.

Avatar
from richardbaxterseo 1295 Days ago #
Votes: 0

Agreed - very nice comments g1smd and thanks for dropping by! Really appreciate your input.

Avatar
from NickWilsdon 1295 Days ago #
Votes: 0

@g1smd very useful tip that Ian. I’ve been using .htaccess on our development area but this sounds a much better option. Thx.

Avatar
from g1smd 1295 Days ago #
Votes: 1

I also like to redirect using .htaccess as that fixes the URL to the right domain should anyone copy the URL from their browser, and paste it into the content of some other site as a link.However, I always have the PHP option installed too. This acts as a backup in case the .htaccess file goes AWOL on a server move or somesuch. More likely, it helps if there is a URL combination that can access the site, but it is a combination that I am not aware of (usual things are bare IP address, IP address with folder name, wild-card sub-domains off the main domain, and both sub-domains and folders off the hosting company domain name), as it is easy to miss one if someone else has set the server up.

Upcoming Conferences

Search Marketing ExpoSearch Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.



Join us at an upcoming SMX event:

Upcoming Webcasts

Search Marketing Now Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include: