Regarding that, Please give this https://www.nuegia.net/articles/open%20letter%20to%20webmasters.xhtml a read. I've written about this exact issue before.