I whole heartedly agree with what you say about google and other search engines in regards to how they index and crawl certain pages. Googles algorithm is quite lacking in terms of determining what is a quality site with quality content. A lot of site owners try and find new ways of "tricking" the algorithm, but some people dont realise that google is smarter than they think. Subsequenly they do constant changes to their algorithm to try and stay one step ahead, but beacuse of this never ending battle between search engines and site owners to try and game the system for self benefit, Its going to be a long time before they figure out a formula to find the QUALITY and deeply embeded documents that so many people search for and should have access to.
I whole heartedly agree with what you say about google and other search engines in regards to how they index and crawl certain pages. Googles algorithm is quite lacking in terms of determining what is a quality site with quality content. A lot of site owners try and find new ways of "tricking" the algorithm, but some people dont realise that google is smarter than they think. Subsequenly they do constant changes to their algorithm to try and stay one step ahead, but beacuse of this never ending battle between search engines and site owners to try and game the system for self benefit, Its going to be a long time before they figure out a formula to find the QUALITY and deeply embeded documents that so many people search for and should have access to.