Why doesn't Google crawl all of my clients webpages? The SE's have crawled the top page and just a few other web pages, last time in december. I can't find no reason why. The website uses ASP.net with aspx-links but a few of these aspx-links is crawled by these SE's. I checked in cached pages and with lynx that outgoing links exists in the top page. Is it possible that for example cookies can stop SE's to crawled further? Lynx asks me to agree to some cookies.
Before, the navigation left menu was in javascript-links but though we changed that a couple a months ago there is no change in crawling.
Before, the navigation left menu was in javascript-links but though we changed that a couple a months ago there is no change in crawling.