I wish to understand how search engine crawlers travers websites, in terms of the pathways they take.