Test for webcrawlers.