What technology do search engines use to ‘crawl’ websites?

20) What technology do search engines use to ‘crawl’ websites?

(A) Androids

(B) Interns

(C) Automatons

(D) Bots