webcrawler

web crawl·er

W w

Definitions of webcrawler word

noun webcrawler (sometimes initial capital letter) a computer program that retrieves data from a website, as in order to index web pages for a search engine. 1
noun Definition of webcrawler in Technology (web) A free web search engine developed by Brian Pinkerton at the University of Washington and now moved to America Online, Inc. WebCrawler collects URLs by searching the Internet and allows users to perform keyword searches through a web browser. 1

before 1990

One of the 1% newest English words

First recorded in 1990-95

noun

adjective

verb

adverb

pronoun

preposition

conjunction

determiner

exclamation

A common word. It’s meaning is known to most children of preschool age. About 97% of English native speakers know the meaning and use the word.

This word is included in each student's vocabulary. Most likely there is at least one movie with this word in the title.

This diagram is provided by Google Ngram Viewer