It then sends its relative path names to the web downloader, which is responsible for downloading the content of the page. For downloads to local web pages, they are stored in the library, pending subsequent processing such as indexing; on the other hand, the url of the downloaded page is placed in the captured url queue, which records the url of the downloaded reptile system to avoid double-checking. For the newly downloaded web page, all the li