How will you design a crawler to discover all web

How will you design a crawler to discover all web pages on the Internet? Goal: understand Windows sockets and multithreaded programming Gnutella: peer-to-peer application for file sharing A two-tier graph, consisting ultra-peers and leaf-peers Each ultrapure maintains a list of leaves (leaf-peers or children) and neighbors (other ultra-peers)Show transcribed image text