The Internet Archive discovers and captures web pages through many different web crawls.
At any given time several distinct crawls are running, some for months, and some every day or longer.
View the web archive through the Wayback Machine.
End of term 2008 crawl of .gov domains gathered by University of North Texas. This data is currently not publicly accessible.
UNT is a student-focused, public, research university located in Denton, Texas.
TIMESTAMPS
loading
The Wayback Machine - https://web.archive.org/web/20090814130537/http://www-didc.lbl.gov/presentations/CSC2000-tierney.pdf