> For the complete documentation index, see [llms.txt](https://riteshs4hu.gitbook.io/infosec-notes/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://riteshs4hu.gitbook.io/infosec-notes/reconnaissance/passive-reconnaissance-techniques/website-archives.md).

# Website Archives

A Website Archive is a collection of saved copies of web pages, typically stored on a server, to preserve a website's content and layout over time. These archives allow users to access historical versions of websites, track changes, and retrieve lost or deleted content.

#### **Why Use Website Archives?**

* **Digital Preservation** – Ensuring websites remain accessible even if taken down.
* **Cybersecurity & OSINT** – Investigating past content for security assessments.
* **Research & Legal Evidence** – Analyzing historical data for verification and compliance.
* **SEO & Web Development** – Recovering lost information and tracking changes.

### **Popular Website Archive Services**

1. [**The Wayback Machine**](https://web.archive.org/) – The largest web archive, managed by the Internet Archive.
2. [**Archive Today**](https://archive.ph/) – Allows users to save and access snapshots of web pages.
3. [**Archive IT**](https://archive-it.org/) – A subscription-based web archiving service.
4. [**Librarian**](https://webarchives.loc.gov/) – Web archive maintained by the Library of Congress.

### **Command-Line Tools for Website Archiving**

1. [**waybackurls**](https://github.com/tomnomnom/waybackurls) – Extracts URLs from the Wayback Machine.

   ```sh
   echo "example.com" | waybackurls
   ```
2. [**gau**](https://github.com/lc/gau) – Fetches archived URLs from various sources, including Wayback Machine and Common Crawl.

   ```sh
   echo "example.com" | gau
   ```