GhostHunter

GhostHunter is a powerful and user-friendly tool designed to uncover hidden treasures from the Wayback Machine. It allows you to search for archived URLs (snapshots) of a specific domain, filter them by file extensions, and save the results in an organized manner. Whether you're a researcher, developer, or cybersecurity enthusiast, GhostHunter makes it easy to explore historical web data.

Features

1. Domain Search

   • Search for all archived URLs of a specific domain from the Wayback Machine.
   • Automatically checks domain availability before starting the search.

2. File Extension Filtering

   • Filter URLs by specific file extensions (e.g., pdf, docx, xlsx, jpg).
   • Customize the list of extensions in the config.json file.

3. Concurrent URL Fetching

   • Fetch URLs concurrently using multiple workers for faster results.
   • Configurable number of workers for optimal performance.

4. Snapshot Finder

   • Find and display snapshots (archived versions) of the discovered URLs.
   • Timestamps are displayed in a human-readable format (e.g., 23 January 2025, 15:46:09).

5. Organized Results

   • Save filtered URLs into separate files based on their extensions (e.g., example.com.pdf.txt, example.com.docx.txt).
   • Save snapshot results into a single file for easy reference.

6. Colorful and User-Friendly Interface

   • Use of colors and tables for a visually appealing and easy-to-read output.
   • Summary tables provide a quick overview of the results.

7. Internet and Wayback Machine Status Check

   • Automatically checks for an active internet connection and Wayback Machine availability before proceeding.

Installation

Prerequisites Go: Make sure you have Go installed on your system.

Steps

1. Clone the repository:

   git clone https://github.com/mysteriza/GhostHunter.git
   

   cd GhostHunter
   

2. Install Dependencies:

   GhostHunter uses the following Go packages:

   • github.com/briandowns/spinner
   • github.com/fatih/color
   • github.com/olekukonko/tablewriter

   Install them using:

   go get github.com/briandowns/spinner
   

   go get github.com/fatih/color
   

   go get github.com/olekukonko/tablewriter
   

   Or install them globally:

   go install github.com/briandowns/spinner@latest
   

   go install github.com/fatih/color@latest
   

   go install github.com/olekukonko/tablewriter@latest
   

3. Usage: Run this command to grants execution (execute) permission to the GhostHunter file:

   chmod +x GhostHunter
   

   Run the Tool (Faster Way):

   ./GhostHunter
   

   Or run directly without using the build file:

   go run scanner.go
   

   You want to rebuild the file? Use:

   go build -o GhostHunter
   

User Interface

Contributing

I've abandoned this project, but for those of you who want to request additional features or want to make changes, please leave a message or pull request. I will consider it.

Acknowledgments

Thanks to the Wayback Machine for providing the CDX API.

Special thanks to the creators of the Go libraries used in this project:

• briandowns/spinner
• fatih/color
• olekukonko/tablewriter