Finding subdomains

From Archiveteam
Revision as of 22:33, 2 January 2023 by Tech234a (talk | contribs) (Initial page)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

There are several ways to attempt to find subdomains for a given domain, such as example.com.

  1. Perform web searches. The two primary search indexes are Bing and Google, and many other search engines use these indexes internally. Bing also has an API available. You can run queries as follows: Google:
    site:example.com
    . Bing:
    site:example.com+
  1. Look for existing archived subdomains in the Internet Archive CDX (which also includes data from Common Crawl):

Get page count: https://web.archive.org/cdx/search/cdx?url=*.example.com&collapse=original&fl=original&showNumPages=1 Iterate through pages: https://web.archive.org/cdx/search/cdx?url=*.example.com&collapse=original&fl=original&page=0

  1. Use Subdomain Finder: https://subdomainfinder.c99.nl/ Paid API also available.
  1. Search Chrome User Experience Report origin lists, which contain domains collected using telemetry in the Chrome browser. See https://archive.org/details/crux_origin_list
  1. Use Cisco Umbrella (OpenDNS) top domains lists: http://s3-us-west-1.amazonaws.com/umbrella-static/index.html