massrdap

- A high-performance RDAP resolver for bulk lookups and reconnaissance
git clone git://git.acid.vegas/massrdap.git
README.md (2762B)
      1 # MassRDAP
      2 
      3 ![](./preview.gif)
      4 
      5 ## Information
      6 This script will take an input list of domains and retrieve [WHOIS](https://en.wikipedia.org/wiki/WHOIS) information for them using the [Registration Data Access Protocol](https://en.wikipedia.org/wiki/Registration_Data_Access_Protocol) *(RDAP)*. Depending on the TLD the domain is under will determine which RDAP server the request is made on. We are using the [Bootstrap Service Registry for Domain Name Space](https://www.iana.org/assignments/rdap-dns/rdap-dns.xhtml) from [IANA](https://www.iana.org/).
      7 
      8 ###### This is a work in progress still *(stay tuned)*
      9 
     10 ## Rate Limiting
     11 From my experience, it seems every RDAP server has their employed rate limits. While I am still benchmarking and testing these limits, proxy support has been added to circumvent this issue.
     12 
     13 ## Usage
     14 | Argument              | Description                                                           | Default Value |
     15 |-----------------------|-----------------------------------------------------------------------|---------------|
     16 | `-i`, `--input_file`  | File containing list of domains (one per line).                       |               |
     17 | `-p`, `--proxy`       | Proxy in `user:pass@host:port` format. If not supplied, none is used. |               |
     18 | `-c`, `--concurrency` | Number of concurrent requests to make.                                | 25            |
     19 | `-o`, `--output`      | Output file to write successful RDAP data to.                         | `output.json` |
     20 | `-f`, `--failed`      | Output file to write failed domains to. (optional)                    | `failed.txt`  |
     21 
     22 ## WHOIS & RDAP Statistics
     23 
     24 By comparing the [root TLDS](https://data.iana.org/TLD/tlds-alpha-by-domain.txt) and the [RDAP Bootstrap](https://data.iana.org/rdap/dns.json) data from IANA, along with querying IANA's [WHOIS](https://www.iana.org/whois) server to find other TLD's WHOIS servers, we can formulate coverage statistics on WHOIS/RDAP availability across all available TLDS:
     25 
     26 ###### RDAP
     27 | Status  | Results       |
     28 | ------- | ------------- |
     29 | RDAP    | 1,174 *(81%)* |
     30 | No RDAP |   275 *(19%)* |
     31 
     32 ###### WHOIS
     33 | Status   | Results       |
     34 | -------- | ------------- |
     35 | WHOIS    | 1,253 *(86%)* |
     36 | No WHOIS |   196 *(14%)* |
     37 
     38 ## Roadmap
     39 - Explore other RDAP servers from RIRs, registrars, IANA *(see [here](https://data.iana.org/rdap/))*
     40 - Mass domain availability lookups
     41 - Find available 1 or 2 letter domains.
     42 
     43 ___
     44 
     45 ###### Mirrors for this repository: [acid.vegas](https://git.acid.vegas/massrdap) • [SuperNETs](https://git.supernets.org/acidvegas/massrdap) • [GitHub](https://github.com/acidvegas/massrdap) • [GitLab](https://gitlab.com/acidvegas/massrdap) • [Codeberg](https://codeberg.org/acidvegas/massrdap)