Folders and files structure

The folder structure is the following:

• /CC/: Indicates the country where the scan was performed
• /year=xxxx/: Indicates the year of the scan
• /week=xx/: Indicates the week of the year of the scan (starting from 0)

Each folder contains 5 JSON files GZip compressed:

• errors.json.gz Contains the list of failed hostname resolutions with the reason.
• host_nodes.json.gz Contains hostname nodes (e.g., example.org., ns1.iana-server.net.). Each node has a one single property, name.
• ip_nodes.json.gz Contains IP nodes, thus IP addresses (e.g., 192.0.2.1). Each node two properties, address and IP version
• domain_nodes.json.gz Contains domain nodes, intended as zone cuts (e.g., jp., iij.ad.jp., but not ad.jp.). Each node has a one single property, name.
• connections.json.gz Contains the relationships between the different aforementioned nodes, each connection contains a source and destination node name and type, a relationships type and a set of properties. The relationships types can be:
  • PARENT: Refers to the parent domain (zone cut). E.g., example.com. -> PARENT -> .com.
  • PART_OF: Refers to the domain (zone cut) of a specific hostname. E.g., www.example.com. -> PART_OF -> example.com.
  • ALIAS_OF: Refers to the CNAME alias of a specific hostname. E.g., www.foo.com. -> ALIAS_OF -> www.bar.com.
  • MANAGED_BY: Specify the authoritative nameservers (as host nodes) for a specific domain (zone cut). Can contain the boolean properties should_follow_glue_v4/6, indicating if the resolver followed glue records for resolving the authoritative nameservers hostnames. E.g., example.com. -> MANAGED_BY -> a.iana-server.net.
  • RESOLVES_TO: Specify the IP address to which a hostname resolves to. Can contain the boolean property: "glue" that indicates that the record was learned as glue record. E.g., example.com. -> RESOLVES_TO -> 192.0.2.1

Terms of Use

If you make use of any of the open access data from the DNS Dependency Graph Dataset Repository, you must acknowledge use of this data by including the following attribution in any document, web page or other communication: We keep track of research papers that use this dataset, and would appreciate it if you can notify us of any publications in which you use it. Please contact r.sommese@utwente.nl and send us the citation of you paper.