| Name | Last modified | Size | Description | |
|---|---|---|---|---|
| Parent Directory | - | |||
| Headers.txt | 2024-11-17 05:52 | 223 | ||
| Headers.json | 2024-11-17 05:52 | 247 | ||
| Exclusions.txt | 2024-11-17 05:52 | 700 | ||
| Exclusions.json | 2024-11-17 05:52 | 871 | ||
| Crawlers.txt | 2024-11-17 05:52 | 17K | ||
| Crawlers.json | 2024-11-17 05:52 | 20K | ||