| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | Add support for robots.txt user agent control from web crawlers (#10) | James Mills | 2018-04-03 | 1 | -0/+2 |
 |
index : gopherproxy | |
| gopherproxy |
| aboutsummaryrefslogtreecommitdiffstats |
path: root/robots.txt
|
index : gopherproxy | |
| gopherproxy |
| aboutsummaryrefslogtreecommitdiffstats |
| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | Add support for robots.txt user agent control from web crawlers (#10) | James Mills | 2018-04-03 | 1 | -0/+2 |