| Age | Commit message (Expand) | Author | Files | Lines |
|---|---|---|---|---|
| 2018-06-15 | Introduces config for user agent, robots.txt and crawler delay. (crawler) | horus | 1 | -2/+5 |
| 2018-06-15 | Introduces central crawler config. (crawler) | Max | 1 | -4/+1 |
| 2018-02-19 | Changes log level while crawling from warning to info. (crawler) | horus_arch | 1 | -6/+6 |
| 2018-02-17 | Minor improvement in logging. (crawler) | horus | 1 | -0/+4 |
| 2018-02-17 | Bugfix in crawler for whiskysite.nl. It's now active (crawler) | horus | 1 | -7/+17 |
| 2018-02-17 | Adds crawler for whiskysite.nl. (crawler) | horus_arch | 1 | -5/+79 |
| 2018-02-17 | Introduces context on errors. (crawler) | horus_arch | 1 | -1/+1 |
| 2018-02-16 | Adds structured logging. (crawler) | horus | 1 | -1/+1 |
| 2018-02-07 | Adds sanitizer. | horus_arch | 1 | -2/+2 |
| 2018-02-06 | Moves crawler to designated directory. | Max | 1 | -0/+59 |
 |
index : fk_crawler | |
| The crawler which powers kategorischeraperitif.de/angebote |
| summaryrefslogtreecommitdiff |