summaryrefslogtreecommitdiff
path: root/crawler/shop_whiskyzone.go
AgeCommit message (Expand)AuthorFilesLines
2019-05-15Improves structured logging. (crawler)Maximilian Möhring1-1/+3
2019-05-14Refactores logging functions. (crawler)Maximilian Möhring1-6/+6
2018-06-15Introduces config for user agent, robots.txt and crawler delay. (crawler)horus1-2/+5
2018-06-15Introduces central crawler config. (crawler)Max1-4/+1
2018-05-14Various fix, e.g. it repairs wrong image urls. (crawler)horus1-0/+10
2018-02-19Changes log level while crawling from warning to info. (crawler)horus_arch1-5/+5
2018-02-17Introduces context on errors. (crawler)horus_arch1-9/+25
2018-02-16Structured logging part two. (crawler)horus1-0/+9
2018-02-16Adds structured logging. (crawler)horus1-5/+17
2018-02-12Crawls now whiskworld.de and whiskyzone.de. (crawler)horus1-15/+75
2018-02-07Adds sanitizer.horus_arch1-2/+2
2018-02-06Moves crawler to designated directory.Max1-0/+56