summaryrefslogtreecommitdiff
path: root/crawler/shop_whiskyde.go
AgeCommit message (Expand)AuthorFilesLines
2018-06-15Introduces config for user agent, robots.txt and crawler delay. (crawler)horus1-2/+5
2018-06-15Introduces central crawler config. (crawler)Max1-4/+1
2018-06-15Fix because changed html. (crawler)horus1-0/+1
2018-05-23Reflects changes in TWS url structure. (crawler)horus1-1/+1
2018-02-19Changes log level while crawling from warning to info. (crawler)horus_arch1-8/+8
2018-02-17Minor improvement in logging. (crawler)horus1-3/+4
2018-02-17Introduces context on errors. (crawler)horus_arch1-8/+30
2018-02-16Structured logging part two. (crawler)horus1-8/+7
2018-02-16Adds structured logging. (crawler)horus1-1/+1
2018-02-15Bugfix. (crawler)horus1-0/+4
2018-02-12Crawler saves whole webpage.horus1-0/+10
2018-02-10Crawler extracts volume, price per litre and abv. (Whisky World)horus1-2/+0
2018-02-10Crawler extracts volume, price per litre and abv. (Whisky.de)horus1-15/+16
2018-02-10Improves whiskyde. (crawler)horus_arch1-0/+27
2018-02-10Minor improvements. (whiskyde)Max1-1/+7
2018-02-07Adds sanitizer.horus_arch1-2/+2
2018-02-06Moves crawler to designated directory.Max1-0/+58