summaryrefslogtreecommitdiff
path: root/crawler
AgeCommit message (Expand)AuthorFilesLines
2018-02-17Introduces context on errors. (crawler)horus_arch15-111/+252
2018-02-17Minor refactoring. (crawler)horus_arch2-37/+30
2018-02-16Log level is now configurable. (crawler)horus3-13/+22
2018-02-16Pass the config file via command line flag. (crawler)horus1-2/+6
2018-02-16Structured logging part two. (crawler)horus10-57/+102
2018-02-16Adds structured logging. (crawler)horus17-64/+196
2018-02-15Bugfix. (crawler)horus3-3/+7
2018-02-14Bugfix. (crawler)horus2-1/+2
2018-02-14Add shop short url. (crawler)horus3-10/+19
2018-02-14Adds URL shorting with polr. (crawler)horus4-2/+82
2018-02-14Changes config params.horus1-16/+18
2018-02-14Bugfix. (crawler+website)horus1-1/+1
2018-02-13Bugfix. (database)horus1-4/+4
2018-02-12Bugfix. (crawler)horus2-6/+6
2018-02-12Commits missing function parameter. (crawler)horus1-1/+1
2018-02-12Crawls now whiskworld.de and whiskyzone.de. (crawler)horus2-19/+102
2018-02-12Crawler saves whole webpage.horus5-0/+20
2018-02-12Improvements, bug fixes, more utility functions, etc... (crawler)horus4-4/+94
2018-02-12Changes in the database schema.horus1-14/+23
2018-02-10Crawler extracts volume, price per litre and abv. (Whisky World)horus3-2/+29
2018-02-10Crawler extracts volume, price per litre and abv. (Whisky.de)horus2-15/+19
2018-02-10Improves whiskyde. (crawler)horus_arch1-0/+27
2018-02-10Improves detecting of spirit_type. (crawler)horus2-10/+20
2018-02-10Minor improvements. (whiskyde)Max1-1/+7
2018-02-10Add shipping costs.Max1-15/+15
2018-02-10More efficient view code.Max1-58/+17
2018-02-10Better detection of spirit type. (bottleworld)Max1-10/+13
2018-02-08Improves database view.Max1-4/+59
2018-02-08 Crawler extracts volume, price per litre and abv. (MC Whisky, Rum & Co, Whic)Max9-24/+221
2018-02-08Adds missing utility functions.Max1-0/+65
2018-02-08Crawler extracts volume, price per litre and abv. (bottleshop only)Max4-11/+66
2018-02-08BugfixMax1-2/+2
2018-02-08Adds missing attributes.Max1-0/+2
2018-02-08Better sanitizing.Max1-4/+67
2018-02-08Better parallelization.Max1-22/+22
2018-02-08Adds database view.Max1-0/+7
2018-02-07Adds sanitizer.horus_arch12-31/+50
2018-02-07Parallelized the crawler.horus_arch1-0/+69
2018-02-07Bugfix .gitignore.horus_arch1-40/+1
2018-02-06Moves crawler to designated directory.Max15-0/+1074