Website
.
Fuselkönig.de
.
Projects
.
Status
index
:
fk_crawler
master
The crawler which powers kategorischeraperitif.de/angebote
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
crawler
/
shop_whiskyworld.go
Age
Commit message (
Collapse
)
Author
Files
Lines
2019-05-15
Improves structured logging. (crawler)
Maximilian Möhring
1
-1
/
+3
2019-05-14
Refactores logging functions. (crawler)
Maximilian Möhring
1
-7
/
+7
2018-06-15
Introduces config for user agent, robots.txt and crawler delay. (crawler)
horus
1
-2
/
+5
2018-06-15
Introduces central crawler config. (crawler)
Max
1
-5
/
+1
2018-06-15
Fix because changed html. (crawler)
horus
1
-1
/
+4
2018-05-14
Various fix, e.g. it repairs wrong image urls. (crawler)
horus
1
-2
/
+3
2018-02-19
Changes log level while crawling from warning to info. (crawler)
horus_arch
1
-7
/
+7
2018-02-17
Minor improvement in logging. (crawler)
horus
1
-3
/
+3
2018-02-17
Introduces context on errors. (crawler)
horus_arch
1
-15
/
+31
2018-02-16
Structured logging part two. (crawler)
horus
1
-9
/
+14
2018-02-16
Adds structured logging. (crawler)
horus
1
-1
/
+1
2018-02-12
Crawls now whiskworld.de and whiskyzone.de. (crawler)
horus
1
-4
/
+27
2018-02-10
Crawler extracts volume, price per litre and abv. (Whisky World)
horus
1
-0
/
+26
2018-02-07
Adds sanitizer.
horus_arch
1
-2
/
+2
2018-02-06
Moves crawler to designated directory.
Max
1
-0
/
+60