Website
.
Fuselkönig.de
.
Projects
.
Status
index
:
fk_crawler
master
The crawler which powers kategorischeraperitif.de/angebote
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
crawler
/
shop_whic.go
Age
Commit message (
Expand
)
Author
Files
Lines
2021-01-21
Detects spirit_type on Whic correctly.
Maximilian Möhring
1
-1
/
+12
2019-05-15
Improves structured logging. (crawler)
Maximilian Möhring
1
-1
/
+3
2019-05-14
Refactores logging functions. (crawler)
Maximilian Möhring
1
-6
/
+6
2018-06-15
Introduces config for user agent, robots.txt and crawler delay. (crawler)
horus
1
-2
/
+5
2018-06-15
Introduces central crawler config. (crawler)
Max
1
-3
/
+1
2018-02-19
Less Fatal(), more Warn(). (crawler)
horus
1
-1
/
+2
2018-02-19
Changes log level while crawling from warning to info. (crawler)
horus_arch
1
-5
/
+5
2018-02-17
Minor improvement in logging. (crawler)
horus
1
-2
/
+3
2018-02-17
Introduces context on errors. (crawler)
horus_arch
1
-9
/
+26
2018-02-16
Structured logging part two. (crawler)
horus
1
-7
/
+14
2018-02-16
Adds structured logging. (crawler)
horus
1
-1
/
+1
2018-02-12
Crawler saves whole webpage.
horus
1
-0
/
+2
2018-02-08
Crawler extracts volume, price per litre and abv. (MC Whisky, Rum & Co, Whic)
Max
1
-1
/
+44
2018-02-07
Adds sanitizer.
horus_arch
1
-2
/
+2
2018-02-06
Moves crawler to designated directory.
Max
1
-0
/
+64