Website
.
Fuselkönig.de
.
Projects
.
Status
index
:
fk_crawler
master
The crawler which powers kategorischeraperitif.de/angebote
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
crawler
/
database.go
Age
Commit message (
Collapse
)
Author
Files
Lines
2019-07-12
Improves readability. (crawler)
Maximilian Möhring
1
-4
/
+20
2019-05-14
Refactores logging functions. (crawler)
Maximilian Möhring
1
-8
/
+8
2018-05-14
Various fix, e.g. it repairs wrong image urls. (crawler)
horus
1
-8
/
+21
2018-02-20
Removes Tx, because I get 'busy buffer' error. (crawler)
horus
1
-10
/
+8
2018-02-20
Bugfix. (crawler)
horus
1
-6
/
+8
2018-02-19
Better error reporting. (crawler)
horus
1
-4
/
+9
2018-02-19
Saving scraped offers runs in Tx. (crawler)
horus
1
-4
/
+4
2018-02-19
Bugfix. (crawler)
horus
1
-1
/
+5
2018-02-19
Improves sanitizing. (crawler)
horus
1
-1
/
+1
2018-02-19
Fix nasty bug. (crawler)
horus
1
-14
/
+14
2018-02-19
Bugfix + better error reporting. (crawler)
horus
1
-5
/
+18
2018-02-19
Bugfix + detects age. (crawler)
horus_arch
1
-4
/
+5
2018-02-17
Bugfix. (crawler)
horus_arch
1
-2
/
+0
2018-02-17
Fix detect duplicates query, prevents error message. (crawler)
horus_arch
1
-3
/
+4
2018-02-17
Messing with database constraints. (crawler)
horus
1
-33
/
+29
2018-02-17
Introduces context on errors. (crawler)
horus_arch
1
-1
/
+3
2018-02-16
Adds structured logging. (crawler)
horus
1
-11
/
+19
2018-02-14
Add shop short url. (crawler)
horus
1
-1
/
+2
2018-02-14
Adds URL shorting with polr. (crawler)
horus
1
-2
/
+2
2018-02-13
Bugfix. (database)
horus
1
-4
/
+4
2018-02-12
Bugfix. (crawler)
horus
1
-5
/
+5
2018-02-12
Changes in the database schema.
horus
1
-14
/
+23
2018-02-10
Improves detecting of spirit_type. (crawler)
horus
1
-1
/
+1
2018-02-10
More efficient view code.
Max
1
-58
/
+17
2018-02-08
Improves database view.
Max
1
-4
/
+59
2018-02-08
Crawler extracts volume, price per litre and abv. (MC Whisky, Rum & Co, Whic)
Max
1
-5
/
+5
2018-02-08
Crawler extracts volume, price per litre and abv. (bottleshop only)
Max
1
-5
/
+16
2018-02-08
Adds database view.
Max
1
-0
/
+7
2018-02-06
Moves crawler to designated directory.
Max
1
-0
/
+130