diff options
| author | dev | 2026-06-25 20:07:08 +0200 |
|---|---|---|
| committer | dev | 2026-06-25 20:07:08 +0200 |
| commit | fa742660190a7d3b7b6f068565ce543d413edbab (patch) | |
| tree | 3515262a4bd47aac3e998ecf134451257b0181a0 /src/main.go | |
| parent | d41b60d08fdd5a6589cdb4e33ac1931fa16aef4c (diff) | |
| download | hnimdbbot-fa742660190a7d3b7b6f068565ce543d413edbab.tar.gz | |
feat: fetch Wikipedia article titles via Wikidata SPARQL
- Query Wikidata SPARQL in batches of 30 for entries missing wiki_article
- Store wiki_article title in imdb table
- Respect rate limits with configurable delay and retry on 5xx/429
- Skip entries that have no Wikipedia article
- Removed unique constraint on wiki_article (multiple entries can share one)
Diffstat (limited to 'src/main.go')
| -rw-r--r-- | src/main.go | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/src/main.go b/src/main.go index 123cc64..272e4b6 100644 --- a/src/main.go +++ b/src/main.go @@ -194,4 +194,8 @@ func main() { if err = app.fetchAndUpdateImdbData(); err != nil { log.Fatalf("fetchAndUpdateImdbData: %v", err) } + + if err = app.fetchWikiArticles(); err != nil { + log.Fatalf("fetchWikiArticles: %v", err) + } } |
