1
0
Fork 0
mirror of https://github.com/benbusby/farside.git synced 2025-04-25 13:10:02 +00:00

Update reddit + ig frontends, update rate limiting

Farside ratelimiting has been updated to return a 429 when a user
exceeds 1 request/sec. This should help eliminate a lot of scraping type
behavior that instance maintainers have been dealing with from Farside
lately.

Service changes:
- Teddit removed (not maintained)
- Bibliogram replaced by Proxigram
- Libreddit merged with redlib
This commit is contained in:
Ben Busby 2024-01-08 12:37:17 -07:00
commit 247114d328
No known key found for this signature in database
GPG key ID: B9B7231E01D924A1
5 changed files with 101 additions and 74 deletions

View file

@ -166,19 +166,19 @@ jobs:
# ==============================================================
# teddit update
# Note: no longer maintained
# ==============================================================
curl -s https://codeberg.org/teddit/teddit/raw/branch/main/instances.json | \
jq '[
.[] |
select(.url != null) |
select(.url | contains("https")) |
.url ] |
sort' > teddit-tmp.json
jq --slurpfile teddit teddit-tmp.json \
'( .[] | select(.type == "teddit") )
.instances |= $teddit[0]' services-full.json > services-tmp.json
#curl -s https://codeberg.org/teddit/teddit/raw/branch/main/instances.json | \
#jq '[
#.[] |
#select(.url | contains("https")) |
#.url ] |
#sort' > teddit-tmp.json
#jq --slurpfile teddit teddit-tmp.json \
#'( .[] | select(.type == "teddit") )
#.instances |= $teddit[0]' services-full.json > services-tmp.json
apply_update
#apply_update
# ==============================================================
# Wikiless update
@ -197,18 +197,25 @@ jobs:
#apply_update
# ==============================================================
# libreddit update
# libreddit + redlib update
# ==============================================================
curl -s https://raw.githubusercontent.com/libreddit/libreddit-instances/master/instances.json | \
curl -s https://raw.githubusercontent.com/redlib-org/redlib-instances/main/instances.json | \
jq '[
.instances[] |
select(.url) |
.url ] |
sort' > libreddit-tmp.json
jq --slurpfile libreddit libreddit-tmp.json \
'( .[] | select(.type == "libreddit") )
.instances |= $libreddit[0]' services-full.json > services-tmp.json
mv services-tmp.json services-full.json
jq --slurpfile redlib libreddit-tmp.json \
'( .[] | select(.type == "redlib") )
.instances |= $redlib[0]' services-full.json > services-tmp.json
apply_update
# ==============================================================