mirror of
https://github.com/benbusby/farside.git
synced 2025-04-25 13:10:02 +00:00
Update reddit + ig frontends, update rate limiting
Farside ratelimiting has been updated to return a 429 when a user exceeds 1 request/sec. This should help eliminate a lot of scraping type behavior that instance maintainers have been dealing with from Farside lately. Service changes: - Teddit removed (not maintained) - Bibliogram replaced by Proxigram - Libreddit merged with redlib
This commit is contained in:
commit
247114d328
5 changed files with 101 additions and 74 deletions
33
.github/workflows/update-instances.yml
vendored
33
.github/workflows/update-instances.yml
vendored
|
@ -166,19 +166,19 @@ jobs:
|
|||
|
||||
# ==============================================================
|
||||
# teddit update
|
||||
# Note: no longer maintained
|
||||
# ==============================================================
|
||||
curl -s https://codeberg.org/teddit/teddit/raw/branch/main/instances.json | \
|
||||
jq '[
|
||||
.[] |
|
||||
select(.url != null) |
|
||||
select(.url | contains("https")) |
|
||||
.url ] |
|
||||
sort' > teddit-tmp.json
|
||||
jq --slurpfile teddit teddit-tmp.json \
|
||||
'( .[] | select(.type == "teddit") )
|
||||
.instances |= $teddit[0]' services-full.json > services-tmp.json
|
||||
#curl -s https://codeberg.org/teddit/teddit/raw/branch/main/instances.json | \
|
||||
#jq '[
|
||||
#.[] |
|
||||
#select(.url | contains("https")) |
|
||||
#.url ] |
|
||||
#sort' > teddit-tmp.json
|
||||
#jq --slurpfile teddit teddit-tmp.json \
|
||||
#'( .[] | select(.type == "teddit") )
|
||||
#.instances |= $teddit[0]' services-full.json > services-tmp.json
|
||||
|
||||
apply_update
|
||||
#apply_update
|
||||
|
||||
# ==============================================================
|
||||
# Wikiless update
|
||||
|
@ -197,18 +197,25 @@ jobs:
|
|||
#apply_update
|
||||
|
||||
# ==============================================================
|
||||
# libreddit update
|
||||
# libreddit + redlib update
|
||||
# ==============================================================
|
||||
curl -s https://raw.githubusercontent.com/libreddit/libreddit-instances/master/instances.json | \
|
||||
curl -s https://raw.githubusercontent.com/redlib-org/redlib-instances/main/instances.json | \
|
||||
jq '[
|
||||
.instances[] |
|
||||
select(.url) |
|
||||
.url ] |
|
||||
sort' > libreddit-tmp.json
|
||||
|
||||
jq --slurpfile libreddit libreddit-tmp.json \
|
||||
'( .[] | select(.type == "libreddit") )
|
||||
.instances |= $libreddit[0]' services-full.json > services-tmp.json
|
||||
|
||||
mv services-tmp.json services-full.json
|
||||
|
||||
jq --slurpfile redlib libreddit-tmp.json \
|
||||
'( .[] | select(.type == "redlib") )
|
||||
.instances |= $redlib[0]' services-full.json > services-tmp.json
|
||||
|
||||
apply_update
|
||||
|
||||
# ==============================================================
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue