# I am the Watcher. I am your guide through this vast new twtiverse.
#
# Usage:
# https://watcher.sour.is/api/plain/users View list of users and latest twt date.
# https://watcher.sour.is/api/plain/twt View all twts.
# https://watcher.sour.is/api/plain/mentions?uri=:uri View all mentions for uri.
# https://watcher.sour.is/api/plain/conv/:hash View all twts for a conversation subject.
#
# Options:
# uri Filter to show a specific users twts.
# offset Start index for quey.
# limit Count of items to return (going back in time).
#
# twt range = 1 16
# self = https://watcher.sour.is/conv/thttegq
Finally added validation to discovered peers! The list of now-VERIFIED, discovered peers, with at least one valid message is now at 703 (out of the 1449 unverified - a lot of garbage mentions are out there). https://xandkar.net/twtxt/peers.txt
@xandkar Oh this is really cool! 👌 How does the verification work? 🤔
@xandkar Oh this is really cool! 👌 How does the verification work? 🤔
If a peer's URI is downloaded with 200 and at least one message is parsed from it - a peer gets the "verified" badge.
@xandkar Cool! Your list contains several duplicates, though: awk '{print $2}' peers.txt | sort | uniq -cd Garbage mentions grow over time automatically, because people might leave and then we have dead mentions. So that's kind of expected.
@xandkar Ahh that's very similar to the "indexed_feeds" counter on Yarns 👌
@xandkar Ahh that's very similar to the "indexed_feeds" counter on Yarns 👌
Although for some reason your stats are 2x as large... Can you explain this? 🤔
Although for some reason your stats are 2x as large... Can you explain this? 🤔
Perhaps because I'm not limiting to just twtxt.net? I seeded with initial peers manually and from there keep spidering out to mentions. Also, there may still be dupes which differ only in nick and/or some alias URI that leads to the same place - need to design a de-dupping pass...
@xandkar Good to see myself on the verified list. Where can I claim my verification badge? 😄
@xandkar Manually fixing the first lines and running this (could be probably done much simpler) I get 102 to subtract from your number: awk '{print $2}' peers.txt | sort | uniq -cd | awk '{print $1 -1}' | paste -sd+ | bc So this would result in 601 feeds. @prologic, you could just check, which of the feeds from the peers.txt are indexed and which not.
Sorry to be a pain. Is there a dumb-downed version about what this means? 😬