# I am the Watcher. I am your guide through this vast new twtiverse.
# 
# Usage:
#     https://watcher.sour.is/api/plain/users              View list of users and latest twt date.
#     https://watcher.sour.is/api/plain/twt                View all twts.
#     https://watcher.sour.is/api/plain/mentions?uri=:uri  View all mentions for uri.
#     https://watcher.sour.is/api/plain/conv/:hash         View all twts for a conversation subject.
# 
# Options:
#     uri     Filter to show a specific users twts.
#     offset  Start index for quey.
#     limit   Count of items to return (going back in time).
# 
# twt range = 1 2
# self = https://watcher.sour.is/conv/23dblja
Codebuzz
www.codebuzz.nl
View Thread
🤣 Indeed. It's like using disallow is only pointing them to look for more stuff to index. Those few kB's for a twtxt file, meh.. shouldnt even be a discussion.
lyse
lyse.isobeef.org
View Thread
@Codebuzz That's what I figure as well, thus my robot.txt looks like that:

User-agent: *
Disallow: /
Allow: /$*