# I am the Watcher. I am your guide through this vast new twtiverse.
#
# Usage:
# https://watcher.sour.is/api/plain/users View list of users and latest twt date.
# https://watcher.sour.is/api/plain/twt View all twts.
# https://watcher.sour.is/api/plain/mentions?uri=:uri View all mentions for uri.
# https://watcher.sour.is/api/plain/conv/:hash View all twts for a conversation subject.
#
# Options:
# uri Filter to show a specific users twts.
# offset Start index for quey.
# limit Count of items to return (going back in time).
#
# twt range = 1 14
# self = https://watcher.sour.is/conv/wosq6ua
@mckinley \n\n> As of about 6 months ago, 3 different yarn.social pods each request /twtxt.txt (with an If-Modified-Since header) every 5 minutes, 24 / 7. I think I also had a different twtxt client requesting it every 10 minutes.\n\nWhich feed is this out of curiosity? 🤔 I'm also thinking about a way to recrawl feeds so it might be time to rethink how pods fetch feeds... 🤔
@mckinley
> As of about 6 months ago, 3 different yarn.social pods each request /twtxt.txt (with an If-Modified-Since header) every 5 minutes, 24 / 7. I think I also had a different twtxt client requesting it every 10 minutes.
Which feed is this out of curiosity? 🤔 I'm also thinking about a way to recrawl feeds so it might be time to rethink how pods fetch feeds... 🤔
@mckinley
> As of about 6 months ago, 3 different yarn.social pods each request /twtxt.txt (with an If-Modified-Since header) every 5 minutes, 24 / 7. I think I also had a different twtxt client requesting it every 10 minutes.
Which feed is this out of curiosity? 🤔 I'm also thinking about a way to recrawl feeds so it might be time to rethink how pods fetch feeds... 🤔
@prologic It was my main feed, @mckinley when I had access logs on for a while.\nIt doesn't take up much bandwidth because it's not actually sending over the file every time. It really just clogs up the log file, and grep -v "/twtxt.txt" access_log fixes that.
@prologic It was my main feed, @mckinley when I had access logs on for a while.
It doesn't take up much bandwidth because it's not actually sending over the file every time. It really just clogs up the log file, and grep -v "/twtxt.txt" access_log fixes that.
Oh so you're not actually bothered by this are you? Because that's how the "social" part of the non-social social media platform that is Yarn.social works 😂 I'd still like to get this down to at most once-per-day and at least once-per-5mins between pods and once-per-15mins for off pod feeds. I _think_ 🤔 -- Trouble is I _have_ to write the code to do this and I'm not quite sure I've worked out all the pieces yet... So experimenting with the search engine crawler _may_ help me figure this out? 🤔 -- Anyway as long as it doesn't bother you 🤗
Oh so you're not actually bothered by this are you? Because that's how the "social" part of the non-social social media platform that is Yarn.social works 😂 I'd still like to get this down to at most once-per-day and at least once-per-5mins between pods and once-per-15mins for off pod feeds. I _think_ 🤔 -- Trouble is I _have_ to write the code to do this and I'm not quite sure I've worked out all the pieces yet... So experimenting with the search engine crawler _may_ help me figure this out? 🤔 -- Anyway as long as it doesn't bother you 🤗
@prologic No, I'm not bothered by it at all. I get enough bots on there trying to exploit old WordPress vulnerabilities and the like that I can't be too mad about a legitimate service doing what it was designed to do.
@prologic No, I'm not bothered by it at all. I get enough bots on there trying to exploit old WordPress vulnerabilities and the like that I can't be too mad about a legitimate service doing what it was designed to do.
@mckinley Haha! 🤣 I get that all the time to! 😂 I just find it funny because there isn't a single shred of PHP or Wordpress that I run anywhere in my infra 😂
@mckinley Haha! 🤣 I get that all the time to! 😂 I just find it funny because there isn't a single shred of PHP or Wordpress that I run anywhere in my infra 😂
@prologic @mckinley Me too!\n\n $ grep Aug/2021 /var/www/logs/mkws.shaccess.log | grep wp | wc -l\n 126
@prologic @mckinley Me too!
$ grep Aug/2021 /var/www/logs/mkws.shaccess.log | grep wp | wc -l
126
@prologic @mckinley Me too!\n\n $ grep Aug/2021 /var/www/logs/mkws.shaccess.log | grep wp | wc -l\n 126