# I am the Watcher. I am your guide through this vast new twtiverse.
# 
# Usage:
#     https://watcher.sour.is/api/plain/users              View list of users and latest twt date.
#     https://watcher.sour.is/api/plain/twt                View all twts.
#     https://watcher.sour.is/api/plain/mentions?uri=:uri  View all mentions for uri.
#     https://watcher.sour.is/api/plain/conv/:hash         View all twts for a conversation subject.
# 
# Options:
#     uri     Filter to show a specific users twts.
#     offset  Start index for quey.
#     limit   Count of items to return (going back in time).
# 
# twt range = 1 16
# self = https://watcher.sour.is/conv/ldrbbkq
👋 Hey y'all Yarn.social pod operators... Looking for testing of this PR and the associated CLI tools there-in:

#1010 - Add support for indexing and searching an archive - yarn - Mills

cc @jlj @darch @xuu @eldersnake @abucci -- Let me know what you think of the interface, capabilities and so on. I plan to integrate this soon into the Web UI and API for yarnd 🤞
👋 Hey y'all Yarn.social pod operators... Looking for testing of this PR and the associated CLI tools there-in:

#1010 - Add support for indexing and searching an archive - yarn - Mills

cc @jlj @darch @xuu @eldersnake @abucci -- Let me know what you think of the interface, capabilities and so on. I plan to integrate this soon into the Web UI and API for yarnd 🤞
@prologic Is the notion to have the indexing kicked off automatically after a post when it's integrated?
@abucci Yes, essentially at "ingestion" time from the Cache.
@abucci Yes, essentially at "ingestion" time from the Cache.
@abucci If you're trying out the CLI tools index_archive and search_archive (I know @xuu is) -- I would appreciate feedback in terms of correctness of the indexed data, whether or not you couldn't find what you wanted easily, etc.

Kind of want to get the "indexing" right -- Even though I _think_ I'll design it such that you can rm -rf data/indexx and let yarnd re-index from the archive. At least this is how it works now, I see no reason to change the source-of-truth here
@abucci If you're trying out the CLI tools index_archive and search_archive (I know @xuu is) -- I would appreciate feedback in terms of correctness of the indexed data, whether or not you couldn't find what you wanted easily, etc.

Kind of want to get the "indexing" right -- Even though I _think_ I'll design it such that you can rm -rf data/indexx and let yarnd re-index from the archive. At least this is how it works now, I see no reason to change the source-of-truth here
@prologic OK, next time I get a chance to sit at my computer I'll give it a whirl
@abucci Thank you! 🙏 I'm _probably_ looking to fully integrate this work into the Web UI and API by next weekend hopefully 🤞
@abucci Thank you! 🙏 I'm _probably_ looking to fully integrate this work into the Web UI and API by next weekend hopefully 🤞
@prologic Initial comments: https://git.mills.io/yarnsocial/yarn/pulls/1010#issuecomment-13106

I'm stuck at this point. Search is not working as expected and I'm not sure what to do to proceed. I will keep hacking at it, but any pointers would be appreciated!
Never mind on that, I found the "hidden" -d option for search_archive!
Now stuck in a different spot. Put another comment in the pull request. I'm going to hold off on further testing till that gets sorted because I don't know what I'm doing 😆
I'm guessing my hangups are mostly because I'm not yet steeped in the lore of the project and they probably won't be an issue once merged into yarnd. Still, I'd like to help test if I can.
@abucci Nah you're all good 🤗 I literally hacked this up in a day 😂 Thays why I needed this feedback! 🙇‍♂️ Gimme time to improve things before final integration 🙏
@abucci Nah you're all good 🤗 I literally hacked this up in a day 😂 Thays why I needed this feedback! 🙇‍♂️ Gimme time to improve things before final integration 🙏