# I am the Watcher. I am your guide through this vast new twtiverse.
# 
# Usage:
#     https://watcher.sour.is/api/plain/users              View list of users and latest twt date.
#     https://watcher.sour.is/api/plain/twt                View all twts.
#     https://watcher.sour.is/api/plain/mentions?uri=:uri  View all mentions for uri.
#     https://watcher.sour.is/api/plain/conv/:hash         View all twts for a conversation subject.
# 
# Options:
#     uri     Filter to show a specific users twts.
#     offset  Start index for quey.
#     limit   Count of items to return (going back in time).
# 
# twt range = 1 6
# self = https://watcher.sour.is/conv/i4iupta
markwylde
twtxt.net
View Thread
How come there is only 25 pages of twts on the feed?

Does it cut off at 25 pages max, or 2 weeks old max?

What happens to older twts?

markwylde
twtxt.net
View Thread
@prologic for example, looking at your feed it says your first post was at 2022-03-09T23:38:24Z. But I know you were posting way before that. But if I look at mine, I see my first post was 2020-09-30T12:50:42Z.

So maybe it's cut off by file size?
mckinley
twtxt.net
View Thread
@markwylde If I recall, the twt retention on Yarn is time-based and it can be changed by the operator of the pod.

As for @prologic's feed, it's using the Archive Feeds extension to cut down on file size.
mckinley
twtxt.net
View Thread
@markwylde If I recall, the twt retention is time-based and it can be changed by the operator of the pod.

As for @prologic's feed, it's using the Archive Feeds extension to cut down on file size.
prologic
twtxt.net
View Thread
@mckinley is right. There are three different things going on here.

- The Cache limits what it hold "in-memory" by Size per Feed
- The Cache limits what it holds "in-memory" by TTL
- Old Twts are Archived to disk.

At _some_ point soon™ we will have integrated search on all Yarn.social pods (running yarnd) that will give us the capability of two things:

- Full Text / Keyword / Tag search (searching the archive)
- Pulling up older Twts for a Conversation view (from the archive)
prologic
twtxt.net
View Thread
@mckinley is right. There are three different things going on here.

- The Cache limits what it hold "in-memory" by Size per Feed
- The Cache limits what it holds "in-memory" by TTL
- Old Twts are Archived to disk.

At _some_ point soon™ we will have integrated search on all Yarn.social pods (running yarnd) that will give us the capability of two things:

- Full Text / Keyword / Tag search (searching the archive)
- Pulling up older Twts for a Conversation view (from the archive)