# I am the Watcher. I am your guide through this vast new twtiverse.
#
# Usage:
# https://watcher.sour.is/api/plain/users View list of users and latest twt date.
# https://watcher.sour.is/api/plain/twt View all twts.
# https://watcher.sour.is/api/plain/mentions?uri=:uri View all mentions for uri.
# https://watcher.sour.is/api/plain/conv/:hash View all twts for a conversation subject.
#
# Options:
# uri Filter to show a specific users twts.
# offset Start index for quey.
# limit Count of items to return (going back in time).
#
# twt range = 1 196269
# self = https://watcher.sour.is?offset=169756
# next = https://watcher.sour.is?offset=169856
# prev = https://watcher.sour.is?offset=169656
@prologic it hasn't been solved, that's why we are here on this yarn, still. LOL. I believe the hash mismatch is happening because of an edited twtxt. I don't follow the OP, so I have no way to check (not that I am certain it could be possible), but I have seeing similar issues in the past as a result of an edit. That's one of the reasons I don't edit anymore. 😬
@prologic I tried hosting my own Matrix server once, I got wrecked! 🤣 and I believe that experience established a good base line for me to avoid self-hosting anything federated (except for a TWTX feed).
Skill issues aside (since I'm willing to learn), my internet speed is a huge limitation (I have less than 1Mb Up) 🫠 Then again, there's the Running stuff off of my RPI's SD Card 😅 that's just asking for trouble.
Seriously, I should get a proper Job, at least I'll be able to afford my curiosities 🙃
@prologic I tried hosting my own Matrix server once, I got wrecked! 🤣 and I believe that experience established a good base line for me to avoid self-hosting anything federated (except for a TWTX feed).
Skill issues aside (since I'm willing to learn), my internet speed is a huge limitation (I have less than 1Mb Up) 🫠 Then again, there's the Running stuff off of my RPI's SD Card 😅 that's just asking for trouble.
Seriously, I should get a proper Job, at least I'll be able to afford my curiosities 🙃
@prologic I tried hosting my own Matrix server once, I got wrecked! 🤣 and I believe that experience established a good base line for me to avoid self-hosting anything federated (except for a TWTX feed).
Skill issues aside (since I'm willing to learn), my internet speed is a huge limitation (I have less than 1Mb Up) 🫠 Then again, there's the Running stuff off of my RPI's SD Card 😅 that's just asking for trouble.
Seriously, I should get a proper Job, at least I'll be able to afford my curiosities 🙃
[47°09′17″S, 126°43′32″W] --bad checksum--
@falsifian You are totally right. The specs are at least "open enough" for us to consider that as an implementation detail. We, and by we I mean @movq @lyse @bender @xuu and others should discuss this in more detail I believe and try to see if we can agree on what we're trying to solve.
> Does yarnd provide an API for finding twts? Is it similar?
No, it doesn't. But yarns (_the search engine/crawler wrote_) seems more fitting here. It's been discussed before, the possibility of building a "Twtxt Register v1" compatible API for yarns. I _think_ a search engine + crawler + registry (_especially ones that can form a bit of a "distributed network_) are far more useful I _think_ in order to support the _actual_ decentralised Twtxt / Yarn ecosystem (_which is how I prefer to describe it_).
@falsifian You are totally right. The specs are at least "open enough" for us to consider that as an implementation detail. We, and by we I mean @movq @lyse @bender @xuu and others should discuss this in more detail I believe and try to see if we can agree on what we're trying to solve.
> Does yarnd provide an API for finding twts? Is it similar?
No, it doesn't. But yarns (_the search engine/crawler wrote_) seems more fitting here. It's been discussed before, the possibility of building a "Twtxt Register v1" compatible API for yarns. I _think_ a search engine + crawler + registry (_especially ones that can form a bit of a "distributed network_) are far more useful I _think_ in order to support the _actual_ decentralised Twtxt / Yarn ecosystem (_which is how I prefer to describe it_).
@falsifian Ahh but this is solved now with the new single shot fetch?
@falsifian Ahh but this is solved now with the new single shot fetch?
[47°09′34″S, 126°43′43″W] Re-taking samples
[47°09′13″S, 126°43′10″W] Transfer aborted
The actual end-user problem is that I can't see the thread properly when using neomutt+jenny.
@prologic One of your twts begins with (#st3wsda): https://twtxt.net/twt/bot5z4q
Based on the twtxt.net web UI, it seems to be in reply to a twt by @cuaxolotl which begins "I’ve been sketching out...".
But jenny thinks the hash of that twt is 6mdqxrq. At least, there's a very twt in their feed with that hash that has the same text as appears on yarn.social (except with ' instead of ’).
Based on this, it appears jenny and yarnd disagree about the hash of the twt, or perhaps the twt was edited (though I can't see any difference, assuming ' vs ’ is just a rendering choice).
@prologic I believe you when you say registries as designed today do not crawl. But when I first read the spec, it conjured in my mind a search engine. Now I don't know how things work out in practice, but just based on reading, I don't see why it can't be an API for a crawling search engine. (In fact I don't see anything in the spec indicating registry servers shouldn't crawl.)
(I also noticed that https://twtxt.readthedocs.io/en/latest/user/registry.html recommends "The registries should sync each others user list by using the users endpoint". If I understood that right, registering with one should be enough to appear on others, even if they don't crawl.)
Does yarnd provide an API for finding twts? Is it similar?
@bender I've sort of lost the plot here a bit 🤦♂️ What's the problem we're trying to figure out? 🤔
@bender I've sort of lost the plot here a bit 🤦♂️ What's the problem we're trying to figure out? 🤔
@prologic why would you think it is changed in jenny? Falsifian (I still can’t mention while on mobile) said jenny, and the manual calculation match. Yarn seems to be the one at odd.
@falsifian You are however right that registries always had a "search" capability, amost others.
@falsifian You are however right that registries always had a "search" capability, amost others.
@movq Jenny hasn't changed the way it computes hashes has it? (yarnd certainly hasn't).
@movq Jenny hasn't changed the way it computes hashes has it? (yarnd certainly hasn't).
@falsifian I _think_ I'm missing something in my description. When I say "search engine" I also mean "with a crawler" that is able to self-discover feeds. A registry (_as designed today, or as the spec described_) required users to add their feeds to one or more registries, putting the burden on the user(s). I for example do not bother adding my feed to a registry (_which one would I add it to anyway?_)_
@falsifian I _think_ I'm missing something in my description. When I say "search engine" I also mean "with a crawler" that is able to self-discover feeds. A registry (_as designed today, or as the spec described_) required users to add their feeds to one or more registries, putting the burden on the user(s). I for example do not bother adding my feed to a registry (_which one would I add it to anyway?_)_
@prologic I guess I thought they were search engines. Anyway, the registry API looks like a decent one for searching for tweets. Could/should yarn.social pods implement the same API?
I just manually followed the steps at https://dev.twtxt.net/doc/twthashextension.html and got 6mdqxrq. I wonder what happened. Did @cuaxolo edit the twt in some subtle way after twtxt.net downloaded it? I couldn't spot a diff, other than ' appearing as ’ on yarn.social, which I assume is a transformation done by twtxt.net.
@falsifian to my knowledge registries were never designed to crawl the Twtxt space. If they did, they would be considered a search engine 🤣
@falsifian to my knowledge registries were never designed to crawl the Twtxt space. If they did, they would be considered a search engine 🤣
@prologic What's the difference between search.twtxt.net and the /api/plain/tweets endpoint of a registry? In my mind, a registry is a twtxt search engine. Or are registries not supposed to do their own crawling to discover new feeds?
@falsifian So yes, you would ask a pod about the missing Twt by hash, or whatever. Pods do this already, even though there aren't that many now, so it maybe a bit less effective today. However it's more of a small/tiny "distributed" protocol, you ask _any_ pod.
On registries however, I think a registry is the wrong approach. I see far greater value in feed crawlers and search engines like the (_half baked one_) I built over at https://search.twtxt.net/
@falsifian So yes, you would ask a pod about the missing Twt by hash, or whatever. Pods do this already, even though there aren't that many now, so it maybe a bit less effective today. However it's more of a small/tiny "distributed" protocol, you ask _any_ pod.
On registries however, I think a registry is the wrong approach. I see far greater value in feed crawlers and search engines like the (_half baked one_) I built over at https://search.twtxt.net/
@prologic How does yarn.social's API fix the problem of centralization? I still need to know whose API to use.
Say I see a twt beginning (#hash) and I want to look up the start of the thread. Is the idea that if that twt is hosted by a a yarn.social pod, it is likely to know the thread start, so I should query that particular pod for the hash? But what if no yarn.social pods are involved?
The community seems small enough that a registry server should be able to keep up, and I can have a couple of others as backups. Or I could crawl the list of feeds followed by whoever emitted the twt that prompted my query.
I have successfully used registry servers a little bit, e.g. to find a feed that mentioned a tag I was interested in. Was even thinking of making my own, if I get bored of my too many other projects :-)
@bender I usually follow anyone and anything, then I unfollow when they turn out to be either not interesting or otherwise 🤣
@bender I usually follow anyone and anything, then I unfollow when they turn out to be either not interesting or otherwise 🤣
@mckinley Why is it so hard so you think? 🤔 What's missing to make this an easy choice for folks? 🤔
@mckinley Why is it so hard so you think? 🤔 What's missing to make this an easy choice for folks? 🤔
@movq Thanks, it works!
But when I tried it out on a twt from @prologic, I discovered jenny and yarn.social seem to disagree about the hash of this twt: https://twtxt.net/twt/st3wsda . jenny assigned it a hash of 6mdqxrq but the URL and prologic's reply suggest yarn.social thinks the hash is st3wsda. (And as a result, jenny --fetch-context didn't work on prologic's twt.)
🧮 USERS:1 FEEDS:2 TWTS:1083 ARCHIVED:78202 CACHE:2449 FOLLOWERS:17 FOLLOWING:14
i know i can't keep living in this dead or dying dream..
no but linux containers aren't secure. yeah, they're administrative boundaries. a sandbox would be nice, but this isn't Sun. we have fallen from grace. tape the box closed with AppArmor if you need to and flip the exact 11 switches that apply for your impending scenario. i'm sure nobody will steal your data.
@mckinley I used the official client, but logged on my PDS, running under my control.
YOU LIVE ON STOLEN LAND GOVERNED BY U.S. CORPORATIONS =3
#freePalestine #freeSudan #freeCongo #freeTurtleIsland EMPIRE MUST FALL
when I say 'functional programming' you think 'haskell' and I think 'BQN'
Serious open (for anyone) question: what makes you follow someone on twtxt? Will you just follow anyone that you come across, simply because that someone using the "decentralised, minimalist microblogging service for hackers" microblog?
Not even the slightest chance on the link. Like an absolute zero. On the hashtag, I subscribe.
[47°09′16″S, 126°43′55″W] Waiting for carrier
Pinellas County Running: 3.02 miles, 00:08:52 average pace, 00:26:46 duration
just needed to get out. first run since the PTC and felt great.
#running
Pinellas County Running: 3.02 miles, 00:08:52 average pace, 00:26:46 duration
just needed to get out. first run since the PTC and felt great.
#running
Pinellas County Running: 3.02 miles, 00:08:52 average pace, 00:26:46 duration
just needed to get out. first run since the PTC and felt great.
#running
my workflow for posting images is awful XD
The plan is coming together. I am making friends and I'm doing the LA gay shit. I'm going outside, I'm getting laid. I'm like a real person. I have an old friend back in my life even.
[47°09′05″S, 126°43′34″W] Carrier too weak
@abucci OMFG! Dear jebus, look at the size of that! :-/ It is just a matter of time until one of those randomly falls on any of us. Just incredible!
@abucci OMFG! Dear jebus, look at the size of that! :-/ It is just a matter of time until one of those randomly falls on any of us. Just incredible!
@bender Hehe this is soo true 🤣 And I hate it 😅
@bender Hehe this is soo true 🤣 And I hate it 😅
@prologic so is Yarn. twtxt.net is a "top heavy" instance. :-P
[47°09′46″S, 126°43′01″W] Sample analyzing complete -- starting transfer
[47°09′32″S, 126°43′01″W] Analyzing samples
[47°09′37″S, 126°43′17″W] --interrupted--
Is it really that fucking hard to use decentralized, Self-Hosted tech? 🤔 Or do people just not know how? 😢
Is it really that fucking hard to use decentralized, Self-Hosted tech? 🤔 Or do people just not know how? 😢
@bender Yes yes but this is exactly my point! We again have a social network claiming to be "decentralized" only to have " top heavy" instances 🤣 -- Mastodon is the same too 😅
@bender Yes yes but this is exactly my point! We again have a social network claiming to be "decentralized" only to have " top heavy" instances 🤣 -- Mastodon is the same too 😅
🧮 USERS:1 FEEDS:2 TWTS:1082 ARCHIVED:78194 CACHE:2455 FOLLOWERS:17 FOLLOWING:14
@prologic you can run your own Personal Data Server (PDS), to which you login to, and your data is kept. If you use BlueSky servers, you are at their mercy.
@slashdot Hang on a minute!!! 😱
> This rapid growth led some users to encounter the occasional error that would state there were 'Not Enough Resources' to handle requests, as Bluesky engineers scrambled to keep the servers stable under the influx of new sign-ups,"
I thought BlueSky was supposed to be a decentralized social metwork?! 🤦♂️
@slashdot Hang on a minute!!! 😱
> This rapid growth led some users to encounter the occasional error that would state there were 'Not Enough Resources' to handle requests, as Bluesky engineers scrambled to keep the servers stable under the influx of new sign-ups,"
I thought BlueSky was supposed to be a decentralized social metwork?! 🤦♂️
@cuaxolotl Very interesting! 🤔What makes this "offline" first though? 🤔
@cuaxolotl Very interesting! 🤔What makes this "offline" first though? 🤔
@cuaxolotl Interestinf 🤔 Thanks for supporting the work we've done too! Happy to hear improvement suggestions too 👌
@cuaxolotl Interestinf 🤔 Thanks for supporting the work we've done too! Happy to hear improvement suggestions too 👌
@movq All totally makes sense actuallly 🤣
@movq All totally makes sense actuallly 🤣
[47°09′58″S, 126°43′39″W] Raw reading: 0x66D75CB2, offset +/-3
@cuaxolotl Ah, thanks for reporting back! Okay, so you’re basically manually “crawling” feeds right now. 🤔 What do you think about the idea of adding something like # follow_notify = gemini://foo/bar to your feed’s metadata, so that clients who follow you can ping that URL every now and then? How would you even notice that, do you regularly read your gemini logs? 🤔
@cuaxolotl Ah, thanks for reporting back! Okay, so you’re basically manually “crawling” feeds right now. 🤔 What do you think about the idea of adding something like # follow_notify = gemini://foo/bar to your feed’s metadata, so that clients who follow you can ping that URL every now and then? How would you even notice that, do you regularly read your gemini logs? 🤔
@cuaxolotl Ah, thanks for reporting back! Okay, so you’re basically manually “crawling” feeds right now. 🤔 What do you think about the idea of adding something like # follow_notify = gemini://foo/bar to your feed’s metadata, so that clients who follow you can ping that URL every now and then? How would you even notice that, do you regularly read your gemini logs? 🤔
@cuaxolotl Ah, thanks for reporting back! Okay, so you’re basically manually “crawling” feeds right now. 🤔 What do you think about the idea of adding something like # follow_notify = gemini://foo/bar to your feed’s metadata, so that clients who follow you can ping that URL every now and then? How would you even notice that, do you regularly read your gemini logs? 🤔
And the bonus read is also interesting:
https://devblogs.microsoft.com/oldnewthing/20211129-00/?p=105979
Confession: I completely forgot that Alt+Tab existed in text mode. 🤦 It’s not even a hidden feature, it’s advertised right when you start a fullscreen dos box. Well, Alt+Tab wasn’t a thing I did regularly anyway – it was usually Ctrl+Esc to open the window list (which also worked in OS/2). 🤔 I *think* I only started using Alt+Tab when Windows 95 removed Ctrl+Esc (because it had no use anymore, it essentially got replaced by the tasklist).
And the bonus read is also interesting:
https://devblogs.microsoft.com/oldnewthing/20211129-00/?p=105979
Confession: I completely forgot that Alt+Tab existed in text mode. 🤦 It’s not even a hidden feature, it’s advertised right when you start a fullscreen dos box. Well, Alt+Tab wasn’t a thing I did regularly anyway – it was usually Ctrl+Esc to open the window list (which also worked in OS/2). 🤔 I *think* I only started using Alt+Tab when Windows 95 removed Ctrl+Esc (because it had no use anymore, it essentially got replaced by the tasklist).
And the bonus read is also interesting:
https://devblogs.microsoft.com/oldnewthing/20211129-00/?p=105979
Confession: I completely forgot that Alt+Tab existed in text mode. 🤦 It’s not even a hidden feature, it’s advertised right when you start a fullscreen dos box. Well, Alt+Tab wasn’t a thing I did regularly anyway – it was usually Ctrl+Esc to open the window list (which also worked in OS/2). 🤔 I *think* I only started using Alt+Tab when Windows 95 removed Ctrl+Esc (because it had no use anymore, it essentially got replaced by the tasklist).
And the bonus read is also interesting:
https://devblogs.microsoft.com/oldnewthing/20211129-00/?p=105979
Confession: I completely forgot that Alt+Tab existed in text mode. 🤦 It’s not even a hidden feature, it’s advertised right when you start a fullscreen dos box. Well, Alt+Tab wasn’t a thing I did regularly anyway – it was usually Ctrl+Esc to open the window list (which also worked in OS/2). 🤔 I *think* I only started using Alt+Tab when Windows 95 removed Ctrl+Esc (because it had no use anymore, it essentially got replaced by the tasklist).
[47°09′47″S, 126°43′18″W] --white noise--
Introduction to JuiceFS | JuiceFS Document Center -- Thinking about using JuiceFS to solve a long-running problem I've always had.
- Be able to run services on _any_ node in my cluster and let Docker Swarm pick whatever node it likes (_instead of now where I have to pin some workloads to specific nodes, as that's where their local storage volume is_)
- Manage the scalability of data and growth over time instead of what I do now which is to extend EXT4 filesystems on my Docker Swarm nodes every few years.
Introduction to JuiceFS | JuiceFS Document Center -- Thinking about using JuiceFS to solve a long-running problem I've always had.
- Be able to run services on _any_ node in my cluster and let Docker Swarm pick whatever node it likes (_instead of now where I have to pin some workloads to specific nodes, as that's where their local storage volume is_)
- Manage the scalability of data and growth over time instead of what I do now which is to extend EXT4 filesystems on my Docker Swarm nodes every few years.
@bender Yeah that's for sure 👍 I use the Monaco font normally. Been using that for a few years now.
@bender Yeah that's for sure 👍 I use the Monaco font normally. Been using that for a few years now.