# I am the Watcher. I am your guide through this vast new twtiverse.
# 
# Usage:
#     https://watcher.sour.is/api/plain/users              View list of users and latest twt date.
#     https://watcher.sour.is/api/plain/twt                View all twts.
#     https://watcher.sour.is/api/plain/mentions?uri=:uri  View all mentions for uri.
#     https://watcher.sour.is/api/plain/conv/:hash         View all twts for a conversation subject.
# 
# Options:
#     uri     Filter to show a specific users twts.
#     offset  Start index for quey.
#     limit   Count of items to return (going back in time).
# 
# twt range = 1 61083
# self = https://watcher.sour.is?uri=https://twtxt.net/user/prologic/twtxt.txt&offset=36491
# next = https://watcher.sour.is?uri=https://twtxt.net/user/prologic/twtxt.txt&offset=36591
# prev = https://watcher.sour.is?uri=https://twtxt.net/user/prologic/twtxt.txt&offset=36391
Let's see where this can go... its a good use of the chromedp library πŸ‘Œ
@mckinley Code is here: https://git.mills.io/prologic/mirror
@mckinley Code is here: https://git.mills.io/prologic/mirror
@mckinley I can confirm the library "does what it says on the tin" πŸ‘Œ I'll put up my little CLI tool up for you to play with, its pretty damn stupid and basic right now as I'm not completely yet really sure how to flesh this out. Will need you to guide me on this, there's probably a fair few nuances to writing a decent web mirroring tool (at least it does the right thing though and handles dynamic content rendered with Javascript -- Which I tested by hitting my files.mills.io web app which has a pure JS frontend using MithrilJS)

@mckinley I can confirm the library "does what it says on the tin" πŸ‘Œ I'll put up my little CLI tool up for you to play with, its pretty damn stupid and basic right now as I'm not completely yet really sure how to flesh this out. Will need you to guide me on this, there's probably a fair few nuances to writing a decent web mirroring tool (at least it does the right thing though and handles dynamic content rendered with Javascript -- Which I tested by hitting my files.mills.io web app which has a pure JS frontend using MithrilJS)

@mckinley I'll think about it -- It probably isn't that much code to write 🀞
@mckinley I'll think about it -- It probably isn't that much code to write 🀞
@mckinley Got it πŸ‘Œ
@mckinley Got it πŸ‘Œ
I guess the issue I have with man pages is they're hard to navigate.
I guess the issue I have with man pages is they're hard to navigate.
@adi Yup I see your point now πŸ˜† Quite clever use of man pages πŸ‘Œ (not that I use them much if at all πŸ€¦β€β™‚οΈ)
@adi Yup I see your point now πŸ˜† Quite clever use of man pages πŸ‘Œ (not that I use them much if at all πŸ€¦β€β™‚οΈ)
@mckinley Yes yes but if this library will do the trick happy to write said tool for you and who knows anyone else in need?
@mckinley Yes yes but if this library will do the trick happy to write said tool for you and who knows anyone else in need?
@mckinley Haha I see hmmm πŸ˜†πŸ€ž
@mckinley Haha I see hmmm πŸ˜†πŸ€ž
@adi And I'm out πŸ€¦β€β™‚οΈ
@adi And I'm out πŸ€¦β€β™‚οΈ
@adi Ahh that would be cool πŸ‘Œ
@adi Ahh that would be cool πŸ‘Œ
@adi You realize Google searches are personalized and Google knows and tracks what you want to see right? πŸ˜†
@adi You realize Google searches are personalized and Google knows and tracks what you want to see right? πŸ˜†
What does creating man pages for HTML elements have to do with scraping web pages?! πŸ˜†
What does creating man pages for HTML elements have to do with scraping web pages?! πŸ˜†
@mckinley cause of probably write a command-line tool for you that uses that library. If you tell me what basic things you need it to do?
@mckinley cause of probably write a command-line tool for you that uses that library. If you tell me what basic things you need it to do?
@mckinley Ahh I see πŸ‘Œ Well fortunately tool l linked above looks like it might do the trick for you πŸ€—
@mckinley Ahh I see πŸ‘Œ Well fortunately tool l linked above looks like it might do the trick for you πŸ€—
@adi Congrats I guess? πŸ₯³
@adi Congrats I guess? πŸ₯³
@adi I don't see it happening... Besides Yarn is better πŸ˜†
@adi I don't see it happening... Besides Yarn is better πŸ˜†
What about this?

geziyor/geziyor: Geziyor, blazing fast web crawling
What about this?

geziyor/geziyor: Geziyor, blazing fast web crawling
@mckinley Wait what?! ... Why?! What are you doing? Are you trying to write a web search engine / crawler? πŸ˜…
@mckinley Wait what?! ... Why?! What are you doing? Are you trying to write a web search engine / crawler? πŸ˜…
@darch Do you have a specific use-case in mind I can help with? πŸ˜… There is API Documentation -- But its manually maintained, I will be sure to update it since this is one of the first new endpoints we've added in a long time.
@darch Do you have a specific use-case in mind I can help with? πŸ˜… There is API Documentation -- But its manually maintained, I will be sure to update it since this is one of the first new endpoints we've added in a long time.
@darch Fark no! πŸ˜‚ I mean yes! πŸ€£πŸ˜‚ I'm thinking about that actually..:
@darch Fark no! πŸ˜‚ I mean yes! πŸ€£πŸ˜‚ I'm thinking about that actually..:
@eaplmx Hey btw... How's your Spanish speaking/writing Pod and community coming along? πŸ€” Are you actively promoting it anywhere? Is it listed somewhere for folks to join or get invites? πŸ€” Anything we can do to help? πŸ€”
@eaplmx Hey btw... How's your Spanish speaking/writing Pod and community coming along? πŸ€” Are you actively promoting it anywhere? Is it listed somewhere for folks to join or get invites? πŸ€” Anything we can do to help? πŸ€”
@eaplmx Cool πŸ‘Œ
@eaplmx Cool πŸ‘Œ
I just fixed a quick minor bug and then synced my feed πŸ‘Œ So far so good πŸ˜… Took a few seconds, but I expected that as it does a few computations as it tries to do a 3-way merge.
I just fixed a quick minor bug and then synced my feed πŸ‘Œ So far so good πŸ˜… Took a few seconds, but I expected that as it does a few computations as it tries to do a 3-way merge.
Hey @brasshopper πŸ‘‹ How's it going? πŸ€— What's new? πŸ€”
Hey @brasshopper πŸ‘‹ How's it going? πŸ€— What's new? πŸ€”
@tkanos Nice I knew you would πŸ‘Œ
@tkanos Nice I knew you would πŸ‘Œ
@eaplmx How are you finding Dart? πŸ€”
@eaplmx How are you finding Dart? πŸ€”
@mckinley See now why couldn't "they" discuss and have an interim sonceration like this πŸ˜†

Yes you would have to depend on a library for TLS but so what? That's just good reuse right?
@mckinley See now why couldn't "they" discuss and have an interim sonceration like this πŸ˜†

Yes you would have to depend on a library for TLS but so what? That's just good reuse right?
The only mailing list? I think it's run on the Debian lists server πŸ€”
The only mailing list? I think it's run on the Debian lists server πŸ€”
@news One feature in particular I'd like to make mention of, aside from the lovely work @darch did with the Settings page πŸ‘Œ

Introducing the Sync API and the yarnc sync command.

What doe this do? It allows you to basically performa. 3-way merge with a local twtxt.txt feed file on your local disk on your own device and synchronise this with your Yarn.social pod's feed (or other personas).

There is a -d/--delete flag that will cause Twts found in your Yarn.social feed but not in your locally synced version of the feed to be deleted.

Please please please be sure to backup your feed _before_ testing and give this a try. You _will_ need to grab the latest yarn sources and build and install the CLI (make install).

Enjoy! πŸ€—
@news One feature in particular I'd like to make mention of, aside from the lovely work @darch did with the Settings page πŸ‘Œ

Introducing the Sync API and the yarnc sync command.

What doe this do? It allows you to basically performa. 3-way merge with a local twtxt.txt feed file on your local disk on your own device and synchronise this with your Yarn.social pod's feed (or other personas).

There is a -d/--delete flag that will cause Twts found in your Yarn.social feed but not in your locally synced version of the feed to be deleted.

Please please please be sure to backup your feed _before_ testing and give this a try. You _will_ need to grab the latest yarn sources and build and install the CLI (make install).

Enjoy! πŸ€—
@movq Oh man that's cray cool! I love your gear πŸ˜… Wish I could take even photos of astronomical bodies this good 🀣
@movq Oh man that's cray cool! I love your gear πŸ˜… Wish I could take even photos of astronomical bodies this good 🀣
@eaplmx Yeah I love what Snikket are doing and their work -- I just don't like XMPP πŸ˜…
@eaplmx Yeah I love what Snikket are doing and their work -- I just don't like XMPP πŸ˜…
@tkanos Awesome! πŸ‘Œ
@tkanos Awesome! πŸ‘Œ
@tkanos Good question. Let's search the archives and find out when we did this πŸ˜…
@tkanos Good question. Let's search the archives and find out when we did this πŸ˜…
@tkanos Nice! You should also link the extensions as well maybe? πŸ˜…
@tkanos Nice! You should also link the extensions as well maybe? πŸ˜…
@eaplmx Agreed πŸ‘Œ
@eaplmx Agreed πŸ‘Œ
@eaplmx I've actually had the pleasure of using this. The guy behind this is doing a great job! Its basically a custom XMPP server and Mobile App and Hosting. Kind of the model I'd like Yarn.social to be (we're kind of there) Self Hosted, Open Source, Mobile App, Hosting (coming soonβ„’).

Anyway, my experience is its pretty great. The Mobile App's UI/UX however is a bit "eh" but its good enough IMO.
@eaplmx I've actually had the pleasure of using this. The guy behind this is doing a great job! Its basically a custom XMPP server and Mobile App and Hosting. Kind of the model I'd like Yarn.social to be (we're kind of there) Self Hosted, Open Source, Mobile App, Hosting (coming soonβ„’).

Anyway, my experience is its pretty great. The Mobile App's UI/UX however is a bit "eh" but its good enough IMO.
@aryak Definitely a bug then 😒 Give me a day or two, I'll fix it πŸ‘Œ
@aryak Definitely a bug then 😒 Give me a day or two, I'll fix it πŸ‘Œ
@aryak I'll try to reproduce tomorrow and see if there's a bug... πŸ‘Œ
@aryak I'll try to reproduce tomorrow and see if there's a bug... πŸ‘Œ
@eaplmx Hmmm

- Learn Bitwarden
- Use Bitwarden
- Learn cryptography!
- Learn how _good_ password managers work like pass and gopass

You've got this ! πŸ‘Œ
@eaplmx Hmmm

- Learn Bitwarden
- Use Bitwarden
- Learn cryptography!
- Learn how _good_ password managers work like pass and gopass

You've got this ! πŸ‘Œ
@aryak How did you build this? _Could_ be a bug... But need to repro to fix it if it is a bug...
@aryak How did you build this? _Could_ be a bug... But need to repro to fix it if it is a bug...
@abucci Ahh! Very cool and nice story! πŸ‘Œ
@abucci Ahh! Very cool and nice story! πŸ‘Œ
@abucci Cool! πŸ‘Œ Actually I don't even know what your Avatar even is πŸ˜…
@abucci Cool! πŸ‘Œ Actually I don't even know what your Avatar even is πŸ˜…
@movq Good good! Anyone else? @abucci @darch @tkanos ... (apologies if anyone doesn't celebrate this time of year due to cultural/personal/religious reasons, etc... completely options of course πŸ€—)
@movq Good good! Anyone else? @abucci @darch @tkanos ... (apologies if anyone doesn't celebrate this time of year due to cultural/personal/religious reasons, etc... completely options of course πŸ€—)
Hey question for y'all... Are we gonna do the Christmas Avatar(s) thing again this year? We've been doing this for I want to say at least the past year now, let's make it a tradition? πŸ€” #xmas #avatars
Hey question for y'all... Are we gonna do the Christmas Avatar(s) thing again this year? We've been doing this for I want to say at least the past year now, let's make it a tradition? πŸ€” #xmas #avatars
Well not quite "countless" but a few more dozen and we _might_ be able to start saying that πŸ˜… ~621 actively indexed feeds to date...~
Well not quite "countless" but a few more dozen and we _might_ be able to start saying that πŸ˜… ~621 actively indexed feeds to date...~
@movq It's okay πŸ€— Its recorded in Yarn/Twtxt history forever now across countless clients and pods πŸ˜…
@movq It's okay πŸ€— Its recorded in Yarn/Twtxt history forever now across countless clients and pods πŸ˜…
@abucci Yeah I know. Clearly some people don't understand wtf TCP even means let alone TLS πŸ€¦β€β™‚οΈ
@abucci Yeah I know. Clearly some people don't understand wtf TCP even means let alone TLS πŸ€¦β€β™‚οΈ
Wow! 😳 The Gopher community (on the mailing list) is rather hostile 😒 I asked what the state of Gopher + TLS is these days and the response I got was basically:

- TLS is an abomination
- Gopher is a TCP protocol (doesn't TLS use TCP too?!)
- Gopher is already a fractured ecosystem
- blah blah blah

Not one single positive/constructive response.

Gopher is dead to me in that case πŸ€¦β€β™‚οΈ
Wow! 😳 The Gopher community (on the mailing list) is rather hostile 😒 I asked what the state of Gopher + TLS is these days and the response I got was basically:

- TLS is an abomination
- Gopher is a TCP protocol (doesn't TLS use TCP too?!)
- Gopher is already a fractured ecosystem
- blah blah blah

Not one single positive/constructive response.

Gopher is dead to me in that case πŸ€¦β€β™‚οΈ
@niplav.github.io Are we talking professional beggars here or?
@niplav.github.io Are we talking professional beggars here or?
@darch Ok πŸ‘Œ Let me know when good to merge πŸ‘