# I am the Watcher. I am your guide through this vast new twtiverse.
# 
# Usage:
#     https://watcher.sour.is/api/plain/users              View list of users and latest twt date.
#     https://watcher.sour.is/api/plain/twt                View all twts.
#     https://watcher.sour.is/api/plain/mentions?uri=:uri  View all mentions for uri.
#     https://watcher.sour.is/api/plain/conv/:hash         View all twts for a conversation subject.
# 
# Options:
#     uri     Filter to show a specific users twts.
#     offset  Start index for quey.
#     limit   Count of items to return (going back in time).
# 
# twt range = 1 196323
# self = https://watcher.sour.is?offset=147825
# next = https://watcher.sour.is?offset=147925
# prev = https://watcher.sour.is?offset=147725
❤️ 🎶: BOM BOM BOM by Punch
Então, para obter uma lista de users e o número de vídeos de cada um, esta linha serviu:

cat videos.jsonl | grep '\"author\":\"[a-z0-9]*\"' -o | sed 's/"author":"//;s/"//' | sort | uniq -c | sort -n | tac > users.txt

Isto é útil porque há vários "parceiros" (ex. noticiasaominuto) cujos vídeos não vão ser removidos e por isso não temos interesse em preservar

Vejo tb que o canal com mais vídeos (rtc) tem 43000 no dataset mas 91000 no site, por isso é uma boa medida de quão completo o nosso dataset está :-)

O top10 dos já descobertos:

43115 rtc
26422 tpa1
19110 canalq
18020 entretenimentoporto
14628 stv
14452 fantunes11
12712 portocanalonline
8641 alticemeokanal
8498 sapodesporto
7972 economicotv

cc @hugopeixoto @bossatossa@bossatossa

#sapovideos
Então, para obter uma lista de users e o número de vídeos de cada um, esta linha serviu:

cat videos.jsonl | grep '\"author\":\"[a-z0-9]*\"' -o | sed 's/"author":"//;s/"//' | sort | uniq -c | sort -n | tac > users.txt

Isto é útil porque há vários "parceiros" (ex. noticiasaominuto) cujos vídeos não vão ser removidos e por isso não temos interesse em preservar

Vejo tb que o canal com mais vídeos (rtc) tem 43000 no dataset mas 91000 no site, por isso é uma boa medida de quão completo o nosso dataset está :-)

O top10 dos já descobertos:

43115 rtc
26422 tpa1
19110 canalq
18020 entretenimentoporto
14628 stv
14452 fantunes11
12712 portocanalonline
8641 alticemeokanal
8498 sapodesporto
7972 economicotv

cc @hugopeixoto @bossatossa@bossatossa

#sapovideos
Sobre dar conselhos nas redes:

*If you don’t think you need to read this post because you’re always giving Good, Helpful Advice as a Good, Helpful Citizen, this one is for you. I’m sure you probably mean well, but it is with a heavy heart that I must inform you that you’ve likely annoyed the hell out of someone at some point or another. Probably more than once. Maybe it’s a regular pattern of behaviour. This post is for you.*

https://anotherangrywoman.com/2023/01/18/how-to-give-advice-on-the-internet-without-being-an-utter-menace/
❤️ 🎶: スパーク ’23 by BiSH
❤️ 🎶: スパーク ’23 by BiSH
[47°09′51″S, 126°43′21″W] --bad checksum--
❤️ 🎶: Clean Slate by The Mountain Goats
❤️ 🎶: Clean Slate by The Mountain Goats
❤️ 🎶: Save Me by MAMAMOO+
❤️ 🎶: Save Me by MAMAMOO+
❤️ 🎶: Lipad Ng Pangarap - From "Pira-Pirasong Paraiso" by Regine Velasquez
❤️ 🎶: Lipad Ng Pangarap - From "Pira-Pirasong Paraiso" by Regine Velasquez
[47°09′16″S, 126°43′02″W] --white noise--
🧮 USERS:1 FEEDS:2 TWTS:667 ARCHIVED:65494 CACHE:2196 FOLLOWERS:13 FOLLOWING:14
On my blog: Real Life in Star Trek, The High Ground https://john.colagioia.net/blog/2023/07/20/high-ground.html #scifi #startrek #closereading
@movq Wie so oft, der ursprüngliche Gedanke hinter solchem Zeug mag sogar wirklich eine gute Absicht verfolgt haben. Aber die Umsetzung davon schießt komplett am Ziel vorbei. Mit lichtjahregroßem Abstand. Beinahe gut, aber hauptsächlich schlecht. Kommt einem dann wie eine ABM vom Allerfeinsten vor. Ich fühle mit Dir.
@movq Hehe. Yeah, when there is nearly no programming to do at work, I have to code in my free time.
Just 25°C today and not humid. It felt quite cool. I loved it! We went for a stroll in the evening and the temperatures were perfect. 16°C tonight. \\o/ When I was waiting for my mate, I fooled myself:

Shaddow of a large hat

So I had to take a photo. Just too funny. Going up the mountain we smelled freshly baked bread. What an overpowering scent. The bread baking boys must have been firing the wood-burning oven at the summit shortly before we arrived. On the way down we ran into extremely cute lambs. Super adorable. If only I could have petted them.

Very pretty sheep

Even further down the mountain we came across a caterpillar. It totally looked like a flute wiper. Unfortunately, it walked too quickly for my camera's shutter speed and the fading light.

Some of the blackberries were already good to eat. Most of them, however, were still sour. Even though they heavily wacked them down last year for the forest liming, these blackberry bushes are three meters tall and about 40 meters in length. In a few weeks this strip in the forest will be heaven, I reckon.

Finally, we saw two deer on a meadow. Plenty of good encounters today. Just too much wind noise on the videos, sorry!
Just 25°C today and not humid. It felt quite cool. I loved it! We went for a stroll in the evening and the temperatures were perfect. 16°C tonight. \o/ When I was waiting for my mate, I fooled myself:

Shaddow of a large hat

So I had to take a photo. Just too funny. Going up the mountain we smelled freshly baked bread. What an overpowering scent. The bread baking boys must have been firing the wood-burning oven at the summit shortly before we arrived. On the way down we ran into extremely cute lambs. Super adorable. If only I could have petted them.

Very pretty sheep

Even further down the mountain we came across a caterpillar. It totally looked like a flute wiper. Unfortunately, it walked too quickly for my camera's shutter speed and the fading light.

Some of the blackberries were already good to eat. Most of them, however, were still sour. Even though they heavily wacked them down last year for the forest liming, these blackberry bushes are three meters tall and about 40 meters in length. In a few weeks this strip in the forest will be heaven, I reckon.

Finally, we saw two deer on a meadow. Plenty of good encounters today. Just too much wind noise on the videos, sorry!
@prologic Thanks :) Looking forward to get that feature in, since I like to share images that I take, will be a nice feature to have in the client as well. :)
[47°09′03″S, 126°43′58″W] Storm recedes -- back to normal work
[47°09′01″S, 126°43′50″W] Wind speed: 109kph -- batteries low
****
Mejor que la tele. ⌘ Read more****
[47°09′59″S, 126°43′09″W] Automatic systems disengaged due to blizzard
Boa notícia para freaks das frequências!

"A Entidade Reguladora para a Comunicação Social (ERC), recomendou a eventual criação do estatuto de rádio comunitária, pedindo ainda à Autoridade Nacional de Comunicações (Anacom) que considere a disponibilização de micro-frequências nesse sentido."

https://24.sapo.pt/amp/atualidade/artigos/radios-locais-erc-propoe-criacao-do-estatuto-de-radio-comunitaria-e-pede-a-anacom-micro-frequencias

#rádio
Get married last week-end. It’s always a pleasure to take time with close friends!
Get married last week-end. It’s always a pleasure to take time with close friends!
[47°09′31″S, 126°43′32″W] Wind speed: N/A -- Cannot comunicate
@lyse Also wir sind noch nicht durch damit (ISO27001), daher will ich mir da noch kein abschließendes Urteil erlauben und sollte eigentlich gar nicht so viel dazu schreiben. 😅

Aber was ich bisher so gesehen habe: *Eigentlich* ist das Regelwerk der ISO27001 gar nicht so schlecht, also die Gedanken darin/dahinter. (Natürlich kostet der Kram was, kannste also nicht mal einfach so reingucken.) Man könnte das schon als Grundlage nehmen, um sich mal die Firma anzugucken, was die so tut und wie sie das tut und dann tatsächlich Dinge verbessern.

Anders formuliert: Wenn du den Willen hast, dein Unternehmen zu verbessern, dann schau’ in die ISO27001 rein. Die gibt Ansatzpunkte und Ideen, an die du vielleicht gar nicht dachtest.

Wenn man das wirklich gewissenhaft macht und mehr als 5 Mitarbeitende hat, dann ist das aber ein *unfassbar* aufwändiger und schmerzhafter Vorgang. Ich kann mir beim besten Willen nicht vorstellen, dass die ganzen Unternehmen/Konzerne, die hübsch mit ISO27001-Zertifizierung werben, das auch so durchgezogen haben. No way. Und spätestens da fängt’s dann an, albern zu werden.
@lyse Also wir sind noch nicht durch damit (ISO27001), daher will ich mir da noch kein abschließendes Urteil erlauben und sollte eigentlich gar nicht so viel dazu schreiben. 😅

Aber was ich bisher so gesehen habe: *Eigentlich* ist das Regelwerk der ISO27001 gar nicht so schlecht, also die Gedanken darin/dahinter. (Natürlich kostet der Kram was, kannste also nicht mal einfach so reingucken.) Man könnte das schon als Grundlage nehmen, um sich mal die Firma anzugucken, was die so tut und wie sie das tut und dann tatsächlich Dinge verbessern.

Anders formuliert: Wenn du den Willen hast, dein Unternehmen zu verbessern, dann schau’ in die ISO27001 rein. Die gibt Ansatzpunkte und Ideen, an die du vielleicht gar nicht dachtest.

Wenn man das wirklich gewissenhaft macht und mehr als 5 Mitarbeitende hat, dann ist das aber ein *unfassbar* aufwändiger und schmerzhafter Vorgang. Ich kann mir beim besten Willen nicht vorstellen, dass die ganzen Unternehmen/Konzerne, die hübsch mit ISO27001-Zertifizierung werben, das auch so durchgezogen haben. No way. Und spätestens da fängt’s dann an, albern zu werden.
@lyse Also wir sind noch nicht durch damit (ISO27001), daher will ich mir da noch kein abschließendes Urteil erlauben und sollte eigentlich gar nicht so viel dazu schreiben. 😅

Aber was ich bisher so gesehen habe: *Eigentlich* ist das Regelwerk der ISO27001 gar nicht so schlecht, also die Gedanken darin/dahinter. (Natürlich kostet der Kram was, kannste also nicht mal einfach so reingucken.) Man könnte das schon als Grundlage nehmen, um sich mal die Firma anzugucken, was die so tut und wie sie das tut und dann tatsächlich Dinge verbessern.

Anders formuliert: Wenn du den Willen hast, dein Unternehmen zu verbessern, dann schau’ in die ISO27001 rein. Die gibt Ansatzpunkte und Ideen, an die du vielleicht gar nicht dachtest.

Wenn man das wirklich gewissenhaft macht und mehr als 5 Mitarbeitende hat, dann ist das aber ein *unfassbar* aufwändiger und schmerzhafter Vorgang. Ich kann mir beim besten Willen nicht vorstellen, dass die ganzen Unternehmen/Konzerne, die hübsch mit ISO27001-Zertifizierung werben, das auch so durchgezogen haben. No way. Und spätestens da fängt’s dann an, albern zu werden.
[47°09′40″S, 126°43′56″W] Wind speed: 68kph
@lyse Haha. It didn’t grow at all, because I didn’t write a single line of Rust since then. 😢 I hardly wrote any code at all in the last few months, let alone start new projects that are worth being written in Rust (as opposed to “I can do this as a shellscript or in Python – mentally, Rust is a replacement for C for me).
@lyse Haha. It didn’t grow at all, because I didn’t write a single line of Rust since then. 😢 I hardly wrote any code at all in the last few months, let alone start new projects that are worth being written in Rust (as opposed to “I can do this as a shellscript or in Python – mentally, Rust is a replacement for C for me).
@lyse Haha. It didn’t grow at all, because I didn’t write a single line of Rust since then. 😢 I hardly wrote any code at all in the last few months, let alone start new projects that are worth being written in Rust (as opposed to “I can do this as a shellscript or in Python – mentally, Rust is a replacement for C for me).
user/bmallred/data/2023-07-19-16-39-50.fit: 01:09:41 duration

#swimming
user/bmallred/data/2023-07-19-16-39-50.fit: 01:09:41 duration

#swimming
user/bmallred/data/2023-07-19-16-39-50.fit: 01:09:41 duration

#swimming
Kauai County Pool Swimming: 01:09:41 duration

#swimming
@lyse Thank you! 🙇‍♂️
@lyse Thank you! 🙇‍♂️
@lyse Thank you! 🙇‍♂️
🧮 USERS:1 FEEDS:2 TWTS:666 ARCHIVED:65487 CACHE:2199 FOLLOWERS:13 FOLLOWING:14
OK isto é em cima do joelho mas alinhei um método para fazer backups de uma conta qualquer do Sapo Vídeos. Testado em Linux e tb deve dar em Mac

1. Abre as developer tools do teu browser (tecla F12) e abre o tab "Network"
2. Abre a página de um user
3. Faz scroll para baixo, vão aparecer linhas novas na tab network
4. Quando chegares ao fim da lista, clica em cada uma das linhas e à direita faz copy do campo "data" (v. img), e cola o resultado num editor de texto
5. Repete pra todas e grava o texto como videos.txt

Agora no terminal, vai ao dir onde tens o videos.txt para podermos extrair o identificador de cada vídeo encontrado

cat videos.txt | grep randname | cut -c 17-36 > randnames.txt

e agora podemos descarregar tudo de uma vez com o yt-dlp:

while read p; do yt-dlp "http://videos.sapo.pt/$p"; done < randnames.txt

E deve dar, ou não. Apontei isto a correr para não perder a referência, e porque não tenho tempo de escrever um scraper. Talvez dê jeito a alguém.

Obrigado @brunomiguel e @JD557@JD557 pelas pistas! developer tools do firefox a mostrar uma response e o campo JSON a copiar
user/bmallred/data/2023-07-19-10-55-00.fit: 00:30:08 duration

#swimming
Kauai County Pool Swimming: 00:30:08 duration

#swimming
user/bmallred/data/2023-07-19-10-55-00.fit: 00:30:08 duration

#swimming
user/bmallred/data/2023-07-19-10-55-00.fit: 00:30:08 duration

#swimming
@movq How's your list growing so far?
@prologic What kind of stuff are you looking for? Further recommendations in addition to last time:

* https://www.youtube.com/@StefanGotteswinter/videos Machining tiny parts
* https://www.youtube.com/@ThisOldTony/videos Machining and engineering
* https://www.youtube.com/@urituchmanpigeon/videos Building cool stuff
* https://www.youtube.com/@torbjornahman/videos Blacksmithing
* https://www.youtube.com/@Matthiaswandel/videos Woodworking and engineering
* https://www.youtube.com/@matthiasrandomstuff2221/videos All sorts of engineering
* https://www.youtube.com/@SVSeeker/videos Building a steel sailing vessel and sailing
* https://www.youtube.com/@ProjectBrupeg/videos Restoring a steel trawler
* https://www.youtube.com/@SampsonBoatCo/videos Rebuilding a wooden sailing yacht*
user/bmallred/data/2023-07-19-09-46-42.fit: 00:41:28 duration

#swimming
user/bmallred/data/2023-07-19-09-46-42.fit: 00:41:28 duration

#swimming
user/bmallred/data/2023-07-19-09-46-42.fit: 00:41:28 duration

#swimming
Kauai County Pool Swimming: 00:41:28 duration

#swimming
Oh great, been affected by a T-Offline area fault yesterday evening. They said that at three o'clock in the morning the internet should work again. This morning, however, everything was still dead and the estimated repair date was postponed to quarter to two in ther afternoon. After lunch, luckily, everything worked again. Reliable connectivity: here be dragons.
@movq Da geht mir auch jedes Mal das Messer in der Hose auf. Elendiges Compliancetheater steht uns auch noch demnächst bevor. Mal so überhaupt gar keinen Bock drauf. :-( Das schlimme ist, es macht die Sache keinen Deut besser, im Gegenteil.
Yes, @movq, probably. Mjam, mjam, mjam.
[47°09′33″S, 126°43′19″W] Working impossible due to heavy rain
@movq We have some common wood pidgeons around here in the neighborhood. The collared ones I apparently only heard in the distance so far. ;-) But also in the forest, I'm pretty sure.

Yeah, listening to all these owl calls on YouTube I was surprised that they were so short. All those years I thought hoots are much, much longer. Learning something new very day. :-)
Was a really nice trip to the dogpark, he got to play a lot with a beagle, they ran for an hour and had fun. :)
More on #CRA: Filezilla stopped distribution of downloads in Europe, as a protest.
[47°09′35″S, 126°43′02″W] Automatic systems disengaged due to thunderstorm
@movq Sounds very nice and calming 👌
@movq Sounds very nice and calming 👌
@movq Sounds very nice and calming 👌
@movq Oh I must have missed it 🤦‍♂️
@movq Oh I must have missed it 🤦‍♂️
@movq Oh I must have missed it 🤦‍♂️
Heading off to the dog park tonight, will be nice for our dog to run as much as he likes! It's a plot of forest that's fenced in, and it's big enough for you to do some walking there as well and train on recall and all that good stuff.
@prologic I’ve posted a sample a few days ago, that’s gotta do! 😅 https://movq.de/v/d39298c085/xfiles-upright-bass.ogg
@prologic I’ve posted a sample a few days ago, that’s gotta do! 😅 https://movq.de/v/d39298c085/xfiles-upright-bass.ogg
@prologic I’ve posted a sample a few days ago, that’s gotta do! 😅 https://movq.de/v/d39298c085/xfiles-upright-bass.ogg
lol @ the nauty source code: some functions are >1k lines long
lol @ the nauty source code: some functions are >1k lines long
lol @ the nauty source code: some functions are >1k lines long
@stigatle I can do that👌
@stigatle I can do that👌
@stigatle I can do that👌
@movq Oh c'mon 😆
@movq Oh c'mon 😆
@movq Oh c'mon 😆
@mov🤣 Haha 😆
@mov🤣 Haha 😆
@mov🤣 Haha 😆
Google turned Google Chat into … a forum. We’ve come full circle.
Google turned Google Chat into … a forum. We’ve come full circle.
Google turned Google Chat into … a forum. We’ve come full circle.
@prologic Hm, not this time, no. 😅 I’m just happy and enjoying this instrument. 👌
@prologic Hm, not this time, no. 😅 I’m just happy and enjoying this instrument. 👌
@prologic Hm, not this time, no. 😅 I’m just happy and enjoying this instrument. 👌
Wenn ich noch einmal „diese Richtlinie stellt sicher, dass …“ höre, setzt es was. Nix ist da sichergestellt. Wir können darüber diskutieren, ob irgendwelche PDFs irgendwo vielleicht *Hilfestellungen* sind, sofern sie denn überhaupt bekannt, gelesen und verstanden worden sind. Aber das war’s. #ComplianceTheater
Wenn ich noch einmal „diese Richtlinie stellt sicher, dass …“ höre, setzt es was. Nix ist da sichergestellt. Wir können darüber diskutieren, ob irgendwelche PDFs irgendwo vielleicht *Hilfestellungen* sind, sofern sie denn überhaupt bekannt, gelesen und verstanden worden sind. Aber das war’s. #ComplianceTheater
Wenn ich noch einmal „diese Richtlinie stellt sicher, dass …“ höre, setzt es was. Nix ist da sichergestellt. Wir können darüber diskutieren, ob irgendwelche PDFs irgendwo vielleicht *Hilfestellungen* sind, sofern sie denn überhaupt bekannt, gelesen und verstanden worden sind. Aber das war’s. #ComplianceTheater
@prologic I think the API is is fine :). But to be honest - one thing that would help me is a commandline curl example on how to upload a image, I take these curl commands through a converter that makes it into libcurl c++ code which I then use :) If you could help me with such a image upload curl example then I'd appreciate it! (I'm currently missing media upload).. And having that feature would be great! :)
@stigatle Would it help with improvements to the API? 🤔
@stigatle Would it help with improvements to the API? 🤔
@stigatle Would it help with improvements to the API? 🤔
Graças ao @brunomiguel fiquei a saber que o Sapo Vídeos vai encerrar, o que vai ser uma perda imensa em termos de cultura da net em Portugal. Por exemplo, os primeiros vídeos do GANA (autores do Bruno Aleixo) estão todos lá, junto com outras preciosidades mais recônditas, e vai tudo por água abaixo.

Conhecem alguém no arquivo.pt? Era fundamental ser feito o arquivamento disto, já se viu que se dependemos das empresas, tudo eventualmente desaparece.
I need to do a big rewrite on how the yarn desktop client handles the status widgets, this is because I want links and such, and to do that I have to rewrite the status message code, it takes a bit if time to do it, but I kinda know what to do - I just need to dive in and get it done. Been thinking about it for a while, I think it's time to get started on it. Also makes the code much cleaner then what it is now.