# I am the Watcher. I am your guide through this vast new twtiverse.
# 
# Usage:
#     https://watcher.sour.is/api/plain/users              View list of users and latest twt date.
#     https://watcher.sour.is/api/plain/twt                View all twts.
#     https://watcher.sour.is/api/plain/mentions?uri=:uri  View all mentions for uri.
#     https://watcher.sour.is/api/plain/conv/:hash         View all twts for a conversation subject.
# 
# Options:
#     uri     Filter to show a specific users twts.
#     offset  Start index for quey.
#     limit   Count of items to return (going back in time).
# 
# twt range = 1 2032
# self = https://watcher.sour.is?uri=https://anthony.buc.ci/user/abucci/twtxt.txt&offset=832
# next = https://watcher.sour.is?uri=https://anthony.buc.ci/user/abucci/twtxt.txt&offset=932
# prev = https://watcher.sour.is?uri=https://anthony.buc.ci/user/abucci/twtxt.txt&offset=732
@tkanos since I keep making claims to data, I made a post with some references: #qryatdq
Regarding "echo chambers": this is a popular, popularized term. It makes some kind of sense to a person who thinks a certain way, but introspection or intuitiveness does not a fact make.

You can slant your intuition the other way if you like. The claim is that in an information environment with lots of specialized sources, people will seek out information sources that support, or at least don't contradict, what they already believe. I.e., they will enter an echo chamber. But it is just as reasonable to believe that in an information environment with that much diversity, people will be exposed to a wide variety of ideas in spite of themselves, and people who actively seek out nuance won't have any trouble finding it. Some people might get sucked into an echo chamber, but most won't.

That's just as intuitive a stance to hold.

It's also the stance that seems to fit the data
> Using a nationally representative survey of adult internet users in the United Kingdom (N = 2000), we find that those who are interested in politics and those with diverse media diets tend to avoid echo chambers. This work challenges the impact of echo chambers and tempers fears of partisan segregation since only a small segment of the population are likely to find themselves in an echo chamber.

Here's a more expository account that surveys numerous data points; as the authors put it
> A deep dive into the academic literature tells us that the “echo chambers” narrative captures, at most, the experience of a minority of the public. Indeed, this claim itself has ironically been amplified and distorted in a kind of echo chamber effect.
@tkanos "being in an echo chamber that you aren't aware of" isn't a thing. Not for rational people. That's not a real phenomenon. It's as real as bogeymen, ghosts, demons....
@mckinley more like they draw them into a space where their worst inclinations are reinforced. Pushback only reinforces beliefs in some people.

The notion that reasonably well-adjusted people who mostly read stuff by other reasonably well-adjusted people are somehow at risk of some ill-defined "echo chamber" effect is bunk. Folks tend to seek out information and adjust their own notions accordingly, unless they've been "info poisoned" for lack of a better term.
@bender
> Indeed! It comes to mind the popular saying, “How do you deal with nazis? — You punch them in the face.”

One of my favorite animated GIFs depicts exactly that 😆

A little less violently, deplatforming works. That's been demonstrated time and again. It's one of the many reasons to be alarmed by what Elon Musk is doing at Twitter, un-banning hateful accounts that had been banned previously. He is re-platforming people who don't merit a platform, and he himself is amplifying them.
@bender @tkanos I'm blanking on where I first read it--might be Jared Yates Sexton, or maybe Sarah Kendzior--but I'm of a mind that sentiments like "debate is the best way to resolve disputes" are kind of nostalgic and naive because they ignore the conditions we're currently living in. Sure, if we lived in a healthy society with a healthy information space, widespread respect for differing points of view, a relative lack of suffering, etc etc etc, then yes, maybe that would be true. There were points in our history (I'm speaking of the US because that's where I'm from) when we approximated those ideals, at least for some people, and many of us aspired to perfect them. But today, in 2022, we do not live in those conditions. There are many people who actively want to destroy any progress towards these ideals we've managed to make, and who actively, publicly advocate for going backwards from there. Debate is no longer the best way to resolve disputes, in these conditions, not with people who are trying to force the world backwards.

It is foolish to think otherwise. It is just as foolish as believing water puts out all fires and throwing water onto an oil fire. You have to recognize the reality you're living in, then choose the right tool for the job. If you're living in a time where political violence is normalized/is being normalized and demonization is rampant, and you're facing a bad faith argument from a bad actor who is preaching something like antisemitism, you don't reach for "debate" as your tool of choice. You reach for "deplatforming" (for example), because that demonstrably works. You take them, and their damaging ideas, off the public square completely and keep them out of it.
@tkanos
> the point on debating in social network, is not stopping people from spreading bad ideas. Is to make everybody else that look at the debate think, and not fall on those bad ideas, by hiding the bad ideas, and not debating them, we may push others people to believe in them, and we may push people that already believe in them to stay in an echo chamber

No. This is a naive point of view, and it does not jibe with current research. Really. I urge you to read up on disinformation research especially after Facebook was called out for the Cambridge Analytica scandal. Other people *do not* look at a debate, see the bad information exposed as bad by good arguments, and change their minds. It doesn't work that way. Misinformation purposely targets people's emotions, and when the emotional appeal works, they tend to view the people debating against the view as enemies. They *reject* the good ideas even more forcefully.

Sure, there are hypothetical people who will see a debate, recognize that bad information has been exposed, and react by rejecting that bad information. Probably most of the people here fall into that group. But people like that were never the problem. The problem is the vast number of people who will react by *believing the bad information even more stubbornly*. Read the research--this is a real, documented effect I am describing.

Also, the dangers of the "echo chamber" that you evoked are very much overblown, almost surely by purveyors of disinformation because that fear helps them do their work (I'll note you raised this as a danger--an emotional appeal--instead of citing data). The echo chamber effect, to the extent it exists, is bad for people *who are already suffering from information poisoning*. People who've already bought into some piece of misinformation fall into or stay in an echo chamber. Once again, misinformation purveyors have very detailed strategies--Google, you can find them--for how to *draw unsupecting people* into an echo chamber and keep them there.
@tkanos @prologic @bender I think we cannot ignore the fact that there are nations with "cyberwarfare" divisions. Hundreds, possibility thousands, of people who sit in rooms all day every day--it's their job--doing nothing but creating and spreading what we call "misinformation" or "disinformation". That is a very different phenomenon from ignorant people spreading beliefs that happen to be dangerous. It is an explicit attempt to cause harm. Social media sites have been horrible conduits of this, but misinformation circulates many ways, including through trusted news media.

One aspect of cyberwarfare that information warriors take advantage of is that well-meaning people *spread the bad information by reacting to it*. Misinformation tends to target the emotions, and receptive people (which is all of us, basically) react to it on an emotional level. However, well-meaning people tend to react to the logical content of the information. They debate the facts being presented, or they attack the logical structure. But this functions to *reinforce the bad information in people who react emotionally*. In other words, the process of debating misinformation functions to reinforce it. Bad actors know this full well. I've read training materials for spreading misinformation--they know exactly what they're doing.

I don't know what the answer is, but we can't be naive and think that just by "debating" we are going to stop people from spreading bad ideas. That's like throwing water on an oil fire--it makes it worse, not better. We need to be better equipped than this.
@eaplmx no, I disagree with you. It is quite different.

Yes, the device might have an impact on the child. Of course, that's obvious.

But we're talking about creating a dossier that is on the internet, available to anyone who looks, and that modifies how the child is perceived by countless people before they are able to give consent for that kind of crafting of their image.

You may not care about either of these in the ways that I do, but you have to admit they have very different impacts on the kid.
@tkanos the thing that bugs me is that social media allows kids to build what might be a permanent, uneraseable image of themselves online before they're fully aware of what the lifelong consequences of that might be.
@lyse I think you need this to go with the picture: https://www.youtube.com/watch?v=jr3gNQEtx_o
I feel like every day more and more stories like #abxlsba come to light about him. He's just an awful person.
when I say "destroying things", I mean stuff like this: https://gizmodo.com/silicon-valleys-transportation-failures-tesla-waymo-bir-1849382788

> So the Hyperloop, for example, he admitted to his biographer that the reason the Hyperloop was announced—even though he had no intention of pursuing it—was to try to disrupt the California high-speed rail project and to get in the way of that actually succeeding.

In other words, Musk explicitly, consciously killed a high-speed rail project, and probably made off with some state of California funding in the process. When we wonder why we have lousy rail service in the United States compared to Europe for instance, it's partly explained by people like Elon Musk.
Elon Musk’s Boring Company Ghosts Cities Across America - WSJ

Con artist through and through. It'd be pathetic if it weren't destroying things.
@prologic he grew up in apartheid South Africa to parents who made their money from emerald mining. He's long been part of "the PayPal Mafia" that includes outspoken bad actors like Peter Thiel and David Sacks. He's always been this way. He's a narcissist and has carefully crafted a cult of personality and legion of fanboys and followers who launder his reputation on his behalf.

I think, as a matter of self protection, we collectively need to *stop idolizing rich tech people*. They are, almost to a one, bad actors and not worthy of our time let alone our adulation. Given the opportunity they will do bad stuff. Just think of all the people over *decades*, like Bill Gates, Jeff Bezos, and Elon Musk who initially were propped up as some kind of unsung tech genius, only to finally reveal themselves as nothing more than greedy money hoarders who won't hesitate to harm people. This is a feature, not a bug, and we need to be better at identifying it sooner.
@prologic I didn't think too much of him previously; didn't dislike him any more than I dislike billionaires generally. He just seemed like a run of the mill rich guy con artist who happened to appeal to a certain type of tech guy. But, the other day he tweeted something about his first born child dying in his arms and how he felt the last heartbeat. But then his ex-wife tweeted that no, in fact the child had suffered from SIDS and died in *her* arms. And that soured me on him completely forever. He's the sort of self-important narcissist who would make up something about a dying baby to try to score points in an online argument. That's so pathetic and contemptible.
Incidentally, this is the line of thinking you seem to be siding with contra my own:



Not a good look imo
Before any free speech absolutists dive into this with the free speech stuff, please be aware that we are being inundated with misinformation spread, especially through social media, by bad actors who are doing this purposely, with great effort and effect. This issue is not about individuals being able to freely discuss ideas. This is about protecting ourselves from bad actors who have dedicated enormous resources to poisoning the information space *so that we are unable to debate ideas on the merits anymore*. Once you come to believe that misinformation is not about people holding bad ideas inadvertently but is about bad actors attempting to harm people, you take a different stance. That is the stance I hold.
@stigatle It's been demonstrated that content warnings like this save lives. Are you really trying to say that you think people "being able to talk" is more important than saving lives?

You'd let them shout "fire" in a crowded movie theater? Because this has been litigated already in the US, and it's illegal.
Twitter no longer enforcing COVID misinformation policy

Today's "twitter is becoming a dangerous shell of its former self" news.
Twitter failed to detect upload of Christchurch mosque terror attack videos | New Zealand | The Guardian

The 4channing of Twitter continues...
@lyse a fine birb
@carsten so, warum/darum is what you're saying
@lyse stay safe online!!!


whew!
@prologic summer and the morning? it's winter and dark night here!
Twitter is 4channing fast. Letting the worst of the previously-banned far right back on, suspending or permanently banning activists and journalists.
@prologic very nice!
@lyse 20.jpg and the train pics are 👌!
@movq I think I like that choice? Not sure yet since I haven't tried using it for anything real. I do like the fact that it doesn't introduce a bunch of weird files to your repository that you then have to worry about managing.
@prologic it's hilarious that it's called "semantic" web when nobody knows what it really means ("semantic" being the word for "meaning")
@prologic @mckinley I can't pretend to understand the guts since I just found it and only tinkered with it for a few minutes. But I can say that git bug push did this:

h
remote: Updating references: 100% (1/1)           
To $REPO
remote: Updating references: 100% (1/1)        19cf0dc6b52363cf5b8032755b16a5 -> refs/identities/af97ed38e619cf0dc6b52363cf5b8032755b16a5remote: Updating references: 100% (1/1)           
To $REPO
 * [new reference]   refs/bugs/00fd29b9f50294a64ad72c039a7340b5863d7907 -> refs/bugs/00fd29b9f50294a64ad72c039a7340b5863d7907


So it puts stuff in $DIR/.git/refs. It creates a cache directory too.

I have to say, it's surprisingly full-featured given that it's pre 1.0 and the main author warns that there be dragons here (though not so surprising given that there are over 2,000 commits!). You can do the entire create/label/comment on/push/pull/clear bug workflow entirely on the CLI with git subcommands, which is how I'd probably use it were I to adopt this. The webui looks remarkably like github/gitea/etc if you're into that.
looks like it's written in go, @prologic
git-bug

> Distributed, offline-first bug tracker embedded in git, with bridges

Interesting!
@marado wow this is pretty horrifying. I didn't realize it was becoming more common
@lyse @darch it really is a great idea!
@eaplmx hahaha 😆
@eaplmx hmm, that's interesting. Many cell phone plans here include unlimited SMS free and a fair number of people use them still, at least among Old People like me.
@mckinley exactly!
@darch yes, you used to be able to tweet through SMS. I actually did that a few times, long ago! It can be handy at times
An only 50% joking idea: an SMS gateway to post twts/yarns
@prologic Tuesday wtf!!!!
An excellent watch, in my opinion. I feel she traces the history of some of the computer science/AI, at least the parts I'm familiar with myself, quite well.

[Teresa Heffernan: Artificial Intelligence and the (Post-)Apocalyptic Imaginary](https://www.youtube.com/watch?v=hGz4jMIgECQ)
given all that's happened, if you're still on Twitter after apartheid Clyde reinstates The Traitor's account, I have no kind words for you.
I just posted on LinkedIn:

> Dear "AI" people,
>
> Stop doing this shit. Just stop. https://arstechnica.com/information-technology/2022/11/after-controversy-meta-pulls-demo-of-ai-model-that-writes-scientific-papers/
>
> Love,
> An AI person
I'd also argue that *not* having varied and robust controls like blocking will be an impediment to adoption. there are populations on the internet who are relentlessly harassed, and they will simply avoid using your tech (and probably will never tell you either) if you don't give them the tools to cut off the harassment. "being a woman on the internet" is not a joke, it's horrible.
@prologic the sad realty is that blocking will always be necessary. I block individual IP addresses and address ranges on my VPS because so e are repeated bad actors. As soon as yarn. social scales, there will be bad actors who need to be blocked. technology does not solve human social problems for you.
@akoizumi instance blocking is absolutely necessary. 100%, without a doubt has to be there.
@darch same for me. "This site can’t be reached"
@movq meh, he gets access to the DMs of countless politicians, business leaders, and other powerful people, and he gets to fuck with another group of technology nerds just like he does at Tesla and SpaceX. Makes perfect sense once you recognize who he is and who's he's been all along.
@marado the first hashtag is too on the nose
@eaplmx lol
@prologic yeah, but at least among the timelines I've been reading people seem to be going for Instagram and TikTok, with Tumblr and Substack also mentioned but not as often.

Obviously they *should* be using a certain text-oriented network where you keep control of your own data and aren't targeted with ads!
@prologic Lots of people are tweeting their goodbyes and their contact info on other sites. Sounds like there's been more firings/resignations and whole departments of the company are gone or nonfunctional. Wild.
Wow twitter seems to be in a bad state.
@prologic the last column should be XMPP lol
@stigatle wowwww
@eaplmx ah OK, I see your point, and yes I agree with you. There is a much deeper problem in tech and in the US generally of a small number of wealthy people holding most of the power in most organizations.
@eaplmx why?
The tech sector needs to organize. The nonsense at Twitter would not be happening if tech workers had organized collective power, which they should.
@miazit hello! are you a real person?
I'm going to have to write a TamperMonkey script that finds all HTML elements in a page with text "Elon" or "Musk" and sets them not to be displayed.
@prologic I hope the person who joined my pod isn't a spammer. It'd be nice to have a pal!
@movq I think the analogy is sound too. I wonder sometimes, though, whether people who aren't steeped in tech have any awareness of what is going on behind the scenes when they send email and why any of that matters.
@darch you mean if I join Mastodon a bunch of old people are going to forward me bad memes and political rants? No thanks!
Before anyone tries to poopoo the JVM, I've written highly-performant scala code that can easily handle manipulating and searching 100-million-document corpora without breaking a sweat on 2010-era rack server hardware. The platform and language are not the performance problem here.
Hmm, it's also really sluggish. There's no reason it should be struggling with a 3.8 Mbyte 70,000-line data file on the machine I have. But every operation I'm performing takes tens of seconds to complete. I can see from the logs that the backend is multithreaded, so I don't know how to explain the sluggishness. Anyway, it's not usable like this.
My assessment so far is that vizier has a lot of potential but it feels early stage.

I started with a text file with 70,000 lines of tab-delimited data. Three columns are ints, and one column is a date string. The closest data format vizier had was CSV. However, it did not give any options for changing the delimiter. So, I preprocessed the data to make it a "standard" CSV with comma as the delimiter, and it imported fine. However, vizier did not autodetect the data, instead treating that column as a string. Strike 1.

Next, I tried to make a line plot out of the int columns. vizier stewed on that a bit, then told me that there were too many data points. 70,000 is a lot, so that's fair. But any other plotting tool I use regularly can handle this automagically, e.g. by downsampling (and giving you the ability to finetune what it does if you want). Strike 2.

I added a cell to downsample the data, and tried the plot again. This time it worked fine. I don't see any obvious way to change the appearance or axes of the plot once it's made. There is a Download button next to the chart, but when I clicked it, nothing happened at first. Eventually, after I'd decided it probably failed, a PDF file was downloaded. Presumably my chart. However, the file was empty. Strike 3.

One thing that's really nice about vizier is that it keeps track of these dependencies, and if you alter anything in the dependency chain it will regenerate only what's needed to update your views. For instance, it knows that the chart is built from the downsampled data, and that the downsampled data comes from a data file. If I altered the file from within vizier, the downsampling and charting would re-run. If I altered the downsampling parameters, the chart would be regenerated. All of this is version controlled and can be rolled back. This feature solves a world of headaches in data analysis, and I'd love to see the rest of the tool come together well enough to make it usable on a daily basis. Not there yet though, for me.
OK, turns out that was (yet again) a JVM version number problem. vizier depends on Apache Spark libraries that are cranky unless you use jdk 8 or jdk 11, apparently. It runs fine for me if I hard specify java 1.8.

If I weren't so used to seeing errors like this, it'd be extremely offputting and probably show stopping. How would someone new to the JVM world know what to do with an error like that unless they got lucky with a StackOverflow search? The JVM ecosystem really took a shit after 1.8, with all these bizarre incompatibilities and uninterpretable error messages. If the C ecosystem weren't worse I'd consider going full scala native and ditching the JVM.
welp,
h
$ vizier                                                                                                                                                         
Checking for dependencies...
Setting up project library...
Starting Mimir...
Exception in thread "main" java.lang.ExceptionInInitializerError
...


...after the install process went smoothly and didn't throw any errors. Does not bode well.

It also created a directory in my home directory, which I hate 😠 Why don't people use $HOME/.local or some equivalent ffs
@prologic would say it was.............honking?
@suezit hi there!
I upped the size limit for posts on my pod, per @prologic 's suggestion 😆
@prologic are you tweeting?
@stigatle love this shot
VizierDB, a Data-Centric Notebook

Wow, this looks interesting. A nice departure from Jupyter. It resembles Polynote, superficially, but is funded by the US National Science Foundation instead of Netflix OSS the way Polynote is. Interested in taking it for a spin.

Random thoughts:

I have nothing against Jupyter or JupyterLab, and use them regularly. However, the promise of truly polyglot notebook tools like Polynote is so high. I've never done a non-trivial data analysis in a single language/tool. Inevitably, there's a great library for doing X in some other language from the one you started the analysis using, and you really want to do X without trying to rewrite it from the ground up. It's been common for me to bounce between two or more of scala, python, sage, R, and KNIME in a single project.

I've been tinkering with Quarto, and while I like it a lot and the flexibility of its output formats is amazing, it's a bit stiff the way Jupyter is when it comes to using multiple languages in one project. It's also more tailored for publishing as opposed to being a notebook where you tinker. Cocalc is great and has amazing features, but it's expensive if you pay for it and I'm unsure whether their docker container for self hosting is going to survive forever. I do like Polynote, but I don't like that it looks to be supported largely by a corporation. So, the search goes on.
Browsing my spam folder and feeling like a winner 🏆
What is NATS - NATS Docs

Might play with this at work next week.
@markwylde How about Riak? I've had good experience with that in a clustered setup.

I have a feeling you'd have better luck googling if you used "partioning" rather than "sharding" as a keyword. In my experience (which may be overly limited of course), "sharding" is a term used for relational databases and their cousins. In the KV world, I've seen the word "partitioning" used to mean what I think you want: each node stores a subset of the full set of key/value pairs.
My date/time widget says today's date is 11 / 11 / 22, which I just read as "11 + 11 = 22"=
@markwylde Why not etcd?
@akoizumi tedu honked back
@abucci blonk! 📯
@lyse wow, the purple color is very nice
I guess they toot on mastodon. So I'll just honk around here.
@prologic I don't know I'm laughing about this: #nl6g7wa
if I honk here will it show up on mastodon?
@tkanos ./honk
I am eating a pickle.
@movq I don't use it, but I know artists who do. I imagine people in visual arts, or visual thinkers generally, enjoy using it to make idea boards or vision boards (among other things).
Pinry Docs

Self-hosted Pinterest.
@prologic Is there a connection between what you were studying and how you've structured yarn.social?
@prologic It is never too late to tie up Apartheid Clyde in never-ending lawsuits that make his life a living hell until he shrinks back into the dark fetid hole that spawned him
@kt84 😍
Thinking about measuring my PPD rate (passwords per day)
bit by bit I'm adding notes to my web site about coevolutionary algorithms: https://www.bucci.onl/notes/coevolutionary-algorithms

It's probably not super accessible yet, but maybe some day!
@prologic I studied evolutionary algorithms, coevolutionary algorithms to be more specific, and finished the PhD in 2007. I went into industry rather than stay in academia, and my interests have branched out since then, but yeah, that's a thing I did. A big component of coevolutionary algorithms involves strategy learning in adversarial settings, and two-player games make good test cases for research. I've gotten computers how to learn checkers, tictactoe, and nim by playing against themselves.....at the time I was working, the computational power available to me was not adequate to work on games like chess or Go using the techniques I was studying, but I did hope to get there some day and probably could now.
The introductory chapter of my Ph.D. dissertation contains a discussion of Arthur Samuels' 1950s/1960s work on training a checkers-playing program by self play and the pitfalls that brings. The article I posted describes a series of articles, this time on Go, that is by my read re-discovering the same lessons. Maybe one of these days I'll throw in on that one.
Folks are slowly rediscovering coevolutionary algorithms without understanding that that's what they're doing, I guess.

https://arstechnica.com/information-technology/2022/11/new-go-playing-trick-defeats-world-class-go-ai-but-loses-to-human-amateurs/
@lyse yes 🤬 I didn't stay up all night trying, though. I gave up and went to bed at a normal time.