char (@[email protected])
ioc.exchange
@[email protected] Actually since yesterday I'm pondering about the idea to build a #federated version of stackoverflow, nothing written yet, I'm reading, researching. Also, right now I was checking this stack exchange sqlite db under CC BY-SA 4.0 to check how useful and doable would be import this data and using as a base for the federated version. Also wondering if we could use this data somehow to train our own opensource AI to help the community, but I'm do not have knowledge on LLM/AI things. Please if there is any expert I would appreciate the opinion on that. https://seqlite.puny.engineering EDIT: A better place to download the dump content, with more interesting tables, like the one with the Votes; the other link the dumped data only contains two tables Users and Posts. Right now downloading the whole data related with stack overflow, and will take some time due my humble home internet connection, so I didn't have the chance to take a look at the data, but I guess that's the interesting thing. here: https://archive.org/download/stackexchange

Codeberg was asking about this. The linked toot by a commenter points to :

SEqlite

These are CC-BY-SA 4.0 remixes of the Stack Exchange Creative Commons Data Dumps. 100% Unendorsed by Stack Exchange, Inc.

They are minimal. They provide the data you probably care about and the data you need to comply with the original license in SQLite format.

  • LalSalaamComrade@lemmy.mlEnglish
    2·
    6 months ago

    1. In the Fediverse, everyone gets access to the data. However, if privacy is what’s bugging you, then you’re free to use a forum - which is going to be archived by someone on the internet, so in a way, the stuff you post on the internet is not going to be private - there’s nothing that can be done about it, except for going under a pseudonym. However, the same cannot be said for Stack Exchange. Will they let you parse their site for free, when Reddit and other private platforms are charging money for the same? They’re using 16 years worth of free volunteer work to make lots of bucks.

    2. In their quest for integrating AI, now the new site will vomit verbal diarrhea. Humans don’t do that. These language models are absolutely terrible in their tasks. They can’t replace humans, at least for now, we know it.

    3. Earlier, the site was free, and their means of earning was through some sort of enterprise solution, but now that they’re going to add AI, it is going to be very resource-intensive. Who is paying for all of that? We have to, from our own pockets, for low quality answers, with no respect to the question asked by the user? Yeah, welcome to paywall 2.0!

    4. Their lofy model will use answers from 2010s to train their data, most of which isn’t applicable in today’s time. Will you be using X11 configs for Wayland on Linux? Or GTK+ solutions for GTK4?

    • DaseinPickle@leminal.space
      3·
      6 months ago

      It’s not about privacy. It’s about AI companies stealing other peoples work and knowledge and profiting. Like what they did with artists. And I think that’s bothering a lot of people. It’s kind of sad that we cannot exchange information with each other for free, without some Silicon Valley crooks taking advantage and trying to convert other people’s good will into profit.

      These LLMs are also polluting the web with AI junk and slop. The web is absolutely tainted with shitty ChatGPT text and images, making it harder and harder to find authentic information. I think a lot of people don’t want to contribute with that.