Does somebody just need to buy a lot of hard drives and data tapes, and program a bunch of raspberry pi to download everything it can find?

Edit: What I’m specifically asking about is the feature reddit had to search the site itself. Obviously for reddit this process is much simpler, since they’re just searching their own database.

    • marsara9@lemmy.world
      0·
      1 year ago

      I haven’t heard of ddg yet, do you have a link or somewhere you can point me to?

      But otherwise I’m actually trying to look at creating a self-hosted search engine that anyone can run along side lemmy or any other fediverse instance. Idea is to have it work similar to Google but just for fediverse. Just getting my build environment setup and hope to start development in the next couple of days as I research ActivityPub and find out how it works in more detail.