Hey everyone,
This isn’t an announcement, just wanted peoples thoughts on this.
I think everyone knows searching the fediverse can be better. Googling doesn’t work too well, etc. So I wanted to do my part and help out.
Indexing all posts, etc is quite a lot to handle, so I wanted to start small and just focus on video search. I’ve started indexing videos from Peertube and other video websites. (Even YouTube but this could be removed to just focus on independent sites)
I know Peertube has their own search engine for videos. I will be reaching out to them. Compared to my site I’m planning it’ll have other video sources and be easier to use.
So that leads to feedback from you guys.
- What do you think about indexing videos posted on the fediverse and other independent platforms?
- Are there similar services?
- Am I just wasting my time?
Why wouldnt people want do have search engine? Without it Fediverse stands no chance against non-free internet. Everything posted here would be much more valuable if it was searchable. Now comment posted once is viewed only until post gets less popular. Any other site of this kind displays answers decades old. Privacy isnt issue as everything posted here is available to everyone on internet.
I mean they are posting on the public internet, they should know that it can be read by anyone. I like the idea of users opting out.
deleted by creator
Good point. They should know they are making public comments. If you want it private then send a private message.
You should federate the search engine so that folks can defed from the search as desired.
But then we would need a search engine for all the search engines…
deleted by creator
Yep
Just, for the love of god, make sure to make it opt-in. Don’t scan people’s posts without their consent.
Also, if you’re going with this, make sure to respect people’s requests for removal, e.g. deleting their posts from the engine when they delete them from their instances. Otherwise you’d get in trouble with the EU regarding GDPR…
Your public posts are not protected from GDPR from indexing…
The fedi elite will snipe you from a bell tower.
There is already Sepiasearch specifically for Peertube.
It’s limited to only Peertube and it’s not the most intuitive. I want to work with them on expanding this.
Is this something you can point yacy at?
I heard it’s not optimized well but I’ll take a look at it.
I’d be interested to know what “not optimized” means.
I heard it will send out requests as fast as possible essentially creating a DOS attack but I could be wrong. Also the UI can use some improvement.