@sneak Is this true? (From https://freeradical.zone/about/more, section “Suspended servers”)
@Hyolobrika yes indeed i have written http clients, i even have curl and wget installed
@Hyolobrika https://github.com/sneak/feta
i was writing a fediverse search engine, but i got death threats for suggesting that people download things that are available on the public web (same as any rss reader or whatever) and so i worked on other projects instead because fediverse people are fucking assholes
Does it respect '#nobot'? Have you considered making it respect a similar hashtag in people's profiles specifically for this case, such as '#noindex', '#noscrape', or '#nosearch', in a similar vein to robots.txt for regular web spiders?
I think this will go a long way towards making it acceptable to the populace of the Fediverse.
It would be nice to see a Fediverse search again since search.social went down. Does anyone know what happened to it btw?
@Hyolobrika publishing something on the web is affirmative consent that others on the web can download it. i'm not interested in "making it acceptable". if you publish something on the web intentionally, it's not a bug or accident that everyone else on the web can view it.
