

With the advent of AI bots trying to flood into Lemmy communities, I don’t really see this as a viable option on the long run.


With the advent of AI bots trying to flood into Lemmy communities, I don’t really see this as a viable option on the long run.
I must mention this FOSS app! https://github.com/danilkinkin/buckwheat
I use this to track my monthly spend with my cards that I manually swipe at stores. This is the only budgeting app that has stuck with me for quite some time.
Peertube supports livestreams with multi ABR live transcoding, and ended lives can be saved as VODs on the platform.
It’s also part of the fediverse. :)


You can have more than 2x 22tb, the SX line is full of storage servers!
SX65 2x 1TB nvme 4x 22tb (~104€ 0%VAT) SX135 2x 2tb nvme 8x 22tb (~204€ 0%VAT) SX295 2x 8tb nvme 14x 22tb (~384 0%VAT)
If you manually add the disks to configurations like AX-line, there is a limit, that may be bypassed if you contact hetzners support, but that’d be expensive compared to the SX line I reckon.
Also, Hetzner’s server auction has quite affordable 4x 16tb servers, starting from 63€ 0%VAT, that’d be pretty affordable RAID1- solution, ~1€ per TB/month.
Unlimited traffic on all of the above, and a sidenote: SX line servers have one-off setup fees, server auction has no setup fees.


I’m donating a shy of 20€ per month to services automatically on Liberapay/Opencollective as long as I can. I do /try/ to give back on the projects that I use a lot in either my time and effort (IE: sitting in their IRC channels helping people for example), or a monetary donation.
It’s not much, and I hope these open source projects never become something that depend on money and donations, but there are always cost to running services online.


It’s supposed to be a dot (.) character. The project’s name is n.eko.



You have a point here.
But when you consider the current worlds web traffic, this isn’t actually the case today. For example Gnome project who was forced to start using this on their gitlab, 97% of their traffic could not complete this PoW calculation.
IE - they require only a fraction of computational cost to serve their gitlab, which saves a lot of resources, coal, and most importantly, time of hundreds of real humans.
Hopefully in the future we can move back to proper netiquette and just plain old robots.txt file!


If you remember the project I would be interested to see it!
But I’ve seen some AI poisoning sink holes before too, a novel concept as well. I have not heard of real world experiences of them yet.


They’re working on no-js support too, but this just had to be put out without it due to the amount of AI crawler bots causing denial of service to normal users.


Doesn’t run against Firefox only, it runs against whatever you configure it to. And also, from personal experience, I can tell you that majority of the AI crawlers have keyword “Mozilla” in the user agent.
Yes, this isn’t cloudflare, but I’m pretty sure that’s on the Todo list. If not, make an issue to the project please.
The computational requirements on the server side are a less than a fraction of the cost what the bots have to spend, literally. A non-issue. This tool is to combat the denial of service that these bots cause by accessing high cost services, such as git blame on gitlab. My phone can do 100k sha256 sums per second (with single thread), you can safely assume any server to outperform this arm chip, so you’d need so much resources to cause denial of service that you might as well overload the server with traffic instead of one sha256 calculation.
And this isn’t really comparable to Tor. This is a self hostable service to sit between your web server/cdn and service that is being attacked by mass crawling.
Edit: If you don’t like the projects stickers, fork it and remove them. This is open source project.
And Xe who made this project is quite talented programmer. More than likely that you have used some of Xe’s services/sites/projects before as well.


Yes, Anubis uses proof of work, like some cryptocurrencies do as well, to slow down/mitigate mass scale crawling by making them do expensive computation.
https://lemmy.world/post/27101209 has a great article attached to it about this.
–
Edit: Just to be clear, this doesn’t mine any cryptos, just uses same idea for slowing down the requests.


In general, to everyone who finds Yacy as an interesting project, just give it a try!
It’s relatively light weight, and having millions of pages indexed does not take that much disk space, in my case: 3.5 million indexed pages is around 200 gigabytes only.
Yacy is far from perfect, and it’s an ancient project. But it’s still alive and kicking strong!


Hi!
I’ve been selfhosting Yacy for some years, even tho I rarely use it (I’m mostly using Kagi these days).
But some tips:
And not directly Yacy related, but you can use your own Yacy through Searxng as well, even in ‘private’(non P2P) mode.


This dwarfstar looks interesting, can you elaborate on your setup and what kind of inference speeds you are getting?