![](https://media.kbin.social/media/56/6c/566c7f86d021b6cf0d9b5dbe53f849a7642468ac9e5a9d23353f0dbdad1e7fd1.png)
![](https://lemmy.hogru.ch/api/v3/image_proxy?url=https%3A%2F%2Fbeehaw.org%2Fpictrs%2Fimage%2F1be75b15-2f18-429d-acf7-dcea8e512a4b.png)
12·
11 months agoI tried finding information on what indexer they are using. Are they using their own?
Edit: says this in the readme:
The commoncrawl organization for crawling the web and making the dataset readily available. Even though we have our own crawler now, commoncrawl has been a huge help in the early stages of development.
Personally I would have some sort of notice regarding these on affected projects, but I don’t think it’s enough to warrant slapping an anti-feature flag on them just because of the author’s choice of code respoitory hosting provider or CDN.