•
1 min read
This Poem is Nifty
This poem is a non-fungible token. This poem is a type of cryptocurrency. This poem is cryptic currently. This poem is interchangeable. This poem cannot buy money. This poem has no value...
I'm thinking it might be good to maintain an allow page with junk plus disallowed poisoned areas. The crawlers respecting robots.txt would pick up stuff that doesn't matter and the crawlers that ignore the permissions file would be fed scraper-hostile content.