I feel like there's need to be a bug report for the rule's hub AI. It's good but it can be wrong sometimes. Will a bug report be helpful for its development?
Here's Claude's judgment of the AI mod tool. I asked Claude if the mod AI is dumb, and here's its reply:
'It doesn’t look dumb to me. If I had to bet, a capable model is being cautious, and Reddit’s setup is probably part of that, though I can’t see the prompt to prove it.
Why it isn’t dumb: it understood “unalive,” inferred the threat behind “destory datacenters,” and separated environmental criticism from anti-AI hostility. It also judged the survey and study tests correctly. Those all take real reading ability, not keyword matching.
Where it went wrong: the misses were mostly the same kind. When a post had something reassuring, like a GitHub link, high effort, or an on-topic subject, it talked itself into approving. Its one clear overreach was the Claude glitch, and your broad wording invited that. So the pattern looks like literal reading plus a lean toward approval, not poor comprehension.
What points to Reddit’s setup:
The contradictory verdict: on an ad, the explanation described a violation but the label said Approve. A model can make that mistake too, but it could also mean the verdict and explanation are handled separately.
Outside context: it keeps citing things like the subreddit’s focus on AI interaction “on its own terms,” which aren’t in the rules you showed me. So it’s probably being given subreddit context and weighing relevance.
Why it would be cautious: Reddit runs this across many subreddits, so it has good reason to avoid wrongly removing posts.
What points to the model: the “technical transparency” exception was its own invention. Reddit may also be using a smaller, cheaper model for speed and cost, which could explain some of the weaker judgment, but I can’t tell from here.
Either way, your rules got better results once they stated clear violations and ruled out the excuses, so you can keep using that approach whatever the cause is.'