I've tweaked how Reviewable posts commit status updates to GitHub to (hopefully) cause less problems.
It turns out that in some projects Reviewable commit status updates triggered the CI tool, which in turn updated a comment that triggered Reviewable, getting into a vicious cycle that ended only when Reviewable bumped up against the limit of 1000 status updates per commit. Reviewable now no longer temporarily flips the status to
pending "Checking status..." and will fall back to an even less invasive approach if it gets close to 1000 checks, so your PR won't get stuck in an error state.
The downside is that if something moves a review from complete back to in-progress, the GitHub status will remain as
success for a few extra seconds, opening a small window of opportunity for a merge that maybe shouldn't have been allowed.