We've come to realize that about 20% of the tests that were created on Waldo would not pass on their very first replay, which causes issues with tests created as dependencies off of them and causes a lot of frustration.
Now, instead of just trusting blindly that a new test should pass and allowing users to create other tests dependent off of potentially failing tests, we validate every new test created before we allow you to use it. That is, we stress test them several times on all the device configurations on your account, and we verify that they output consistent and reliable results.
Until these tests pass validation, the newly created tests will be categorized as "Pending validation" and will NOT be included in automatic runs. You will also not be able to use them as dependencies either until they have passed.