Waldo updates
Waldo updates

Edit variables ๐ŸŽฐ




Variables View.png

Now, you can easily view all variables used in a testing flow and make any necessary changes. Our new Variable Viewer shows each variable's status and allows you to make changes directly.

To access the Viewer: go to your Tests page, click on the test you would like to view, and use the tab at the top left of the screen (next to Overview) to select โ€œVariables.โ€

From here, you can see which step the variable is used in (if it is active), the pattern the variable follows if it is inherited, and make any required edits.

Additionally: making a change to the variable at the parent test level will automatically update all instances independent tests with the same change. This should significantly simplify variable management for all current customers!

Improved similarity score ๐Ÿงฎ




We've made changes to how we compute the similarity scores for a pair of screens.

Specifically, we now only take into account characteristics that are visible to the human eye (e.g. text, size, shape, position) whereas before we would also rely on some invisible attributes (such as accessibilityIds).

This means that the scores are now going to reflect the reality as seen by an end user, and not the underlying implementation details. Specifically:

  • you should no longer see similarity scores drop without any noticeable changes in the UI
  • this score will more efficiently catch changes in structure or content that an end user could notice

You might now see some screens having a different score, and potentially not passing the similarity assertion. If that's the case, you should simply accept the new result state as the reference going forward.

As usual, let us know if you have any questions!

Introducing: Waldo Academy ๐Ÿ“š




We are excited to announce the launch of Waldo Academy: a series of courses paired with real product use cases, designed to give you an in-depth understanding of Waldo.

Unlock even more value from your testing suite by diving into our best practice tips and testing methodology!

Start exploring by clicking here.


Improvements to the step modal ๐Ÿ‘๏ธ




We made several changes to the step modal overview.

Screen Shot 2022-09-28 at 1.08.49 PM.png

  • clear information about the actual loading time for a step
  • more documentation for each of the sections
  • ability to re-record a baseline for one device configuration or for all

As usual, we'd love to hear your feedback on this release!

Select a specific git commit for a CI run ๐Ÿ”Œ




When you trigger a test run via Waldo API, you can now target a specific version of your application you wish to test by providing the corresponding git commit.

You will find more information in the docs ๐Ÿ‘‰

See Git branch statuses in Waldo ๐ŸŒฟ







We've updated branch displays in Waldo to support various git branch statuses! It's much easier now to visually differentiate between default, open, merged, and closed branches to quickly understand whether or not tests updates will be applied globally.

Learn more about how Waldo tracks branches in the docs ๐Ÿ‘‰

Inspect your test results using Studio ๐Ÿ“ฝ๐ŸŽž





We're very excited to release Results Studio, which makes it easier than ever to understand your test results!

Sometimes the information you need to understand an error is hidden between the screenshots Waldo takes at each replay step. Now, you can see your test playback alongside your step-by-step test results! See a full breakdown of your test in the timeline, jump to problem areas, and see how your app reacted to test scenarios live without ever leaving the results page.

Learn how to use the Results Studio to understand better your results in the docs ๐Ÿ‘‰

Select a specific configuration for a manual run ๐Ÿ“ฑ





When you want to run a test manually quickly, you might want to select only one configuration instead of all of them in order to get fast test results. With this feature, you'll be able to do that when launching a manual run on Waldo!


Weekly Updates - 6/13/22




Resizable SideBar.gif

Resize and hide the Issues Sidebar

If you have long test names or need more space while browsing your test results, you can now resize or even hide the run issue sidebar.

Other Improvements

  • Enhanced usability of run filters and build/branch search.
  • Access run information from the Test Results page by hovering the run number in the breadcrumb.
  • Navigate to the baseline test from the Test Results page by hovering the test's name in the breadcrumb, and clicking View test.
  • Enhanced Analytics requests catching on Android apps.

Cheers โœŒ๏ธ

Referral program! ๐ŸŽ




โœจ Our marketing team just announced a new referral promotion for Waldo customers! For every introduction you make, we will send you a $150 (10 intros = $1500 for you, or $1500 for a charity of your choice).

For every referral that becomes a Waldo customer, we'll send you a $1,500 cash prize or make a donation to the charity of your choice (yes, we confirmed that you could win over $50,000).

To make your referrals, please see the instructions here.