Checkly changelog
Checkly changelog

Checkly Runtime 2021.10 with faker.js and updated Playwright




Checkly has released a new runtime version 2021.10. This is great news for anyone creating browser checks in Checkly, as we have added some new features and brought everything up to date.

Here are some of the highlights of runtime 2021.10:

  • Playwright 1.15.2: new Headers API, mouse wheel support, new Locators API, and more.
  • Faker - We've added faker.js so you can generate fake data in your check scripts. Checkly users requested this. See an example script here.

For the complete list of everything included in runtime 2021.10, see the runtime specification documentation.

All new Checkly accounts will use the latest runtime by default. For existing accounts, you can configure the default in the account settings page. You can also override the default runtime on a per-check or per-group level. See the documentation for details.

User-scoped API Keys




You can (and should) now create API keys on a per-user basis. Previously API keys were account-scoped and did not respect user roles and permissions. User-scoped API keys have the same roles and permissions as the user.

You can now also create multiple API keys. This simplifies key rotation and allows you to have different keys for different applications.

You can create user-scoped API keys on the user settings page. We will not be removing account-scoped API keys any time soon, but we will disable the creation of new account-scoped keys.

Screenshot 2021-11-15 at 17.42.15.png

Account deletion




You can now delete your Trial or Free account directly from your account settings at


Note, if you are on a paid plan, you will first have to cancel your plan before you can remove it.

Upgraded Vercel Integration




Together with the team at Vercel we built a massive upgrade to our existing Vercel integration. Now, you can:

  • Trigger your Browser checks, API checks and Groups on each Production and Preview Deployment.
  • Block any deployment with issues or bugs right in Vercel.
  • Get detailed Web Vitals performance metrics reported directly in the Vercel UI.

Learn more about our new Vercel integration or directly install it from the Vercel Marketplace.


Performance and Error Tracing




We just launched Performance and Error tracing for Browser Checks! This means Checkly now automatically collects:

  • Network traces
  • Web Vitals
  • Console logs
  • Screenshots on every error

Learn more about Performance and Error Tracing in our docs


Run checks on deployment in any location




You can now select a specific location where we should run your checks when they are triggered by a deployment through GitHub, Vercel or using our command line triggers.

This option is now available on the CI/CD Triggers tab for all checks and check groups.


Just select any location from the drop down.

For command line triggers, you add the optional runLocation to trigger you check in that location. Note, we use the shorter notation here.


Overview of bug fixes last weeks





Hope you're doing great! We are working on some larger product initiatives, but always squeeze in some bug fixes reported by our customers or discovered by our team. Here are some of the highlights from the last weeks.

Home dashboard

  • Empty groups on the home dashboard no longer show up when filtering by name, tag or any of the other filters.
  • Sometimes, the home dashboard (and the Reporting pages) didn't show any tags, or had tags missing. This is fixed!


  • Duplicating an API check in a Group created a Browser check instead. Yeah, that was silly.
  • Also, duplicating an API check could throw an error when the check had no locations selected.

Alerting & Alerting channels

  • The Webhook editor always loaded the placeholder code in the user interface, instead of the user supplied code. This is fixed. The actual webhooks did execute user supplied code BTW.

Deployment & integrations

  • We addressed a timeout issue in our queueing system that reran checks in a loop when triggered by a GitHub, Vercel or command line trigger.

Extra special thanks to our customers for helping us with reporting these!

Run the latest Playwright, Puppeteer and Node with Versioned Runtimes





You can now upgrade your JavaScript-powered checks to the latest and greatest Playwright versions, Node.js version and other dependencies with just one click on the new "Runtimes" tab!


This feature give you full control over when and how you want to update all Javascript functionality for your Browser checks the setup & teardown scripts for API checks.

To kick it off, we shipped a new runtime named 2021.06 which includes

  • Playwright 1.12.2
  • Puppeteer 10.0.0
  • Node.js 14.x

We plan to release a new runtime every quarter with new major and minor versions of the supported packages.

If you want to test the waters a bit before flipping your whole account to a new runtime, you can override just for a single check or a groups of checks.

Read more about how to use versioned runtimes in our docs

P.S. you can also manage your runtimes through our public API and with our Terraform provider in the latest release candidate.

DNS module is now available in all runtimes





We just added the dns module to our allow-list for all script runtimes. Some customers expressed interest in using a DNS lookup or some other DNS operation in their API setup scripts and / or in their Playwright browser checks.

We recommend using the .promises API. This works as follows:

const resolver = require('dns').promises
const res = await resolver.lookup('')
// this prints: { address: '', family: 4 }

Full docs are here for the Nodejs 12 runtime

New code editor for Browser checks





We just released a major overhaul of our browser check editor.


  • It's based on Visual Studio Code / Monaco.
  • It has better code completion on all supported frameworks.
  • It's has a way more efficient screen layout for a quicker debug cycle.
  • Snippets and process.env are now autocompleted and preview in the editor.
  • You can run and stop check runs with the CMD + SHIFT + K short cut.

This is live for everyone now, check it out in your account.