TestRail

Set up

  1. Select an app in the top left corner from the Switcher

  2. Navigate to App Settings by clicking the gear icon (⚙️) at the top of the Timeline sidebar

  3. Click on Integrations in the sidebar

Connect TestRail

  • Find the TestRail integration module under the Regression testing section

  • Click the Connect button

  • Enter your TestRail instance’s base URL, including the https:// and excluding any trailing /

  • Enter a TestRail API Key

    • You can generate API Keys within TestRail by going to My Settings > API Keys > Add Key

The API key creation flow in TestRail can be confusing. Make sure you both generate and add the new API key, then click "Save Settings" (takes multiple separate clicks). If you refresh the main TestRail API keys page (My Settings > API Keys) and the key you created doesn't appear, you missed a click!

  • Click Save; you’ll be presented with a dialog in which to select your TestRail project and add any test run naming keywords

For the release linkage, Runway will parse your test run names for the presence of a version string (e.g. “2.3.0”)

You can optionally add test run naming keywords (case insensitive) to associate test runs with a particular app, e.g. "iOS" or "Android"

For more information on how Runway will leverage TestRail, visit the Regression testing step article.

Last updated