TestRail

Set up

  1. 1.
    Select an app in the top left corner from the Switcher
  2. 2.
    Navigate to App Settings by clicking the gear icon (⚙️) at the top of the Timeline sidebar
  3. 3.
    Click on Integrations in the sidebar

Connect TestRail

  • Find the TestRail integration module under the Regression testing section
  • Click the Connect button
  • Enter your TestRail instance’s base URL, including the https:// and excluding any trailing /
  • Enter a TestRail API Key
    • You can generate API Keys within TestRail by going to My Settings > API Keys > Add Key
TestRail’s UI in the key creation flow can be a bit confusing: make sure you both generate AND add the new key (takes a few separate clicks)
  • Click Save; you’ll be presented with a dialog in which to select your TestRail project and add any test run naming keywords
For the release linkage, Runway will parse your test run names for the presence of a version string (e.g. “2.3.0”)
You can optionally add test run naming keywords (case insensitive) to associate test runs with a particular app, e.g. "iOS" or "Android"
For more information on how Runway will leverage TestRail, visit the Regression testing step article.