Organization overview

Some features may be limited to certain plans. Please visit our pricing page to learn more.

The Organization overview page provides a high-level view of aggregated statistics across your entire organization. Your team can use these metrics to draw insights on the overall health of your release process, and identify areas that are trending either in a positive or negative direction across your organization.

Navigating to the organization overview page

• Method 1: Click your organization icon or name on the floating 'pill', at the bottom of the sidebar

• Method 2: Open the first dropdown at the top of the sidebar, and click your organization name

Organization overview statistics and controls

At the highest level, you’ll see statistical averages and trends for a number of key metrics across recent releases for all apps in your organization.

Don’t see a statistic that your team would find useful? Reach out and let us know! We’ll be adding more types of statistics to this page regularly.

Filtering

Leverage the filters on the left-hand side to drill into data across any time range, flightpath, destination, platform, or team. We've also added benchmark data to key metrics like release frequency, hotfix rate, and time to recovery so that you can understand how your team is performing relative to your peers.

Layout

Click and drag from the bottom right of any chart to adjust the height or width of the chart.

Click and drag from the top of a chart to move its position within its category.

Insights

The Insights banner at the top of the view surfaces high-level, noteworthy trends.

Insights are computed based on the past 90 days of data and reflect all available metrics, regardless of the time frame or filters applied.

Metrics details

Metric	Calculation
Time to recovery	Time elapsed between a failed release and a subsequent hotfix. A failed release is one that meets at least one of the following conditions: - The release has a hotfix released directly afterwards - Rollout health metrics are set up and one or more metrics become unhealthy after release - The release was phased and its rollout was halted and never resumed
Release failure rate	Period average of failed releases as a percentage of all releases. A failed release is one that meets at least one of the following conditions: - The release has a hotfix released directly afterwards - Rollout health metrics are set up and one or more metrics become unhealthy after release - The release was phased and its rollout was halted and never resumed Exclusions: Hotfix releases
Hotfix to non-hotfix release ratio	Period average of the ratio of releases that were hotfixes to releases that were not hotfixes.
Checklist item completion time	Average time to complete a checklist item within a given release.
Release step completion time (non-hotfixes)	Completion times for all steps during a given release. Steps may be running in parallel, so the sum of all times for a given release will not necessarily correspond to real time elapsed. Exclusions: Releases with no step timing data, hotfix releases. Missing step types do not factor into calculations.
Release step completion time (hotfixes)	Completion times for all steps during a given hotfix release. Steps may be running in parallel, so the sum of all times for a given release will not necessarily correspond to real time elapsed. Exclusions: Releases with no step timing data, non-hotfix releases. Missing step types do not factor into calculations.
Release frequency	Period average for the rate of releases.
Lifecycle timing	Aggregated period averages of time spent in each phase of the product development lifecycle. Exclusions: Work items with no ticket creation time are excluded from wait time; negative durations are dropped.
Target date hit rate - Kickoff	Period average of percentage of releases where kickoff was completed on, or before, the target kickoff date. Exclusions: Hotfix releases.
Target date hit rate - Submission	Period average of percentage of releases where submission was completed on, or before, the target submission date. Exclusions: Hotfix releases.
Target date hit rate - Release	Period average of percentage of releases shipped on, or before, the target release date. Exclusions: Hotfix releases.
Checklist item completion rate	Percentage of checklist items completed. Exclusions: Hotfix releases.
Checklist item overdue rate	Percentage of checklist items that were not marked as completed before deadline passed. Exclusions: Hotfix releases.
Build distro builds	Total number of builds downloaded during the selected date range.
Build distro artifact size	Average size (MB) of artifacts during the selected date range.
Bundle install size	Average install size on device (in MB) for selected app store build for a given release Exclusions: non-iOS apps.
Bundle download size	Download size (in MB) for selected app store build for given release (or average download size for multiple Android builds)
App store builds	Total app store builds during the given release.
Build time	Average CI build duration for all builds during the given release.
Build success rate	Percentage of CI builds that completed successfully during the given release.
Builds	Total number of CI builds triggered during the given release.
Release duration (hotfix)	Time from kickoff to release for hotfixes. Exclusions: Non-hotfix releases.
Release duration (non-hotfix)	Elapsed time from kickoff to release completion for the given release. Exclusions: Releases missing kickoff or release events, hotfix releases.
Fix acceptance rate	Accepted fix requests divided by total number of fix requests for a given release, expressed as a percentage.
Lines of code added (non-hotfixes)	Total lines of code added for the given release. Exclusions: Hotfix releases.
Lines of code added (hotfixes only)	Total lines of code added for the given hotfix release. Exclusions: Non-hotfix releases.
Lines of code changed (non-hotfixes)	Total lines of code changed for the given release. Exclusions: Hotfix releases.
Lines of code changed (hotfixes)	Total lines of code changed for the given hotfix release. Exclusions: Non-hotfix releases.
Lines of code deleted (non-hotfixes)	Total lines of code deleted for the given release. Exclusions: Hotfix releases.
Lines of code deleted (hotfixes)	Total lines of code deleted for the given hotfix release. Exclusions: Non-hotfix releases.
Items of work completed	Total number of work items shipped in a given release. Work items include any of the following: - Any commits/code in the diff since the preceding version's release tag - Any open PRs against the release branch - Any tickets which are explicitly labeled for the release via a “feature affiliation” (e.g. a label, 'Fix version', tag, etc.) - Any tickets, regardless of explicit label or otherwise, which are referred to by code (via commit message, PR title, or branch name) that is associated with the release (either 1 or 2 above) - Any code, regardless of where it lives, that refers to a ticket (via commit message, PR title, branch name) which is explicitly labeled for the release
Number of fix requests	Total number of fix requests for a given release.
Number of fixes	Total number of fixes for a given release.
Number of tickets	Total number of tickets associated with the given release. Runway associates tickets with a release via the following logic: - Any tickets which are explicitly labeled for the release via a “feature affiliation” (e.g. a label or 'Fix version' in Jira) - Any tickets, regardless of explicit label or otherwise, which are referred to (via commit message, PR title, or branch name) by code that is associated with the release (either 1 or 2 above)
Fix requests approved	Total number of approved fix requests for a given release.
Fix requests rejected	Chart: Total number of rejected fix requests for a given release. Primary value: Average over the selected date range.
Completed work items fix percentage	Completed work items that were fix requests divided by total number of completed work items for a given release, expressed as a percentage.
Review wait time	Time a new app submission spent waiting in Apple's review queue before active review began. Exclusions: Releases missing a submission or review start event.
Time in review	Time a new app submission spent actively in review by Apple.
Release rejection rate	Period average of percentage of releases that were rejected by the app store. Exclusions: Non-iOS apps.
Number of commits (non-hotfixes)	Total number of commits included in the given release. Exclusions: Hotfix releases.
Number of late merges	Total number of pull requests merged after the release branch is cut.
Session adoption rate	Max adoption rate achieved for a given release.
Metrics from an 'Observability & analytics' integration	Metric (ingested from an 'Observability & analytics' integration and configured in Health metrics within Settings) associated with a given release.
Crash-free sessions	Percentage of sessions without crashes in a given release.
Crash-free users	Percentage of users without crashes in a given release.
Beta crash-free sessions	Percentage of sessions without crashes in a given beta release.
Beta crash-free users	Percentage of users without crashes in a given beta release.
User rating (release-specific)	Average rating from user reviews for a given release. Due to API restrictions, this only includes ratings associated with a written review. Exclusions: Apps other than iOS and Android.
User rating (all releases)	Period average of the overall app rating (across all versions). Exclusions: Apps other than iOS and Android.

Trends are computed using basic linear regression.