How to Compare App Performance Reports?

Prev Next

Comparing two app performance reports is a critical step in maintaining and improving the quality of your mobile application. It allows you to identify regressions, validate improvements, and ensure consistent performance across various environments. Performance can vary significantly depending on factors like device models, operating system versions, screen sizes, or even different app versions. For example, an app might perform well on a flagship device but experience lags on an older model. Similarly, changes introduced in a new app version may unintentionally increase memory usage or slow down launch times. By comparing reports, you gain a clearer picture of how your app behaves under different conditions, helping you catch issues early and make informed optimization decisions. This is also useful when benchmarking against a different app altogether, whether it’s your previous release or a competitor’s product, to set performance standards or identify best practices. Ultimately, report comparison helps you validate enhancements, uncover performance bottlenecks, and deliver a smooth, reliable experience to all users, regardless of their device or app version. This guide explains how to compare two performance reports to identify changes and trends in your application's performance. 


1. Open the Report - Begin by opening the generated performance report you wish to use as your starting point.

2. Access Comparison Tool - On the Summary page of the report, locate and click the "Compare Session" button.

3. Select Comparison Filters - By default, the following filters are automatically selected:

  • Tag

  • OS (iOS)

  • Baseline Session

You can modify these filters as needed. Both the Baseline and Compare sessions will be filtered based on your selected tag.

4. Configure Your Comparison - For a detailed comparison, select the desired fields:

  • Tag - Filter reports by specific tags

  • Operating System - Select iOS or other platforms

  • Date - Choose the time period for comparison

  • Baseline Session - The reference report

  • Compare Session - The report you want to compare against the baseline

5. Generate Comparison Report - After making your selections, the system will generate a comprehensive comparison report.

The comparison report will analyze and display differences between sessions across the following metrics: 

  • Performance Scores

    • Apdex Score - Application Performance Index

    • App Launch Time - Time taken to fully load the application

    • Session Duration - Total length of user sessions

  • Issues Analysis

    • Performance Issues including:  

      • App Insight issues

      • UI Insight issues

  • Resource Utilization

    • Network Parameters

    • CPU Usage  

      • Average usage

      • Peak usage

      • P90 (90th percentile)

    • Memory Usage  

      • Average usage

      • Peak usage

      • P90 (90th percentile)

    • Battery Drainage

  • User Interface Performance

    • UI Metrics  

      • FPS Stability

      • Average FPS

      • Jank Frames

Note

  • Compare reports from similar environments for the most meaningful results

  • Comparison session should be of same duration and same scenario for meaningful report

  • Based on Tag is used user can filter session