VF -Release Notes
We’re always optimizing AGILITY. Use this page to keep track of what’s new.
Release Version 3
Iteration 66
What’s New
AGILITY’s new Flow Extractions tab allows you to accelerate protocol-level issue isolation. The Flow Extractions tab supports all of the existing network services in AGILITY, including:
*Voice and Video over LTE **
Voice and Video over New radio
4G & 5G NSA connectivity*
5G SA Connectivity*
5G SA Mobility (EPSfallback)
5G SA Data (might delete)
Special Services - e911
The Per Protocol Level Analysis tab was added to the Call Flow Details page to allow users to view a summary of the selected call flow; it provides a bird’s eye view of every protocol within the selected flow, making it an excellent starting point for quick low-effort analyses that provide significant actionable insights.
The Analyzed Call Flows list was made collapsable to improve user viability of the Call Flow Details page.
A user feedback survey was added to AGILITY to gather insights for continuous product optimization.
Bug Fixes
The expandable Elements Detailed Information panel now contains Message Attributes.
Labels were created to help users easily identify when newly uploaded files (PCAPs uploaded for analysis) have failed to process.
Sample files for mock predictions were restored.
Comprehensive Service Coverage was enabled to support troubleshooting across services, including:
Support for 5G SA Connectivity Service*
Support for 4G & 5G NSA Connectivity *
Support for VONR
Support for Special Services E911
Support for 5G SA Mobility EPSFallback
Support for 5G SA Data (if available)
Internal sign-up options were removed from the sign-up flow for increased usability.
The expandable Element’s Detailed Information panel was added to the Sequence Diagram to display Descriptions and Details for network elements.
Iteration 67
What’s New
Reintroduction of Legacy features on the new UI, including:
The ability to select specific results to explore them in depth.
Tallys of: the total number of call flows, the total number of network elements, the total number of protocols, and the total number of procedures.
The Call Flow Details card displays: Start Date and Time, Duration, IMSI, MSISDN, Device Type, B Number, Call Lag, and Header Size.
The Results tab includes Protocol Level Analysis, Flow Extractions, Call Flow (multi-view), and KPI Analysis.
Call Flow Details can be expanded and collapsed, allowing users to zone in on Call Flow diagrams (the Sequence Diagram & Topology Diagram), ProtocolLevel Analysis, Flow Extractons, and Diagnostics.
Bug Fixes
Resolved unresponsiveness on the Per Protocol Evaluation level for 5G SA connectivity.
Resolved the unintuitive scrolling direction encountered on the Play feature for the Call Flow visualization tab.
Ensured compatibility with .cap file uploads on AGILITY.
Restored labeling functionality to Failed call flows that were missing labels.
Remedied Topology Diagram views wherein the Network functions per domain were misrepresented.
Iteration 68
Track, visualize & analyze subscriber-specific activity for network troubleshooting & optimization.
What’s New
AGILITY’s new High-Level Summary page allows you to identify analyses with the highest failure rates at the outset of the troubleshooting process. (Individual subscribers are classified by Impacted International Subscriber Identity (IMSI number).
Improved fonts for increased readability.
Bug Fixes
User access to partially completed ML analysis sessions has been blocked to prevent user-end confusion. Partially completed analyses will remain “In Progress” while the backend retries the prediction multiple times before determining that the analysis has failed.
Iteration 69
What’s New on the UI
Isolate Root Casues with Diagnostics: Users are now able to view the root causes for network errors; AGILITY’s new Diagnostics tab uses deep root cause analysis to expose the root causes for network errors.
Enhanced readability of Protocol Level Analysis HTTP2 sublabels.
Added HTTP2 Details to Callflow Visualizer and Flow Extractions. On the Sequence Diagram, users can filter by HTTP2 if the protocol is http2 or SIP. On the Call Flow Details page, under the Flow Extractions tab, users can select a sequence and then select the message’s Attributes button to view metadata for the selected frame number.
What We’re Doing Behind the Scenes
Monitoring and Observability: We’ve created a dashboard with stats that monitor our tool's performance, including:
average time spent parsing each chunk of call flows,
average time spent preparing analytics
Test automation: We enhanced test automation by adding 19 new automated tests covering Auto Detection, 5G Mobility service, and High-Level Summary.
Added VONR Call detection based on HTTP2, VoLTE to our ML model library.
Created a VS Code SME Tool kit to help troubleshoot offsite
Set up end-to-end (E2E) test automation for sequence and topology diagrams. Our E2E testing includes tests validating the following:
all network elements are presented,
all domains presented without unknowns,
correct network elements are assigned to the correct domain,
there are no duplications of network elements in each domain, the numbers of network elements, or the protocols detected,
Bug Fixes
Resolved an issue wherein AGILITY’s backend service accepted null and undefined user IDs.
Remedied inaccurate depictions of connections between disconnected network elements on the Topology diagram (Such as connections between User Equipment and the Mobility Management Entity.
Iteration 70
What’s New on the UI
View Colleagues' Analyses: We’ve increased knowledge sharing and transparency by adding the “Others' Analyses” tab to the My Analyses page. The “Others' Analyses” tab allows users to access analyses conducted by other team members.
Email Notifications for Analysis Results: We’re creating a User Settings page to facilitate Email Notification configuration. From the User Settings page, users will be able to:
Create and modify email notification lists for analysis result dissemination
Set their own email notification receipt preferences.
Easily Identify Call Flows with Network Errors: On the My Analyses list, we’ve added red exclamation point error icons beside Call Flows containing network errors so that users can fast-track troubleshooting by sporting network issues quickly. We’ve also added Yellow exclamation point error icons.
Filter by Message: On the sequence Diagram, users can use the Messages filter to refine the results depicted on the diagram.
Comprehensive Protocol Level Analysis: On the Call Flow Details page, under the Protocol Level Analysis tab, we’ve exposed more protocol attributes. Initially, the Protocol Level Analysis tab exposed SIP & HTTP2 protocols. Now, the feature also exposes PFCP, GTPV, S1AP_NAS, and more.
Service Auto Detection Update: We’ve added a popup on our new Service Auto Detection Feature to inform users that occasional processing errors may occur as we continue to improve the feature’s performance.
Unification of our Service Models on AGILITY: We’ve migrated all of our Service Models from the Legacy edition of AGILITY to the New AGILITY.
What We’re Doing Behind the Scenes
Additional validation was added for AGILITY’s Topology and Sequence diagrams to ensure accuracy.
AGILITY Registry: We’ve created a repository with a Python script that allows all agility applications to be in one central authority.
Service Auto-Detection Beta Warning: To improve the accuracy of our Service Auto-Detection feature, we set up a registry for cross-referencing.
Bug Fixes
We resolved a glitch where uploads of VoNR PCAPs were producing duplicate network element depictions on the Sequence Diagram.
Iteration 71
What’s New on the UI
Multi-File Processing: AGILITY now allows users to process multiple files uploaded in a zip in a single analysis.
Multi-File Processing Email Notifications: We’ve set up new email notifications that complement multi-file processing. Users who process (a) network analysis/analyses receive a notification email summarizing the analysis/analyses run. The email notification also lists files where call flows weren’t detected, prompting users to take remedial action when necessary.
User Feedback on Predictions: For continuous ML Model improvement, users can now provide feedback concerning the accuracy of call flow analysis results. Feedback icons are located on the Call Flow Details screen, where users can select thumbs up to agree with the analysis result or thumbs down to disagree.
Display Analysis Results for Partially Analyzed Call Flows: Now, AGILITY displays partial results for incomplete analyses. This means that data will still be available for review when a file is stuck in the processing status.
What We’re Doing Behind the Scenes
Expanded Coverage to all Services: Coverage now includes the following Service types;
4g-5g-NSA
5g-SA
5g-Mobility
VoNR
VoNR
Improved Execution Time: We migrated our test suit framework to Playwright to improve execution time:
4g-5g-NSA
5g-SA
5g-Mobility
VoNR-Cisco
VoNR-Dish
Previous execution time from Cypress:
Current execution time with parallelism in Playwright:
Bug Fixes
Functional Prediction Failure Procedures:
Previously:
Analysis reports were systematically discarded when a prediction failed
Now:
Reports are downloaded for any analysis/analyses that encounter prediction failures.
AGILITY depicts the call flows within the files uploaded for any analysis/analyses.
On the Call Flow Details page, we rectified duplicate messages appearing on the Message filter drop-down located on the Call Flow Details page.
Iteration 72
User-friendly UI Messages, Warnings and Prompts:
Added UI messaging and guidance when AGILITY cannot find call flows in your trace files.
Clear messaging is provided to users to inform them when AGILITY is unable to detect call flows in the uploaded file(s) thereby allowing for remediate action.. If a user uploads a zip file containing many files and any of the files fail to generate a call flow, a warning icon and the file name will be displayed.
Filter analyses by status - Under Advanced Filters, find your analyses that are processing, completed, completed with errors, or processing error (could not be completed).
Improved User Experience for Running Analyses:
File selection/upload and service selection are separated, and a second step is added to pick services.
Modify placeholder so that it displays the number of services selected rather than their names, and for automatic service discovery, render enabled auto-detection
For each type of file selection, a previous button has been included so that users may go back and forth to pick different filenames.
Analysis Page View Update:
Added Count of Prediction Results of each status
The charts for IMSI Distribution, Call Flows Distribution, and Call Flows Distribution by Service have all been updated.
New Start Analysis Flow
File selection/upload and service selection are separated, and a second step is added to pick services.
Modify placeholder so that it displays the number of services selected rather than their names, and for automatic service discovery, render enabled auto-detection
For each type of file selection, a previous button has been included so that users may go back and forth to pick different filenames.
Exposing APN Attribute
Exposing APN attributes inside flow extraction and message details.
Present Diameter Sublabel in Tabular View
Present the diameter as a tabular view in the protocol-level analysis section.E2E
•Added smoke tests as part of the deployment process (currently testing on dev)
•Added 17 new tests for label validations for each supported service (volte_telus is in progress)
•Added logic to handle CSV files and create dynamic tests based on that.
•Adapt existing tests to new UI changes (in progress)
The SIP reason header now appears in the UI in Flow extractions:
KPI Analysis tab added to the Call Flow Details page. You can now view a list of supported Key Performance Indicators (KPIs) and their values. You can also search using the KPI name.
Improved messaging for email notifications - a high-level summary and clearer text
PCAP file names are now included in the Call Flow section. The original file name allows you to navigate and manage call flows more effectively.
Access the AGILITY Knowledge Base through the AGILITY home page Quick Start Tutorial button.
Terminology clarification in the Call Flow Details section to “classification” instead of “root error”.
Leave feedback on label accuracy - the AGILITY team will use your comments to improve the AI
Keep the network functions visible when scrolling in the Call Flow Details screen.
Color tags implemented for each label:
green: success
yellow: warning
red: failure
gray: unknown
Updated the RCA table to show E911 diagnostic data.
What We’re Doing Behind the Scenes
Updates to include the following KPIs in the API:
device_time_for_session_establishment
call_setup_time
call_duration
device_time_to_registration
Adding elements to implement application and user settings from the AGILITY UI
Adding backend requirements to give more guidance when no call flows are found.
Bug Fixes
SDAA-6929 - Data displays after analysis is completed rather than requiring a refresh.
SDAA-6894 - Duplicate records in Call Flow analysis removed.
SDAA-3392 - Filter by name is now working correctly.
Iteration 73
What’s New on the UI
You can now jump directly from an element in Call Flow Details > Call Flow to the element in the Flow Extraction tab. Select the call flow element and from the Element’s Detailed Information window, select Message Attributes.
Additional attributes for S1AP, Diameter, NGAP, and SIP have been added in the Flow Extractions tab.
The email sent by AGILITY confirming the status of your network analysis now includes a direct link to your High Level Summary in AGILITY.
5G Network Slicing is now visualized in AGILITY. You can also group call flows by Network Slice. This added level of filtering and organization further enhances troubleshooting optimization.
Coming up: Iteration 74 & Beyond
Call Flow Comparative Analysis (Against Golden Flow): We’re creating a comparative analysis for call flows that will allow users to compare call flows extracted by AGILITY against golden flows. This new capability will enable easier identification of failures in the flow and guide the rapid identification of the root causes for failures by precisely pinpointing the network elements in the flow that resulted in errors. Call flow comparisons will be made at the procedural level and displayed as a side-by-side diagram, allowing users to filter by Procedure.