Skip to content

Usage Analysis

The Usage Analysis page in the PinionAI Studio provides comprehensive tracking, visualization, and export capabilities for LLM token usage across all your AI Agents. It allows administrators and operations teams to monitor costs, analyze model efficiency, and understand token distribution across different sessions, agents, and LLM models.

Permissions & Prerequisites

To access and view the Usage Analysis dashboard, the following criteria must be met:

  1. Authentication: You must be logged into PinionAI Studio.
  2. Account Selection: An Account must be selected from the sidebar.
  3. User Permissions: Your user role must have at least one of the following permissions:
  4. owner
  5. admin
  6. observability

Filter Options

The page features filtering controls at the top to refine the dataset displayed in the reports:

  • Start Date & End Date: Date input selectors that define the timeframe for the analysis. The default start date is 30 days prior to the current date, and the default end date is today.
  • Select Agent: A dropdown selector to filter usage for a specific agent or view aggregated usage for "All Agents" under the selected account.

Summary Metrics

The top of the usage report displays a summary panel with four key metric cards:

  1. Sessions with Usage: The total count of unique customer sessions within the date range that generated model token usage.
  2. Total Input Tokens: The sum of prompt/input tokens sent to the LLM models.
  3. Total Output Tokens: The sum of response/output tokens generated by the LLM models.
  4. Total Tokens Used: The aggregate sum of both input and output tokens.

Data Export

A Download CSV Report button is available in the summary section. Clicking this compiles the session-by-session detailed token usage data into a downloadable CSV file named usage_report_<start_date>_to_<end_date>.csv.

The exported CSV contains the following columns for granular off-platform analysis:

  • Session UID
  • Date
  • Agent Name
  • Agent UID
  • Model (e.g., gemini-3.5-pro, gpt-4o)
  • Input Tokens
  • Output Tokens
  • Total Tokens

Detailed Reporting & Tabs

The dashboard organizes deeper insights into three distinct, interactive tabs:

1. Usage Graphs

This tab provides two visual, interactive Plotly charts:

  • Daily Token Usage by Model: A stacked bar chart showing the daily distribution of total tokens consumed, color-coded by the LLM model. This is critical for spotting spikes in traffic or shifts in model usage over time.
  • Input vs. Output Tokens by Model: A grouped bar chart comparing the total input (prompt) tokens and output (response) tokens for each model. This helps evaluate prompt-to-completion ratios and optimize system instructions.

2. Model Breakdown

This tab presents a tabular breakdown grouped by Model. It includes:

  • Model: Name of the LLM model.
  • Input Tokens: Formatted count of input tokens.
  • Output Tokens: Formatted count of output tokens.
  • Total Tokens: Formatted count of total tokens.
  • Sessions: Number of unique sessions using this model.
  • % of Total: The percentage of overall token consumption attributed to this model.

This breakdown is invaluable for auditing model-specific costs and tracking which models are utilized most frequently.

3. Agent Breakdown

This tab displays token usage statistics grouped by AI Agent:

  • Total Tokens Consumed by Agent Chart: An interactive bar chart showing total tokens color-coded by agent name, facilitating quick visual comparisons.
  • Agent Usage Table: A tabular view containing columns for Agent Name, Sessions, Input Tokens, Output Tokens, Total Tokens, and % of Total.

Use this view to identify which virtual assistants or custom agents are driving the majority of your token usage and operational costs.