Skip to content
This repository has been archived by the owner on Jun 30, 2022. It is now read-only.

[DO NOT MERGE] Conversational Analytics Dashboard referencing 4.2 telemetry #411

Merged
merged 11 commits into from
Dec 14, 2018

Conversation

ryanisgrig
Copy link
Collaborator

@ryanisgrig ryanisgrig commented Dec 9, 2018

Description

Moving PowerBI sample dashboard to a centralized /Microsoft/AI/solutions/analytics directory that will be referenced in related README files. The Conversational Analytics sample is using dashboards from the VPA work, allowing users to gain insights into their dialog health and conversation properties.

  • Overall Usage tab is refactored from the previous dashboard.
  • All Dialogs Overview will show all a count of all dialogs captured, as well as their proportionate status (Abandoned/Canceled/Done/Started are provided by Waterfall SDK telemetry)
  • Dialog Overview shows the previous graphs per dialog, by date. You can also gain insights into the average bot/user turn counts each day.
  • Conversation Metrics will highlight the average numbers of conversations per unique users and average duration.
  • Conversation Drill Down tab shows how to drill down by conversation to view all related user utterances, bot responses, and dialogs triggered during the same session.
  • Transcript tab demonstrates how to show a defined From here, you can select a specific conversation to gain further insights on how a conversation went between your bot and it's users.
  • Demographics & Usage merges the Demographics & Users and Conversations tabs from the previous dashboard.
  • Word Cloud merges the Word Cloud and Common Words tabs from the previous dashboard.
  • Sentiment remains from the previous dashboard.
  • QnAMaker Insights remains from the previous dashboard, plus new Answer Found filter.
New tab

image

Related Issue

#134
#354 - new telemetry tracked here
microsoft/botframework-sdk#5148

Testing Steps

Checklist

  • I have updated related documentation

If this contains changes that needs to be replicated between the Enterprise Template <-> Virtual Assistant

If you have updated responses or .lu files:

  • All languages have been updated - n/a
  • You have tested deployment with your new models - n/a

…le Dashboard (new) to AI\solution\analytics.
@ryanisgrig ryanisgrig changed the title Conversational Analytics Dashboard referencing 4.2 telemetry [Do not merge] Conversational Analytics Dashboard referencing 4.2 telemetry Dec 9, 2018
@ryanisgrig ryanisgrig changed the title [Do not merge] Conversational Analytics Dashboard referencing 4.2 telemetry [DO NOT MERGE] Conversational Analytics Dashboard referencing 4.2 telemetry Dec 9, 2018
@ryanisgrig
Copy link
Collaborator Author

I'm open to feedback on if there's a need to keep the old dashboard?

Copy link
Contributor

@darrenj darrenj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PowerBI template needs to be exported as a PowerBI Template (within PowerBI - File - Export) to create a .pbit file as per the original dashboard. Then when a user downloads and double clicks it prompts for the AppInsights Id

We should update the enterprise template docs for analytics to reflect the changes and perhaps add some screenshots. repo is here.

Same for VA :)

@ryanisgrig
Copy link
Collaborator Author

@darrenj .pbit file provided instead - it will now ask for an application ID.

@ryanisgrig ryanisgrig merged commit 4872586 into master Dec 14, 2018
@lauren-mills lauren-mills deleted the ryanlengel/conversationAnalyticsDashboard branch December 17, 2018 16:30
lauren-mills pushed a commit that referenced this pull request Apr 18, 2019
…emetry (#411)

* Added both Example Dashboard (old) and Conversational Anayltics Example Dashboard (new) to AI\solution\analytics.

* Rename dashboards

* Removed old PowerBI sample

* Added template

* Removed .pbix file

* Removing old template

* Added READMEs and new .pbit

* Fixed formatting

* Fixed app insights image

* Removed PBIT

* Updated PBIT
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants