more_intents_results_20240310_012320 - Analysis Report

Overall Accuracy: 0.35, Mean Precision: 0.84, Mean Recall: 0.49, Mean F1-Score: 0.59

Intent Descriptions

recommendationsuser looking for activity ideas.
feedbackUser provider feedback
conversationUser having a conversation with the assistant
profile_updateUsers want to update their profile (location, language, preferences)
satisfiedUser wants to end the conversation, they are satisfied
activity_detailsUsers wants more details about an activity
human_business_inquiryUser has a business inquiry or wants to talk to a human
service_questionUser has questions about you as an assistant or this service.
otherAnything else

Results

Data Table

  filename truth detection_0 detection_1 detection_2 result
0 corrected_conversation_10.csv recommendations recommendations recommendations recommendations True
1 corrected_conversation_11.csv recommendations recommendations detection_failed recommendations False
2 corrected_conversation_12.csv recommendations detection_failed detection_failed detection_failed False
3 corrected_conversation_13.csv recommendations recommendations recommendations recommendations True
4 corrected_conversation_4.csv recommendations recommendations recommendations recommendations True
5 corrected_conversation_5.csv recommendations recommendations recommendations recommendations True
6 corrected_conversation_54.csv conversation conversation conversation conversation True
7 corrected_conversation_55.csv conversation feedback feedback feedback False
8 corrected_conversation_56.csv conversation detection_failed conversation detection_failed False
9 corrected_conversation_57.csv conversation detection_failed detection_failed detection_failed False
10 corrected_conversation_58.csv conversation detection_failed detection_failed detection_failed False
11 corrected_conversation_59.csv conversation detection_failed detection_failed detection_failed False
12 corrected_conversation_6.csv recommendations detection_failed detection_failed detection_failed False
13 corrected_conversation_60.csv conversation detection_failed detection_failed detection_failed False
14 corrected_conversation_61.csv conversation conversation conversation conversation True
15 corrected_conversation_62.csv satisfied satisfied satisfied satisfied True
16 corrected_conversation_63.csv satisfied satisfied satisfied satisfied True
17 corrected_conversation_7.csv recommendations recommendations recommendations recommendations True
18 corrected_conversation_8.csv recommendations detection_failed detection_failed recommendations False
19 corrected_conversation_9.csv recommendations detection_failed detection_failed recommendations False
20 corrected_human_business_inquiry_conversation_44.csv human_business_inquiry human_business_inquiry human_business_inquiry human_business_inquiry True
21 corrected_human_business_inquiry_conversation_45.csv human_business_inquiry human_business_inquiry human_business_inquiry human_business_inquiry True
22 corrected_human_business_inquiry_conversation_46.csv human_business_inquiry feedback feedback feedback False
23 corrected_human_business_inquiry_conversation_47.csv human_business_inquiry feedback detection_failed feedback False
24 corrected_human_business_inquiry_conversation_48.csv human_business_inquiry human_business_inquiry human_business_inquiry human_business_inquiry True
25 corrected_human_business_inquiry_conversation_49.csv human_business_inquiry human_business_inquiry detection_failed human_business_inquiry False
26 corrected_human_business_inquiry_conversation_50.csv human_business_inquiry human_business_inquiry human_business_inquiry human_business_inquiry True
27 corrected_human_business_inquiry_conversation_51.csv human_business_inquiry service_question service_question service_question False
28 corrected_human_business_inquiry_conversation_52.csv human_business_inquiry detection_failed detection_failed detection_failed False
29 corrected_human_business_inquiry_conversation_53.csv human_business_inquiry feedback feedback feedback False
30 corrected_new_conversation_14.csv activity_details activity_details activity_details activity_details True
31 corrected_new_conversation_15.csv activity_details activity_details detection_failed detection_failed False
32 corrected_new_conversation_16.csv activity_details activity_details activity_details activity_details True
33 corrected_new_conversation_17.csv activity_details detection_failed detection_failed detection_failed False
34 corrected_new_conversation_18.csv activity_details detection_failed detection_failed detection_failed False
35 corrected_new_conversation_19.csv activity_details activity_details activity_details activity_details True
36 corrected_new_conversation_20.csv activity_details detection_failed detection_failed detection_failed False
37 corrected_new_conversation_21.csv activity_details detection_failed detection_failed detection_failed False
38 corrected_new_conversation_22.csv activity_details activity_details activity_details activity_details True
39 corrected_new_conversation_23.csv activity_details detection_failed detection_failed detection_failed False
40 corrected_profile_update_conversation_24.csv profile_update profile_update profile_update profile_update True
41 corrected_profile_update_conversation_25.csv profile_update detection_failed activity_details detection_failed False
42 corrected_profile_update_conversation_26.csv profile_update recommendations recommendations recommendations False
43 corrected_profile_update_conversation_27.csv profile_update recommendations recommendations recommendations False
44 corrected_profile_update_conversation_28.csv profile_update profile_update profile_update profile_update True
45 corrected_profile_update_conversation_29.csv profile_update profile_update recommendations recommendations False
46 corrected_profile_update_conversation_30.csv profile_update recommendations profile_update profile_update False
47 corrected_profile_update_conversation_31.csv profile_update recommendations recommendations recommendations False
48 corrected_profile_update_conversation_32.csv profile_update profile_update profile_update profile_update True
49 corrected_profile_update_conversation_33.csv profile_update profile_update profile_update profile_update True
50 corrected_service_question_conversation_34.csv service_question recommendations recommendations recommendations False
51 corrected_service_question_conversation_35.csv service_question detection_failed detection_failed detection_failed False
52 corrected_service_question_conversation_36.csv service_question detection_failed detection_failed detection_failed False
53 corrected_service_question_conversation_37.csv service_question detection_failed detection_failed detection_failed False
54 corrected_service_question_conversation_38.csv service_question detection_failed detection_failed detection_failed False
55 corrected_service_question_conversation_39.csv service_question service_question detection_failed detection_failed False
56 corrected_service_question_conversation_40.csv service_question profile_update profile_update profile_update False
57 corrected_service_question_conversation_41.csv service_question detection_failed detection_failed detection_failed False
58 corrected_service_question_conversation_42.csv service_question detection_failed detection_failed detection_failed False
59 corrected_service_question_conversation_43.csv service_question detection_failed detection_failed detection_failed False