after_changing_intent_enum_results_20240310_005738 - Analysis Report

Overall Accuracy: 0.37, Mean Precision: 0.51, Mean Recall: 0.48, Mean F1-Score: 0.42

Intent Descriptions

recommendationsThe user is looking for ideas about things to do. They are seeking inspiration and specific activity ideas
feedbackThe user is providing feedback on the recommendations or wants to know more about a specific activity
conversationThe user is starting or is having a casual conversation which is not related to any of the other intents
more_infoThe user wants to update generic information about their profile. This may be about their main location like where they live, about their preferences or their user language
reflect_on_pastThe user is asking the assistant about previous interactions with the assistant or is reflecting on past experiences
satisfiedThe user tells they are satisfied and wants to end the conversation
otherAnything else

Results

Data Table

  filename truth detection_0 detection_1 detection_2 result
0 corrected_conversation_10.csv recommendations recommendations recommendations recommendations True
1 corrected_conversation_11.csv recommendations recommendations recommendations recommendations True
2 corrected_conversation_12.csv recommendations conversation conversation more_info False
3 corrected_conversation_13.csv recommendations recommendations recommendations recommendations True
4 corrected_conversation_4.csv recommendations recommendations recommendations recommendations True
5 corrected_conversation_5.csv recommendations recommendations recommendations recommendations True
6 corrected_conversation_54.csv conversation conversation conversation conversation True
7 corrected_conversation_55.csv conversation conversation conversation conversation True
8 corrected_conversation_56.csv conversation conversation conversation conversation True
9 corrected_conversation_57.csv conversation recommendations recommendations conversation False
10 corrected_conversation_58.csv conversation conversation conversation conversation True
11 corrected_conversation_59.csv conversation conversation conversation conversation True
12 corrected_conversation_6.csv recommendations recommendations recommendations recommendations True
13 corrected_conversation_60.csv conversation conversation conversation conversation True
14 corrected_conversation_61.csv conversation conversation conversation conversation True
15 corrected_conversation_62.csv satisfied recommendations recommendations satisfied False
16 corrected_conversation_63.csv satisfied satisfied detection_failed satisfied False
17 corrected_conversation_7.csv recommendations recommendations recommendations recommendations True
18 corrected_conversation_8.csv recommendations recommendations recommendations recommendations True
19 corrected_conversation_9.csv recommendations recommendations recommendations recommendations True
20 corrected_human_business_inquiry_conversation_44.csv other detection_failed detection_failed detection_failed False
21 corrected_human_business_inquiry_conversation_45.csv other conversation conversation conversation False
22 corrected_human_business_inquiry_conversation_46.csv other recommendations recommendations recommendations False
23 corrected_human_business_inquiry_conversation_47.csv other conversation recommendations recommendations False
24 corrected_human_business_inquiry_conversation_48.csv other detection_failed detection_failed detection_failed False
25 corrected_human_business_inquiry_conversation_49.csv other conversation conversation conversation False
26 corrected_human_business_inquiry_conversation_50.csv other conversation conversation conversation False
27 corrected_human_business_inquiry_conversation_51.csv other detection_failed detection_failed detection_failed False
28 corrected_human_business_inquiry_conversation_52.csv other reflect_on_past detection_failed detection_failed False
29 corrected_human_business_inquiry_conversation_53.csv other conversation conversation conversation False
30 corrected_new_conversation_14.csv reflect_on_past recommendations recommendations recommendations False
31 corrected_new_conversation_15.csv reflect_on_past recommendations recommendations recommendations False
32 corrected_new_conversation_16.csv reflect_on_past conversation recommendations recommendations False
33 corrected_new_conversation_17.csv reflect_on_past recommendations recommendations recommendations False
34 corrected_new_conversation_18.csv reflect_on_past recommendations recommendations recommendations False
35 corrected_new_conversation_19.csv reflect_on_past recommendations recommendations recommendations False
36 corrected_new_conversation_20.csv reflect_on_past recommendations recommendations recommendations False
37 corrected_new_conversation_21.csv reflect_on_past recommendations recommendations recommendations False
38 corrected_new_conversation_22.csv reflect_on_past reflect_on_past reflect_on_past reflect_on_past True
39 corrected_new_conversation_23.csv reflect_on_past recommendations recommendations reflect_on_past False
40 corrected_profile_update_conversation_24.csv more_info more_info more_info more_info True
41 corrected_profile_update_conversation_25.csv more_info recommendations recommendations recommendations False
42 corrected_profile_update_conversation_26.csv more_info conversation conversation conversation False
43 corrected_profile_update_conversation_27.csv more_info recommendations recommendations recommendations False
44 corrected_profile_update_conversation_28.csv more_info detection_failed detection_failed detection_failed False
45 corrected_profile_update_conversation_29.csv more_info more_info more_info more_info True
46 corrected_profile_update_conversation_30.csv more_info more_info more_info more_info True
47 corrected_profile_update_conversation_31.csv more_info recommendations recommendations recommendations False
48 corrected_profile_update_conversation_32.csv more_info more_info more_info more_info True
49 corrected_profile_update_conversation_33.csv more_info more_info more_info more_info True
50 corrected_service_question_conversation_34.csv other conversation conversation conversation False
51 corrected_service_question_conversation_35.csv other conversation conversation conversation False
52 corrected_service_question_conversation_36.csv other conversation conversation conversation False
53 corrected_service_question_conversation_37.csv other conversation detection_failed conversation False
54 corrected_service_question_conversation_38.csv other detection_failed reflect_on_past detection_failed False
55 corrected_service_question_conversation_39.csv other detection_failed detection_failed detection_failed False
56 corrected_service_question_conversation_40.csv other detection_failed more_info more_info False
57 corrected_service_question_conversation_41.csv other conversation conversation conversation False
58 corrected_service_question_conversation_42.csv other more_info more_info reflect_on_past False
59 corrected_service_question_conversation_43.csv other detection_failed detection_failed detection_failed False