before_changing_intent_enum_results_20240310_004911 - Analysis Report

Overall Accuracy: 0.38, Mean Precision: 0.49, Mean Recall: 0.51, Mean F1-Score: 0.44

Intent Descriptions

recommendationsThe user has provided info and/or is asking for recommendations
feedbackThe user is providing feedback on the recommendations
conversationThe user is starting a conversation with the assistant or answering a question
more_infoThe user is providing more information about their profile, such as location, language, or preferences
reflect_on_pastThe user is asking the assistant to reflect on past interactions
satisfiedThe user tells they are satisfied and wants to end the conversation
otherAnything else

Results

Data Table

  filename truth detection_0 detection_1 detection_2 result
0 corrected_conversation_10.csv recommendations recommendations recommendations recommendations True
1 corrected_conversation_11.csv recommendations recommendations recommendations recommendations True
2 corrected_conversation_12.csv recommendations recommendations recommendations recommendations True
3 corrected_conversation_13.csv recommendations recommendations recommendations recommendations True
4 corrected_conversation_4.csv recommendations recommendations recommendations recommendations True
5 corrected_conversation_5.csv recommendations recommendations recommendations recommendations True
6 corrected_conversation_54.csv conversation conversation conversation conversation True
7 corrected_conversation_55.csv conversation conversation conversation conversation True
8 corrected_conversation_56.csv conversation conversation conversation conversation True
9 corrected_conversation_57.csv conversation recommendations recommendations conversation False
10 corrected_conversation_58.csv conversation conversation conversation conversation True
11 corrected_conversation_59.csv conversation conversation conversation conversation True
12 corrected_conversation_6.csv recommendations recommendations recommendations recommendations True
13 corrected_conversation_60.csv conversation conversation conversation conversation True
14 corrected_conversation_61.csv conversation conversation conversation conversation True
15 corrected_conversation_62.csv satisfied satisfied recommendations satisfied False
16 corrected_conversation_63.csv satisfied recommendations recommendations recommendations False
17 corrected_conversation_7.csv recommendations recommendations recommendations recommendations True
18 corrected_conversation_8.csv recommendations recommendations recommendations recommendations True
19 corrected_conversation_9.csv recommendations recommendations recommendations recommendations True
20 corrected_human_business_inquiry_conversation_44.csv other detection_failed detection_failed detection_failed False
21 corrected_human_business_inquiry_conversation_45.csv other recommendations more_info recommendations False
22 corrected_human_business_inquiry_conversation_46.csv other recommendations recommendations recommendations False
23 corrected_human_business_inquiry_conversation_47.csv other recommendations recommendations recommendations False
24 corrected_human_business_inquiry_conversation_48.csv other conversation detection_failed conversation False
25 corrected_human_business_inquiry_conversation_49.csv other conversation conversation conversation False
26 corrected_human_business_inquiry_conversation_50.csv other conversation conversation conversation False
27 corrected_human_business_inquiry_conversation_51.csv other conversation conversation conversation False
28 corrected_human_business_inquiry_conversation_52.csv other reflect_on_past reflect_on_past conversation False
29 corrected_human_business_inquiry_conversation_53.csv other feedback feedback feedback False
30 corrected_new_conversation_14.csv reflect_on_past detection_failed detection_failed recommendations False
31 corrected_new_conversation_15.csv reflect_on_past recommendations recommendations recommendations False
32 corrected_new_conversation_16.csv reflect_on_past reflect_on_past reflect_on_past reflect_on_past True
33 corrected_new_conversation_17.csv reflect_on_past recommendations recommendations recommendations False
34 corrected_new_conversation_18.csv reflect_on_past recommendations recommendations recommendations False
35 corrected_new_conversation_19.csv reflect_on_past recommendations recommendations recommendations False
36 corrected_new_conversation_20.csv reflect_on_past recommendations recommendations recommendations False
37 corrected_new_conversation_21.csv reflect_on_past recommendations recommendations recommendations False
38 corrected_new_conversation_22.csv reflect_on_past reflect_on_past more_info reflect_on_past False
39 corrected_new_conversation_23.csv reflect_on_past recommendations recommendations recommendations False
40 corrected_profile_update_conversation_24.csv more_info more_info more_info more_info True
41 corrected_profile_update_conversation_25.csv more_info recommendations recommendations recommendations False
42 corrected_profile_update_conversation_26.csv more_info recommendations recommendations recommendations False
43 corrected_profile_update_conversation_27.csv more_info recommendations recommendations recommendations False
44 corrected_profile_update_conversation_28.csv more_info more_info more_info more_info True
45 corrected_profile_update_conversation_29.csv more_info recommendations recommendations recommendations False
46 corrected_profile_update_conversation_30.csv more_info more_info more_info more_info True
47 corrected_profile_update_conversation_31.csv more_info recommendations recommendations recommendations False
48 corrected_profile_update_conversation_32.csv more_info more_info more_info more_info True
49 corrected_profile_update_conversation_33.csv more_info more_info more_info more_info True
50 corrected_service_question_conversation_34.csv other recommendations recommendations recommendations False
51 corrected_service_question_conversation_35.csv other recommendations recommendations recommendations False
52 corrected_service_question_conversation_36.csv other recommendations recommendations recommendations False
53 corrected_service_question_conversation_37.csv other conversation conversation conversation False
54 corrected_service_question_conversation_38.csv other reflect_on_past detection_failed detection_failed False
55 corrected_service_question_conversation_39.csv other conversation conversation detection_failed False
56 corrected_service_question_conversation_40.csv other more_info more_info more_info False
57 corrected_service_question_conversation_41.csv other conversation conversation conversation False
58 corrected_service_question_conversation_42.csv other reflect_on_past conversation conversation False
59 corrected_service_question_conversation_43.csv other more_info more_info more_info False