better_engine_results_20240311_152143 - Analysis Report

Overall Accuracy: 0.82, Mean Precision: 0.83, Mean Recall: 0.84, Mean F1-Score: 0.82

Intent Descriptions

recommendationsThe user is looking for activity ideas or ask for more like this.
conversationThe user is starting or is having a casual conversation which is not related to any of the other intents.
profile_updateThe user wants to update their profile (location, language, preferences)
satisfiedThe user is satisfied and wants to end the conversation.
activity_detailsIF the assistant made a recommendation earlier AND the user wants more details about an activity or suggestion. The user has questions about the suitability of the suggested activities
human_business_inquiryThe user has a business inquiry: for example a business partner or an influencer is reaching out. Alternatively it can be the user wants or needs to talk to a human: for example the user is aggressive, expresses frustration or anger towards you.
service_questionThe user has questions or comments (feedback) about you as an assistant or this service. It's related to the assistant functionalities: how it works, what is the privacy policy, what data does it uses, which languages are available.
otherAnything else that is not covered by the other intents. It's a catch-all for anything else.

Results

Data Table

  filename truth detection_0 detection_1 detection_2 result
0 corrected_conversation_10.csv recommendations recommendations recommendations recommendations True
1 corrected_conversation_11.csv recommendations recommendations recommendations recommendations True
2 corrected_conversation_12.csv recommendations recommendations recommendations recommendations True
3 corrected_conversation_13.csv recommendations conversation recommendations conversation False
4 corrected_conversation_4.csv recommendations recommendations recommendations recommendations True
5 corrected_conversation_5.csv recommendations recommendations recommendations recommendations True
6 corrected_conversation_54.csv conversation conversation conversation conversation True
7 corrected_conversation_55.csv conversation conversation conversation conversation True
8 corrected_conversation_56.csv conversation service_question service_question service_question False
9 corrected_conversation_57.csv conversation other other other False
10 corrected_conversation_58.csv conversation conversation conversation conversation True
11 corrected_conversation_59.csv conversation conversation conversation conversation True
12 corrected_conversation_6.csv recommendations recommendations recommendations recommendations True
13 corrected_conversation_60.csv conversation conversation conversation conversation True
14 corrected_conversation_61.csv conversation conversation conversation conversation True
15 corrected_conversation_62.csv satisfied satisfied satisfied satisfied True
16 corrected_conversation_63.csv satisfied satisfied satisfied satisfied True
17 corrected_conversation_7.csv recommendations recommendations recommendations recommendations True
18 corrected_conversation_8.csv recommendations recommendations recommendations recommendations True
19 corrected_conversation_9.csv recommendations recommendations recommendations recommendations True
20 corrected_human_business_inquiry_conversation_44.csv human_business_inquiry human_business_inquiry human_business_inquiry human_business_inquiry True
21 corrected_human_business_inquiry_conversation_45.csv human_business_inquiry human_business_inquiry human_business_inquiry human_business_inquiry True
22 corrected_human_business_inquiry_conversation_46.csv human_business_inquiry human_business_inquiry human_business_inquiry human_business_inquiry True
23 corrected_human_business_inquiry_conversation_47.csv human_business_inquiry satisfied satisfied satisfied False
24 corrected_human_business_inquiry_conversation_48.csv human_business_inquiry human_business_inquiry human_business_inquiry human_business_inquiry True
25 corrected_human_business_inquiry_conversation_49.csv human_business_inquiry human_business_inquiry human_business_inquiry human_business_inquiry True
26 corrected_human_business_inquiry_conversation_50.csv human_business_inquiry human_business_inquiry human_business_inquiry human_business_inquiry True
27 corrected_human_business_inquiry_conversation_51.csv human_business_inquiry human_business_inquiry human_business_inquiry human_business_inquiry True
28 corrected_human_business_inquiry_conversation_52.csv human_business_inquiry service_question service_question service_question False
29 corrected_human_business_inquiry_conversation_53.csv human_business_inquiry service_question service_question service_question False
30 corrected_new_conversation_14.csv activity_details activity_details activity_details activity_details True
31 corrected_new_conversation_15.csv activity_details activity_details activity_details activity_details True
32 corrected_new_conversation_16.csv activity_details activity_details activity_details activity_details True
33 corrected_new_conversation_17.csv activity_details activity_details activity_details activity_details True
34 corrected_new_conversation_18.csv activity_details activity_details activity_details activity_details True
35 corrected_new_conversation_19.csv activity_details activity_details activity_details activity_details True
36 corrected_new_conversation_20.csv activity_details activity_details activity_details activity_details True
37 corrected_new_conversation_21.csv activity_details activity_details activity_details activity_details True
38 corrected_new_conversation_22.csv activity_details activity_details activity_details activity_details True
39 corrected_new_conversation_23.csv activity_details activity_details activity_details activity_details True
40 corrected_profile_update_conversation_24.csv profile_update profile_update profile_update profile_update True
41 corrected_profile_update_conversation_25.csv profile_update profile_update profile_update profile_update True
42 corrected_profile_update_conversation_26.csv profile_update profile_update profile_update profile_update True
43 corrected_profile_update_conversation_27.csv profile_update recommendations conversation recommendations False
44 corrected_profile_update_conversation_28.csv profile_update profile_update profile_update profile_update True
45 corrected_profile_update_conversation_29.csv profile_update profile_update profile_update profile_update True
46 corrected_profile_update_conversation_30.csv profile_update profile_update profile_update profile_update True
47 corrected_profile_update_conversation_31.csv profile_update profile_update profile_update profile_update True
48 corrected_profile_update_conversation_32.csv profile_update profile_update profile_update profile_update True
49 corrected_profile_update_conversation_33.csv profile_update service_question service_question service_question False
50 corrected_service_question_conversation_34.csv service_question activity_details detection_failed detection_failed False
51 corrected_service_question_conversation_35.csv service_question activity_details activity_details activity_details False
52 corrected_service_question_conversation_36.csv service_question activity_details service_question activity_details False
53 corrected_service_question_conversation_37.csv service_question service_question service_question service_question True
54 corrected_service_question_conversation_38.csv service_question service_question service_question service_question True
55 corrected_service_question_conversation_39.csv service_question service_question service_question service_question True
56 corrected_service_question_conversation_40.csv service_question service_question service_question service_question True
57 corrected_service_question_conversation_41.csv service_question service_question service_question service_question True
58 corrected_service_question_conversation_42.csv service_question service_question service_question service_question True
59 corrected_service_question_conversation_43.csv service_question service_question service_question service_question True