Im going through 50k chat conversations in customer service. Im using textcat.teach to set labels on them.
Example labels: payment, order info, cancellation.
There is a lot of messages inside the conversation that are not relevant at the moment, like welcome phrases and confirmations.
My questions is if I should reject them or just simply skip them?
I started out with annotations for the payment label and got quite good score but after thousands of annotations with a majority of rejects I got close to zero in score for a relevant payment conversation.
Can you confirm that skip is a good solution at this point?