Displaying a confidence score next to a user-defined entity

Yes, definitely give this a try! If you install spaCy from master, you'll also get this feature, which lets you access the individual spancat scores: Add scores to output in spancat by polm · Pull Request #8855 · explosion/spaCy · GitHub