Yes, potentially – it sounds like what you're annotating and training here might be a bit different from what's typically considered named entity recognition, e.g. named "real world objects" like proper nouns where boundaries are important. A single token can also only be part of one entity. That's both things that NER model implementations are designed for, so if your annotations are different, that might explain why you're not seeing good results.