I keep it simple. I have a document with 20+ command lines of the form:
PRODIGY_CONFIG=custom_config.jsonl PRODIGY_PORT=8251 PRODIGY_BASIC_AUTH_USER=user PRODIGY_BASIC_AUTH_PASS=password prodigy --all_the_options
This is used so that when I have to add more documents for annotation/change to a model in the loop/update whatever I can easily do that. It also helps me keep track of the ports. The Prodigy instances are started up in a Tmux session.... Yeah, barbarian method, but oh well, it's been working well for almost 6 months now.
And the annotators have their own document where they keep track of what's the link for each project and who is working on them.