# Querying Relations Layer Annotations (for Rhetoric Text Structure Analysis) **URL:** \ **Category:** Uncategorized\ **Tags:** usage, database, relations\ **Created:** [August 29, 2023, 9:27am UTC](https://support.prodi.gy/t/querying-relations-layer-annotations-for-rhetoric-text-structure-analysis/6759 "2023-08-29T09:27:09Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![yanirmr](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/yanirmr/32/4035_2.png) [@yanirmr](https://support.prodi.gy/u/yanirmr)\ **Post date:** [August 29, 2023, 9:27am UTC](https://support.prodi.gy/t/querying-relations-layer-annotations-for-rhetoric-text-structure-analysis/6759/1 "2023-08-29T09:27:09Z")
Hello, I'm embarking on a project focused on tagging relationships between entities to annotate the structure of rhetorical texts. The goal is to identify and analyze structures such as claims, rhetorical questions, facts, opinions, declines of hypothetical claims, regard for other speakers, and more. While I believe I have a schema that suits my needs, I have a few queries regarding the post-annotation phase: 1. Querying the Tagged Dataset: How can I query the tagged dataset once the annotation is complete? Are there built-in tools within Prodigy, or would I need to export the data and use external tools to analyze the annotations? 2. Examples: Are there any exemplary projects or datasets that demonstrate the usability of relationship annotations and querying processes, especially in the context of rhetorical text structures? Any references would be greatly appreciated. 3. Analysis of Structures and Sequences: I'm interested in analyzing the frequency of certain structures and sequences in the annotated data. Is there a recommended approach for this within Prodigy, or should I consider external tools or scripts? 4. Effort Estimation: Given my objective to identify specific rhetorical patterns based on the annotations, how much effort would be required to query and analyze the data? Does Prodigy have any built-in features to assist in this, or should I be prepared to implement a custom querying system? Any guidance or insights would be invaluable. Thank you for your time and expertise. Best regards, Yanir ---
**Author:** ![ryanwesslen](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ryanwesslen/32/2969_2.png) [@ryanwesslen](https://support.prodi.gy/u/ryanwesslen)\ **Post date:** [August 29, 2023, 7:27pm UTC](https://support.prodi.gy/t/querying-relations-layer-annotations-for-rhetoric-text-structure-analysis/6759/2 "2023-08-29T19:27:25Z")
hi @yanirmr! Thanks for your question and welcome to the Prodigy community ๐Ÿ‘‹ > [@yanirmr](#): > > I'm embarking on a project focused on tagging relationships between entities to annotate the structure of rhetorical texts. The goal is to identify and analyze structures such as claims, rhetorical questions, facts, opinions, declines of hypothetical claims, regard for other speakers, and more. While I believe I have a schema that suits my needs, I have a few queries regarding the post-annotation phase: Sounds like an interesting project! > [@yanirmr](#): > > 1. Querying the Tagged Dataset: How can I query the tagged dataset once the annotation is complete? Are there built-in tools within Prodigy, or would I need to export the data and use external tools to analyze the annotations? Yes. There are [database components](https://prodi.gy/docs/api-database#database) that allow you to connect directly to the database. You can create your own Python scripts off of these: ```python from prodigy.components.db import connect db = connect() all_dataset_names = db.datasets examples = db.get_dataset_examples("my_dataset") ``` You can also use [`db-out`](https://prodi.gy/docs/recipes#db-out) to export the data, but I'd recommend using the Python components first as it will give you more flexibility. Alternatively if you plan to train a model with spaCy, I'd also consider [`data-to-spacy`](https://prodi.gy/docs/recipes#data-to-spacy) as it's a very helpful recipe to convert your annotations to spaCy binary files and creates a default config file that can be used for `spacy train`. > [@yanirmr](#): > > Examples: Are there any exemplary projects or datasets that demonstrate the usability of relationship annotations and querying processes, especially in the context of rhetorical text structures? Any references would be greatly appreciated. If you mean example projects on relations extraction, yes! Sofie has written a wonderful blog post with an accompanying tutorial [video](https://www.youtube.com/watch?v=8HL-Ap5_Axo) and GitHub [template project](https://github.com/explosion/projects/tree/v3/tutorials/rel_component). The use case is biomedical, not rhetoric text structure, but hopefully it should give you a good understanding. It also includes a Prodigy recipe and some ideas of how to annotate in Prodigy. > **[Implementing a custom trainable component for relation extraction ยท Explosion](https://explosion.ai/blog/relation-extraction/)** > > Relation extraction refers to the process of predicting and labeling semantic relationships between named entities. In this blog post, we'll go over the process of building a custom relation extraction component using spaCy and Thinc. We'll also add... What's important to know is that this project was also developed to show how to create a custom trainable component in spaCy. I mention because it does start to get a bit deep, but this can also be powerful as it also shows how to extend the trainable component if your problem is slightly different. I'd also recommend searching spaCy's [GitHub discussion forum](https://github.com/explosion/spaCy/discussions) if you have questions on the spaCy component. > [@yanirmr](#): > > - Analysis of Structures and Sequences: I'm interested in analyzing the frequency of certain structures and sequences in the annotated data. Is there a recommended approach for this within Prodigy, or should I consider external tools or scripts? > - Effort Estimation: Given my objective to identify specific rhetorical patterns based on the annotations, how much effort would be required to query and analyze the data? Does Prodigy have any built-in features to assist in this, or should I be prepared to implement a custom querying system? Are you simply looking for basic stats about your annotations, e.g., how frequently certain relations or entity types exist? Prodigy doesn't offer a lot of out of the box stats functions so likely it'll be best to write your own scripts. We are releasing soon a built-in component for Inter-Annotator Agreement (IAA), but I suspect you're more interested in stats about the annotations rather than agreement metrics across different users. Likely the closest may be spaCy's [`data debug`](https://spacy.io/api/cli#debug-data), which if you save your annotations as spaCy binary files (i.e., use `data-to-spacy`), and then run `data debug` on your binary files. This is helpful for tasks like `spancat` where you can see a host of data characteristics. I suspect `ner` should work too. Unfortunately, I don't think there's support for `relations` as it's not a native component. Hope this helps! ---
**Author:** ![yanirmr](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/yanirmr/32/4035_2.png) [@yanirmr](https://support.prodi.gy/u/yanirmr)\ **Post date:** [September 3, 2023, 7:22pm UTC](https://support.prodi.gy/t/querying-relations-layer-annotations-for-rhetoric-text-structure-analysis/6759/3 "2023-09-03T19:22:44Z")
Thank you for your comprehensive response; it's greatly appreciated. 1. Regarding querying the dataset, I understand the flexibility that the Python components provide, and I'm intrigued by the capabilities of connecting directly to the database. However, a significant part of my team is not technically inclined. Is there a no-code platform or alternative approach you'd suggest that could facilitate easier access for my non-tech-savvy teammates to query the data? 2. Another crucial aspect for our project is language support. Can you confirm if Prodigy supports Hebrew and Aramaic for annotations? Once again, thank you for the guidance. I'm excited to delve deeper into the resources and get started with the annotation process. Best regards, Yanir ---
**Author:** ![ryanwesslen](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ryanwesslen/32/2969_2.png) [@ryanwesslen](https://support.prodi.gy/u/ryanwesslen)\ **Post date:** [September 6, 2023, 10:57am UTC](https://support.prodi.gy/t/querying-relations-layer-annotations-for-rhetoric-text-structure-analysis/6759/4 "2023-09-06T10:57:57Z")
hi @yanirmr, > [@yanirmr](#): > > Is there a no-code platform or alternative approach you'd suggest that could facilitate easier access for my non-tech-savvy teammates to query the data? We offer the [`db-out` recipe](https://prodi.gy/docs/recipes#db-out) which exports out the `.jsonl` file. You're welcome to write your own script to simplify for non-programmer teammates. Maybe you could write a custom jupyter notebook that analyzes that output file? Prodigy is designed to be a developer's annotation tool. The assumption is that you'd have at least one developer who then could try to write your own custom tools (e.g., a streamlit app or jupyter notebook) for non-tech savvy teammates. > [@yanirmr](#): > > Can you confirm if Prodigy supports Hebrew and Aramaic for annotations? So what's most important is that you have some tokenizer for those languages if you're annotating spans or relations. Technically, Prodigy can work for any language -- but you'd need to have a tokenizer. Out-of-the-box, Prodigy works with spaCy so you'd need to use one of the tokenizers. SpaCy does have a [tokenizer](https://spacy.io/usage/models#languages) for Hebrew, which I know Prodigy users have used. However, I'm not aware of one for Aramaic and I'm not sure if the Hebrew tokenizer would work. One feature Prodigy does have is right-to-left support: > [@Right to left support for Hebrew](https://support.prodi.gy/t/right-to-left-support-for-hebrew/5158/2): > > Done! Just figured out there is a writing\_dir property in prodigy.json that I should set to "rtl". Thanks, Oren It sounds like you're planning to write your own custom component and maybe need help on tokenizers like for Aramaic. So I'd encourage you to look through and use [spaCy's GitHub discussion forum](https://github.com/explosion/spaCy/discussions). Since you mention your team isn't very tech savvy, I think you may find a lot of your questions are spaCy questions.