@@ -4,9 +4,9 @@ We have used 6 different main prompts with different variations, which are hereu
***Prompt 1: Zero-shot instruction**. It instructs the model to list observable characteristics classified by TUIs and STs, emphasizing the use of “phenotypic manifestations” to capture a broad range of symptoms beyond strict biomedical terms. A guided variation (**Zero-shot with guidance**) explicitly specifies the disease or condition in the text to enhance precision when identification is ambiguous, incorporating automation to extract condition names dynamically.
**Prompt 2: Entity dictionary*. It employs an entity dictionary, defined by TUIs and STs, with variations designed to assess the impact of dictionary detail and task framing. The base prompt focuses on identifying entities using the full dictionary, including detailed TUIs and STs descriptions. **Entity dictionary with guidance** adds the specific condition as seen in Prompt 1. **Entity dictionary simplified** simplifies the task by omitting the detailed TUI descriptions, reducing the dictionary’s complexity. **Entity dictionary simplified with guidance** is a combination of the two previous ones. Entity dictionary plus manifestations adds “manifestations” to the list of entities to be extracted, expanding the task scope. **Entity dictionary optimized by ChatGPT** extends the base Prompt 2 but with formatting and optimizations suggested by ChatGPT.
***Prompt 2: Entity dictionary**. It employs an entity dictionary, defined by TUIs and STs, with variations designed to assess the impact of dictionary detail and task framing. The base prompt focuses on identifying entities using the full dictionary, including detailed TUIs and STs descriptions. **Entity dictionary with guidance** adds the specific condition as seen in Prompt 1. **Entity dictionary simplified** simplifies the task by omitting the detailed TUI descriptions, reducing the dictionary’s complexity. **Entity dictionary simplified with guidance** is a combination of the two previous ones. Entity dictionary plus manifestations adds “manifestations” to the list of entities to be extracted, expanding the task scope. **Entity dictionary optimized by ChatGPT** extends the base Prompt 2 but with formatting and optimizations suggested by ChatGPT.
*** Prompt 3: One-shot learning + entity dictionary**. It builds upon the structure of Prompt 2, introducing one-shot learning to enhance entity extraction. This approach includes an explicit example in the “assistant” role, showing the expected output format to guide the model's responses. It also uses a detailed entity dictionary with long descriptions for TUIs and STs. **One-shot learning + entity dictionary simplified** replaces the detailed entity dictionary with a concise version, reducing complexity while maintaining the same input text and example output.
***Prompt 3: One-shot learning + entity dictionary**. It builds upon the structure of Prompt 2, introducing one-shot learning to enhance entity extraction. This approach includes an explicit example in the “assistant” role, showing the expected output format to guide the model's responses. It also uses a detailed entity dictionary with long descriptions for TUIs and STs. **One-shot learning + entity dictionary simplified** replaces the detailed entity dictionary with a concise version, reducing complexity while maintaining the same input text and example output.
***Prompt 4: Self-explanation + entity dictionary**. It integrates self explanation with an entity dictionary to enhance Named Entity Extraction (NEE) by requiring the model to justify each entity’s classification into specific TUIs and STs. This approach improves comprehension, accuracy, and transparency by breaking down the task into detailed reasoning steps, thereby reducing errors and increasing trustworthiness. Research has demonstrated that self-explanation prompting consistently outperforms zero-shot techniques and matches or exceeds the effectiveness of few-shot prompts across various dialogue-centric tasks [1]. **Self-explanation + entity dictionary simplified** replaces the detailed entity dictionary with a concise version as before.
