INTERNATIONAL JOURNAL OF NOVEL RESEARCH AND DEVELOPMENT International Peer Reviewed & Refereed Journals, Open Access Journal ISSN Approved Journal No: 2456-4184 | Impact factor: 8.76 | ESTD Year: 2016
Scholarly open access journals, Peer-reviewed, and Refereed Journals, Impact factor 8.76 (Calculate by google scholar and Semantic Scholar | AI-Powered Research Tool) , Multidisciplinary, Monthly, Indexing in all major database & Metadata, Citation Generator, Digital Object Identifier(DOI)
In recent years, the field of Natural Language Processing (NLP) has witnessed the remarkable advancements with emergence of general language models like BERT, GPT-3. These models have demonstrated impressive capabilities in understanding and generating human like text across wide range of domains. However, their potential remains largely untapped when it comes to specialized domains such as biomedicine.
This proposed work aims to explore and harness the latent potential of general language models within the biomedical domain. The biomedical field is characterized by its intricate terminology, complex relationships, and vast volumes of specialized textual data, ranging from clinical notes and research articles to medical records and drug databases. This proposed work endeavours to bridge the gap between the capabilities of existing language models and the unique requirements of the biomedical domain.
The primary objective of this proposed work is to develop a tailored pre-training approach that optimizes language models
for biomedical tasks. By delving into domain-specific data sources and curating a comprehensive biomedical language corpus, this work intend to enhance the language model's understanding of biomedical concepts, relationships, and context. Additionally, this work seeks to design fine-tuning strategies that adapt the pre-trained models to perform specific biomedical tasks, such as text classification, relation extraction, and medical text summarization. This paper overcomes this difficulties of previous papers of bio-medical domain in language understanding by gaining a good performance.
Keywords:
Bio-Medical, BERT
Cite Article:
"Enhanced pre-trained general natural language model for Bio-medical domain", International Journal of Novel Research and Development (www.ijnrd.org), ISSN:2456-4184, Vol.9, Issue 4, page no.a718-a729, April-2024, Available :http://www.ijnrd.org/papers/IJNRD2404088.pdf
Downloads:
00046
ISSN:
2456-4184 | IMPACT FACTOR: 8.76 Calculated By Google Scholar| ESTD YEAR: 2016
An International Scholarly Open Access Journal, Peer-Reviewed, Refereed Journal Impact Factor 8.76 Calculate by Google Scholar and Semantic Scholar | AI-Powered Research Tool, Multidisciplinary, Monthly, Multilanguage Journal Indexing in All Major Database & Metadata, Citation Generator
Facebook Twitter Instagram LinkedIn