Exploring the application of Natural Language Processing to scientific medical cannabis publications

de Beer, James Charles

Exploring the application of Natural Language Processing to scientific medical cannabis publications

Master Thesis

2022

Abstract

Cannabis has become recognised internationally as a powerful medicinal plant. The explosion of clinical research on cannabis has made it difficult for researchers and medical professionals to keep up to date with new findings. Analyzing the large quantities of available text data using natural language processing and machine learning algorithms could improve the speed and accuracy at which cannabis research is processed, as well as expose hitherto unknown connections between cannabis compounds and the treatment of healtth conditions. In turn, this would help direct future research and clinical trials. This thesis aims to develop an appropriate method to extract the key connections between cannabis compounds, human physiology and disease from the existing medical literature. First, natural language processing techniques (such as document clustering and topic modelling, global vector word embeddings and supervised document classifiers) are used to group 500 journal articles from the general literature on cannabis according to broad research topics; analyse the interaction between cannabis compounds, human physiology and diseases; and train a classifier to classify unseen documents. Second, the connections generated through this quantitative process are assessed qualitatively against those in a manual dataset of research findings from more than 500 studies collated over a number of years and provided by a medical company specialising in cannabis research. The results indicate that the methods developed were able to effectively and accurately demonstrate conenction between cannabis plant compounds and diseases. Hence, the working code accurately reproduced the results of manual analysis. This was shown by the close similarity of ranked key word to diseases. The unsupervised methods were able to effectively cluster and model topic distributions between the data to group documents by topic, while the supervised learning methods were able to accurately train models based on these suggestions, thereby solving a real-world practical problem in data management and analysis.

Keywords

Statistical Sciences

Reference:

Collections

Masters

Full item page