Domain-Specific Pretraining of NorDeClin-Bidirectional Encoder Representations From Transformers for International Statistical Classification of Diseases, Tenth Revision, Code Prediction in Norwegian Clinical Texts: Model Development and Evaluation Study

Phuong Dinh Ngo   ^{1, 2 *} , PhD ;   Miguel Ángel Tejedor Hernández   ^{1, 3 *} , PhD ;   Taridzo Chomutare   ^{1, 4} , PhD ;   Andrius Budrionis   ^{1, 2} , PhD ;   Therese Olsen Svenning   ¹ , MSc ;   Torbjørn Torsvik   ¹ , PhD ;   Anastasios Lamproudis   ¹ , PhD ;   Hercules Dalianis   ^{1, 5} , PhD

¹ Norwegian Centre for E-health Research, University Hospital of Northern Norway, Tromsø, Norway

² Department of Physics and Technology, Faculty of Sciences and Technology, UiT The Arctic University of Norway, Tromsø, Norway

³ Department of Mathematics and Statistics, Faculty of Sciences and Technology, UiT The Arctic University of Norway, Tromsø, Norway

⁴ Department of Computer Sciences, Faculty of Sciences and Technology, UiT The Arctic University of Norway, Tromsø, Norway

⁵ Department of Computer and Systems Sciences, Stockholm University, Kista, Sweden

*these authors contributed equally