Suicidal behavior represents a complex problem with a substantial impact on public health worldwide [1-3]. Its heterogeneity and multifactorial nature make prediction in clinical practice particularly challenging, especially in the medium and long terms [4]. Nevertheless, evidence indicates that many individuals who die by suicide have sought some form of help prior to their death [5]. Approximately 50% to 80% of people who died by suicide had a prior interaction with the public health care system. Of these, around 60% did so during the previous month [6,7].

The implementation of early-stage interventions in this context is particularly crucial, as a prompt identification of individuals at high and imminent risk may allow for the effective mitigation of progression along the suicidal behavior continuum before it advances to more severe phases [8,9].

Although most prevention programs rely on training health care professionals to detect potential suicide risk and address it, recent reviews and meta-analyses suggest that such preventive measures may not achieve the expected effectiveness [10-14], and clinicians generally perform poorly at predicting who will attempt suicide [15]. This limitation highlights the need for novel approaches to identify patients at risk within health care settings—approaches designed not to replace clinical judgment but to complement and enhance existing assessment strategies [16].

In this context, electronic health records (EHRs) typically include longitudinal information, allowing for the monitoring of patients over extended periods and the identification of temporal patterns preceding suicidal behavior [17]. EHRs integrate a wide range of variables, including sociodemographic characteristics, clinical diagnoses, treatment histories, comorbidities, and health care utilization patterns [7]. Multiple studies have demonstrated that applying AI-based tools to EHR data can identify novel characteristics beyond the well-established risk factors for suicidal behavior [17-22], thereby enhancing the predictive accuracy of suicide risk models compared with previous approaches [17,23,24]. Furthermore, AI approaches using machine learning (ML) models enable the simultaneous assessment of multiple variables, capturing complex interdependencies [25,26] and nonlinear associations [27,28] in the development of predictive models.

The use of AI has also been extended to the development of early warning systems (EWSs) in hospitals as a clinical decision support system (CDSS) for clinicians [29,30]. These systems typically generate risk scores designed to assist clinicians in recognizing clinical deterioration among hospitalized patients. When integrated into EHRs, some EWSs have been associated with reductions in in-hospital mortality [31,32]. Building on this concept, similar AI-driven early warning approaches could be adapted to mental health care, enabling the timely identification of individuals at elevated risk for suicide and facilitating prompt, targeted interventions.

The IDICIUS project aims to develop a CDSS, motivated by EWS, that applies AI predictive models to prevent suicide risk. This tool will integrate information on suicide attempts, suicidal ideation, and deaths by suicide with clinical and sociodemographic factors derived from real-world data (RWD) recorded in EHRs and public health care and/or administrative databases, based on a cohort of 41,557 adult patients receiving psychiatric care. The IDICIUS project consists of a 4-stage approach, including (1) gathering of usable data, (2) analysis and modeling of risk, (3) building of a predictive tool, and (4) the implementation of the tool for effectiveness assessment. This study presents the first 2 stages of the IDICIUS project. Phase 1 focuses on integrating and harmonizing multiple databases with input from relevant stakeholders; implementing data curation, standardization, and anonymization; and defining key risk factors. Phase 2 aims to develop and validate predictive models using advanced ML techniques, selecting and optimizing the most effective, efficient, and generalizable algorithm for suicide prevention. Ultimately, these models are designed to assist clinicians in monitoring variations in suicide risk among patients and to be implemented within routine clinical workflows.

This study evaluates the potential of AI for suicide prevention in a psychiatric setting using harmonized clinical data from 4 public databases. In a cohort of 32,661 patients receiving mental health care, suicidal behavior was associated with a relatively small set of common clinical and pharmacological features, including anxiety and depressive episodes, conduct disorders, corticosteroids, lorazepam, clonazepam, and olanzapine. Ensemble methods outperformed traditional approaches, in line with prior evidence that boosting methods often perform strongly across settings [36].

GradientBoosting and XGBoost showed the best overall performance (F₁-scores of 0.68 and 0.67, respectively). In screening or triage settings, where FNs are particularly consequential, recall should be as high as possible. Here, recall was relatively high (0.85 and 0.84, respectively), supporting the potential use of these models alongside clinical judgment to guide targeted interventions. Accordingly, threshold selection should be guided by the clinical context and the relative costs of FPs and FNs [37]. A previous meta-analysis assessing ML performance in clinical populations reported a pooled recall of 0.58 [38]. Similarly, Pigoni et al [39] found substantial heterogeneity in recall/sensitivity across ML studies in psychiatric clinical populations, with values ranging from 0.13 to 0.98 and an overall mean of 0.72 after harmonizing percentages and range estimates. Traditional clinical judgment and standardized risk scales have demonstrated only modest predictive performance, slightly better than chance, although they may capture contextual and behavioral cues not reflected in structured data, such as affect or tone of voice [4,15]. At the same time, a substantial proportion of individuals who die by suicide have recent contact with health services, up to 80% within the year prior and 50% within the month before death [7]. Together, these findings highlight the potential value of data-driven approaches to support the identification of risk signals that may not be consistently detected during routine clinical assessment.

Precision was moderate (0.56‐0.57), indicating that some flagged individuals may not ultimately be at high risk. In the context of psychiatric follow-up, the additional burden of risk flags may be more manageable, particularly when alerts are restricted to patients already receiving care and when the output is used to support rather than replace clinical judgment. Although FPs can still contribute to unnecessary workload, the potential benefits of preventing suicide may justify a low-to-moderate positive predictive value when the intervention is cost-effective, actionable, and integrated into routine care. Indeed, comparable low positive predictive value strategies are routinely employed in other areas of health care, including breast cancer screening and stroke prevention [40]. Nevertheless, FPs should be minimized through threshold calibration, tiered risk stratification, and workflow integration.

Previous studies applying AI to EHRs have yielded mixed findings, with some reporting strong predictive power [27] and others showing good performance with classical statistical models such as LASSO or logistic regression [19]. Such variability likely reflects differences in methods, sample sizes, populations, and feature selection. Importantly, we excluded variables capturing prior suicide attempts, regardless of their known clinical value, to avoid data leakage. Although including these features markedly improved performance (precision from 0.56 to 0.98 for boosting methods), the models became overly dependent on them. Instead, we aimed to develop a clinically useful EWS that prioritizes recall and can identify individuals at risk even in the absence of prior attempts—when prevention is most challenging yet most critical.

Corticosteroid use consistently ranked as a highly important feature across both models, suggesting that it captures key clinical information, possibly reflecting chronic and severe underlying physical conditions linked to chronic suffering, underlying inflammatory conditions, or even a risk for corticosteroid-induced psychiatric symptoms and behavioral disturbances, and relapse or worsening of underlying psychiatric conditions [41]. Its prominence, alongside any other medications, may also indicate broader systemic issues. In GradientBoosting, corticosteroid use showed high variability in impact (SHAP values ~−2 to +3), while in XGBoost, its effect was similarly important but more constrained. Antipsychotic medications (olanzapine and quetiapine) and dosing patterns also contributed notably, potentially reflecting their role as markers for underlying severe psychiatric morbidity, such as schizophrenia, impulsivity disorders, or complicated depression, which are usual indications for their use and may be the actual underlying risk factors [7]. Similarly, clonazepam is often used for insomnia, a clinical condition that has been reported to increase the risk of suicide [42]. In these cases, exposure to these medications may be a useful marker of risk and is convenient for algorithms, since these are structured data that are readily available in databases [43]. Benzodiazepines, such as lorazepam and diazepam, ranked as a highly important feature across both models, are commonly used in psychiatric practice for anxiety, insomnia, and agitation [7]. The models incorporate demographic characteristics (eg, biological sex) alongside behavioral risk indicators (eg, alcohol consumption). Together, these clinically familiar features provide face validity to the model and integrate multiple variables simultaneously rather than relying on any single risk factor, potentially highlighting risk patterns that may not be readily apparent in routine practice. Thus, value is added by ensuring completeness in recovering and summarizing relevant risk information from existing records, easing the health care professional’s task. This may be particularly relevant in primary care and emergency settings, where EHRs can be incomplete, fragmented across care environments, or not immediately accessible and where timely risk identification and stratification are essential.

While EHRs provide valuable clinical information, they fail to capture the full multidimensional complexity of individuals’ lives. We previously reported [44] that DL models improved the detection of TPs by incorporating domains absent from EHRs, such as risk-taking behavior, social media activity, social connectedness, sexual behavior, and personality traits. In that study, recall ranged from 0.67 to 0.87 and accuracy from 0.83 to 0.87, although precision remained lower. Subsequent work further improved performance, with the best models achieving area under the curve values of 0.85 to 0.90 and recall values of 0.81 to 0.93, but with very low precision of 0.17 to 0.16. These results highlight that suicide risk prediction may benefit from integrating routinely collected clinical data with broader psychosocial and behavioral dimensions.

However, ensuring responsible data integration requires coordinated efforts across stakeholders while maintaining privacy and ethical standards. In addition, generalizability remains a major challenge, as models developed in one population may not transfer well to others due to differences in ethnicity, age, cultural context, or clinical characteristics [39,45,46]. Furthermore, methodological variability in EHR recording can introduce additional inconsistencies, even across hospitals within the same country [47]. For instance, our control group consisted of individuals receiving psychiatric treatment, reflecting a clinically realistic population in which distinctions between individuals at varying levels of suicide risk may be more subtle.

Suicide is a global public health problem, accounting for 1.5% of all deaths worldwide [3,46,48]. Public health action is urgently needed, and EHRs appear well-suited for developing suicide prevention algorithms and CDSS, as they can capture and integrate newly available clinical information in real time to help prevent deaths. The system is intended to support, not replace, clinical judgment, and its value will depend on integration into existing care pathways. In this setting, FNs are the more consequential error because missed cases may delay or prevent timely intervention, whereas FPs can be addressed through confirmatory assessments and structured follow-ups. Once a risk flag is generated, the model could trigger evidence-based responses such as safety planning-type interventions, associated with a 43% reduction in reattempts over 12 months [49], and brief contact and continuity interventions, which have been shown to significantly reduce suicide reattempts [50]. The Catalan Suicide Risk Code provides a real-world example of this integrated pathway, linking detection with structured follow-up and continuity of care [51]. Implementation should also include ethical safeguards such as subgroup monitoring, patient transparency, and institutional governance.

Key limitations include restricted generalizability, a lack of broader psychosocial data, and a relatively small sample size reduced further by undersampling. To improve generalizability, we applied techniques such as cross-validation, separate training and testing sets, and bootstrapping. These limitations will be partially mitigated through clinical validation and large-scale implementation in the public health system, enabling evaluation in large populations. The clinical validation of these findings is a critical next step, planned as part of the second phase of this project. This will involve implementing the algorithm within the hospital information system and prospectively validating its predictions against newly collected clinical data. While we removed variables known to improve metrics, such as prior suicide attempts, with the aim of predicting nonobvious risk of suicidal behavior, known risk factors may be used in combination with the proposed algorithms to complement the detection of individuals at unknown and known risks. In summary, the use of AI-generated algorithms based on readily available and well-structured data may allow us to make progress in the identification of individuals at risk, thus increasing the chances of applying preventive measures in a timely manner.