- Open Access
Development and evaluation of Intensive Case Management Screening Sheet in the Japanese population
International Journal of Mental Health Systems volume 13, Article number: 22 (2019)
In Japan, the mental health system has been shifting from hospitalization-based to community-based care; some organizations have gradually begun providing intensive case management (ICM) services. We developed an Intensive Case Management Screening Sheet (ICMSS) to screen for the need for ICM in people with mental illness.
The aim of this study was to examine the psychometric properties and discriminative ability of ICMSS. Subjects consisted of 911 people with mental illness. The ICMSS score was rated by a professional such as a nurse, social worker, or occupational therapist.
Exploratory factor analysis showed a one-factor structure with 14 items. The factor structure was supported by confirmatory factor analysis (comparative fit index, 0.98; Tucker–Lewis index, 0.97; root mean square error test of close fit, 0.05). In the receiver operating characteristic analysis for discriminating between users and non-users of ICM services, the area under the curve (AUC) for ICMSS was significantly larger than for Global Assessment of Functioning and Personal and Social Performance Scale, indicating better discriminative ability. However, the AUC for ICMSS was moderate. Thus, we suggest that the need for ICM services is determined by quantitative assessment (i.e., ICMSS) and clinical judgment.
ICMSS is a brief tool for mental health professionals that will be useful in routine clinical practice. We expect that ICMSS will be used as a measure that reflects the views of professionals from various disciplines in Japanese institutions.
In the context of deinstitutionalization, it is widely accepted that most people with severe mental illness do not need to reside in the hospital if they receive support from community mental health services [1, 2]. Case (care) management, a method to coordinate services for meeting their needs , is a key component of assistance for people with mental illness to live in the community. There are several models of case management with varying levels of intensity. In broker case management, the case manager’s role is to connect people with mental illness to necessary services; but with a staff-to-client ratio of approximately 50, interventions by the case manager and outreach services are poor. Broker case management was shown to be ineffective, particularly for people with severe mental illness . A case management model, which includes a staff-to-client ratio of less than 20, services directly provided by the case manager, and outreach services is generally considered intensive case management (ICM). For instance, assertive community treatment is a well-known model of ICM . A Cochrane review showed that ICM services reduce hospitalization rates, increase retention in care, and improve social functioning compared to standard care . However, ICM services appear to be considerably effortful and costly to provide for all patients with mental disorders; mental health resources in the real world are clearly limited. Considering the efficiency of community mental health services , it is imperative to assess the proper allocation of ICM services to people with severe mental illness who need them.
In Japan, the mental health system has been shifting from hospitalization-based to community-based care . In addition, some organizations have gradually begun to provide ICM services. However, psychiatric hospitals and mental health clinics in Japan accept all people who potentially have mental health problems regardless of the care level needed . Thus, it is important that psychiatrists and other professionals assess the need for ICM services to efficiently provide services.
People who need ICM services may be defined as those who have problems living in the community without ICM services. The current level of functioning is associated with the level of care ; thus, it seems to be useful as a screen for ICM need. Moreover, since ICM is effective for reducing hospitalization rates and improving social functioning , ICM is considered necessary for patients at risk of frequent readmissions and challenges in adapting to living in the community. Systematic reviews have pointed out that medication adherence and family involvement are factors associated with readmission [11, 12]. Prisoners, inmates, and probationers frequently have mental illness , and recidivism is high in people with and without mental illness . Previous reviews have pointed out that poverty might cause mental illness, and mental illness worsens socioeconomics status [15, 16]. Therefore, we hypothesized that the need for ICM services is based not only on current functioning, but also on these predictors of readmission and future challenges, i.e., medication adherence, family involvement, risk of criminal activity, and financial problems.
Assessment of functioning and prediction of readmission and future challenges in people with mental illness rely on multidisciplinary assessment by psychiatrists, mental health nurses, social workers, and occupational therapists. Such assessments are made in different contexts. Multidisciplinary professionals such as nurses, social workers, and occupational therapists are involved in the care of people with mental illness under different conditions . For example, nurses in general have many opportunities to interact with and observe people in medical settings . Social workers help their patients receive social and community services ; thus, they usually have information about family, financial, and social circumstances. Occupational therapists may support their patients in acquiring occupational and daily skills ; they usually assess functioning and characteristics related to occupational experiences and daily activities through their clinical practice. In summary, the views of multidisciplinary professionals can shed light on multiple aspects of people with mental illness that might be helpful for identifying the need for ICM services.
Over the past three decades, several scales have been developed to assess levels of care and functioning [21,22,23,24,25]. The Global Assessment of Functioning (GAF)  and Personal and Social Performance Scale (PSP)  are common tools measuring functioning in people with mental illness. Lyons et al.  developed the Severity of Psychiatric Illness Scale to assess the need for psychiatric admission. These measures do not include all of the factors associated with the need for ICM services, since they were not specifically created for assessing this need. Furthermore, algorithms for determining levels of care were proposed in previous studies [26, 27]. The Level of Care Utilization System for Psychiatric and Addiction Services (LOCUS) was developed by the American Association of Community Psychiatrists  and used by some Japanese institutions . LOCUS consists of six dimensions of five detailed grading systems. It classifies people with mental illness into six levels, from outpatients via ICM to inpatients . Raters need training to precisely evaluate people with mental illness according to the five detailed grading systems. In addition, if clinical staff members use LOCUS, they may need much effort to gather the needed information. In other words, it may be hard for professionals in various disciplines to acquire the relevant information in routine clinical practice to use LOCUS. Taken together, for the Japanese mental health system, we considered it important to develop a scale that comprehensively includes factors associated with the need for ICM and is easy for professionals from various disciplines to rate.
In this context, we developed the Intensive Case Management Screening Sheet (ICMSS) to briefly assess the need for ICM services in people with mental illness. ICMSS consists of items relevant to current functioning and predictors for readmission and future challenges in living independently. In addition, we developed ICMSS for professionals from various disciplines to use easily in clinical practice. Using data from two institutions that voluntarily provided ICM services to people with mental illness [29, 30], we aimed to examine the psychometric properties of ICMSS and its discriminative ability for users and non-users of ICM services.
Participants were recruited from a population of patients who received psychiatric outpatient services, psychiatric day care, or outreach services at two medical institutions during the study entry period (Fig. 1). We set the following inclusion criteria for this study: age over 20 years; continuous use of services for at least 6 months at one of the participating medical institutions or a total duration of mental health services use of at least 12 months; and diagnosis codes from F10 to F99 in the International Statistical Classification of Diseases and Related Health Problems, 10th revision. We excluded patients who utilized residential care facilities for the aged and disabled, except for group home care. In terms of informed consent, we employed an opt-out approach in this study. Participants were provided information about this study via posters about the study in waiting rooms, which guaranteed opportunities to decline participation in the study and the use of their data.
A total of 1064 people participated in this study (Fig. 1). We used data from 911 people in the analysis after exclusion of missing values. ICM services were provided to 309 of 911 people at two institutions. The characteristics of each group are shown in Table 1. The study protocol was approved by the ethics committee of Asahi General Hospital (No. 2016092001).
Intensive Case Management Screening Sheet (ICMSS)
ICMSS was preliminarily developed based on similar research projects regarding case management. First, 11 items were created to assess the need for ICM services in acute psychiatric units . Next, 19 items were created by modifying the original 11 items with reference to the Discharge Difficulty Scale  for a study involving inpatients . These items were used for other Japanese studies . Four of 19 items were associated with issues related to hospital admission; these items were excluded for this study. Consequently, ICMSS consisted of 15 items related to current functioning and predictors for readmission and future challenges in living independently.
Mental health professionals (e.g., social workers, nurses, and occupational therapists) evaluated participants using ICMSS. They rated each item as yes, no, or unknown. There were unknown responses for 196 of 911 participants. For factor analysis, 196 participants were excluded from the dataset (i.e., n = 715). On the other hand, we considered it useful to group unknown and missing responses together for ICMSS scoring; such scoring procedures have been used in other clinical assessment tools, e.g., Camberwell Assessment of Need . Thus, we performed ROC analysis using both datasets with 715 and 911 participants, respectively.
Attending doctors rated the participants’ functioning using Japanese versions of GAF and PSP. All doctors had received training on the rating methods for these scales. GAF is a measure of social, occupational, and psychological functioning . PSP consists of four domains of personal and social functioning, including socially useful activities, personal and social relationships, self-care, and disturbing and aggressive behavior . Scores for each measure range from 1 to 100, with higher scores representing better functioning.
Statistical analysis was performed with R 3.3.1  and the “psych,” “polycor,” “MASS,” “pROC,” “epiDisplay,” and “lavaan” packages. The dataset (n = 715) was divided into two subsets for exploratory and confirmatory factor analyses using the random function. The minimum average partial correlation (MAP) test was performed using a polychoric correlation matrix to determine the factor structure. We performed exploratory factor analysis with polychoric correlation analysis and maximum likelihood estimation, because values for each ICMSS item were either zero or one. For confirmatory factor analysis, we used a diagonally weighted least squares method. All of the data (n = 715) were used for correlational analyses. Pearson’s correlation coefficients between measures were calculated. Using both datasets (n = 715 and n = 911), we performed logistic regression on discriminating between users and non-users of ICM services and ICMSS, PSP, age, sex, previous hospitalization, diagnosis of schizophrenia spectrum disorder (F20–29), and diagnosis of mood disorder (F30–39). Stepwise selection was performed based on the Akaike information criterion (AIC).
MAP was smallest for a one-factor model (one factor, 0.016; two factor, 0.021). Thus, we considered the one-factor model appropriate for ICMSS. Table 2 shows the results of the exploratory factor analysis. We excluded one item with low factor loadings (0.22): “The latest hospitalization was involuntary.” Factor loadings for other items were greater than 0.35. Confirmatory factor analysis (Table 2) showed excellent fit (comparative fit index, 0.98; Tucker–Lewis index, 0.97; root mean square error test of close fit, 0.05), while the χ2 test was significant (χ2(77) = 148.61, P < 0.01). In addition, Cronbach’s α showed acceptable internal consistency (α = 0.77).
ICMSS was significantly correlated with GAF (r = − 0.48 < 0.001). We also found the significant correlation between ICMSS and PSP (r = − 0.53 < 0.001).
Figure 2 shows the ROC curves for ICMSS, GAF, and PSP for both datasets. The area under the curve (AUC) was significantly larger for ICMSS (n = 715: AUC, 0.78; 95% CI 0.75–0.81; n = 911: AUC, 0.77; 95% CI 0.74–0.80) than GAF (n = 715: AUC, 0.62; 95% CI 0.58–0.66; n = 911: AUC, 0.60; 95% CI 0.56–0.64) and PSP (n = 715: AUC, 0.64; 95% CI 0.60–0.68; n = 911: AUC, 0.63; 95% CI 0.60–0.67) (all ps < 0.001). For ICMSS (Table 3), the cutoff of ≥ 1 resulted in high sensitivity (n = 715: 0.91; n = 911: 0.91) and low specificity (n = 715: 0.48; n = 911: 0.44), whereas the cutoff of ≥ 2 had moderate sensitivity (n = 715: 0.71; n = 911: 0.72) and moderate specificity (n = 715: 0.69; n = 911: 0.66). We found no remarkable difference in results between the two datasets.
Table 4 shows the stepwise logistic regression analysis results. Use of ICM services was significantly associated with ICMSS, PSP, age, sex, previous hospitalization, and diagnosis of schizophrenia spectrum disorder. AUC improved in the model (n = 715: AUC, 0.82, 95% CI 0.79–0.85; n = 911: AUC, 0.80, 95% CI 0.77–0.83) (Fig. 2) and ICMSS remained significant in the model (P < 0.01).
In this study, we developed the ICMSS to assess the need for ICM services among people with mental illness and examined its psychometric properties and discriminative ability. Exploratory factor analysis showed a one-factor structure and 14 items were selected by the factor loadings. Confirmatory factor analysis also supported the factor structure. ICMSS had a significantly larger AUC than GAF and PSP, indicating that it had better discriminative ability. Previous studies have identified some predictors such as medication adherence and family involvement [11, 12]. GAF and PSP are associated with current functioning, whereas ICMSS was developed to assess both current functioning and predictors for readmission and future challenges in living independently. ICM services are necessary not only to support people with current problems, but also to prevent readmission and future challenges in living independently. Thus, we suggest that ICMSS is useful for assessing the need for ICM services in people with mental illness.
For ICMSS, sensitivity was high for both datasets when the cutoff was ≥ 1, but drastically lower with a cutoff of ≥ 2. Hence, we suggest that a cutoff of ≥ 1 is appropriate for screening whether ICM services are needed. However, the AUC was not very large, even in the stepwise logistic regression analysis. In this study, ICMSS was rated by a single mental health professional on a multidisciplinary treatment team; thus, the ICMSS score for each participant does not reflect the views of professionals in other disciplines. Flexible clinical judgment seems important for decision-making about whether to provide ICM services. Therefore, we thought that the need for ICM services was being determined by quantitative assessments (i.e., ICMSS) and clinical judgment.
We performed ROC analysis to evaluate the discriminative ability of ICMSS. For one dataset (n = 715), we excluded unknown ICMSS responses. Unknown and missing responses were grouped together for ICMSS scoring for the other dataset (n = 911). Regardless of the difference in scoring, the results from the two datasets showed similar discriminative ability. Grouping unknown and missing responses appeared to be useful for clinical ICMSS scoring. Moreover, in the Camberwell Assessment of Need, which is used broadly in clinical settings, a similar scoring procedure is applied for unknown responses . Although it is necessary to gather as much information about users as possible for ICMSS scoring, we may recommend grouping together unknown and missing responses for scoring in a clinical setting.
Algorithms for determining the level of care were proposed in previous studies [26, 27]. Ideally, these algorithms can be used in the Japanese system. It is expected that community mental health services, including ICM services, are provided according to actual resource and community characteristics . In Japan, the mental health system is shifting from hospitalization-based to community-based care . However, ICM services are not fully supported by the Japanese system; the costs of ICM services are borne by the medical institution. Thus, the criteria for providing ICM services changed flexibly according to resource and staff assignments at each institution in Japan. Algorithms provide a precise classification of the level of care, but they are inflexible. ICMSS helps in the acquisition of information by professionals of various disciplines that we consider useful for flexible judgment in Japanese institutions.
In confirmatory factor analysis, the χ2 test was significant, suggesting poor model fit. Generally, the χ2 test is sensitive to sample size and tends to reject models with a large sample. Our sample was relatively large. However, other indices showed excellent fit. Thus, we believe that a one-factor model is appropriate for ICMSS. The age range of our participants was broad (20–92 years). In the stepwise logistic regression analysis, ICMSS remained significant in the model including age. However, in Japan, persons aged > 65 years can choose to use welfare system services for elderly people, which might have affected the present results. This study included patients from two psychiatric institutions. The generalizability of findings may be limited. In addition, participants were recruited from patients who received psychiatric outpatient services, psychiatric day care, or outreach services. We did not obtain data from current and recently discharged inpatients of psychiatric hospitals. The results might vary when focusing on inpatients.
In summary, we developed ICMSS for nurses, social workers, and occupational therapists to use easily in clinical practice. ROC analysis showed that ICMSS has better discriminative ability between users and non-users of ICM services than GAF and PSP. Thus, we suggest that ICMSS is a useful screening tool that reflects the views of professionals of various disciplines. However, the AUC of ICMSS was not large. The need for ICM services might be associated with quantitative assessment (i.e., ICMSS) and clinical judgment. In Japan, ICM services are provided only by a limited number of advanced organizations. We expect that ICMSS will be used as a measure that reflects the views of professionals from various disciplines in several Japanese institutions, which may contribute to the further spread of ICM services in Japan.
intensive case management
Intensive Case Management Screening Sheet
area under the curve
Global Assessment of Functioning
Personal and Social Performance Scale
Level of Care Utilization System for Psychiatric and Addiction Services
International Statistical Classification of Diseases and Related Health Problems, 10th revision
Thornicroft G, Tansella M. Better mental health. Cambridge: Cambridge University Press; 2009.
Winkler P, Barrett B, McCrone P, Csémy L, Janouskova M, Höschl C. Deinstitutionalised patients, homelessness and imprisonment: systematic review. Br J Psychiatry. 2016;208(5):421–8. https://doi.org/10.1192/bjp.bp.114.161943.
Killaspy H, Rosen A. Case management and assertive community treatment. In: Thornicroft G, Szmukler G, Mueser KT, Drake RE, editors. Oxford textbook of community mental health. Oxford: Oxford University Press; 2011. p. 142–51. https://doi.org/10.1093/med/9780199565498.003.0081.
Mueser KT, Bond GR, Drake RE, Resnick SG. Models of community care for severe mental illness: a review of research on case management. Schizophr Bull. 1998;24(1):37–74. https://doi.org/10.1093/oxfordjournals.schbul.a033314.
Bond GR, Drake RE, Mueser KT, Latimer E. Assertive community treatment for people with severe mental illness. Dis Manag Health Outcomes. 2001;9(3):141–59. https://doi.org/10.2165/00115677-200109030-00003.
Dieterich M, Irving CB, Bergman H, Khokhar MA, Park B, Marshall M. Intensive case management for severe mental illness. Cochrane Lib. 2017;1:CD007906.
Thornicroft G, Tansella M. Translating ethical principles into outcome measures for mental health service research. Psychol Med. 1999;29(4):761–7. https://doi.org/10.1017/S0033291798008034.
Ministry of Health Labour and Welfare Japan. 精神保健医療福祉の改革ビジョン. [Vision of reforming mental health services]. 2006. http://www.mhlw.go.jp/topics/2004/09/tp0902-1.html.
Fujisawa D, Hashimoto N, Masamune-Koizumi Y, Otsuka K, Tateno M, Okugawa G, et al. Pathway to psychiatric care in Japan: a multicenter observational study. Int J Ment Health Syst. 2008;2(1):14. https://doi.org/10.1186/1752-4458-2-14.
Mulder CL, Koopmans GT, Lyons JS. Special section on the GAF: determinants of indicated versus actual level of care in psychiatric emergency services. Psychiatr Serv. 2005;56(4):452–7. https://doi.org/10.1176/appi.ps.56.4.452.
Sfetcu R, Musat S, Haaramo P, Ciutan M, Scintee G, Vladescu C, et al. Overview of post-discharge predictors for psychiatric re-hospitalisations: a systematic review of the literature. BMC Psychiatry. 2017;17(1):227. https://doi.org/10.1186/s12888-017-1386-z.
Donisi V, Tedeschi F, Wahlbeck K, Haaramo P, Amaddeo F. Pre-discharge factors predicting readmissions of psychiatric patients: a systematic review of the literature. BMC Psychiatry. 2016;16(1):449. https://doi.org/10.1186/s12888-016-1114-0.
Markowitz FE. Mental illness, crime, and violence: risk, context, and social control. Aggress Violent Behav. 2011;16(1):36–44. https://doi.org/10.1016/j.avb.2010.10.003.
Baumer EP, Wright R, Kristinsdottir K, Gunnlaugsson H. Crime, shame, and recidivism. The case of Iceland. Br J Criminol. 2002;42(1):40–59. https://doi.org/10.1093/bjc/42.1.40.
Saraceno B, Levav I, Kohn R. The public mental health significance of research on socio-economic factors in schizophrenia and major depression. World Psychiatry. 2005;4(3):181.
Lund C, De Silva M, Plagerson S, Cooper S, Chisholm D, Das J, et al. Poverty and mental disorders: breaking the cycle in low-income and middle-income countries. Lancet. 2011;378(9801):1502–14. https://doi.org/10.1016/S0140-6736(11)60754-X.
Liberman RP, Hilty DM, Drake RE, Tsang HW. Requirements for multidisciplinary teamwork in psychiatric rehabilitation. Psychiatr Serv. 2001;52(10):1331–42. https://doi.org/10.1176/appi.ps.52.10.1331.
Shattell M. Nurse–patient interaction: a review of the literature. J Clin Nurs. 2004;13(6):714–22.
National Association of Social Wokers. NASW standards for clinical social work in social work practice. Washington: National Association of Social Wokers; 2005.
Burson KA, Cynthia Barrows M, Cathy Clark M, Jamie Geraci M, Lisa Mahaffey M. Specialized knowledge and skills in mental health promotion, prevention, and intervention in occupational therapy practice. Am J Occup Ther. 2010;64(6):S30–40. https://doi.org/10.5014/ajot.2010.64S30.
Aas IM. Guidelines for rating global assessment of functioning (GAF). Ann Gen Psychiatry. 2011;10(1):2. https://doi.org/10.1186/1744-859X-10-2.
Morosini PL, Magliano L, Brambilla L, Ugolini S, Pioli R. Development, reliability and acceptability of a new version of the DSM-IV Social and Occupational Functioning Assessment Scale (SOFAS) to assess routine social funtioning. Acta Psychiatr Scand. 2000;101(4):323–9. https://doi.org/10.1034/j.1600-0447.2000.101004323.x.
Lyons JS, Colletta J, Devens M, Finkel SI. Validity of the severity of psychiatric illness rating scale in a sample of inpatients on a psychogeriatric unit. Int Psychogeriatr. 1995;7(3):407–16. https://doi.org/10.1017/S1041610295002158.
Glazer WM, Gray GV. Psychometric properties of a decision-support tool for the era of managed care. J Ment Health Adm. 1996;23(2):226–33.
Bonynge ER, Thurber S. Development of a measure for mental health crisis assessment: preliminary psychometrics of the crisis acuity scale. Psychol J. 2010;7(1):15–30.
Sowers W, George C, Thompson K. Level of care utilization system for psychiatric and addiction services (LOCUS): a preliminary assessment of reliability and validity. Community Ment Health J. 1999;35(6):545–63. https://doi.org/10.1111/j.1365-2702.2004.00965.x.
Srebnik D, Uehara E, Smukler M. Field test of a tool for level-of-care decisions in community mental health systems. Psychiatr Serv. 1998;49(1):91–7. https://doi.org/10.1176/ps.49.1.91.
Kimura T, Yagi F, Yoshizumi A. Application of level of care utilization system for psychiatric and addiction services (LOCUS) to psychiatric practice in Japan: a preliminary assessment of validity and sensitivity to change. Community Ment Health J. 2013;49(4):477–91. https://doi.org/10.1007/s10597-012-9562-6.
Kawasoe Y, Iwagami Y, Ueshima M, Okabe M, Kayama A, Kikuiri K, et al. 精神障害者の地域移行における多職種連携によるケアマネジメントに関する研究. [Intensive case management provided by multidisciplinary team], Reports of Health Labor Sciences Research Grant (H28-001) from the Ministry of Health, Labour, and Welfare of Japan. 2017. p. 99–110.
Kawasoe Y, Iwagami Y, Ueshima M, Okabe M, Kayama A, Kikuiri K, et al. 多職種連携による包括的支援マネジメントに関する研究. [Intensive case management provided by multidisciplinary team], Reports of Health Labor Sciences Research Grant (H28-001) from the Ministry of Health, Labour, and Welfare of Japan. 2018. p. 219–43.
Setoya Y, Takahara Y, Yoshida K, Maeda K, Sato S, Takahashi M, et al. Development of Psychiatric Acute Unit Care Management Model. In: Ito J, ed. Desirable psychiatric emergency and acute treatment to implement community based mental health. 2011. p. 167–96.
Sato S, Ikebuchi E, Anami K, Hokari K, Ishigo-oka T, Morita S, Ohshima M, Ohshima K, Segawa T, Anzai N. The study of developing a scale of difficulty in hospital discharge for patients with mental disorder. Jpn Bull Soc Psychiatry. 2008;16(3):229–40.
Ito J. 「地域生活中心」を推進する、地域精神科医療モデル作りとその効果検証に関する研究. [The study for community mental health model and its effect, to promote community based care]. Reports of the Health Labour Sciences Research Grant (H24) of the Ministry of Health, Labour and Welfare, Japan. 2014.
Yamaguchi S, Furuie M, Yoshida K, Sato S, Shimohira M, Taneda A, et al. Utilization and costs of community services for people with severe mental illness after discharge from hospitals: a nested cross-sectional survey. Jpn J Psychiatric Rehabil. 2015;19(1):52–62.
Phelan M, Slade M, Thornicroft G, Dunn G, Holloway F, Wykes T, et al. The Camberwell assessment of need: the validity and reliability of an instrument to assess the needs of people with severe mental illness. Br J Psychiatry. 1995;167(5):589–95.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 4th ed. Washington, DC: American Psychiatric Association Press; 2000.
R Development Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2018. http://www.R-project.org.
KS: made substantial contribution to the analysis and writing of the manuscript. SY CF: involved in designing the study, data collecting, analyzing the data, and drafting the manuscript. YK, KN, TA, NH: involved in data collection and drafting and revising the manuscript. All authors read and approved the final manuscript.
We would like to extend special thanks to the staff of Asahi General Hospital, and Psychiatric Day Care & Clinic Hotto Station.
The authors declare that they have no competing interests.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Consent for publication
Ethics approval and consent to participate
The study protocol was approved by the ethics committee of Asahi General Hospital (No. 2016092001). In terms of informed consent, we employed an opt-out approach in this study. Participants were provided information about this study via posters about the study in waiting rooms, which guaranteed opportunities to decline participation in the study and the use of their data.
This study was partly supported by a Health Labor Sciences Research Grant (H28-001) from the Ministry of Health, Labour, and Welfare of Japan.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
- Case (care) management
- Community mental health
- Factor analysis
- Receiver operating characteristic analysis
- Mood disorder