2Department of Psychiatry, Sabuncuoğlu Serefeddin Training and Research Hospital, Amasya-Türkiye
3Division of Psychosocial Oncology and Education, Department of Preventive Oncology, İstanbul University Oncology Institute, İstanbul-Türkiye
4Division of Consultation-Liaison Psychiatry, Department of Psychiatry, İstanbul University İstanbul Faculty of Medicine, İstanbul-Türkiye DOI : 10.5505/tjo.2025.4739
Summary
OBJECTIVECancer is a systemic disease caused by many different factors that negatively affect people's lives and may substantially reduce the quality of life. The Basic Documentation for Psycho-Oncology (PO-BADO) is an expert rating scale for assessing distress in cancer patients. The main aim of this study is to evaluate the validity and reliability of this scale in Turkish.
METHODS
151 patients with oncologic diagnoses were included in the study. Sociodemographic Data Form, The
Basic Documentation For Psycho-Oncology (PO-BADO), Hospital Anxiety and Depression Scale
(HADS), Perceived Stress Scale (PSS), Karnofsky Performance Scale (KPS), and Cancer Coping Questionnaire
(CCQ) were conducted.
RESULTS
The PO-BADO scale demonstrated a high level of internal consistency, with Cronbach"s alpha of 0.826
for the overall scale, 0.792 for the physical symptoms subscale, and 0.749 for the mental symptoms subscale.
PO-BADO scores showed strong positive correlation with HADS and PSS scores (r=0.657, 0.769,
0.763 and 0.685), and moderate negative correlation (r=-0.527) with KPS scores. Confirmatory factor
analysis yielded an x2/sd value lower than 3, a CFI of 0.97, and an RMSEA of 0.034.
CONCLUSION
Our results indicate that the Turkish version of PO-BADO is a valid tool for evaluating mental health
issues, as well as the medical challenges experienced by Turkish cancer patients.
Introduction
Cancer, which is documented as the second leading cause of death worldwide, is a multifactorial systemic disease that and significantly reduces the quality of life. In 2022, cancer caused the deaths of approximately 10 million people. It is estimated that one in six deaths is due to cancer.[1] In Turkiye, cancer is the second leading cause of death after circulatory system diseases.[2] Studies have reported that 47% of cancer patients experience mental disorders at a diagnosable level.[3,4]The prevalence of psychiatric disorders in cancer patients highlights the importance of routine psychiatric evaluations when considering the impact of these disorders on disease progression, quality of life, and treatment adherence.[5,6] In this context, it becomes clear that cancer treatment should not solely focus on physical recovery; addressing psychosocial issues is also essential for improving patients" quality of life. Therefore, screening for mental health is mandatory for oncology centers.[7] Although the symptoms of distress are often manageable, they remain inadequately under-identified and underreported.[8] By incorporating the Psychosocial screening tools into clinical oncology clinics, healthcare professionals can reduce the percentage of unrecognized distress and improve the health and outcomes of patients.[9,10] Hence, it has been found essential to use early screening for mental health to meet psychosocial needs in oncology patients.[10]
Psychosocial screening aims to identify at-risk individuals early and facilitate timely interventions. Morover, this tailored approach can lead to more effective psychosocial interventions that directly address the individual's needs.[11] Although various self-report scales exist, tools that comprehensively assess patients" psychosocial and physical conditions remain limited. The Basic Documentation For Psycho-Oncology (POBADO) is an expert-rated scale developed to evaluate cancer patients" psychosocial and physical distress comprehensively. Expert-rated scales complement the data provided by self-report measures.
Distinguishing between physical and psychological distress is crucial in clinical practice. PO-BADO aims to determine whether a patient's distress is primarily physical or psychological. Rather than replacing screening tools, it functions as an instrument that enhances initial assessments made with such tools. When a patient is identified as high-risk through a screening questionnaire, the PO-BADO provides a more detailed evaluation that complements self-report scales. With its structured format, this form can be used by healthcare professionals from different disciplines, fostering communication and a shared language among professionals from various fields.[12]
To the best of our knowledge, no screening scale in Turkish allows for the simultaneous evaluation of the physical and psychological issues of cancer patients by an expert. The primary objective of this research is to adapt and validate the PO-BADO for assessing psychosocial issues specific to cancer patients, thereby addressing a critical gap in comprehensive cancer care of Turkish cancer patients. By utilizing this tool, healthcare professionals can efficiently assess the psychosocial needs of cancer patients, allowing for more targeted and personalized care.
Methods
ParticipantsThe study included outpatients and inpatients referred for psychiatric consultation at the Division of Consultation- Liaison Psychiatry, Department of Psychiatry, Istanbul Faculty of Medicine, Istanbul University, and Oncology Institute, Istanbul University between March and December 2023.
The sample size was determined based on the commonly used 10:1 case-to-variable ratio in the literature, by using the data of the original scale as the reference. [12] Considering potential data loss, the study was conducted with 151 participants for the 12-item scale. Participants were randomly selected from individuals 18 years or older, had no intellectual disability or active psychotic disorder, were at least literate, had a general medical condition suitable for the interview, and consented to participate in the study.
During the interviews with 75 patients, a second evaluator was present as an observer, independently scoring responses without interfering with the application. Aiming for the inter-rater reliability testing, the primary interviewer and the second evaluator recorded their responses separately on different forms.
Before commencing the study, ethical approval was obtained from the Clinical Researches Ethics Committee of Istanbul University Istanbul Faculty of Medicine on March 8, 2023, with decision number 1672709. The study was conducted following the principles of the Helsinki Declaration. Informed consent was obtained from all participants before they completed the forms.
Measures
Volunteers who met the inclusion criteria were administered
a sociodemographic data form, Basic Documentation For Psycho-Oncology (PO-BADO), Hospital
Anxiety and Depression Scale (HADS), Perceived
Stress Scale (PSS), Karnofsky Performance Scale, and
Cancer Coping Scale (CCS).
1. Sociodemographic Data Form: This is a semistructured interview form generated by the investigators to collect detailed demographic information such as age, gender, marital status, and educational background. It also gathers data on patients" psychiatric and medical history, family history, and subjective experiences related to their illness. Cancers classified as stage 3-4 and/or grade 2-4 were categorized as advanced-stage cancers.[13]
2. The Basic Documentation For Psycho-Oncology (PO-BADO): PO-BADO was developed by the PO-BADO Working Group between 2000 and 2006, with the support of DAPO (German Psycho- Oncology Working Group) and PSO (German Cancer Society Psycho-Oncology Working Group). [14] It is used to assess the psychosocial status of individuals diagnosed with cancer. This tool is valid for various cancer diagnoses and stages. PO-BADO can be used to monitor cancer patients" health status, compare their outcomes with those of other cancer patients, and/or determine and justify care needs.[12] PO-BADO can be used multiple times throughout the treatment process. It includes the patient"s sociodemographic and medical records, physical distress (4 items), psychological distress (8 items), additional stress factors (3 items), and a question that characterizes the treatment indication.[15] Empirically determined threshold criteria based on PO-BADO for identifying cancer patients in need of psycho-oncological care include:
• If the patient scores at least 4 on one of the physical or psychological distress or at least 3 on two different items, • If the scores for physical and psychological distress are below these criteria but there are at least two "yes" answers on the additional distress items, • If the score is at least 3 on one of the physical or psychological distress and at least one "yes" answer on the additional distress items, it can be said that the patient requires psycho-oncological support.[15]
3. Hospital Anxiety and Depression Scale (HADS): Developed in 1983 by Zigmond and Snaith, this scale is used to detect anxiety and depression symptoms in non-psychiatric clinical settings.[16] It consists of two subscales: Anxiety (HADS-A) and depression (HADS-D), each containing seven items.[17] The Turkish adaptation and the validity and reliability analyses of the scale were performed by Aydemir et al.[18]
4. Perceived Stress Scale (PSS): The PSS is a tool measure the degree to which individuals perceive various situations they encounter in their lives as stressful.[19] Each item on the scale is rated on a 5-point Likert scale ranging from "Never (0)" to "Very often (4)". Higher scores indicate higher perceived level of stress. Turkish adaptation and validation study was done by Eskin et al.[20]
5. Karnofsky Performance Scale (KPS): Developed by Karnofsky and Burchenal in 1949,[21,22] this scale assesses cancer patients" ability to perform daily activities, symptoms, independence, and need for medical care. Scores range from 100 (normal health) to 0 (death), with 10-point decrements indicating worsening function. The Turkish validity and reliability study of the KPS was conducted by Çeltek et al.[23]
6. Cancer Coping Scale (CCS): Based on cognitivebehavioral therapy principles, the CCS is designed to reflect patients" coping methods.[24] The Turkish validity and reliability study of the CCS was conducted by Bahçivan.[25]
Translation Process
The validity and reliability study of the PO-BADO
scale was conducted according to international standards
after obtaining written permission from the authors
of the original scale. In the first phase, the translation
of the scale into Turkish was carried out by a
Turkish consultant psychiatrist working in Germany
over 10 years, who was proficient in German language.
The Turkish translated form was evaluated by the two
acamicians of the reseach team, for its linguistic and
cultural eligibility. In the following phase, the form was
back-translated by an other Turkish physician who was
fluent in the original language and blind to the original
document. In the third phase, the back-translation
was compared with the original by Dr. Birgitt Marten-
Mittag, one of the developers of PO-BADO, and the
Turkish form was revised based on her suggestions.
The Turkish form was found to be understandable by
patients, and the final version was created based on
feedback from the pilot application on 10 randomly
selected participants. Prof. Dr. Peter Herschbach and
Dr. Birgitt Marten-Mittag approved the final form.
Data Analyses
For descriptive statistics, mean, median, and standard deviation
values were calculated. The internal consistency
of the scale was assessed using Cronbach"s alpha (α) value and item-total item correlation analysis. The suitability
of the Turkish form for the original factor structure was
evaluated through Bartlett"s test of sphericity and Kaiser-
Meyer-Olkin (KMO) sample adequacy measures. The reliability
of the PO-BADO scale was analyzed in terms of
item-total score correlations and internal consistency by
calculating the Cronbach α coefficient. The homogeneity
between evaluators was analyzed using the intra-class
correlation coefficient (ICC). Confirmatory factor analysis
(CFA) was performed to determine the construct validity
of the PO-BADO. For CFA, the following fit indices
were used: x2/df, Comparative Fit Index (CFI), Root
Mean Square Error of Approximation (RMSEA), and
Tucker Lewis Index (TLI). Convergent validity was assessed
by analyzing the correlation between PO-BADO
scores and HADS, PSS, KPS, and CCS scores. Statistical
analyses were performed using the Jamovi Version
2.2.5.0 and SPSS Statistics Version 26.0.[26,27]
Results
56.3% of the participants (n=85) are women, and 43.7% (n=66) are men. The age range of the participants is between 18 and 64 years, with an average age of 40.9±13.5. The sociodemographic and oncological characteristics of the participants are presented in Table 1.Table 1 Sociodemographic and clinical characteristics of participants
Cronbach's ? reliability analysis was conducted to determine the internal consistency of the PO-BADO. The test results from 151 patients were used to calculate the internal consistency coefficient. The overall Cronbach"s ? coefficient was found to be 0.826, indicating high internal consistency for the PO-BADO. The itemtotal score correlation ranged from a lowest value of 0.235 to a highest value of 0.628. The Cronbach"s ? for the physical symptom subscale was 0.792, while the Cronbach"s ? for the psychological symptom subscale was 0.749. The item-total score correlations and the changes in the Cronbach's ? reliability coefficient after removing items from the scale are presented in Table 2. Inter-rater agreement was evaluated using the ICC. For the physical items, the ICC ranged from 0.93 to 0.99, and for the psychological items, it also ranged from 0.93 to 0.99. The ICC for the total score of the physical items was 0.93, while for the total score of the psychological items, it was 0.98 (Table 2).
The KMO test value was found to be 0.839, indicating that the data is suitable for factoranalysis. The results of the CFA revealed that the factor loading values for all items were greater than 0.30. It was determined that the factor loading values for all items were above 0.30, the error variances were below 0.90, and all items were statistically significant (p<0.001) (Table 3).
Table 3 PO-BADO psychological distress and physical distress items" factor load values
The results of the CFA showed that for the scale administered by the other evaluator, the factor loadings for all items were above 0.30, and the error variances were below 0.90. Additionally, all items were found to be statistically significant (p<0.001).
When examining the CFA results, the x²/sd value was 1.17, the CFI was 0.97, the TLI was 0.973, and the RMSEA was 0.034. Based on these indices, it can be concluded that the model showed good fit to the data. In the French validity and reliability study of the PO-BADO, the CFI was 0.950, the RMSEA was 0.055, and the SRMR (Standardized Root Mean Square Residual) was 0.057, all of which were found to be within acceptable fit ranges.[28] These results suggest that the model fits well with the data and aligns with the findings from other studies in the literature.
In the convergent validity analysis, the correlation between PO-BADO scores and the Hospital Anxiety and Depression Scale (HADS), Perceived Stress Scale (PSS), Karnofsky Performance Scale (KPS), and Cancer Coping Questionnaire (CCQ) scores was evaluated. Both HADS-D, HADS-A and HADS-Total scores showed strong correlation with PO-BADO Psychological and PO-BADO Total scores; and moderate correlation with PO-BADO Physical scores. PSS scores were strongly correlated with PO-BADO Psychological and PO-BADO Total scores and weakly correlated with PO-BADO Physical scores. While KPS scores showed moderate negative correlation with PO-BADO Physical subscale and POBADO total scores; the correlation between PO-BADO Psychological scores were found to be weak. CCQ scores did not show significant correlation with PO-BADO Physical scores and only showed weak negative correlation with PO-BADO Psychological and PO-BADO Total scores. The correlation coefficients (r values) and the significance evaluations are presented in Table 4.
Discussion
In this study, we conducted the Turkish translation, adaptation and validity-reliability analysis of the PO-BADO, the first scale to assess the psychosocial challenges of oncology patients by a specialist. To our knowledge, by the time of our research this scale has been used only in German, English, and French.The homogeneity of the scales was demonstrated through internal consistency. The internal consistency coefficient is one of the key parameters in determining the reliability of a scale.[29] In research, a Cronbach α value ≥0.70 is considered to meet the standard reliability criteria.[30] For PO-BADO scores, Cronbach α was found to be 0.826 in this study. Cronbach α for the physical symptoms subscale was 0.792, and for the psychological symptoms subscale, it was 0.749, indicating that PO-BADO has a high internal consistency and reliability.
The reliability of the PO-BADO was assessed using ICC. The ICC values for the total score of physical symptoms were 0.93, and for psychological symptoms, it was 0.98. The excellent range of the intra-class correlation coefficient indicates that the evaluators had a high level of agreement and that PO-BADO was rated similarly among different practitioners. In a study by Knight et al.,[12] the total score for the psychological items of the PO-BADO was 0.84, and for the physical items, it was 0.88. In the French validity and reliability study of the PO-BADO, the average ICC for inter-rater reliability was 0.71.[30] Therefore, the intra-class correlation coefficient values in our Turkish version of PO-BADO align well with the literature and show high reliability.
The KMO test was found to be 0.839, indicating that our data is suitable for factor analysis. In our study, all items had factor loadings above 0.30, and error variances were below 0.90 (p<0.001). When examining the factor loadings for the 12 items in our study, eight items showed high factor loadings, while four items had moderate loadings. In the psychometric evaluation of the original German version of PO-BADO by Knight et al.[12] and the French validation study of the PO-BADO scale, all factor loadings were above 0.50.[28] Therefore, the factor loadings in the Turkish version of PO-BADO are consistent with the original psychometric data.
In our study, the TLI value was calculated to be 0.97, suggesting that the model has a good fit. Upon examining the results of the confirmatory factor analysis (CFA), the x²/df ratio was found to be below 3, with CFI=0.97 and RMSEA=0.034. According to these indices, it can be concluded that the model fits the data well. In the French validity and reliability study of POBADO, CFI=0.950, RMSEA=0.055, and SRMR=0.057 were within acceptable ranges.[28] Therefore, our findings show that PO-BADO is consistent with studies where the scale has been used previously.
In the convergent validity analysis, we evaluated the correlation levels between PO-BADO total and subscale scores and HADS, PSS, KPS, and CCQ scores. HADS scores showed a strong correlation with POBADO psychological and total scores, while showing moderate correlation with physical scores. This is an expected outcome because HADS is not a scale that focuses specifically on physical parameters. However, the strong correlation with psychological and total scores shows that PO-BADO is a valid tool for assessing psychological difficulties such as anxiety and depression.
Similarly, PO-BADO physical scores showed weak correlation with PSS scores, however the psychological and total sections showed strong correlation. This result is thought to stem from PSS not being a suitable test for measuring physical parameters, but it shows that both scales are similar in measuring psychological parameters.
The KPS is a test used to measure physical condition, and it showed moderate correlation with the physical section of PO-BADO, indicating that PO-BADO can also provide an acceptable insight into physical difficulties experienced by oncology patients in their current medical condition. However, the correlation between KPS and the psychological section of PO-BADO was weak, which can be explained by the fact that KPS does not focus on psychological parameters.
The CCQ scale did not show a significant correlation with the physical section of the PO-BADO and showed a weak correlation with the other sections. Although the p-value appears statistically significant, the low r-value indicates that PO-BADO does not provide an adequate assessment of coping with cancer. From this perspective, it can be said that BADO is a tool that focuses on patients" recent psychosocial status and physical difficulties, but is not a suitable tool for assessing coping skills.
The developers of the scale have not established a cut-off score for referring patients for psychiatric evaluation. However, as previously stated in the methods section, they have identified three key criteria that indicate a patient"s need for psycho-oncological support. Likewise, we believe that as a screening tool, the same criteria indicate a need for psychosocial support in Turkish cancer patients, but do not point to a need for the assessment of psychiatric disorders. In our opinion, psycho-oncological support can be provided by mental health professionals such as psychologists, psychological counsellors, or psychiatric nurses who have received specialized training in this field, and referral to psychiatry departments may be considered in clinical situations where mental disorders are suspected.
There are some limitations of our study. The first limitation is conducting a single-center study, which may affect the generalizability of our results. Secondly, we obtained data from patients in stable stages of the disease since many of the patients in the terminal stage did not consent to participate in the interviews. When the psychosocial status of patients with severe medical conditions is not assessed, their needs may not be fully understood. Finally, the scale administrators were a fourth-year psychiatry resident and a psychologist with a master"s degree in psycho-oncology. Both of these practitioners have extensive experience in interviewing oncology patients. However, PO-BADO is described as a tool that can be used by all healthcare professionals involved in the treatment process of oncology patients with just basic training.
Conclusion
The results of our study indicate that the Turkish version of the PO-BADO is a reliable tool for comprehensively assessing the psychosocial and physical distress of cancer patients. For future research, we recommend the PO-BADO to be applied in different centers and different socio-cultural settings with Turkish-speaking patients, also with patients in various clinical conditions (e.g., palliative care units), and by healthcare professionals outside the psychiatry and psychology fields.Ethics Committee Approval: The study was approved by the Istanbul University Istanbul Faculty of Medicine Clinical Researches Ethics Committee (no: 1672709, date: 08/03/2023).
Informed Consent: Participants gave written informed constent.
Conflict of Interest Statement: The authors have no competing interests to declare that are relevant to the content of this article.
Funding: The authors did not receive financial support from any organization for the submitted work.
Use of AI for Writing Assistance: No AI technologies utilized. Author Contributions: Concept - U.B.N., D.A., I.P.; Design - U.B.N., D.A., I.P.; Supervision - I.P.; Data collection and/ or processing ? U.B.N.; Data analysis and/or interpretation - U.B.N., M.K., D.A., I.P.; Literature search - U.B.N.; Writing - U.B.N., I.P.; Critical review - M.Ö.
Acknowledgments: The authors would like to thank Mustafa Alican Dirican, M.D., for his contributions to the translation and back-translation process.
Peer-review: Externally peer-reviewed.
References
1) World Health Organization. Cancer: Key facts. Available
at: https://www.who.int/news-room/fact-sheets/
detail/cancer. Accessed Jan 17, 2024.
2) TUIK. Cause of death statistics, 2022. Available at: https://
data.tuik.gov.tr/Bulten/Index?p=Olum-ve-Olum-Nedeni-
Istatistikleri-2022-49679. Accessed Jan 17, 2024.
3) Caruso R, Nanni MG, Riba MB, Sabato S, Grassi L.
The burden of psychosocial morbidity related to
cancer: Patient and family issues. Int Rev Psychiatry
2017;29(5):389-402.
4) Caruso R, Nanni MG, Riba M, Sabato S, Mitchell AJ,
Croce E, et al. Depressive spectrum disorders in cancer:
Prevalence, risk factors and screening for depression:
A critical review. Acta Oncologica 2017;56(2):146?55.
5) Adler NE, Page AE. Cancer care for the whole patient:
Meeting psychosocial health needs. Washington DC:
National Academies Press; 2008.
6) Peters L, Brederecke J, Franzke A, de Zwaan M, Zimmermann
T. Psychological distress in a sample of inpatients
with mixed cancer: A cross-sectional study of
routine clinical data. Front Psychol 2020;11:591771.
7) Donovan KA, Grassi L, Deshields TL, Corbett C, Riba
MB. Advancing the science of distress screening and
management in cancer care. Epidemiol Psychiatr Sci
2020;29:e92.
8) Ownby KK. Use of the distress thermometer in clinical
practice. J Adv Pract Oncol 2019;10(2):175-9.
9) Deshields TL, Wells-Di Gregorio S, Flowers SR, Irwin
KE, Nipp R, Padgett L, et al. Addressing distress management
challenges: Recommendations from the consensus
panel of the American Psychosocial Oncology
Society and the Association of Oncology Social Work.
CA Cancer J Clin 2021;71(5):407-36.
10) Riba MB, Donovan KA, Ahmed K, Andersen B, Braun
I, Breitbart WS, et al. NCCN Guidelines® insights: Distress
management, Version 2.2023. J Natl Compr Canc
Netw 2023;21(5):450-7.
11) Grassi L, Spiegel D, Riba M. Advancing psychosocial
care in cancer patients. F1000Res 2017;6:2083.
12) Knight L, Mussell M, Brandl T, Herschbach P, Marten-
Mittag B, Treiber M, et al. Development and psychometric
evaluation of the basic documentation for
psycho-oncology, a tool for standardized assessment of
cancer patients. J Psychosom Res 2008;64(4):373-81.
13) Greene FL, Sobin LH. The staging of cancer: A retrospective
and prospective appraisal. CA Cancer J Clin
2008;58(3):180-90.
14) Herschbach P, Book K, Brandl T, Keller M, Marten-
Mittag B. The Basic Documentation for Psycho-
Oncology (PO-Bado): An expert rating scale for
the psychosocial experience of cancer patients. Onkologie
2008;31(11):591-6.
15) Herschbach P. The need for treatment in psychooncology:
Principles and assessment strategies. Der Onkologe
2006;12(1):41-7.
16) Zigmond AS, Snaith RP. The hospital anxiety and depression
scale. Acta Psychiatr Scand 1983;67(6):361-70.
17) Bjelland I, Dahl AA, Haug TT, Neckelmann D. The
validity of the hospital anxiety and depression scale.
An updated literature review. J Psychosom Res
2002;52(2):69-77.
18) Aydemir O, Güvenir T, Küey L, Kültür S. Reliability
and Validity of the Turkish version of Hospital Anxiety
and Depression Scale. Turk J Psych 1997;8:280-7.
[Article in Turkish]
19) Cohen S, Kamarck T, Mermelstein R. A global measure of
perceived stress. J Health Soc Behav 1983;24(4):385-96.
20) Eskin M, Harlak H, Demirkıran F, Dereboy Ç. Adaptation
of the perceived stress scale to Turkish: Reliability
and validity analysis. New Symposium J
2013;51(3):132-40.
21) Karnofsky DA. The clinical evaluation of chemotherapeutic
agents in cancer. New York City: Columbia
University Press; 1949, p. 191-205.
22) Péus D, Newcomb N, Hofer S. Appraisal of the Karnofsky
performance status and proposal of a simple algorithmic
system for its evaluation. BMC Med Inform
Decis Mak 2013;13:72.
23) Çeltek YN, Süren M, Demir O, Okan I. Karnofsky
performance scale validity and reliability of
Turkish palliative cancer patients. Turk J Med Sci
2019;49(3):894-8.
24) Moorey S, Frampton M, Greer S. The cancer coping
questionnaire: A self-rating scale for measuring the
impact of adjuvant psychological therapy on coping
behaviour. Psychooncology 2003;12(4):331-44.
25) Bahcivan O, Alkan N, Erdener D. The adaptation of
the Cancer Coping Questionnaire (CCQ) for Turkish-
speaking population. Acad Lett 2021;2:1363.
26) The Jamovi Project. (2021). Jamovi (Version 2.2.5).
Available at: https://www.jamovi.org. Accessed Jan 10,
2024.
27) IBM Corp. IBM SPSS Statistics for Windows, Version
26.0 [Computer software]. Armonk: IBM Corp;
2019.
28) Saada Y, Gana K, Duguey-Cachet O, Stadelmaier
N, Quintard B. French adaptation of the PO-Bado
short form, an interview-based expert rating scale
for distress screening. Health Psychol Behav Med
2019;7(1):78-89.




