<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "journalpublishing3.dtd">
<article xml:lang="en" article-type="research-article" xmlns:xlink="http://www.w3.org/1999/xlink">
<?release-delay 0|0?>
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">MCO</journal-id>
<journal-title-group>
<journal-title>Molecular and Clinical Oncology</journal-title>
</journal-title-group>
<issn pub-type="ppub">2049-9450</issn>
<issn pub-type="epub">2049-9469</issn>
<publisher>
<publisher-name>D.A. Spandidos</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">MCO-0-0-02356</article-id>
<article-id pub-id-type="doi">10.3892/mco.2021.2356</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Articles</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>A phenomenological three-parameter model for predicting the extent of outpatient palliative care</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Harms</surname><given-names>Dirk</given-names></name>
<xref rid="af1-mco-0-0-02356" ref-type="aff">1</xref>
<xref rid="af2-mco-0-0-02356" ref-type="aff">2</xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Reinwald</surname><given-names>Mark</given-names></name>
<xref rid="af1-mco-0-0-02356" ref-type="aff">1</xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Krauthausen</surname><given-names>Felise</given-names></name>
<xref rid="af2-mco-0-0-02356" ref-type="aff">2</xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Stein</surname><given-names>Dagmar</given-names></name>
<xref rid="af2-mco-0-0-02356" ref-type="aff">2</xref>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Deckert</surname><given-names>Peter Markus</given-names></name>
<xref rid="af1-mco-0-0-02356" ref-type="aff">1</xref>
<xref rid="af3-mco-0-0-02356" ref-type="aff">3</xref>
<xref rid="c1-mco-0-0-02356" ref-type="corresp"/>
</contrib>
</contrib-group>
<aff id="af1-mco-0-0-02356"><label>1</label>Faculty of Medicine and Psychology, Brandenburg Medical School Theodor Fontane, D-14770 Brandenburg an der Havel, Germany</aff>
<aff id="af2-mco-0-0-02356"><label>2</label>Outpatient Palliative Care Team Brandenburg, D-14770 Brandenburg an der Havel, Germany</aff>
<aff id="af3-mco-0-0-02356"><label>3</label>Faculty of Health Sciences Brandenburg, Brandenburg Medical School Theodor Fontane, D-14770 Brandenburg an der Havel, Germany</aff>
<author-notes>
<corresp id="c1-mco-0-0-02356"><italic>Correspondence to:</italic> Professor Peter Markus Deckert, Faculty of Medicine and Psychology, Brandenburg Medical School Theodor Fontane, Campus Brandenburg an der Havel, Hochstrasse 29, D-14770 Brandenburg an der Havel, Germany <email>deckert@klinikum-brandenburg.de</email></corresp>
</author-notes>
<pub-date pub-type="ppub">
<month>09</month>
<year>2021</year></pub-date>
<pub-date pub-type="epub">
<day>21</day>
<month>07</month>
<year>2021</year></pub-date>
<volume>15</volume>
<issue>3</issue>
<elocation-id>194</elocation-id>
<history>
<date date-type="received">
<day>11</day>
<month>11</month>
<year>2020</year>
</date>
<date date-type="accepted">
<day>01</day>
<month>06</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright: &#x00A9; Harms et al.</copyright-statement>
<copyright-year>2020</copyright-year>
<license license-type="open-access">
<license-p>This is an open access article distributed under the terms of the <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by-nc-nd/4.0/">Creative Commons Attribution-NonCommercial-NoDerivs License</ext-link>, which permits use and distribution in any medium, provided the original work is properly cited, the use is non-commercial and no modifications or adaptations are made.</license-p></license>
</permissions>
<abstract>
<p>Whether a patient receives general or specialized outpatient palliative cancer care rarely follows clear criteria, leading to undertreatment or overtreatment. Detailed scores exist to predict prognosis, but not treatment requirements, leaving caregivers to follow their intuition. As a phenomenological indicator incorporating possibly important subjective information, intuition may in fact be a helpful tool. In this prospective observational study, a score to estimate three global dimensions of patients&#x0027; resources was applied: Medical prognosis, feeling of strength and feeling of support. The score results were correlated with the actual amount and effort of care required during the subsequent palliative care time. This phenomenological score correlated well with the performance index and the Hospice and Palliative care Evaluation score. Whilst various individual items correlated significantly with the score or its constituent parameters, there was no uniform coherent pattern, reflecting the complexity of palliative care and the potential value of this predictive tool.</p>
</abstract>
<kwd-group>
<kwd>health care economics</kwd>
<kwd>medical ethics</kwd>
<kwd>health services</kwd>
<kwd>palliative care</kwd>
<kwd>health sciences</kwd>
<kwd>oncology</kwd>
</kwd-group>
<funding-group>
<funding-statement><bold>Funding:</bold> The study was in part funded by internal institutional funds from the Brandenburg Medical School Theodor Fontane.</funding-statement>
</funding-group>
</article-meta>
</front>
<body>
<sec sec-type="intro">
<title>Introduction</title>
<p>Both general practitioners and specialized palliative care teams tend to terminally ill cancer patients at home. Predicting the degree of care a patient needs, and hence, the suitable type or level of outpatient care required, is not trivial. Erring on either side will result in withholding adequate care, either by undertreating the index patient or by straining the resources available to other patients. A number of scales and scores in palliative care exists to estimate overall prognosis and partly to identify areas of need (<xref rid="b1-mco-0-0-02356" ref-type="bibr">1</xref>). The difference between general and specialized palliative care has often been defined by &#x2018;complexity&#x2019;, which is in itself an ill-defined term, and most often translates into the quantification of symptoms (<xref rid="b2-mco-0-0-02356" ref-type="bibr">2</xref>).</p>
<p>This analytic approach is largely driven by an effort to fragmentize the need for palliative care into manageable items, not least to justify costs. In its essence however, palliative care is a holistic approach, qualified by the need to keep in contact with the situation at large, whilst adequately addressing present symptoms (<xref rid="b3-mco-0-0-02356" ref-type="bibr">3</xref>). Hence, in this study, a tool to support decision-making in touch with the patient&#x0027;s situation and the caregivers&#x0027; intuition was examined, attempting to establish criteria that are neither overly detailed nor arbitrary.</p>
<p>In particular with regard to palliative care, intuition appears to implicitly inform medical decisions more often than generally presumed. This happens rather as an unacknowledged subtext than a consciously employed and recorded method (<xref rid="b4-mco-0-0-02356" ref-type="bibr">4</xref>). Thus, to develop a scoring method, a phenomenological grounded theory approach was employed (<xref rid="b5-mco-0-0-02356" ref-type="bibr">5</xref>), evaluating existing literature on referral criteria and patient- or proxy-reported outcome measures in palliative care (<xref rid="b6-mco-0-0-02356 b7-mco-0-0-02356 b8-mco-0-0-02356 b9-mco-0-0-02356 b10-mco-0-0-02356" ref-type="bibr">6-10</xref>). The results showed that three core aspects directed the perception of a terminally ill patient&#x0027;s multi-facetted situation.</p>
<p>In a first approach, these three items had been termed &#x2018;instability of the environment&#x2019;, &#x2018;weight of symptoms&#x2019; and &#x2018;instability of the situation&#x2019;. Upon validating this score, it underwent further development using the grounded theory process. The revised score then consisted of three dimensions termed &#x2018;perception of strength&#x2019;, &#x2018;perception of support and stability&#x2019; and &#x2018;medical prognosis&#x2019;. This score placed a clearer distinction between patient-reported and caregiver-observed criteria. In addition, it was easier to apply in practice, as instead of being deficiency-oriented, it was resource-oriented; that is, the higher the value, the better off the patient.</p>
<p>As these terms, such as a coordinate system, describe different dimensions, further consolidation into a single figure would come at the price of losing information gained in the process. Thus, it was decided to record the three dimensions separately in addition to combining them into one score.</p>
<p>The primary aim of this exploratory, non-interventional study was to assess whether this synthetic approach to summarizing the information gathered by the initial patient work-up in an ambulatory palliative care setting may predict the level of care required.</p>
<p>The secondary aims were to assess whether such an intuitive assessment and its documentation were feasible in daily practice.</p>
</sec>
<sec sec-type="Patients|methods">
<title>Patients and methods</title>
<sec>
<title/>
<sec>
<title>Study design and ethics approval</title>
<p>In a monocentric study, 142 patients referred for ambulatory palliative care were assessed in a mixed urban and rural area in Germany over a 2-year period between October 2015 and September 2017. Inclusion criteria were advanced and progredient incurable disease with a short life expectancy of weeks to months and complex symptoms. Exclusion criteria were incapability to give informed consent or lack thereof, and incapability to participate in a complete initial anamnestic and physical assessment. All patients referred to ambulatory palliative care within the study period were screened and finally included into the study. The present study was approved by the Ethics Committee of the Medizinische Hochschule Brandenburg Theodor Fontane and conducted according to the Declaration of Helsinki as adopted by the World Medical Organization in October 2013(<xref rid="b11-mco-0-0-02356" ref-type="bibr">11</xref>), and all patients provided written informed consent to participate.</p>
</sec>
<sec>
<title>Patient characteristics</title>
<p>The distribution of the sexes of the total study population was skewed towards males (n=83; 58&#x0025; vs. n=59; 42&#x0025;). Excluding one pediatric patient from further evaluation, the median age was 73 years (age range, 42-91 years), and 18&#x0025; were living alone. In the vast majority of patients, the life-limiting diagnosis was malignant disease (90.1&#x0025;). Amongst the 60 patients evaluated using the final version of the scoring system, the distribution of sexes was slightly more even with 33 male and 27 female patients (55 and 45&#x0025;, respectively), the median age was 76 years (age range, 50-91 years), and 88.3&#x0025; of the patients had a malignant disease as the primary diagnosis; <xref rid="tI-mco-0-0-02356" ref-type="table">Table I</xref> shows the demographic characteristics, <xref rid="tII-mco-0-0-02356" ref-type="table">Table II</xref> the medical characteristics of the patients.</p>
</sec>
<sec>
<title>Study procedure</title>
<p>The assessments were performed by one of three participating palliative care physicians, who contributed 67, 28, and 5&#x0025; of the assessments for this study. Patients&#x0027; consent only covered assessment by their assigned primary palliative care physician. All participating physicians were board certified in palliative medicine with &#x003E;20 years professional experience each. The initial outpatient palliative care visit routinely consisted of recording a multi-dimensional patient history including medical, family and psychosocial aspects, their current situation and patients&#x0027; perceptions and expectations, followed by a physical examination and subsequent care-planning for the immediate future. Upon completion of this visit, the physician rated and documented the score parameters. After the end of ambulatory palliative care, items describing each patient&#x0027;s pre-existing condition and the palliative care effort delivered (documentation items) were collected in a pseudonymized database.</p>
</sec>
<sec>
<title>Development and evaluation of the score</title>
<p>A total of 82 patients were assessed with the first scoring approach described in the introduction. Upon analyzing the results, both as to practical applicability and prognostic value for the required extent of palliative care, it was revisited, and for the subsequent 60 patients, the score comprising the parameters &#x2018;perception of strength&#x2019;, &#x2018;perception of support and stability&#x2019;, and &#x2018;medical prognosis&#x2019; was used. Upon performing the initial patient workup, the physician gave an estimate of these parameters using a positive visual analog scale, where 10 was the best possible or &#x2018;healthy&#x2019; realization of each parameter and 0 was the worst possible realization. The complete score for each patient was calculated as the sum of the three constituent parameters, and thus had a range of 0-30.</p>
<p>Both the complete score and its constituent parameters were compared with two established scores, the Hospice and Palliative care Evaluation (HOPE) (<xref rid="b9-mco-0-0-02356" ref-type="bibr">9</xref>) and the Karnofsky index (KI) (<xref rid="b12-mco-0-0-02356" ref-type="bibr">12</xref>), and with documentation items indicating the actual care effort delivered to a patient. The established scores were applied by the same physician at the same time as the experimental score.</p>
</sec>
<sec>
<title>Statistical analysis</title>
<p>Statistical calculations were performed using SPSS version 21.0 (TBM Corp). Numerically scaled values of the individual observation items as listed in <xref rid="f1-mco-0-0-02356" ref-type="fig">Figs. 1</xref> and <xref rid="f2-mco-0-0-02356" ref-type="fig">2</xref> were compared to the total score value using a Pearson&#x0027;s correlation analysis, followed by subsequent multivariate regression analysis, where correlations &#x003E;0.2 were found to be significant. As all items were at least interval scaled, this analysis was deemed appropriate to maintain a uniform evaluation method. For the initial version of the score, a sample size of n=83, and for the final version, a sample size of n=60 was evaluated. For the sample size and distribution, the indicated Pearson&#x0027;s r correlation coefficients were associated with the following levels of significance according to the two-sided Student&#x0027;s t-test: r&#x003E;0.3, P&#x003C;0.01; r&#x003E;0.4, P&#x003C;0.001; r&#x003E;0.5, P&#x003C;0.0001. Correlation coefficients reaching a level of significance of P&#x003C;0.01 have been highlighted in bold italics in the figures.</p>
</sec>
</sec>
</sec>
<sec sec-type="Results">
<title>Results</title>
<sec>
<title/>
<sec>
<title>Inter-rater variability</title>
<p>A direct comparison between raters on the same patient was methodologically impossible. Comparing the two physicians who together provided &#x003E;90 percent of the assessments, descriptive statistics revealed mean rating scores of 4.0/10 vs. 6.10/10 (perception of support and stability), 7.5/10 vs. 8.0/10 (perception of strength) and 7.95/10 vs. 7.5/10 (medical condition), respectively. Due to the small number of interviews, a meaningful comparison with the third participating physician was not possible.</p>
</sec>
<sec>
<title>Primary score</title>
<p>To provide an impression of the actual score figures with the initial scoring approach, the means (and confidence intervals) were 19.67 (12.75-26.59) for the total and 5.13 (0.87-9.39) for &#x2018;instability of the environment&#x2019;, 7.28 (4.07-10.50) for &#x2018;weight of symptoms&#x2019; and 7.25 (4.12-10.39) for &#x2018;instability of the situation&#x2019;. Here, the total score correlated well with all three constituent parameters, but significant correlations were found only of the total score, &#x2018;weight of symptoms&#x2019; and &#x2018;instability of the situation&#x2019; as score parameters, and the documentation items &#x2018;number of medical visits&#x2019;, &#x2018;number of urgent medical visits&#x2019; and &#x2018;number of medical phone calls&#x2019;. None of these reached a correlation coefficient of 0.3, which was considered the significance threshold; thus, this score was not pursued any further.-</p>
</sec>
<sec>
<title>Revised score</title>
<p>The means (and confidence intervals) of the revised score were 16.1 (7.3-24.9) for the total score, 4.6 (0-9.5) for &#x2018;perception of strength&#x2019;, 6.8 (3.2-10.4) for &#x2018;perception of support and stability&#x2019; and 4.7 (0.1-9.3) for &#x2018;medical prognosis&#x2019;. From sample size and distribution, the indicated Pearson&#x0027;s r correlation coefficients were associated with the following significance levels: r&#x003E;0.3, P&#x003C;0.01; r&#x003E;0.4, P&#x003C;0.001; and r&#x003E;0.5, P&#x003C;0.0001. These results are summarized in <xref rid="f1-mco-0-0-02356" ref-type="fig">Figs. 1</xref> and <xref rid="f2-mco-0-0-02356" ref-type="fig">2</xref>, where statistically significant correlations (P&#x003C;0.01) have been highlighted.</p>
<p>With correlation coefficients of 0.66 and 0.49, the scores of the present study correlated well with KI and HOPE scores, respectively; the latter correlation being inverse as HOPE increases with symptom load, whereas KI and the experimental score increase with performance and resources. The constituent dimensions &#x2018;perception of strength&#x2019; and &#x2018;medical prognosis&#x2019; (correlation coefficients 0.79 and 0.78, respectively) most strongly predicted the total score (<xref rid="f1-mco-0-0-02356" ref-type="fig">Figs. 1</xref> and <xref rid="f2-mco-0-0-02356" ref-type="fig">2</xref>).</p>
<p>The actual care effort delivered to the patient did not correlate with rural/urban residence, age, sex, number of symptom-relieving drugs taken, assigned degree of nursing care, tumor stage or number of residents in the household.</p>
<p>Looking at individual documentation items indicating the palliative care efforts actually delivered, none correlated with &#x2018;perception of support and stability&#x2019; (<xref rid="f2-mco-0-0-02356" ref-type="fig">Fig. 2</xref>). A subgroup defined by this parameter in which the score was &#x003C;5 however, showed consistently high documentation item values for care effort, consistent with high care requirements due to little existing support (data not shown).</p>
<p>Both the total score and its constituent parameters &#x2018;perception of strength&#x2019; and &#x2018;medical prognosis&#x2019; correlated inversely with the following documentation items for palliative care effort: Time for medical visits, time for medical and nursing visits, number of entries by coordinator and by palliative physician, and number of urgent nursing visits. The number of medical phone calls and the total number of nursing visits per day correlated inversely with &#x2018;medical prognosis&#x2019; and with the total score.</p>
</sec>
</sec>
</sec>
<sec sec-type="Discussion">
<title>Discussion</title>
<p>There are several different scoring systems available for evaluating palliative care, starting with the KI and ECOG scores developed for use in oncology. These are still being amended to develop newer more accurate models (<xref rid="b1-mco-0-0-02356" ref-type="bibr">1</xref>,<xref rid="b9-mco-0-0-02356" ref-type="bibr">9</xref>,<xref rid="b13-mco-0-0-02356" ref-type="bibr">13</xref>). However, the focus of these models is primarily on symptom severity and overall prognosis, rather than estimation of resources needed (<xref rid="b1-mco-0-0-02356" ref-type="bibr">1</xref>,<xref rid="b6-mco-0-0-02356" ref-type="bibr">6</xref>,<xref rid="b14-mco-0-0-02356" ref-type="bibr">14</xref>,<xref rid="b15-mco-0-0-02356" ref-type="bibr">15</xref>). In 2016, an international group found six predominant themes, which largely corresponded to the dimensions of the score developed in the present study (<xref rid="b10-mco-0-0-02356" ref-type="bibr">10</xref>). Far from a one-to-one translation, other groups also came across similar dimensions to evaluate the need for palliative care. An international consensus paper on referral criteria for outpatient specialty palliative care by Hui <italic>et al</italic> (<xref rid="b16-mco-0-0-02356" ref-type="bibr">16</xref>) comprised 11 major and 36 minor criteria. Thus, a demand for brief, patient-oriented assessment tools has been recognized and is being addressed by newer scales, such as the integrated palliative care outcome scale (IPOS) (<xref rid="b13-mco-0-0-02356" ref-type="bibr">13</xref>,<xref rid="b15-mco-0-0-02356" ref-type="bibr">15</xref>).</p>
<p>In the present study, the practical reliability of intuitive decisions regarding resource allocations in palliative care, and whether this approach can be systematically incorporated into structured decision-making was assessed. By applying a phenomenological method to the experience of the examining physician (<xref rid="b4-mco-0-0-02356" ref-type="bibr">4</xref>,<xref rid="b5-mco-0-0-02356" ref-type="bibr">5</xref>), it was assumed that intuition facilitates perceptions that allow for a more focused comprehensive picture, in that it does not seek separated parts, but incorporates several meaningful entities which are difficult to measure. The perceived entities arise and differ depending on the question asked. Hence, the three dimensions of the score employed here feed back on the reported perceptions of the rating physician and focuses their attention towards them.</p>
<p>The score introduced here strongly correlated with documentation items indicating palliative care effort, such as the number of interactions of caregivers, the time required and the number of emergency visits. In this, it may actually be suitable to support decision-making about general or specialized palliative care assignments. Yet the present study has clear limitations. The numbers of patients as well as rating physicians were small, and it was a single center study. If one were to &#x2018;calibrate&#x2019; this score, a larger population or a less diverse setting as to the patients&#x0027; environmental situation would be required. In addition, it would be interesting to apply it in different countries and cultural settings to see to what extent its questions and the perceptions informing their answers are culturally defined or universal.</p>
<p>A very stimulating result in this context is the lack of correlation between the initial &#x2018;perception of support and stability&#x2019; and the outcomes of interest. One explanation could be a principal inaccuracy of assessment due to rapid changes in the event of massive disturbances leading to hospital admissions or relocation to the hospice. Therefore, this constituent parameter of the score may be particularly prone to culturally defined perceptions, and further phenomenological research should deal with an intercultural and situational meaning of support. Another explanation could be that this estimator serves as an internal correction to the others. This is, in part, supported by the observation that there may be a threshold effect where patients with &#x2018;less than sufficient&#x2019; perception of support and stability require a greater degree of palliative care. To see this statistically would again require larger numbers, but a closer prospective look at this parameter in individual future patients may help to resolve this question.</p>
<p>The good correlation of the scoring system developed in the present study with that of the KI for general performance poses the question whether both measure the same quality. The KI basically pertains to general physical fitness, not to dimensions of prognosis and self-perception of the patient. Still, these qualities are associated with each other; improved physical performance is likely associated with an improved perception of strength and less subjective need of being cared for.</p>
<p>To test for this, the KI was statistically incorporated into the scoring system, either as an additional or as a substitute for the apparently weak predictor &#x2018;perception of support and stability&#x2019;. In both cases, it performed worse in predicting the actual care effort than the original score did (data not shown), supporting a preliminary view that both do not measure the same. Again, to confirm this statistically rather than narratively will require larger datasets.</p>
<p>Beyond that however, the value of the present approach by its intention should not be limited to an improved prediction of care effort, but support a more comprehensive attitude of interacting with the patient, their environment and a patient-centered medical view, and to do so without being inferior in prediction to existing scores.</p>
<p>The idea of this approach is to counter a tendency towards ever more detailed itemizations and to direct time and attention back to inter-personal patient attention and care. In this, it is a radically pragmatic approach to utilize caregiver&#x0027;s capabilities of intuitive assessment in an explicit and reflected manner. It must be emphasized however, that this does not in any way imply to save time by placing a precedence of &#x2018;gut feeling&#x2019; over factual assessment. To the opposite, the score was gathered only after a thorough initial patient workup.</p>
<p>Whilst this score may help to estimate the amount and intensity of palliative care required, a question not addressed here is its cutoff. Obviously, no precise threshold, but only scale areas indicating &#x2018;rather general palliative care&#x2019;, &#x2018;rather specialized palliative care&#x2019; or &#x2018;indeterminate&#x2019; may possibly be established in the future.</p>
<p>In summary, the present study explored a 3D phenomenological model and suggests, without yet defining a practically applicable discriminator, that their combination correlates with the required extent of care at least as well as existing scores. It was also suggested that performing and documenting this score is feasible in the actual everyday work of ambulatory palliative care. To validate the system for prospective application and decision-making; however, will require additional, larger and multi-center studies.</p>
</sec>
</body>
<back>
<ack>
<title>Acknowledgements</title>
<p>Not applicable.</p>
</ack>
<sec sec-type="data-availability">
<title>Availability of data and materials</title>
<p>The datasets used and/or analyzed during the present study are available from the corresponding author on reasonable request.</p>
</sec>
<sec>
<title>Authors&#x0027; contributions</title>
<p>DH, MR and PMD conceived the study, and analyzed and interpreted the data. DH performed the background research. DH, DS and FK collected the data. PMD wrote the manuscript. DH, MR and PMD edited the manuscript. DH and PMD confirm the authenticity of all the raw data. All authors have read and approved the final manuscript.</p>
</sec>
<sec>
<title>Ethics approval and consent to participate</title>
<p>The present study was approved by the Ethics Committee of the Brandenburg Medical School Theodor Fontane (approval no. E-01-20180716) and was performed in accordance with the Declaration of Helsinki. Consent was obtained as described in the Methods section. All patients provided written informed consent to participate.</p>
</sec>
<sec>
<title>Patient consent for publication</title>
<p>Not applicable.</p>
</sec>
<sec sec-type="COI-statement">
<title>Competing interests</title>
<p>The authors declare that they have no competing interests.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="b1-mco-0-0-02356"><label>1</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bausewein</surname><given-names>C</given-names></name><name><surname>Le Grice</surname><given-names>C</given-names></name><name><surname>Simon</surname><given-names>S</given-names></name><name><surname>Higginson</surname><given-names>I</given-names></name></person-group><comment>PRISMA</comment><article-title>The use of two common palliative outcome measures in clinical care and research: A systematic review of POS and STAS</article-title><source>Palliat Med</source><volume>25</volume><fpage>304</fpage><lpage>313</lpage><year>2011</year><pub-id pub-id-type="pmid">21464119</pub-id><pub-id pub-id-type="doi">10.1177/0269216310395984</pub-id></element-citation></ref>
<ref id="b2-mco-0-0-02356"><label>2</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kamps</surname><given-names>H</given-names></name><name><surname>Harms</surname><given-names>D</given-names></name></person-group><article-title>Komplexe hausarztmedizin</article-title><source>Z Allg Med</source><volume>87</volume><issue>5</issue><year>2011</year></element-citation></ref>
<ref id="b3-mco-0-0-02356"><label>3</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Juli&#x00E3;o</surname><given-names>M</given-names></name><name><surname>Sobral</surname><given-names>MA</given-names></name><name><surname>Cal&#x00E7;ada</surname><given-names>P</given-names></name><name><surname>Antunes</surname><given-names>B</given-names></name><name><surname>Nunes</surname><given-names>B</given-names></name><name><surname>Bragan&#x00E7;a</surname><given-names>A</given-names></name><name><surname>Runa</surname><given-names>D</given-names></name><name><surname>Faria de Sousa</surname><given-names>P</given-names></name><name><surname>Chochinov</surname><given-names>HM</given-names></name><name><surname>Bruera</surname><given-names>E</given-names></name></person-group><article-title>&#x2018;Truly holistic?&#x2019; Differences in documenting physical and psychosocial needs and hope in Portuguese palliative patients</article-title><source>Palliat Support Care</source><volume>19</volume><fpage>69</fpage><lpage>74</lpage><year>2021</year><pub-id pub-id-type="pmid">32580800</pub-id><pub-id pub-id-type="doi">10.1017/S1478951520000413</pub-id></element-citation></ref>
<ref id="b4-mco-0-0-02356"><label>4</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Todd</surname><given-names>PM</given-names></name><name><surname>Gigerenzer</surname><given-names>G</given-names></name></person-group><article-title>Precis of Simple heuristics that make us smart</article-title><source>Behav Brain Sci</source><volume>23</volume><fpage>727</fpage><lpage>780</lpage><year>2000</year><pub-id pub-id-type="pmid">11301545</pub-id><pub-id pub-id-type="doi">10.1017/s0140525x00003447</pub-id></element-citation></ref>
<ref id="b5-mco-0-0-02356"><label>5</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Giorgi</surname><given-names>A</given-names></name></person-group><article-title>An affirmation of the phenomenological psychological descriptive method: A response to Rennie (2012)</article-title><source>Psychol Methods</source><volume>19</volume><fpage>542</fpage><lpage>551</lpage><year>2014</year><pub-id pub-id-type="pmid">24773359</pub-id><pub-id pub-id-type="doi">10.1037/met0000015</pub-id></element-citation></ref>
<ref id="b6-mco-0-0-02356"><label>6</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Glare</surname><given-names>P</given-names></name><name><surname>Shariff</surname><given-names>I</given-names></name><name><surname>Thaler</surname><given-names>HT</given-names></name></person-group><article-title>External validation of the number of risk factors score in a palliative care outpatient clinic at a comprehensive cancer center</article-title><source>J Palliat Med</source><volume>17</volume><fpage>797</fpage><lpage>802</lpage><year>2014</year><pub-id pub-id-type="pmid">24871990</pub-id><pub-id pub-id-type="doi">10.1089/jpm.2013.0256</pub-id></element-citation></ref>
<ref id="b7-mco-0-0-02356"><label>7</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Maltoni</surname><given-names>M</given-names></name><name><surname>Scarpi</surname><given-names>E</given-names></name><name><surname>Pittureri</surname><given-names>C</given-names></name><name><surname>Martini</surname><given-names>F</given-names></name><name><surname>Montanari</surname><given-names>L</given-names></name><name><surname>Amaducci</surname><given-names>E</given-names></name><name><surname>Derni</surname><given-names>S</given-names></name><name><surname>Fabbri</surname><given-names>L</given-names></name><name><surname>Rosati</surname><given-names>M</given-names></name><name><surname>Amadori</surname><given-names>D</given-names></name><name><surname>Nanni</surname><given-names>O</given-names></name></person-group><article-title>Prospective comparison of prognostic scores in palliative care cancer populations</article-title><source>Oncologist</source><volume>17</volume><fpage>446</fpage><lpage>454</lpage><year>2012</year><pub-id pub-id-type="pmid">22379068</pub-id><pub-id pub-id-type="doi">10.1634/theoncologist.2011-0397</pub-id></element-citation></ref>
<ref id="b8-mco-0-0-02356"><label>8</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shinall</surname><given-names>MC</given-names></name><name><surname>Ely</surname><given-names>EW</given-names></name><name><surname>Karlekar</surname><given-names>M</given-names></name><name><surname>Robbins</surname><given-names>SG</given-names></name><name><surname>Chandrasekhar</surname><given-names>R</given-names></name><name><surname>Martin</surname><given-names>SF</given-names></name></person-group><article-title>Psychometric properties of the FACIT-Pal 14 administered in an outpatient palliative care clinic</article-title><source>Am J Hosp Palliat Care</source><volume>35</volume><fpage>1292</fpage><lpage>1294</lpage><year>2018</year><pub-id pub-id-type="pmid">29529883</pub-id><pub-id pub-id-type="doi">10.1177/1049909118763793</pub-id></element-citation></ref>
<ref id="b9-mco-0-0-02356"><label>9</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stiel</surname><given-names>S</given-names></name><name><surname>Pollok</surname><given-names>A</given-names></name><name><surname>Elsner</surname><given-names>F</given-names></name><name><surname>Lindena</surname><given-names>G</given-names></name><name><surname>Ostgathe</surname><given-names>C</given-names></name><name><surname>Nauck</surname><given-names>F</given-names></name><name><surname>Radbruch</surname><given-names>L</given-names></name></person-group><article-title>Validation of the symptom and problem checklist of the german hospice and palliative care evaluation (HOPE)</article-title><source>J Pain Symptom Manage</source><volume>43</volume><fpage>593</fpage><lpage>605</lpage><year>2012</year><pub-id pub-id-type="pmid">22071164</pub-id><pub-id pub-id-type="doi">10.1016/j.jpainsymman.2011.04.021</pub-id></element-citation></ref>
<ref id="b10-mco-0-0-02356"><label>10</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hui</surname><given-names>D</given-names></name><name><surname>Meng</surname><given-names>YC</given-names></name><name><surname>Bruera</surname><given-names>S</given-names></name><name><surname>Geng</surname><given-names>Y</given-names></name><name><surname>Hutchins</surname><given-names>R</given-names></name><name><surname>Mori</surname><given-names>M</given-names></name><name><surname>Strasser</surname><given-names>F</given-names></name><name><surname>Bruera</surname><given-names>E</given-names></name></person-group><article-title>Referral criteria for outpatient palliative cancer care: A systematic review</article-title><source>Oncologist</source><volume>21</volume><fpage>895</fpage><lpage>901</lpage><year>2016</year><pub-id pub-id-type="pmid">27185614</pub-id><pub-id pub-id-type="doi">10.1634/theoncologist.2016-0006</pub-id></element-citation></ref>
<ref id="b11-mco-0-0-02356"><label>11</label><element-citation publication-type="journal"><comment>World Medical Association</comment><article-title>World Medical Association Declaration of Helsinki: Ethical principles for medical research involving human subjects</article-title><source>JAMA</source><volume>310</volume><fpage>2191</fpage><lpage>2194</lpage><year>2013</year><pub-id pub-id-type="pmid">24141714</pub-id><pub-id pub-id-type="doi">10.1001/jama.2013.281053</pub-id></element-citation></ref>
<ref id="b12-mco-0-0-02356"><label>12</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Crooks</surname><given-names>V</given-names></name><name><surname>Waller</surname><given-names>S</given-names></name><name><surname>Smith</surname><given-names>T</given-names></name><name><surname>Hahn</surname><given-names>TJ</given-names></name></person-group><article-title>The use of the karnofsky performance scale in determining outcomes and risk in geriatric outpatients</article-title><source>J Gerontol</source><volume>46</volume><fpage>M139</fpage><lpage>M144</lpage><year>1991</year><pub-id pub-id-type="pmid">2071835</pub-id><pub-id pub-id-type="doi">10.1093/geronj/46.4.m139</pub-id></element-citation></ref>
<ref id="b13-mco-0-0-02356"><label>13</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Roch</surname><given-names>C</given-names></name><name><surname>Palzer</surname><given-names>J</given-names></name><name><surname>Zetzl</surname><given-names>T</given-names></name><name><surname>Stork</surname><given-names>S</given-names></name><name><surname>Frantz</surname><given-names>S</given-names></name><name><surname>van Oorschot</surname><given-names>B</given-names></name></person-group><article-title>Utility of the integrated palliative care outcome scale (IPOS): A cross-sectional study in hospitalised patients with heart failure</article-title><source>Eur J Cardiovasc Nurs</source><volume>19</volume><fpage>702</fpage><lpage>710</lpage><year>2020</year><pub-id pub-id-type="pmid">32370552</pub-id><pub-id pub-id-type="doi">10.1177/1474515120919386</pub-id></element-citation></ref>
<ref id="b14-mco-0-0-02356"><label>14</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Etkind</surname><given-names>SN</given-names></name><name><surname>Lovell</surname><given-names>N</given-names></name><name><surname>Bone</surname><given-names>AE</given-names></name><name><surname>Guo</surname><given-names>P</given-names></name><name><surname>Nicholson</surname><given-names>C</given-names></name><name><surname>Murtagh</surname><given-names>FEM</given-names></name><name><surname>Higginson</surname><given-names>IJ</given-names></name></person-group><article-title>The stability of care preferences following acute illness: A mixed methods prospective cohort study of frail older people</article-title><source>BMC Geriatr</source><volume>20</volume><issue>370</issue><year>2020</year><pub-id pub-id-type="pmid">32993526</pub-id><pub-id pub-id-type="doi">10.1186/s12877-020-01725-2</pub-id></element-citation></ref>
<ref id="b15-mco-0-0-02356"><label>15</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Murtagh</surname><given-names>FE</given-names></name><name><surname>Ramsenthaler</surname><given-names>C</given-names></name><name><surname>Firth</surname><given-names>A</given-names></name><name><surname>Groeneveld</surname><given-names>EI</given-names></name><name><surname>Lovell</surname><given-names>N</given-names></name><name><surname>Simon</surname><given-names>ST</given-names></name><name><surname>Denzel</surname><given-names>J</given-names></name><name><surname>Guo</surname><given-names>P</given-names></name><name><surname>Bernhardt</surname><given-names>F</given-names></name><name><surname>Schildmann</surname><given-names>E</given-names></name><etal/></person-group><article-title>A brief, patient- and proxy-reported outcome measure in advanced illness: Validity, reliability and responsiveness of the Integrated Palliative care Outcome Scale (IPOS)</article-title><source>Palliat Med</source><volume>33</volume><fpage>1045</fpage><lpage>1057</lpage><year>2019</year><pub-id pub-id-type="pmid">31185804</pub-id><pub-id pub-id-type="doi">10.1177/0269216319854264</pub-id></element-citation></ref>
<ref id="b16-mco-0-0-02356"><label>16</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hui</surname><given-names>D</given-names></name><name><surname>Mori</surname><given-names>M</given-names></name><name><surname>Watanabe</surname><given-names>SM</given-names></name><name><surname>Caraceni</surname><given-names>A</given-names></name><name><surname>Strasser</surname><given-names>F</given-names></name><name><surname>Saarto</surname><given-names>T</given-names></name><name><surname>Cherny</surname><given-names>N</given-names></name><name><surname>Glare</surname><given-names>P</given-names></name><name><surname>Kaasa</surname><given-names>S</given-names></name><name><surname>Bruera</surname><given-names>E</given-names></name></person-group><article-title>Referral criteria for outpatient specialty palliative cancer care: An international consensus</article-title><source>Lancet Oncol</source><volume>17</volume><fpage>e552</fpage><lpage>e559</lpage><year>2016</year><pub-id pub-id-type="pmid">27924753</pub-id><pub-id pub-id-type="doi">10.1016/S1470-2045(16)30577-0</pub-id></element-citation></ref>
</ref-list>
</back>
<floats-group>
<fig id="f1-mco-0-0-02356" position="float">
<label>Figure 1</label>
<caption><p>Correlation of palliative care documentation items with the complete score and the score parameters &#x2018;perception of strength&#x2019;. Significant correlations are printed in bold italics. Numerical values of the individual observation items listed were compared to the total score value using Pearson&#x0027;s correlation analysis for linear correlation. As all items were at least interval scaled, this calculation was deemed appropriate to maintain a uniform evaluation method. HOPE, Hospice and Palliative care Evaluation.</p></caption>
<graphic xlink:href="mco-15-03-02356-g00.tif" />
</fig>
<fig id="f2-mco-0-0-02356" position="float">
<label>Figure 2</label>
<caption><p>Correlation of palliative care documentation items with the score parameters &#x2018;perception of support and stability&#x2019; and &#x2018;medical prognosis&#x2019;. Significant correlations are printed in italics.</p></caption>
<graphic xlink:href="mco-15-03-02356-g01.tif" />
</fig>
<table-wrap id="tI-mco-0-0-02356" position="float">
<label>Table I</label>
<caption><p>Demographic patient characteristics.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="middle">Characteristic</th>
<th align="center" valign="middle">Female</th>
<th align="center" valign="middle">Male</th>
<th align="center" valign="middle">Total</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="middle">Sex, &#x0025;</td>
<td align="center" valign="middle">41.5</td>
<td align="center" valign="middle">58.5</td>
<td align="center" valign="middle">100</td>
</tr>
<tr>
<td align="left" valign="middle">Age, years, mean</td>
<td align="center" valign="middle">73.5</td>
<td align="center" valign="middle">71.7</td>
<td align="center" valign="middle">72.4</td>
</tr>
<tr>
<td align="left" valign="middle">Age, years, median</td>
<td align="center" valign="middle">72</td>
<td align="center" valign="middle">75</td>
<td align="center" valign="middle">73</td>
</tr>
<tr>
<td align="left" valign="middle">Age, 95 &#x0025; confidence interval</td>
<td align="center" valign="middle">53.1-93.9</td>
<td align="center" valign="middle">50.3-91.6</td>
<td align="center" valign="middle">51.7-92.5</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap id="tII-mco-0-0-02356" position="float">
<label>Table II</label>
<caption><p>Medical patient characteristics.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="middle">Diagnostic category</th>
<th align="center" valign="middle">&#x0025;</th>
<th align="center" valign="middle">n</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="middle">Total</td>
<td align="center" valign="middle">100</td>
<td align="center" valign="middle">142</td>
</tr>
<tr>
<td align="left" valign="middle">Malignant</td>
<td align="center" valign="middle">90.1</td>
<td align="center" valign="middle">128</td>
</tr>
<tr>
<td align="left" valign="middle">Hematologic</td>
<td align="center" valign="middle">9.2</td>
<td align="center" valign="middle">13</td>
</tr>
<tr>
<td align="left" valign="middle">Solid, intermediate stage</td>
<td align="center" valign="middle">17.6</td>
<td align="center" valign="middle">25</td>
</tr>
<tr>
<td align="left" valign="middle">Solid, late stage</td>
<td align="center" valign="middle">63.4</td>
<td align="center" valign="middle">90</td>
</tr>
<tr>
<td align="left" valign="middle">Non-malignant</td>
<td align="center" valign="middle">6.3</td>
<td align="center" valign="middle">9</td>
</tr>
<tr>
<td align="left" valign="middle">Unknown</td>
<td align="center" valign="middle">3.5</td>
<td align="center" valign="middle">5</td>
</tr>
<tr>
<td align="left" valign="middle">Malignant diagnoses</td>
<td align="center" valign="middle">&#x00A0;</td>
<td align="center" valign="middle">&#x00A0;</td>
</tr>
<tr>
<td align="left" valign="middle">Leukemia</td>
<td align="center" valign="middle">2.1</td>
<td align="center" valign="middle">3</td>
</tr>
<tr>
<td align="left" valign="middle">Lymphoma</td>
<td align="center" valign="middle">7</td>
<td align="center" valign="middle">10</td>
</tr>
<tr>
<td align="left" valign="middle">Central nervous system</td>
<td align="center" valign="middle">1.4</td>
<td align="center" valign="middle">2</td>
</tr>
<tr>
<td align="left" valign="middle">Head and neck</td>
<td align="center" valign="middle">5.6</td>
<td align="center" valign="middle">8</td>
</tr>
<tr>
<td align="left" valign="middle">Esophageal</td>
<td align="center" valign="middle">2.1</td>
<td align="center" valign="middle">3</td>
</tr>
<tr>
<td align="left" valign="middle">Gastric</td>
<td align="center" valign="middle">4.2</td>
<td align="center" valign="middle">6</td>
</tr>
<tr>
<td align="left" valign="middle">Intestinal</td>
<td align="center" valign="middle">1.4</td>
<td align="center" valign="middle">2</td>
</tr>
<tr>
<td align="left" valign="middle">Colorectal</td>
<td align="center" valign="middle">7</td>
<td align="center" valign="middle">10</td>
</tr>
<tr>
<td align="left" valign="middle">Liver</td>
<td align="center" valign="middle">7</td>
<td align="center" valign="middle">10</td>
</tr>
<tr>
<td align="left" valign="middle">Pancreatic</td>
<td align="center" valign="middle">6.3</td>
<td align="center" valign="middle">9</td>
</tr>
<tr>
<td align="left" valign="middle">Lung and pleura</td>
<td align="center" valign="middle">16.9</td>
<td align="center" valign="middle">24</td>
</tr>
<tr>
<td align="left" valign="middle">Breast</td>
<td align="center" valign="middle">6.3</td>
<td align="center" valign="middle">9</td>
</tr>
<tr>
<td align="left" valign="middle">Gynacological</td>
<td align="center" valign="middle">2.1</td>
<td align="center" valign="middle">3</td>
</tr>
<tr>
<td align="left" valign="middle">Prostate</td>
<td align="center" valign="middle">5.6</td>
<td align="center" valign="middle">8</td>
</tr>
<tr>
<td align="left" valign="middle">Urogenital</td>
<td align="center" valign="middle">7</td>
<td align="center" valign="middle">10</td>
</tr>
<tr>
<td align="left" valign="middle">Melanoma, sarcoma or neuroendocrine</td>
<td align="center" valign="middle">2.8</td>
<td align="center" valign="middle">4</td>
</tr>
<tr>
<td align="left" valign="middle">Carcinoma of unknown primary</td>
<td align="center" valign="middle">4.9</td>
<td align="center" valign="middle">7</td>
</tr>
</tbody>
</table>
</table-wrap>
</floats-group>
</article>
