\u201cYou only have a few months to live.\u201d That sentence is undoubtedly something no one ever wants to hear. The bearer of such a message is usually a doctor, a person who knows about illness \u2013 and whether a patient will survive it or not.<\/p>\n
According to the 2016 report on nursing care<\/a><\/strong> by German health insurer DAK, 60 percent of Germans say they would like to die at home. The most common reason given is that dying in one\u2019s accustomed surroundings would be easier and more dignified. In reality, however, things are much different: 75 percent of Germans die in a hospital or nursing home.<\/p>\n Since 2007 patients in Germany have had a\u00a0legal right<\/a><\/strong>\u00a0 <\/strong>to \u201cspecialized home-based palliative care\u201d if their condition cannot be treated and is considered terminal. \u00a0In such cases, the patient remains in their own four walls, attended to by an interdisciplinary team of doctors, nurses, psychologists and counselors who are specially trained in end-of-life care.<\/p>\n There are a number of factors, however, that can make it difficult for patients to access such care:<\/p>\n But how does a physician decide which patients would benefit from at-home palliative care? And how do the possibilities change when it is not a single practitioner making the decision, but when they are assisted by a computer program?<\/p>\n Algorithmic systems are already being used, and further developed, to provide medical care \u2013 a trend that can hardly be reversed. There are already systems in place calculating the chances of a lethal event taking place \u2013 when hospital patients are connected to monitors tracking their vital signs, for example.<\/strong><\/a>\u00a0<\/strong>Medical professionals and data scientists have even been working on a way to predict the probability that a terminally ill patient will die within a given amount of time. Two examples from the United States are currently getting a lot of attention:<\/p>\n 1. Algorithm developed by Aspire Health, a new player in the area of palliative care<\/strong><\/p>\n Aspire Health, which has received funding from Google\u2019s parent company, Alphabet, developed an algorithm that can predict when people with serious illnesses will die. \u201cWe can say which patients will die in one week, in six weeks or in a year,\u201d said Bill Frist, co-founder of the US-based firm, to the Wall Street Journal<\/em><\/a><\/strong> in 2016. The algorithm is used for seriously ill individuals, e.g. those with late-stage cancer or a terminal chronic condition.<\/p>\n The company\u2019s goal is to use the algorithm to prevent patients from undergoing unnecessary treatment. Instead, they should receive professional palliative care in their own home instead \u2013 and sooner than they otherwise might. The Aspire program examines data from patients\u2019 medical records and from the outcomes of frequently used therapies to identify who would benefit from palliative treatment.<\/p>\n 2. Algorithm developed by Stanford University<\/strong><\/p>\n Researchers in the Department of Computer Science at Stanford University have taken a similar approach. In a current paper,<\/a><\/strong>\u00a0<\/strong>the researchers describe a neural network that they trained using health records to predict whether hospital patients will die within 3 to 12 months.<\/p>\n As the Stanford team led by Anand Avati states in the paper: \u201cOur approach uses deep learning to screen patients admitted to the hospital to identify those who are most likely to have palliative care needs.\u201d These are people, the paper notes, which conventional care systems might potentially overlook. The predictions are meant to help doctors meet patients\u2019 needs at the end of life, especially by getting palliative-care specialists involved early on.<\/p>\n Commercial use vs. public interest<\/strong><\/p>\n The timeframe of 3 to 12 months is particularly significant in palliative medicine, since that is when end-of-life care benefits patients most. The systems developed by Aspire Health and the Stanford researchers are designed to achieve the same goal: identify patients who are most likely to die within this timeframe at an early stage of treatment. That would make it possible to provide them with a high level of at-home palliative care sooner than patients generally receive it today \u2013 thus helping them die peacefully and in a dignified manner.<\/p>\n In contrast to the Stanford researchers, Aspire Health is running a commercial business. The company\u2019s main service is providing various types of at-home palliative care. Interdisciplinary teams of doctors, nurses and psychologists attend to seriously ill patients in the patient\u2019s own home while also supporting family members. The company focuses on providing relief from pain and other symptoms. It also offers a telephone hotline that patients or family members can call 24\/7.<\/p>\n Since 2013, investors have committed more than $50 million in risk capital to the former startup based in Nashville, Tennessee.<\/a><\/strong> Aspire Health now\u00a0operates in numerous cities in 25 states and in the District of Columbia.<\/a><\/strong>\u00a0Bill Frist, the company\u2019s co-founder and the chair of its Board of Directors, represented Tennessee for 12 years in the US Senate. He served as Senate Majority Leader for four years and was even considered a possible candidate for president in 2008. A former heart and lung transplant surgeon, the Republican politician is well versed in the policy framework impacting the US health-care system and what the country needs in terms of nursing care.<\/p>\n In addition to patient care, Frist has set a clear goal for Aspire Health: reducing the cost of treatment for seriously and chronically ill patients by offsetting it against life expectancies. The idea is to prevent patients who only have a short while to live from having to undergo unpleasant treatments or take unneeded medications with harmful side effects; likewise, patients are spared hospital stays that would do little to improve their condition. What the company promises instead is palliative care that is more professional and cost effective and that allows people to die in a more dignified manner in the comfort of their own home.<\/p>\n Aspire Health\u2019s algorithm: Big promises \u2013 but does it work?<\/strong><\/p>\n According to a study by the US-based Henry J. Kaiser Family Foundation,<\/a><\/strong>\u00a0<\/strong>about one-quarter of all expenditures by\u00a0Medicare,<\/a><\/strong>\u00a0the national US statutory health plan for senior citizens, is spent on beneficiaries in the last year of their life. It is money that is not being spent \u201csmartly, well, efficiently or productively,\u201d Frist says.<\/a><\/strong> In contrast, insurers save thousands of dollars per patient when unnecessary treatments are avoided thanks to services provided by Aspire Health. Moreover,\u00a0<\/strong>the former Congressman says,<\/a><\/strong> these services result in exceptionally high levels of patient and family satisfaction while reducing hospitalizations by over 50 percent.<\/p>\n What remains unclear, however, is which treatments Aspire Health considers \u201cunnecessary.\u201d For example, is chemotherapy unnecessary if it will only extend a person\u2019s life by a few months or weeks? Some patients decide they do not want to suffer the unpleasant side effects and prefer to have more quality of life instead. Others, however, want to try every possibility and therefore choose chemo, even though their doctor advises against it \u2013 a decision they have every right to make.<\/p>\n The problem is that Aspire Health has yet to demonstrate that its algorithm is in fact effective. There are no public studies available about how high the cost-savings actually are, whether using the algorithm to identify patients actually improves access to care, or how good the algorithm is at identifying the \u201cright\u201d patients. No one outside the company knows how the \u201cdeath algorithm,\u201d as it was recently deemed by German broadcaster ARD,<\/a><\/strong> actually works. It\u2019s a trade secret.<\/p>\n Stanford algorithm shown to be highly accurate<\/strong><\/p>\n That is the most glaring difference between Aspire Health\u2019s algorithm and the one developed by the Stanford researchers, which can be scrutinized by anyone. The first study provided an initial proof of concept: The patient information used for developing the algorithm was taken from a data pool encompassing some 2 million adults and children who were cared for at either the Stanford Hospital or the Lucile Packard Children\u2019s Hospital between 1995 and 2015.<\/p>\n The data were taken from patients\u2019 electronic records and included diagnoses, completed treatments, the number and type of visual diagnostics (x-rays, ultrasounds, CTs, etc.), prescription medications and the length of hospital stays. The team took the dataset and filtered out some 160,000 cases, which they used to train their model, a deep neural network. They then tested the system using data from an additional 40,000 patients to see how well it had learned to calculate the date of death.<\/p>\n The result: Nine out of ten patients whose deaths were predicted to occur within 3 to 12 months did die within that time. Thus, there were few false alarms. And 95 percent of the patients who were assigned a low probability of dying survived for more than a year.<\/p>\n Human biasBias<\/span> In der KI bezieht sich Bias auf Verzerrungen<\/strong> in Modellen oder Datens\u00e4tzen. Es gibt zwei Arten:\r\rEthischer Bias<\/em>:<\/strong> systematische Voreingenommenheit, die zu unfairen oder diskriminierenden Ergebnissen f\u00fchrt, basierend auf Faktoren wie Geschlecht, Ethnie oder Alter.\r\rMathematischer Bias<\/em>:<\/strong> eine technische Abweichung in statistischen Modellen, die zu Ungenauigkeiten f\u00fchren kann, aber nicht notwendigerweise ethische Probleme verursacht.<\/span><\/span><\/span>: optimism<\/strong><\/p>\n As research has repeatedly shown, doctors are less adept at predicting a patient\u2019s impending death. An overview study from London,<\/a><\/strong>\u00a0for example, comes to the conclusion that the accuracy of clinical estimates can range from 23 to 76 percent. And multiple studies have shown that doctors often overestimate a patient\u2019s chance of survival \u2013 since they are only human and thus tend to be optimistic. Their over-optimism, however, means that patients might receive palliative care later than they should and thus might not get the support they need when they need it.<\/p>\n At the same time, there are many tools and scoring systems clinicians can use to more objectively assess what a seriously ill patient\u2019s chances of survival are. Unfortunately, they do not result in timely and dependable predictions of when the patient is likely to die.<\/p>\n That is why in most cases doctors rely on their own experience. For example, they know what the statistical survival rates are for pancreatic cancer and how long, on average, people have who develop the disease. Moreover, they know the patient\u2019s general condition. And if they have been involved in the case for a while, they know what the patient\u2019s mental state is: Does the patient still want to live? Or are they discouraged or despondent and have come to accept that they are dying?<\/p>\n In Germany, there are no standardized criteria for prescribing at-home palliative care. That means when doctors recommend such treatment for a patient, the decision is based on a range of factors, many of them subjective \u2013 i.e. human.<\/p>\n The paper published by the Stanford academics has yet to be subjected to a peer review, meaning by other researchers not involved in the study. And their algorithm has yet to be tested under real-world conditions, meaning with data from patients who are still alive. However, in contrast to the one used by Aspire Health, the Stanford algorithm is not a trade secret.<\/p>\n Lessons for using algorithms within palliative care<\/strong><\/p>\n Using the Stanford research as a starting point, there is nothing to prevent a public discussion from taking place of \u201cdeath algorithms\u201d and the ethics underlying them. Such a discussion is greatly needed, since many challenges must be overcome before self-learning algorithms of this sort can be used as a standard part of palliative care:<\/p>\n If an algorithm can accurately predict whether and at what point a patient would benefit from palliative care, then it could indeed support doctors in doing their jobs. The more confident doctors are about the prognosis they make, the surer they can be that the treatment they recommend will help the patient as it should.<\/p>\n Many people might be very uncomfortable with the idea of a computer program predicting the probability that someone will die. Yet whether or not an algorithm is involved, doctors are ultimately responsible for the message they give their patients \u2013 and for working with them to decide if palliative treatment is the right choice or not.<\/p>\n The prerequisite for this, however, is transparency: Doctors must know how an algorithm works and which data are being used to generate predictions, taking into account related characteristics such as specificity and sensitivity. In other words, how often does the algorithm correctly identify those people who do in fact die within a certain timeframe, and those who have a high probability of surviving beyond a given point in time?<\/p>\n It is the job of the regulatory authorities to ensure this level of transparency. Developers must be held responsible for their algorithms and required to provide proof of their algorithms\u2019 efficiency, effectiveness, residual risk and accuracy, among other factors. Conversely, regulators must develop new benchmarks that reflect these challenges \u2013 without hampering the developers\u2019 ability to innovate.<\/p>\n A black box like the algorithm used by Aspire Health leaves too many questions unanswered. After all, the company is earning money with its palliative services. It would be all too easy to assert that its software has been trained to identify as many patients as possible who require its services \u2013 leading them to abandon curative treatment too soon. Would we really want to trust such an algorithm?<\/p>\n This is the second part in a three-part series on using algorithms to predict death.<\/p>\n Part 1 is available here: \u201cHow algorithms can save people from an early death<\/strong>\u201d<\/strong><\/a><\/p>\n\n
\n
\n