Estimated Indirect Cost Savings of Using Telehealth Among Nonelderly Patients With Cancer

January 10, 2023

Krupal B. Patel, MD, MSc1,2Kea Turner, PhD, MPH3Amir Alishahi Tabriz, MD, PhD, MPH3et alBrian D. Gonzalez, PhD3Laura B. Oswald, PhD3Oliver T. Nguyen, MSHI3Young-Rock Hong, PhD, MPH4Heather S. L. Jim, PhD3Anthony C. Nichols, MD5Xuefeng Wang, PhD6Edmondo Robinson, MD, MBA7,8Cristina Naso, MEd9Philippe E. Spiess, MD, MS9,10

Author Affiliations Article Information

JAMA Netw Open. 2023;6(1):e2250211. doi:10.1001/jamanetworkopen.2022.50211

Key Points

Question  What are the estimated cost savings of using telehealth among patients with cancer?

Findings  This economic evaluation of cost savings from completed telehealth appointments included 11 688 patients younger than 65 years, with 25 496 telehealth visits at a National Cancer Institute–Designated Comprehensive Cancer Center from April 1, 2020, to June 30, 2021. According to cost models, the estimated mean total cost savings ranged from $147.4 to $186.1 per visit.

Meaning  These findings suggest that telehealth saves time, travel, and money for patients, which could improve care delivery and may reduce the financial toxicity of cancer care.

Abstract

Importance  Patients with cancer typically have greater financial hardships and time costs than individuals without cancer. The COVID-19 pandemic has exacerbated this, while posing substantial challenges to delivering cancer care and resulting in important changes in care-delivery models, including the rapid adoption of telehealth.

Objective  To estimate patient travel, time, and cost savings associated with telehealth for cancer care delivery.

Design, Setting, and Participants  An economic evaluation of cost savings from completed telehealth visits from April 1, 2020, to June 30, 2021, in a single-institution National Cancer Institute–Designated Comprehensive Cancer Center. All patients aged 18 to 65 years who completed telehealth visits within the designated time frame and had a Florida mailing address documented in their electronic medical record were included in the study cohort. Data were analyzed from April 2020 to June 2021.

Main Outcomes and Measures  The main outcome was estimated patient cost savings from telehealth, which included 2 components: costs of travel (defined as roundtrip distance saved from car travel) and potential loss of productivity due to the medical visit (defined as loss of income from roundtrip travel plus loss of income from in-person clinic visits). Two different models with a combination of 2 different mileage rates ($0.56 and $0.82 per mile) and census tract–level median hourly wages were used.

Results  The study included 25 496 telehealth visits with 11 688 patients. There were 4525 (3795 patients) new or established visits and 20 971 (10 049 patients) follow-up visits. Median (IQR) age was 55.0 (46.0-61.0) years among the telehealth visits, with 15 663 visits (61.4%) by women and 18 360 visits (72.0%) by Hispanic non-White patients. According to cost models, the estimated mean (SD) total cost savings ranged from $147.4 ($120.1) at $0.56/mile to $186.1 ($156.9) at $0.82/mile. For new or established visits, the mean (SD) total cost savings per visit ranged from $176.6 ($136.3) at $0.56/mile to $222.8 ($177.4) at $0.82/mile, and for follow-up visits, the mean (SD) total cost savings per visit was $141.1 ($115.3) at $0.56/mile to $178.1 ($150.9) at $0.82/mile.

Conclusions and Relevance  In this economic evaluation, telehealth was associated with savings in patients time and travel costs, which may reduce the financial toxicity of cancer care. Expansion of telehealth oncology services may be an effective strategy to reduce the financial burden among patients with cancer.

Introduction

Financial toxicity includes both objective financial burden (ie, costs) and subjective financial distress.1,2 Costs of cancer care include: direct cost of care (cost sharing through higher deductibles, copayments, coinsurance, and even entire cost of care for uninsured patients) and indirect costs of care (lost productivity and cost of driving to and from appointments).1,3 Patients with cancer have greater time-based costs than those without cancer (eg, time spent traveling back and forth to appointments and time spent receiving medical care).46 Strategies are needed to reduce the direct and indirect costs of cancer care delivery.

The rapid adoption of telehealth during the COVID-19 pandemic has allowed patients to receive care in a location that is convenient for them, which may reduce the costs of cancer care. To date, there has been limited research regarding the cost savings of telehealth among patients with cancer. The COVID-19 pandemic is providing a unique opportunity to estimate the potential cost savings of telehealth in oncology care.7 Although it is well established that patients with cancer experience substantial financial toxicity, few studies have explored the indirect costs that they face. Thus, this study focused specifically on an oncologic population from a comprehensive cancer center with a substantially large sample size to estimate the indirect cost savings (driving costs and lost productivity) from telehealth visits.

Methods

This was an economic evaluation estimating cost savings from completed telemedicine visits at Moffitt Cancer Center (MCC), the only National Cancer Institute (NCI) –Designated Comprehensive Cancer Center in Florida. Data from telehealth visits were collected from April 1, 2020, to June 30, 2021. All patients aged between 18 and 65 years who completed telehealth visits within the designated time frame and had a Florida mailing address documented in their electronic medical record were included in the study cohort. All patients were offered telehealth if deemed appropriate by the clinical team. Telehealth visits were not offered to patients who needed physical examinations beyond what can be assessed during a telehealth visit. Patients who presented in person for chemotherapy infusion and/or radiation treatment were excluded from the analysis. This study was exempt from MCC institutional review board approval with a waiver of informed consent from patients because the study was deemed low risk. This study used the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) reporting guideline.8

Due to the COVID-19 pandemic, implementation of telehealth at MCC was accelerated in March 2020. Telehealth was defined as care delivered through a videoconferencing platform in real time. Starting in April 2020, MCC instituted videoconferencing for their telehealth visits. Patient visits were defined as new, established, or follow-up. New patient visits were patients not having received any previous medical care from MCC; established patient visits had received care at MCC previously but were referred to a new subspecialty for consultation; and follow-up patient visits were seen at MCC for follow-up care by clinicians in the same subspecialty they had previously received care from.

Statistical Analysis

We assessed patient time, travel, and indirect cost savings from using telehealth for cancer care delivery (Figure 1). Analyses were guided by the framework recommended by Sanders and colleagues9 for assessing the time and transportation costs of patients. Time savings were calculated as the difference between the roundtrip time required to travel from each patient’s home address to an in-person consultation at MCC, plus in-person consultation time vs the time required to attend a telehealth visit from home (ie, time savings = roundtrip drive time + [time for in-person consultation – time for telehealth visit]). Travel savings were calculated as the roundtrip driving distance in miles from each patient’s home address to an in-person consultation at MCC. Indirect cost savings were calculated as the roundtrip costs associated with traveling from each patient’s home address to an in-person consultation at MCC. This included 2 components: the costs of travel and the potential loss of productivity due to the medical visit.

The American Community Survey (ACS)10 was used to determine census tract–level data for hourly median income per year. The census tract income data were then matched to the patient’s address. This analysis focused on patients younger than 65 years, because these patients were more likely to be employed full time than those aged 65 years or older.

Two different models were generated with a combination of 2 different mileage rates and hourly wage rates determined via ACS census tract level data. Driving distance traveled in miles was calculated in October 2021 by Buxton Company,11 an analytics organization that uses Alteryx’s12 analytic platform to provide geospatial data. Briefly, the locations are geocoded, and distance is calculated between the 2 geocoded locations by finding the route that results in the least amount of drive time between the 2 locations.

Calculations for different models were conducted using R (R Project for Statistical Computing).13 Details are available in the eMethods in Supplement 1. Data were analyzed from April 2020 to June 2021.

Results

A total of 25 496 telehealth visits for 11 688 patients were conducted for patients aged between 18 and 65 years during the study period. There were 4525 (3795 patients) new or established visits and 20 971 (10 049 patients) follow-up visits (Figure 2A). The eTable in Supplement 1 highlights the demographics of the telehealth visits. Median (IQR) age was 55.0 years (46.0-61.0) among the telehealth visits, with 15 663 visits (61.4%) being women, 18 443 visits (72.3%) having private insurance, and 18 360 (72.0%) visits by White non-Hispanic individuals. In travel, an estimated 3 789 963 roundtrip miles (804 969 for new or established visits and 2 984 994 for follow-up visits) were saved, equating to 75 055 hours (15 422 new or established visits and 59 633 for follow-up visits) of savings in total driving time. Per visit, telehealth was associated with mean (SD) savings of 148.6 (143.7) roundtrip travel miles and 2.9 (2.3) hours of roundtrip driving time (Table 1Figure 2B and 2C). An additional 29 626 hours of in-clinic visits were saved by using telehealth with a mean (SD) savings of 1.2 (0.13) hours per visit (Figure 2D). For new or established visits, telehealth was associated with mean (SD) savings of 177.6 (161.6) roundtrip travel miles, 3.4 (2.6) hours of roundtrip driving time and 1.5 (0.0) hours of in-clinic time per visit (Figure 2B, 2C, and 2D). For follow-up visits, telehealth was associated with mean (SD) savings of 142.4 (138.8) roundtrip travel miles, 2.8 (2.3) hours of roundtrip driving time and 1.1 (0.0) hours of in-clinic time per visit (Figure 2B, 2C, and 2D).

Telehealth was associated with an estimated $1 170 160 savings in lost productivity (income) due to driving time, $467 247 savings in lost productivity due to visit time, and $1 637 407 total savings in lost productivity (Table 2Figure 2B, 2C, and 2D). For new or established visits, the following savings were noted: $245 113 savings in lost productivity due to driving time, $104 522 savings in lost productivity due to visit time, and $349 655 total savings in lost productivity. For follow-up visits, the following savings were noted: $925 027 savings in lost productivity due to driving time, $362 725 savings in lost productivity due to visit time, and $1 287 752 total savings in lost productivity. Mean (SD) savings in lost productivity per visit due to driving time were $45.9 (41.5) per visit overall, and $54.1 (47.9) for new or established visits and $44.1 (39.7) for follow-up visits (Table 2Figure 3A). Mean (SD) savings per visit in lost productivity due to visit time was $18.3 (5.9) per visit overall, and $23.1 (6.9) for new or established visits and $17.3 (5.1) for follow-up visits. Estimated mean (SD) total savings per visit from lost productivity was $64.2 (43.6) per visit overall, $77.2 (50.6) for new or established visits, and $61.4 (41.4) for follow-up visits. Total driving-cost savings ranged from $2 122 379 at $0.56/mile (Figure 3B) to $3 107 777 at $0.82/mile (Figure 3C). For new or established visits, total driving-cost savings were $450 782 at $0.56/mile to $660 074 at $0.82/mile, while for follow-up visits, total driving-cost savings were $1 671 597 at $0.56/mile to $2 447 695 at $0.82/mile. According to cost models, the mean (SD) driving cost savings per visit ranged from $83.2 ($80.5) at $0.56/mile to $122.0 ($118.0) at $0.82/mile (Table 2Figure 3B and 3D). For new or established visits, the mean (SD) driving cost savings per visit ranged from $99.6 ($90.5) at $0.56/mile to $146.0 ($132.6) at $0.82/mile, and for follow-up visits, the mean (SD) cost savings per visit was $79.7 ($77.7) at $0.56/mile to $116.7 ($113.8) at $0.82/mile. According to cost models, the mean (SD) total cost savings per visit ranged from $147.4 ($120.1) at $0.56/mile to $186.1 ($156.9) at $0.82/mile (Table 2Figure 3B and 3D). For new or established visits, the mean (SD) total cost savings per visit ranged from $176.6 ($136.3) at $0.56/mile to $222.8 ($177.4) at $0.82/mile, and for follow-up visits, the mean total cost savings per visit was $141.1 ($115.3) at $0.56/mile to $178.1 ($150.9) at $0.82/mile.

Discussion

This economic evaluation study uses a large data set collected at an NCI-Designated Comprehensive Cancer Center to estimate patients’ savings from using telehealth. From April 1, 2020, to June 30, 2021, a total of 25 496 telehealth visits were conducted. Telehealth was associated with a total savings of 3 789 963 roundtrip travel miles, which equates to traveling 152.2 times around the earth, and a total savings of 75 055 roundtrip drive hours, which equates to 8.6 calendar years. An additional 3.4 calendar years (29 626 hours) were saved in clinic visits by using telehealth. Depending on the visit types, mean savings in lost productivity per visit due to driving time ranged from $44.1 to $54.1, mean savings in lost productivity due to visit time ranged from $17.3 to $23.1, and mean total savings in lost productivity per visit ranged from $61.4 to $77.2. Mean driving cost savings per telehealth visits ranged from $79.71 to $146.0 depending on visit type and model used. Mean total cost savings per visit ranged from $141.1 to $222.8 depending on the visit type and model used.

Some of the main arguments for implementing telehealth are to increase access to care, patient convenience, and cost savings in outpatient clinics.14 Telehealth may also provide an opportunity to reduce emergency department visits, readmissions, and patient mortality.14 As patients’ financial costs of cancer care increase, telehealth may reduce their burden of travel including costs associated with parking and lodging, and lost income from missing work.

The burden of travel has been identified as an important factor that can change access to diagnosis, treatment of cancer and participation in clinical trials.15,16 Transportation is a key determinant of health care access and has been identified as an important source of out-of-pocket nonmedical costs for patients receiving cancer care.17 Patients without adequate transportation are more likely to miss appointments and rely on emergency department care,15 and there is substantial variability in the estimated parking costs throughout cancer treatment.18 In addition, a recent study noted that the number of rural hospitals has decreased over the last decade, resulting in almost double the number of people living outside a 60-minute radius of major hospitals and longer drive times to receive care.19 Thus, telehealth could be beneficial among rural patients in particular.20

In the models previously mentioned, we did not consider the cost savings of telehealth for cancer caregivers. Caregivers for patients with cancer spend substantial time and effort to coordinate and attend appointments with patients. In 2020, 53 million individuals were caregivers, 6% of whom were caregivers for patients with cancer. The vast majority of caregivers (80%) help with transportation; 18% report high financial strain; and 45% have experienced at least 1 financial impact as a result of caregiving.21 Although the current study was focused on indirect cost savings from patients’ perspectives, future studies should include caregivers’ indirect cost savings as often patients and caregivers function as a unit and share expenses. Therefore, savings from telehealth would be even higher if caregivers’ savings from lost productivity were accounted for, especially when telehealth has the ability for multiple caregivers to join the same appointment from various geographical locations.

Although telehealth offers considerable cost savings to patients with cancer, it is well documented that telehealth adoption is affected by the digital divide. Factors associated with financial toxicity (eg, age, insurance, race, and education) are also associated with the digital divide.22 Future studies are needed to address inequities in telehealth uptake. Additionally, telehealth requires substantial infrastructure costs and investments from health systems with buy-in from administrators and clinicians to ensure high patient satisfaction.23

Limitations

Our study has several limitations. This analysis was retrospectively conducted at a tertiary/quaternary referral center, and so roundtrip travel distances may be higher than usual because this is a destination center for cancer care. Our assumption of employment rates and incomes for patients younger than 65 years may vary. Additionally, a percentage of patients on active treatment or following treatment may not be fully employed given their functional status, thus affecting the savings from lost productivity. Because we were unable to accurately capture employment among older adults, patients aged over 65 years were excluded; however, future studies should examine cost savings in this population. Cost savings due to lost productivity assumed that all patients are nonsalaried and the loss due to travel time and hours of visit time could not be made up for. Therefore, the savings in this study might be considered a maximum amount of lost productivity. This study only considered telehealth visits that were completed via synchronous videoconference, and the costs of electronic devices and internet access were not considered. This study also did not assess other factors likely to affect cost savings, such as rural vs urban residences, race, education, or insurance type, all of which should be explored in future studies. Finally, further data are needed if long-term oncologic outcomes with telehealth visits are equivalent to those seen in person, which can change costs of treatment.

Conclusions

Patients with cancer spend a substantial amount of time and money traveling to receive care. Using a large data set, we found that cancer care delivery via telehealth was associated with time, travel, and cost savings for patients with cancer, which may reduce the financial toxicity of cancer care. Future studies should explore other cost savings, such as the savings to cancer caregivers and how these vary for rural and urban patients with cancer.

Back to top

Article Information

Accepted for Publication: November 18, 2022.

Published: January 10, 2023. doi:10.1001/jamanetworkopen.2022.50211

Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2023 Patel KB et al. JAMA Network Open.

Corresponding Author: Krupal B. Patel, MD, MSc, Department of Head and Neck and Endocrine Oncology, Moffitt Cancer Center, 12902 Magnolia Dr, Tampa, FL 33612 (krupal.patel@moffitt.org).

Author Contributions: Dr Patel had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Patel, Alishahi Tabriz, Gonzalez, Wang, Spiess.

Acquisition, analysis, or interpretation of data: Patel, Turner, Gonzalez, Oswald, Nguyen, Hong, Jim, Nichols, Wang, Robinson, Naso.

Drafting of the manuscript: Patel, Nichols.

Critical revision of the manuscript for important intellectual content: Patel, Turner, Alishahi Tabriz, Gonzalez, Oswald, Nguyen, Hong, Jim, Wang, Robinson, Naso, Spiess.

Statistical analysis: Patel, Wang, Naso.

Obtained funding: Patel.

Administrative, technical, or material support: Patel, Turner, Alishahi Tabriz, Gonzalez, Robinson, Naso.

Supervision: Patel, Gonzalez, Jim, Nichols.

Conflict of Interest Disclosures: Dr Gonzalez reported receiving personal fees from Sure Med Compliance and personal fees from Elly Health outside the submitted work. Dr Jim reported being a consultant for Janssen Scientific Affairs and Merck, and reported receiving grants from Kite Pharma outside the submitted work. Dr Spiess reported being the Vice Chair of the National Comprehensive Cancer Network Penile/Bladder Guidelines Panel, President of the Global Society of Rare GU Tumors, and a board member of the Societe of Internationale D’Urologie Journal outside the submitted work; none of these roles are compensated. No other disclosures were reported.

Data Sharing Statement: See Supplement 2.

Additional Contributions: The authors would like to acknowledge the members of Moffitt Cancer Center’s Planning and Market Data Analytics Department for their help with data curation and analysis, and April Manna, MS, for administrative assistance. Editorial assistance was provided by the Moffitt Cancer Center’s Office of Scientific Publishing by Gerard Hebert, MA, and Daley Drucker, BA. No compensation was given beyond their regular salaries. We would also like to thank donors to the COVID-19 Fund at Moffitt Cancer Center for their generous support, which helped to fund research to improve the quality and cost savings offered through Virtual Health.

References

1.

Witte  J, Mehlis  K, Surmann  B,  et al.  Methods for measuring financial toxicity after cancer diagnosis and treatment: a systematic review and its implications. ï»¿  Ann Oncol. 2019;30(7):1061-1070. doi:10.1093/annonc/mdz140PubMedGoogle ScholarCrossref

2.

Zafar  SY, Abernethy  AP.  Financial toxicity, part I: a new name for a growing problem. ï»¿  Oncology (Williston Park). 2013;27(2):80-81.PubMedGoogle Scholar

3.

Yabroff  KR, Zhao  J, Zheng  Z, Rai  A, Han  X.  Medical financial hardship among cancer survivors in the United States: what do we know? What do we need to know? ï»¿  Cancer Epidemiol Biomarkers Prev. 2018;27(12):1389-1397. doi:10.1158/1055-9965.EPI-18-0617PubMedGoogle ScholarCrossref

4.

Yabroff  KR, Guy  GP  Jr, Ekwueme  DU,  et al.  Annual patient time costs associated with medical care among cancer survivors in the United States. ï»¿  Med Care. 2014;52(7):594-601. doi:10.1097/MLR.0000000000000151PubMedGoogle ScholarCrossref

5.

Yabroff  KR, Davis  WW, Lamont  EB,  et al.  Patient time costs associated with cancer care. ï»¿  J Natl Cancer Inst. 2007;99(1):14-23. doi:10.1093/jnci/djk001PubMedGoogle ScholarCrossref

6.

Yabroff  KR, Mariotto  A, Tangka  F,  et al.  Annual report to the nation on the status of cancer, part 2: patient economic burden associated with cancer care. ï»¿  J Natl Cancer Inst. 2021;113(12):1670-1682. doi:10.1093/jnci/djab192PubMedGoogle ScholarCrossref

7.

Novara  G, Checcucci  E, Crestani  A,  et al; Research Urology Network (RUN).  Telehealth in urology: a systematic review of the literature. how much can telemedicine be useful during and after the COVID-19 pandemic? ï»¿  Eur Urol. 2020;78(6):786-811. doi:10.1016/j.eururo.2020.06.025PubMedGoogle ScholarCrossref

8.

Husereau  D, Drummond  M, Augustovski  F,  et al.  Consolidated Health Economic Evaluation Reporting Standards (CHEERS) 2022 explanation and elaboration: a report of the ISPOR CHEERS II Good Practices Task Force. ï»¿  Value Health. 2022;25(1):10-31. doi:10.1016/j.jval.2021.10.008PubMedGoogle ScholarCrossref

9.

Sanders  GD, Neumann  PJ, Basu  A,  et al.  Recommendations for conduct, methodological practices, and reporting of cost-effectiveness analyses: second panel on cost-effectiveness in health and medicine. ï»¿  JAMA. 2016;316(10):1093-1103. doi:10.1001/jama.2016.12195
ArticlePubMedGoogle ScholarCrossref

10.

American Community Survey (ACS) 2019. Accessed November 30, 2022. https://www.census.gov/programs-surveys/acs

11.

Buxton Co. Accessed October 15, 2021. https://www.buxtonco.com/

12.

Alteryx. Accessed October 15, 2021. https://www.alteryx.com/

13.

R: a language and environment for statistical computing. 2019. Accessed November 30, 2022. https://www.R-project.org/

14.

Tuckson  RV, Edmunds  M, Hodgkins  ML.  Telehealth. ï»¿  N Engl J Med. 2017;377(16):1585-1592. doi:10.1056/NEJMsr1503323PubMedGoogle ScholarCrossref

15.

Ambroggi  M, Biasini  C, Del Giovane  C, Fornari  F, Cavanna  L.  Distance as a barrier to cancer diagnosis and treatment: review of the literature. ï»¿  Oncologist. 2015;20(12):1378-1385. doi:10.1634/theoncologist.2015-0110PubMedGoogle ScholarCrossref

16.

Nipp  RD, Lee  H, Gorton  E,  et al.  Addressing the financial burden of cancer clinical trial participation: longitudinal effects of an equity intervention. ï»¿  Oncologist. 2019;24(8):1048-1055. doi:10.1634/theoncologist.2019-0146PubMedGoogle ScholarCrossref

17.

Wolfe  MK, McDonald  NC, Holmes  GM.  Transportation barriers to health care in the United States: findings from the National Health Interview Survey, 1997-2017. ï»¿  Am J Public Health. 2020;110(6):815-822. doi:10.2105/AJPH.2020.305579Google ScholarCrossref

18.

Lee  A, Shah  K, Chino  F.  Assessment of parking fees at National Cancer Institute-designated cancer treatment centers. ï»¿  JAMA Oncol. 2020;6(8):1295-1297. doi:10.1001/jamaoncol.2020.1475
ArticlePubMedGoogle ScholarCrossref

19.

Diaz  A, Schoenbrunner  A, Pawlik  TM.  Trends in the geospatial distribution of inpatient adult surgical services across the United States. ï»¿  Ann Surg. 2021;273(1):121-127. doi:10.1097/SLA.0000000000003366PubMedGoogle ScholarCrossref

20.

Bynum  AB, Irwin  CA, Cranford  CO, Denny  GS.  The impact of telemedicine on patients’ cost savings: some preliminary findings. ï»¿  Telemed J E Health. 2003;9(4):361-367. doi:10.1089/153056203772744680PubMedGoogle ScholarCrossref

21.

National Alliance for Caregiving (NAC) in Collaboration with AARP. Caregiving in the US. May 2020. Accessed October 31, 2021. https://www.caregiving.org/wp-content/uploads/2021/01/full-report-caregiving-in-the-united-states-01-21.pdf

22.

Roberts  ET, Mehrotra  A.  Assessment of disparities in digital access among medicare beneficiaries and implications for telemedicine. ï»¿  JAMA Intern Med. 2020;180(10):1386-1389. doi:10.1001/jamainternmed.2020.2666
ArticlePubMedGoogle ScholarCrossref

23.

Turner  K, Bobonis Babilonia  M, Naso  C,  et al.  Health care providers’ and professionals’ experiences with telehealth oncology implementation during the COVID-19 pandemic: a qualitative study. ï»¿  J Med Internet Res. 2022;24(1):e29635. doi:10.2196/29635PubMedGoogle ScholarCrossref