PDF

J Cancer 2019; 10(24):5944-5954. doi:10.7150/jca.35785 This issue Cite

Research Paper

A novel and validated nomogram to predict overall survival for gastric neuroendocrine neoplasms

Sheng Zhang, Yi Xin Tong, Xin Hua Zhang, Yu Jie Zhang, Xiang Shang Xu, Ai Tang Xiao, Teng Fei Chao, Jian Ping Gong

Department of Gastrointestinal Surgery Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology Jie Fang Ave, No. 1095 Wuhan, China.

✉ Corresponding author: Dr. Jian Ping Gong MD PhD Department of Gastrointestinal Surgery Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology Jie Fang Ave, No. 1095 Wuhan, China, Tel: 86-27-83665216 Email: jp_gongcom More

Abstract

Background: This study aims to develop and validate an effective nomogram to estimate the individual outcome of patients with Gastric neuroendocrine neoplasms (G-NENs).

Methods: A total of 260 patients diagnosed with G-NENs at two medical centers were included, with 156 patients allocated as training set and 104 patients as validation. Predictive nomogram was constructed based on multivariate analyses using RMS package in R version. The predictive accuracy and discriminative ability were analyzed by C-index, risk group stratification and calibration curve, which was compared with other predictive systems for G-NENs.

Results: In multivariate analysis, age, Ki-67, mitoses, neutrophil to lymphocyte ratio, serum tumor marker and distant metastasis were significantly associated with overall survival. The constructed prognostic nomogram demonstrated a good calibration and discrimination value with 0.884 and 0.852 C-indices in training and validation dataset. Compare to World Health Organization (WHO) grading system (C-indices=0.760 and 0.732) and American Joint Committee on Cancer (AJCC) tumor-node-metastasis (TNM) staging system (C-indices=0.747 and 0.811), the nomogram displayed a better predictive accuracy.

Conclusions: The novel prognostic nomogram showed superior predictive value in overall survival of G-NENs. It might be a useful tool for clinicians in estimating individual survival in G-NENs patients.

Keywords: Gastric neuroendocrine neoplasm, Nomogram, Overall survival

Introduction

Gastric neuroendocrine neoplasms (G-NENs) are common type of gastroenteropancreatic neuroendocrine neoplasms (GEP-NENs), accounting for about 20% of all neuroendocrine neoplasms (NENs). ¹ Although G-NENs are relatively rare malignancies, the incidence of neuroendocrine tumors has increased recently. ¹ Compare to gastric cancer, G-NENs have better prognosis but the patients will still suffer from recurrence and metastasis. ^2,3 Consequently, it is both necessary and meaningful to explore an effective model to precisely evaluate overall survival of G-NEN patients in clinical practice.

Diversifications in biological behavior and clinical manifestation are predominant features of G-NENs. Thus, to clinically estimate the individual outcome of the G-NEN patients is very difficult. The grading system from World Health Organization (WHO)/European Neuroendocrine Tumor Society (ENETS) and the TNM staging system from the American Joint Committee on Cancer/Union for International Cancer Control (AJCC/UICC) are in use to evaluate outcomes of G-NEN patients. ^4-8 Studies have demonstrated that G grading and TNM staging are independent prognostic factors for survival and effective to predict outcomes of G-NEN patients. ^9-11 However, while these systems stratify patients into different prognostic groups, they fail to predict individual survival of G-NENs. Therefore, there is essential to develop a predictive model including more prognostic factors to estimate overall survival of G-NENs patients.

Nomogram is a calculating score combining clinical or laboratory parameters to predict individual outcome. ^12-14 Many nomograms have been developed to predict outcomes in various types of malignancies. ^15-18 Limited numbers of nomograms predicting lymph node metastasis of appendix NET or overall survival of pancreas and small intestine NETs have been reported. ^19-21 However, these models included very few prognostic factors. Recently, Fang et al analyzed 1183 GEP-NEN patients and constructed a comprehensive nomogram to predict overall survival. ²² Fang's nomogram included both pancreatic and gastrointestinal NETs, which might not be specific for clinical use. Therefore, we performed a multicenter retrospective analysis aiming to construct (training cohort) and validate (validation cohort) a novel survival prediction model to estimate prognosis of G-NENs patients. In addition, we also compared the predictive accuracy and discrimination ability of this model with current G grading, TNM staging system and Fang's nomogram mentioned above.

Materials and Methods

Study design and participants

A multicenter retrospective study was conducted involving two cohorts: a training cohort (score construction and internal validation) and an external validation cohort. Approvals for data collection and patient informed consent were obtained from Institutional Review Board (IRB) in two individual institutions.

For training cohort, we retrospectively collected data of 156 patients who were diagnosed with G-NENs between January 2000 and December 2010 at department of gastrointestinal-pancreatic surgery, 1^st affiliated hospital of Sun Yat-Sen University (SYSU). Pathological evidence of G-NENs were achieved from either curative/palliative operation or biopsy. Eligible patients were included based on the following criteria: histopathological confirmed diagnosis of G-NENs (site of the origin was classified as stomach including cardia, body, lesser or greater curvature, angle and antrum). The exclusion criteria were patients with non-gastric NETs, simultaneously with other malignant neoplasm, tumor of uncertain origin or patients with missing key data either in terms of clinical parameters or follow-up reports. The following information were retrospectively collected: 1. Demographic characteristics such as age, gender, primary location; 2. Clinical or laboratory characteristics such as neutrophil to lymphocyte ratio, serum tumor markers as carcinoembryonic antigen (CEA) and carbohydrate antigen 19-9 (CA19-9), tumor size, invasion depth (T), presence of lymph node metastases (N), presence of distant metastases (M), treatment; 3. Pathology characteristics such as ki-67 index, mitotic count, G grade were collected for identification of prognostic factors and construction of the nomogram. G grade was defined according to WHO 2010 classification system. ⁷ Low grade (G1) is defined as <2 mitoses/10 high power field (HPF) and/or <3% Ki-67 index; Intermediate grade (G2) is defined as 2-20 mitoses/10 HPF and/or 3-20% Ki-67 index; High grade (G3) is defined as >20 mitoses/10 HPF and/or >20% Ki-67 index. We performed telephone interviews or outpatient follow-ups every year. The follow-up period was measured from the time of diagnosis to the date of last follow-up (December 31^st, 2012) or death date. Overall survival (OS) is the primary endpoint measured from the time of confirmed diagnosis to the last follow-up date (or date of death).

For external validation cohort, we retrospectively collected information of 104 G-NEN patients who met the inclusion criteria at department of gastrointestinal surgery and department of oncology, Tongji Hospital of Huazhong University of Science and Technology (TJH) from April 2011 to December 2016. The same baseline clinical characteristics were collected and patients without data in any of the items in the constructed nomogram were excluded. The follow-up schedules and primary endpoints (OS) were the same as in the training cohort. The last follow-up date of validation cohort is August 31^st, 2018.

Assessment of NLR and serum tumor markers

The data of preoperative blood cell counts were collected from the electronic patient record systems. The NLR was calculated as the ratio of absolute neutrophil count divided by the lymphocyte count. Receiver operating characteristic (ROC) curve was performed to determine the optimal cut-off value of NLR. The value of serum tumor marker CEA and CA19-9 was also retrieved from electronic record system, the normal range of CEA and CA19-19 is 0-5μg/L and 0-34μg/L.

Development and validation of the predictive model

The predictive model was formulated based on the results of the multivariate Cox regression analysis using R language (version 3.1.1, http://www.r-project.org) via the design and survival packages: survival, mice, and Hmisc. ²³ Variables included in the predictive model were identified by a backward stepwise selection process with the Akaike information criteria. ²⁴

The performance of the predictive model was evaluated by measuring both discrimination and calibration using bootstraps with 1000 resamples in both training (internal validation) and validation (external validation) cohorts. Discrimination was evaluated with concordance index (C-index) which referred to the model's ability to accurately predict outcomes. The maximum C-index value is 1.0 which indicates that a perfect prediction ability of the nomogram whereas the value 0.5 indicates that it is a random chance to correctly predict the outcome of the nomogram. The larger the value of C-index was, the more accurate the model predicted. Calibration curves were applied to compare the predicted survival and the actual survival. ²⁵ For external validation of the nomogram, the total point of each patient was computed and used for Cox regression. C-index and calibration curves were also applied to evaluate the prognostic efficiency. Additionally, we used the decision curve analysis (DCA) and area under ROC curve (AUC) method to estimate the predictive precision of nomogram. ²⁶

Risk stratification and quality assessment

According to individual points calculated by the nomogram in both training and validation cohort, we divided patients into 3 risk groups (<25%, 25-75% and >75% percentile quartiles). We accessed the discrimination ability of the nomogram and applied the Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD) guideline for our nomogram. ²⁷ Every applicable item in the checklist of TRIPOD guideline was described and reported in this study (Supplemental Table S1).

Statistical analyses

Continuous variables were presented as medians (range) and analyzed with Student's t-test or Mann-Whitney U test. Categorical variables were reported as whole numbers and percentages. The Kaplan-Meier method was used to evaluate potential prognostic factors. In the univariate statistical analysis, factors associated with outcome was assessed by univariate logistic analysis for quantitative variables and χ2 test for qualitative variables. Only factors with p-value<0.1 in univariate analysis were included in the final multivariate analysis model. Multivariate Cox regression was employed to identify independent prognostic factors for OS and predictive model was formulated based on the results. We only reported variables included in the final model with hazard ratio (HR) and 95% confidence interval (CI). All statistical tests were performed in SPSS version 21 (IBM, Armonk, NY, USA) with a significance level of p-value<0.05.

Results

Patient baseline characteristics

A total 378 patients were identified and considered eligible for this study. After screening based on inclusion and exclusion criteria, 260 patients were included in final analysis, with 156 patients in the training cohort and 104 patients in the validation cohort. (Figure 1). Most patients were men (170/260, 68%) and the average age is 57±13.1 years old. The distribution of grade for G1, G2, G3 was 32.7% (85/260), 17.3% (45/260) and 50.0% (130/260) respectively. Lymph node metastasis and distal metastasis presented in 66.9% (174/260) and 17.7% (46/260) patients respectively. Curative operation was performed on 78.1% (203/260) patients. Palliative operation was defined as R1/R2 resection of the primary tumor site or patients with distant metastasis and underwent resection of the primary tumor. Within the whole cohort, 16.2% (42/260) patients underwent palliative operation and 5.8% (15/260) patients received no operations or systematic therapy. The median follow-up time was 48.4±1.6 months and 51.0±1.8 months in training and validation cohort. The median time for relapse was 36.7±1.5 months and 35.0±1.6 months in training and validation cohort. The 1-, 3-, 5-year OS rates were 98.1%, 67.3%, 57.2% in training cohort and 97.1%, 74.8%, 62.7% in validation cohort. Other characteristics were described in Table 1 and no significant differences were detected between training and validation cohorts.

Survival analysis and identification of risk factors in G-NENs

Risk factors for overall survival and relapse free survival identified from univariate analysis in training cohort were shown in Table 2. Kaplan-Meier analysis suggested that age (HR=1.042, 95%CI, 1.021-1.064, p<0.001), Ki67 (HR=1.030, 95%CI, 1.022-1.038, p<0.001), Mitoses (HR=1.013, 95%CI, 1.009-1.018, p<0.001), NLR (HR=6.327, 95%CI, 3.676-10.890, p<0.001), CEA/CA19-9 (HR=4.829, 95%CI, 2.837-8.218, p<0.001), T stage (HR=1.865, 95%CI, 1.101-3.161, p=0.021), distant metastasis (HR=6.260, 95%CI, 3.405-11.509, p<0.001), tumor size (HR=1.676, 95%CI, 1.009-2.785, p=0.046) were significantly associated with poor overall survival in G-NENs. Age (HR=1.053, 95%CI, 1.025-1.082, p<0.001), Ki67 (HR=1.032, 95%CI, 1.022-1.042, p<0.001), Mitoses (HR=1.019, 95%CI, 1.014-1.025, p<0.001), NLR (HR=7.997, 95%CI, 3.98-16.069, p<0.001), CEA/CA19-9 (HR=7.061, 95%CI, 3.562-13.995, p<0.001) were significantly associated with poor relapse free survival in G-NENs.

In the multivariate survival analysis, age, Ki67, mitoses, NLR, CEA/CA19-9 and distant metastasis were identified as independent prognostic factors for OS in G-NENs. The details of multivariate analysis of OS and RFS were listed in Table 2.

Construction and validation of the nomogram

The prognostic nomogram was constructed in training cohort based on multivariate analysis including six independent prognostic factors: age, Ki67, mitoses, NLR, CEA/CA19-9 and distant metastasis (Figure 2).

In the training cohort, our nomogram demonstrated a good ability to discriminate patients with good and poor prognoses with a C-index of 0.884 (95%CI, 0.846-0.922). As illustrated in Figure 3, the calibration plot showed a good agreement between actual observation and the nomogram prediction for probability of 1-year and 3-year overall survival.

To test the predictive value of the nomogram, we applied it in the validation cohort. The C-index of the nomogram was 0.852 (95%CI, 0.777-0.927). The calibration curve revealed consistency between actual and observed 1-year and 3-year overall survival(Figure 3).

 Figure 1 

Brief flow chart for patients included in the training and validation cohorts

 Figure 2 

Nomogram predicting the 3-year and 5-year overall survival in G-NENs

 Figure 3 

The calibration curve of nomogram in training (A & B) and validation cohorts (C & D). The calibration curve for predicting OS at 3 years (A for training cohort; C for validation cohort) and 5 years (B for training cohort; D for validation cohort) in G-NEN patients. The x axis represents the nomogram predicted survival rate and the y axis indicates the actual survival rate.

Comparison of nomogram with current predictive systems

We compared the predictive accuracy of our nomogram with both current G grading system and TNM staging system in G-NEN patients. In the training, the C-index values of WHO G grade system and AJCC TNM staging system were 0.760 (95%CI, 0.716-0.804) and 0.747 (95%CI, 0.689-0.723) respectively, which was significantly lower (P<0.001) than the C-index value of our nomogram. In validation cohort, the C-index of our nomogram is 0.852, which was also higher than the WHO G grade system (C-index=0.732, 95%CI, 0.660-0.804) and AJCC TNM staging system (C-index=0.811, 95%CI, 0.752-0.870). These results demonstrated that our nomogram, compared with the current G grading and TNM staging system, exhibited an enhanced discrimination in evaluating the prognosis of G-NEN patients (Supplemental Figure S1).

In addition, we applied the nomogram published by Fang in our training and validation cohort. ²² The C-index of Fang's nomogram was 0.751 (95%CI, 0.694-0.808) and 0.778 (95%CI, 0.703-0.853) in training and validation cohort, respectively, which indicated that our nomogram (C-index: 0.884 and 0.852) showed superior predictive value to Fang's in this data set.

Furthermore, we examined the survival prediction ability using AUC model. As demonstrated in Supplemental Figure 2, the AUCs of our nomogram were 0.922 (95%CI, 0.880-0.964) and 0.911 (95%CI, 0.856-0.966) in training and validation cohort, respectively. While the AUCs of WHO G grade system, AJCC TNM staging system and Fang's nomogram were 0.811 (95%CI, 0.745-0.877), 0.734 (95%CI, 0.647-0.835) and 0.767 (95%CI, 0.693-0.842) in training cohort, 0.774 (95%CI, 0.686-0.863), 0.787 (95%CI, 0.697-0.877) and 0.795 (95%CI, 0.708-0.881) in validation cohort (Supplemental Figure 2). These results suggested that our nomogram exhibited better predictive ability than current available prognosis models. The performance results of predictive models are summarized in Supplemental Table 2.

Risk stratification and clinical use of nomogram

We use DCAs to evaluate clinical usefulness of the constructed nomogram. Our results showed that the constructed nomogram has a better net benefit with higher threshold probabilities and improved performance for predicting 3-year and 5-year overall survival than G grade, TNM stage and Fang's nomogram both in training and validation cohorts (Figure 4). In training cohort, the mean risk score generated by the nomogram is 103±6. We categorized patients into 8 groups based on each individual score generated by the nomogram (Supplemental Table 3&4). To better distinguish and facilitate clinical use, we stratified patients into three distinct risk classes (low risk: <25th percentile, medium risk: 25-75th percentile, high risk: >75th percentile). In training cohort among 156 patients analyzed, 45 (28.8%), 51 (32.7%) and 60 (38.5%) patients were in low-risk, medium-risk and high-risk groups, respectively. As illustrated in Supplemental Figure 3A, the 5-year OS was 100.0%, 63.8% and 11.7% in low-, medium- and high-risk groups separately. Similarly, in validation cohort, 34 (32.7%), 40 (38.5%) and 30 (28.8%) patients were stratified into three risk group. The 5-year overall survival rate was 96.9%, 66.1% and 18.5% in three groups respectively (Supplemental Figure 3B).

Discussion

In this study a novel and clinical applicable nomogram was developed to predict survival for patients with G-NENs. The multivariable Cox regression analysis identified 6 variables as independent prognostic factors and a nomogram was created based on these factors. These 6 factors--Age (HR 1.030), Ki-67 (HR 1.013), Mitoses (HR 1.011), NLR (HR 2.346), Serum CEA/CA19-9 (HR 2.013) and distant metastasis (HR 7.023) --could be accessed by clinical or pathological examinations which were applicable for clinician to evaluate individual outcome in G-NEN patients. We applied the nomogram in an external validation dataset and proved that the nomogram has a good predictive value (C-index for calibration is 0.852, 95%CI 0.777-0.927).

The recent increasing incidence of neuroendocrine tumors is related to the development of diagnostic techniques and the rising public awareness of the disease. ¹ The large-scale Surveillance, Epidemiology, and End Results Program (SEER) study from United States in 2017 showed that the overall incidence rate for neuroendocrine tumors increased from 1.09 cases per 100,000 people per year in 1973 to 6.98 cases per 100,000 people per year in 2012. ^2-3 The two most well accepted prognostic systems for G-NENs are TNM classification from AJCC and G grade system from WHO in 2010. ^7,8 The former includes clinical parameters such as tumor characteristics (T), lymph node status (N), and distant metastasis (M), while the latter is based on pathological reports of mitoses count and Ki-67 index. In the present study, we developed a novel nomogram integrating more predictors accurately predict overall survival in G-NEN patients.

 Figure 4 

G-NENs decision curve analysis (DCA). Nomogram is compared with the G grade, AJCC TNM stage and Fang's nomogram, in terms of 3-year (A for training cohort; C for validation cohort) and 5-year (B for training cohort; D for validation cohort) overall survival.

We compared the predictive ability of our nomogram with G grade and TNM staging system. The C-indices of our nomogram were 0.884 and 0.852 in training and validation cohorts, which demonstrated better discrimination values than G grade (C-index 0.760 for training and 0.732 for validation cohort) and TNM staging (C-index 0.747 for training and 0.811 for validation cohort). More recently Fang et al published a novel nomogram with larger sample size (n=1183) including five variables (age, tumor size, differentiation, lymph node and distant metastasis) to predict overall survival in GEP-NEN patients. ²² We validated Fang's nomogram with our two independent cohorts. Our results showed that C-indices of Fang's nomogram were 0.751 and 0.778 in training and validation cohorts respectively, which were lower than our predictive nomogram (0.884 and 0.852). Furthermore, we distinguished G-NENs from other NENs and included more variables, which achieved a superior specificity and performance of discrimination.

Based on multivariate analysis, we included six variables in our final predictive nomogram. According to WHO 2010 classification, the cut-off values of Ki-67 index to categorize G1, G2 and G3 are <3%, 3-20% and >20% respectively. ⁷ Various studies have showed that Ki-67 index and mitoses count are independent prognostic factors for GEP-NENs. ^28-30 RGETNE study from Spain collected clinical information from 2813 GEP-NEN patients and found that 5-year OS rates for G1, G2 and G3 were 86%, 73% and 28% respectively. The multivariate analysis identified G3 (vs. G1/G2) as an independent prognostic factor (HR 2.333, 95%CI 1.668-3.264). ³¹ We applied Ki-67 and mitoses count as continuous variables which could more precisely predict the overall survival compare to categorical variables. Distant metastasis and age have also been reported as predictors for OS in GEP-NEN patients. ^31-33 The latest population-based investigation employing SEER database demonstrated that age ≥61yrs (HR 1.85, 95%CI 1.75-1.96) and distant metastasis (HR 5.05, 95%CI 4.64-5.50) showed a high correlation with overall survival. ¹ In our analysis, distant metastasis (M stage) was a strong prognostic factor (HR 7.023) and age also correlated to poor OS (HR 1.030) in G-NEN patients.

Moreover, we found that neutrophil to lymphocyte ratio (NLR) is an independent prognostic factor in G-NENs. The interactions between systemic inflammatory response and cancer development have been widely revealed in several studies. ^34-35 Recent studies also proved that high NLR is a poor prognostic factor in gastric and pancreatic neuroendocrine tumors. ^36-37 Our results showed that NLR is a predictor for overall survival in G-NENs and integrate it into the final nomogram. Another novel finding of our study is that we identified the elevation of serum tumor marker CEA/CA19-9 as a poor prognostic factor for G-NENs. Limited studies reported the predictive role of serum tumor marker in neuroendocrine tumors. Chen et al found the CEA and CA19-9 is elevated in 11.2% and 12.4% GEP-NENs patients. Elevated CEA or CA19-9 is a poor prognostic factor based on univariate analysis (P<0.001).³⁸ Our results are in accordance with the previous study and demonstrated that elevation of serum tumor marker CEA or CA19-9 is an independent poor prognostic factor for gastric NENs (HR 2.013).

Based on our nomogram, we stratified G-NEN patients into three risk groups. Our results showed that 5-year overall survival rates were significantly different among risk groups (100.0%, 63.8% and 11.7% in training cohort and 96.9%, 66.1% and 18.5% in validation cohort). Based on the risk stratification, our nomogram may provide evidence for clinicians to predict individuals with poor prognosis and suggest an intense surveillance schedule for the patients in high risk group.

In our training cohort, 21.8% (34/156) patients are with metastasis. Within these patients, 73.5% (25/34) underwent palliative operation. (Supplemental figure 4). Literatures reported that certain patients with metastatic neuroendocrine tumors may be beneficial from palliative operation. ^39-40 Therefore, we include patients with distant metastasis to widen the scope of the nomogram. The present study has several limitations that should be taken into consideration when we interpret and apply the nomogram. First, relatively small sample size might limit the scope of our investigation. Nevertheless, literatures reporting nomograms in predicting outcome in various type of neuroendocrine tumors includes similar number of patients in development of the predictive model. ^41-43 Therefore, it should be a reasonable number of patients in the training cohort of the present study. Second, due to the retrospective nature of two cohorts, our nomogram might inevitably have selection bias. Our nomogram did not include some potential prognostic factors such as serum CgA since these data were incomplete in our two datasets. ⁴⁴ Therefore, further multicenter prospective studies with larger sample size are needed to validate and confirm our nomogram.

Despite the limitations mentioned above, there are still many valuable implications of this nomogram. First, the present study for the first time evaluated the independent prognostic factors in G-NENs, constructed and validated a convenient predictive model for clinical use. Second, we proved that our nomogram, integrated 6 variables, showed a superior predictive capability to current evaluation models. In conclusion, this nomogram can help physicians to predict specific individual overall survival in G-NENs and select high risk patients for more intense surveillance.

Supplementary Material

Supplementary figures and tables.

Acknowledgements

We thank Ms. Cheng Chen for English grammatical correction of this manuscript. This research is supported by grant from the National Natural Science Foundation of China (No.81201820).

Author Contributions

All authors participated in the study design. All authors have agreed on the final version and meet the major criteria recommended by the ICMJE (http://www.icmje.org/).

Ethical approval

Ethics committee of Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology.

Competing Interests

The authors have declared that no competing interest exists.

References

1. Dasari A, Shen C, Halperin D, Zhao B, Zhou S, Xu Y. et al. Trends in the Incidence, Prevalence, and Survival Outcomes in Patients With Neuroendocrine Tumors in the United States. JAMA Oncol. 2017;3:1335-1342

2. Turaga KK, Kvols LK. Recent progress in the understanding, diagnosis, and treatment of gastroenteropancreatic neuroendocrine tumors. CA Cancer J Clin. 2011;61:113-32

3. Fang C, Wang W, Zhang Y, Feng X, Sun J, Zeng Y. et al. Clinicopathologic characteristics and prognosis of gastroenteropancreatic neuroendocrine neoplasms: a multicenter study in South China. Chin J Cancer. 2017;36:51

4. Rindi G, Klöppel G, Alhman H, Caplin M, Couvelard A, de Herder WW. et al. TNM staging of foregut (neuro) endocrine tumors: a consensus proposal including a grading system. Virchows Arch. 2006;449:395-401

5. Rindi G, Klöppel G, Couvelard A, Komminoth P, Körner M, Lopes JM. et al. TNM staging of midgut and hindgut (neuro) endocrine tumors: a consensus proposal including a grading system. Virchows Archiv. 2007;451:757-62

6. Kulke MH, Shah MH, Benson AB 3rd, Bergsland E, Berlin JD, Blaszkowsky LS. et al. National comprehensive cancer network. Neuroendocrine tumors. 2018 version 2

7. Bosman FT, Carneiro F. et al. WHO Classification of Tumours of the Digestive system 4^th edn Vol. 3. Lyon: International Agency for Research on Cancer (IARC) press. 2010

8. Edge S, Byrd D, Compton C, Fritz A, Greene F, Trotti A. AJCC cancer staging manual, 8th ed. Chicago, IL, USA: Springer. 2018

9. Scarpa A, Mantovani W, Capelli P, Beghelli S, Boninsegna L, Bettini R. et al. Pancreatic endocrine tumors: improved TNM staging and histopathological grading permit a clinically efficient prognostic stratification of patients. Mod Pathol. 2010;23:824-833

10. Zhang M, Zhao P, Shi X, Zhao A, Zhang L, Zhou L. Clinicopathological features and prognosis of gastroenteropancreatic neuroendocrine neoplasms in a Chinese population: a large, retrospective single-centre study. BMC Endocrine Disorders. 2017;17:39

11. Clift AK, Faiz O, Goldin R, Martin J, Wasan H, Liedke MO. et al. Predicting the survival of patients with small bowel neuroendocrine tumours: comparison of 3 systems. Endocrine Connections. 2017;6:71-81

12. Touijer K, Scardino PT. Nomograms for staging, prognosis, and predicting treatment outcomes. Cancer. 2009;115:3107-11

13. Balachandran VP, Gonen M, Smith JJ, DeMatteo RP. Nomograms in oncology: more than meets the eye. Lancet Oncol. 2015;16:e173-80

14. Kattan MW, Scardino PT. Evidence for the usefulness of nomograms. Nat Clin Pract Urol. 2007;4:638-9

15. Rose PG, Java J, Whitney CW, Stehman FB, Lanciano R, Thomas GM. et al. Nomograms predicting progression-free survival, overall survival, and pelvic recurrence in locally advanced cervical cancer developed from an analysis of identifiable prognostic factors in patients from nrg oncology/gynecologic oncology group randomized trials of chemoradiotherapy. Journal of Clinical Oncology. 2015;33:2136-42

16. Wang Y, Li J, Xia Y, Gong R, Wang K, Yan Z. et al. Prognostic nomogram for intrahepatic cholangiocarcinoma after partial hepatectomy. J Clin Oncol. 2013;31:1188-95

17. Wan G, Gao F, Chen J, Li Y, Geng M, Sun L. et al. Nomogram prediction of individual prognosis of patients with hepatocellular carcinoma. BMC Cancer. 2017;17:91

18. Jiang Y, Li T, Liang X, Hu Y, Huang L, Liao Z. et al. Association of adjuvant chemotherapy with survival in patients with stage II or III gastric cancer. JAMA Surg. 2017;152:e171087

19. Mosquera C, Fitzgerald TL, Vora H, Grzybowski M. Novel nomogram combining depth of invasion and size can accurately predict the risk for regional nodal metastases for appendiceal neuroendocrine tumors (A-NET). J Surg Oncol. 2017;116:651-57

20. Ellison TA, Wolfgang CL, Shi C, Cameron JL, Murakami P, Mun LJ. et al. A single institution's 26-year experience with nonfunctional pancreatic neuroendocrine tumors: a validation of current staging systems and a new prognostic nomogram. Ann Surg. 2014;259:204-12

21. Modlin IM, Gustafsson BI, Pavel M, Svejda B, Lawrence B, Kidd M. A nomogram to assess small-intestinal neuroendocrine tumor ('carcinoid') survival. Neuroendocrinology. 2010;92:143-57

22. Fang C, Wang W, Feng X, Sun J, Zhang Y, Zeng Y. et al. Nomogram individually predicts the overall survival of patients with gastroenteropancreatic neuroendocrine neoplasms. Br J Cancer. 2017;117:1544-50

23. Iasonos A, Schrag D, Raj GV, Panageas KS. How to build and interpret a nomogram for cancer prognosis. J Clin Oncol. 2008;26:1364-70

24. Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15:361-87

25. Huitzil-Melendez FD, Capanu M, O'Reilly EM, Duffy A, Gansukh B, Saltz LL. et al. Advanced hepatocellular carcinoma: which staging systems best predict prognosis? J Clin Oncol. 2010;28:2889-95

26. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29-36

27. Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD Statement. Ann Intern Med. 2015;162:55-63

28. Pape UF, Jann H, Müller-Nordhorn J, Bockelbrink A, Berndt U, Willich SN. et al. Prognostic relevance of a novel TNM classification system for upper gastroenteropancreatic neuroendocrine tumors. Cancer. 2008;113:256-65

29. Durante C, Boukheris H, Dromain C, Duvillard P, Leboulleux S, Elias D. et al. Prognostic factors influencing survival from metastatic (stage IV) gastroenteropancreatic well-differentiated endocrine carcinoma. Endocr Relat Cancer. 2009;16:585-97

30. Lim T, Lee J, Kim JJ, Lee JK, Lee KT, Kim YH. et al. Gastroenteropancreatic neuroendocrine tumors: incidence and treatment outcome in a single institution in Korea. Asia Pac J Clin Oncol. 2011;7:293-9

31. Nuñez VB, Carmona BA, Jimenez FP, Capdevila J, Castaño PÁ, Benavent M. et al. Neuroendocrine Tumor Heterogeneity Adds Uncertainty to the World Health Organization 2010 Classification: Real-World Data from the Spanish Tumor Registry (R-GETNE). Oncologist. 2018;23:422-32

32. Özaslan E, Demir S, Karaca H, Güven K. Evaluation of the concordance between the stage of the disease and Ki-67 proliferation index in gastroenteropancreatic neuroendocrine tumors. Eur J Gastroenterol Hepatol. 2016;28:836-41

33. Pape UF, Berndt U, Müller-Nordhorn J, Böhmig M, Roll S, Koch M. et al. Prognostic factors of long-term outcome in gastroenteropancreatic neuroendocrine tumors. Endocr Relat Cancer. 2008;15:1083-97

34. Zheng J, Cai J, Li H, Zeng K, He L, Fu H. et al. Neutrophil to lymphocyte ratio and platelet to lymphocyte ratio as prognostic predictors for hepatocellular carcinoma patients with various treatments: a meta-analysis and systematic review. Cell Physiol Biochem. 2017;44:967-81

35. Bowen RC, Little NAB, Harmer JR, Ma J, Mirabelli LG, Roller KD. et al. Neutrophil-to-lymphocyte ratio as prognostic indicator in gastrointestinal cancers: a systematic review and meta-analysis. Oncotarget. 2017;8:32171-89

36. Cao LL, Lu J, Lin JX, Zheng CH, Li P, Xie JW. et al. A novel predictive model based on preoperative blood neutrophil-to-lymphocyte ratio for survival prognosis in patients with gastric neuroendocrine neoplasms. Oncotarget. 2016;7:42045-58

37. Gaitanidis A, Patel D, Nilubol N, Tirosh A, Sadowski S, Kebebew E. Markers of systemic inflammatory response are prognostic factors in patients with pancreatic neuroendocrine tumors (PNETs): A prospective analysis. Ann Surg Oncol. 2018;25:122-130

38. Chen L, Zhang Y, Chen M, Chen J. Prognostic value of carcinoembryonic antigen, alpha fetoprotein, carbohydrate antigen 125 and carbohydrate antigen 19-9 in gastroenteropancreatic neuroendocrine neoplasms. Chin J Gastrointest Surg. 2017;20:1002-08

39. Lesurtel M, Nagorney DM, Mazzaferro V, Jensen RT, Poston GJ. When should a liver resection be performed in patients with liver metastases from neuroendocrine tumours? A systematic review with practice recommendations. HPB (Oxford). 2015;17:17-22

40. Mayo SC, de Jong MC, Pulitano C, Clary BM, Reddy SK, Gamblin TC. et al. Surgical management of hepatic neuroendocrine tumor metastasis: results from an international multi-institutional analysis. Ann Surg Oncol. 2010;17:3129-36

41. Cao LL, Lu J, Lin JX, Zheng CH, Li P, Xie JW. et al. Nomogram based on tumor-associated neutrophil-to-lymphocyte ratio to predict survival of patients with gastric neuroendocrine neoplasms. World J Gastroenterol. 2017;23:8376-86

42. Ruzzenente A, Bagante F, Bertuzzo F, Aldrighetti L, Ercolani G, Giuliante F. et al. A Novel Nomogram to Predict the Prognosis of Patients Undergoing Liver Resection for Neuroendocrine Liver Metastasis: an Analysis of the Italian Neuroendocrine Liver Metastasis Database. J Gastrointest Surg. 2017;21:41-48

43. Liang W, Yang P, Huang R, Xu L, Wang J, Liu W. et al. A Combined Nomogram Model to Preoperatively Predict Histologic Grade in Pancreatic Neuroendocrine Tumors. Clin Cancer Res. 2019;25:584-94

44. Chan DL, Clarke SJ, Diakos CI, Roach PJ, Bailey DL, Singh S. et al. Prognostic and predictive biomarkers in neuroendocrine tumours. Crit Rev Oncol Hematol. 2017;113:268-82

Author contact

Corresponding author: Dr. Jian Ping Gong MD PhD Department of Gastrointestinal Surgery Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology Jie Fang Ave, No. 1095 Wuhan, China, Tel: 86-27-83665216 Email: jp_gongcom

Received 2019-4-16
Accepted 2019-8-23
Published 2019-10-15

Citation styles

©2025 Ivyspring International Publisher. Terms of use