1. Division of Gastroenterology and Hepatology, Key Laboratory of Gastroenterology and Hepatology, Ministry of Health, Renji Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai Institute of Digestive Disease, Shanghai, China
2. Department of General Surgery, Shanghai Ninth People's Hospital, School of Medicine, Shanghai Jiao Tong University, Baoshan, 201999, Shanghai, China
3. Department of Neurosurgery, Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, Zhejiang, China.
4. Dipartimento Scienze Gastroenterologiche ed Endocrino-Metaboliche, Fondazione Policlinico Universitario A. Gemelli IRCCS -Università Cattolica del Sacro Cuore, Roma, Italy Largo F. Vito, 100168 Rome, Italy.
5. School of Public Health, Shanghai Jiaotong University School of Medicine, South Chongqing Road No, Shanghai 227, China.
* contributed equally to this work.
Background and aim: To construct proper and externally validate cut-off points for log odds of positive lymph nodes scheme (LODDS) staging scheme in colorectal cancer (CRC).
Patients and methods: The X-tile approach was used to find the cut-off points for the novel LODDS staging scheme in 240,898 patients from the Surveillance, Epidemiology and End Results (SEER) database and externally validated in 1,878 from the international multicenter cohort. Kaplan-Meier plot and multivariate Cox proportional hazard models were performed to investigate the role of the novel LODDS classification.
Results: The prognostic cut-off values were determined as -2.18, and -0.23 (P< 0.001). Patients had 5-year cancer-specific survival rates of 83.8%, 57.4% and 24.4% with increasing LODDS (P< 0.001) in the SEER database. Five-year overall survival rates were 77.2%, 55.0% and 26.7% with increasing LODDS (P< 0.001) in the external international multicenter cohort. Multivariate survival analysis identified both the LODDS classification, the patient's age, the T category, the M status, and the tumor grade as independent prognostic factors in both two independent databases. The analyses of the subgroup of patients stratified by tumor location (colon or rectum), number of retrieved lymph node (< 12 or ≥ 12), TNM stage III, lymph node-negative also confirmed the LODDS as independent prognostic factors (P< 0.001) in both two independent databases.
Conclusions: The novel LODDS classification was an independent prognostic factor for patients with CRCs and should be calculated for additional risk group stratification with pN scheme.
Keywords: Colorectal cancer, cause-specific survival, overall survival, log odds of positive lymph nodes, multicenter, SEER.
The presence of lymph node metastases (LNM) and the number of lymph node metastasis, also called the number of positive lymph node (pN), are robust risk factors in patients with colorectal cancers (CRCs) , which may determine subsequent adjuvant therapies and surveillance strategies [2, 3]. Based on the number of involved LNM, CRCs could be classified as pN0, pN1 (1-3 tumor invaded LNM), and pN2 (4 and more tumor invaded LNM) cancers .
Adequate lymph node histopathological assessment is of significant impact on accurate pN staging but the minimum of recommendations in the literature ranged significantly [5-7]. In order to avoid stage migration effect, adequate evaluation of the lymph node status is of great importance and, to date, the widely accepted minimum number of retrieved lymph nodes is 12 [8-10]. However, it was surprising that the reported numbers of retrieved lymph nodes (rN) in CRCs varied widely in published literatures, median ranging from 6 to 13 [11, 12], though precise recommendations and guidelines are available.
Considering inadequate examination of lymph nodes in nearly half of CRC patients, it is urgent to recommend new measures of lymph node status with combination of rN. To the best of our knowledge, two measures, namely lymph node ratio (LNR) , log odds of positive lymph nodes (LODDS)  have been proposed. Multiple studies have shown superiority of LNR to pN in accurately predicting patient's survival [13, 15]. Although LNR seems to be a superior predictor of survival in Stage III colorectal cancer [7, 15-18], the results remained controversial, particularly in CRC with no LNM and inadequate rN. In node-negative CRCs accounting for more than half of CRCs , LNR0, same to pN0 classification, does not provide any more additional prognostic evaluation than pN0. In this situation, patients with no LNM may be at high risk of understaging with lack of adequate of rN and incorrect choice of postoperative adjuvant treatments after surgery may be made.
LODDS has been recently proposed as a new prognostic index in CRCs [14, 20-23], showing powerful ability to classify patients into different groups with homogeneous survival, regardless of lymph node status and count. However, different methods were used in different studies to determine their cut-off LODDS values. Three studies used statistical methods to calculate cut-off values in limited numbers of patients [14, 21, 23]. Two studies even used arbitrary classification for investigation [20, 22]. Though Song's study  used the statistical method to calculate cut-off values in relative large number of CRC patients, its cut-off values were not validated in other populations.
In the present study, we aimed to find optimal categorization of LODDS values using X-tile approach in a large population-based database involving 240,898 CRCs and validate our determined LODDS cut-off values in the international multicenter cohort, providing a more precise lymph node staging scheme for patients with CRCs.
Patients with CRCs from Surveillance, Epidemiology, and End Results (SEER) database were created and collected through query to the latest version of the SEER 18 Regs Research data (1973-2014), released in April 2017 with the SEER*Stat 8.3.5 software. The inclusion criteria for selected patients were as follows: 1) Patients aged 18 years old or more diagnosed between 1988 and 2010; 2) Patients with CRCs diagnosed as the only primary cancers without multiple primary cancers elsewhere; 3) Patients with cancers diagnosed microscopically, in whom surgery for primary cancers and regional lymph node resection had been performed with pathological examination of at least one lymph node; 4) International Classification of Diseases for Oncology third edition (ICD-O-3) codes were used as 8010-8231 and 8255-8576 for CRCs; 5) Patients with active follow-up for at least 2 months. Patients were excluded if they received radiotherapy before surgery or CRC was not the only one primary carcinoma or the number of retrieved lymph nodes and positive lymph nodes were missing.
For SEER database, cancer-specific survival (CSS) was defined as death due to CRC and OS was defined as death regardless of any causes. The primary outcome was CSS with OS and CSS considering competing death due to non-CRC death as the secondly outcome. Survival time was defined as the time from diagnosis to the date of death or last contact or Nov 2016.
Since SEER database is public-use data, no institutional review was required, and we have been allowed to access SEER database for only research using the private SEER ID (zhangqw).
An independent international multicenter cohort from three medical centers was used as validation group using the same inclusion and exclusion criteria. Patients who underwent colectomy for histopathological confirmed CRC from February 2004 to March 2017 in Renji Hospital of of Shanghai Jiao Tong University, Shanghai Ninth People's Hospital of Shanghai Jiao Tong University and from January 2004 to April 2017 in Catholic University of Rome were selected. The follow-up time in the two Chinese hospitals was every 6 months until death or study ended (30th March 2018), except for those lost to follow-up. For patients in the Catholic University of Rome, the patients were followed up until death or study end (30th April 2018) except for those lost to follow-up according to the European Society of Medical Oncology guidelines .
This study was approved by the Institutional Review Board in the all participating hospital.
Two values, namely pN and the number of negative lymph node (nN), were needed to calculate LODDS values. The pN value indicates the number of positive lymph node. rN value is defined as the number of retrieved lymph nodes for histological examination of lymph node metastasis status. The nN value is the absolute number of negative lymph node, which is calculated by subtracting pN value from the total number of rN value. The LODDS value is defined as loge ([pN + 0.5]/ [nN + 0.5]). As a continuous variable, LODDS values are then classified as a novel five-subgroup LODDS classification using proper cut-off points using the X-tile .
For descriptive statistics, the absolute number with proportion for categorical variable, mean and standard deviation for continuous variable with Gaussian distribution and median and interquartile range (IQR) for continuous variable with non-normally distribution were used respectively. The chi-square test for categorical variable, Student's t-test for continuous variable with Gaussian distribution and the nonparametric Kruskal-Wallis rank sum test for continuous variable with non-normally distributed data were used for comparisons among different patient groups respectively. The above descriptive statistics and exploratory comparisons were done using CBCgrps package .
For survival analysis, Kaplan-Meier method was performed to calculate and show survival rates in different patient groups with log-rank test used for statistical comparisons. Meanwhile, multivariate Cox regression models with variable selection procedures were used to explore potential risk factors associated with patient's survival. Besides, cumulative probability of CRC-specific death and multivariate regression modeling of subdistribution functions in competing risks were also performed for sensitivity analysis for our findings using cmprsk package . Five-year survival rate and hazard ratios (HRs) were calculated with 95% confidence intervals (CIs).
To determined optimal categorization of LODDS values, X-tile technique was used to define the optimal cut-off points by the log-rank test . Firstly, X-tile technique would divide the population into low-, medium- and high-level LODDS value by every possible cut-off. Then, survival between all possible divisions according to LODDS values were tested by the log-rank test. Finally, the optimal LODDS cut-off would be selected by selecting the highestχ2 value.
Statistical analyses and plotting graphics were conducted using R software package (version R-3.4.3, the R Foundation for statistical computing). All statistical comparisons were considered significant with P< 0.05.
With defined inclusion and exclusion criteria (Supplementary Figure 1), a total of 240,898 patients with CRCs were finally identified from the SEER database. As shown in the Table 1, the median number (IQR) of retrieved lymph nodes was 12 (7, 18) for the total patient group. The median number (IQR) of continuous LODDS value for the total patient group was -2.51 (-3.3, -1.21) and the follow-up time was 65 (26, 116) months.
With the same inclusion and exclusion criteria as SEER database, we identified 1,878 patients from the international multicenter cohort. In the international multicenter cohort, the median number (IQR) of retrieved lymph nodes was 10 (5, 14) for the total patient group. The median number (IQR) of continuous LODDS value for the total patient group was -2.51 (-3.3, -1.21) and the follow-up time was 48 (21, 75) months.
The remaining clinicalpathological characteristics for SEER database and the international multicenter cohort could be seen in the Table 1.
Characteristics of patients with colorectal cancer in Surveillance, Epidemiology, and End Results database (N= 240898) and the international multicenter cohort (N= 1878).
|No. of patients (Percent)|
|SEER database||multicenter cohort|
|Sex||Female||125827 (52.23%)||811 (43.23%)|
|Male||115071 (47.77%)||1065 (56.77%)|
|Age (year)||Median (IQR)||69 (59, 78)||68 (59, 76)|
|< 60||64750 (27%)||489 (26.26%)|
|≥ 60||176148 (73%)||1373 (73.74%)|
|Tumor size (cm)||Median (IQR)||4.40 (3.00, 6.00)||4.50 (3.50, 6.00)|
|≤ 2||24020 (11.18%)||116 (6.24%)|
|≤ 3||34309 (15.96%)||269 (14.47%)|
|≤ 5||85233 (39.65%)||823 (44.27%)|
|> 5||71390 (33.21%)||651 (35.02%)|
|Tumor site||Proximal colon||119078 (50.13%)||604 (32.46%)|
|Distal colon||79834 (33.61%)||779 (41.86%)|
|Rectum||38642 (16.27%)||478 (25.69%)|
|Histology||Adenocarcinoma||211146 (87.65%)||1688 (89.83%)|
|Mucinous adenocarcinoma||25809 (10.71%)||186 (9.91%)|
|Signet ring cell carcinoma||2371 (0.65%)||4 (0.21%)|
|Grade||Well/Moderately differentiated||182915(79.67%)||1327 (71.89%)|
|Poorly or undifferentiated||46663 (20.33%)||519 (28.11%)|
|7th T stage||T1||31113 (14.21%)||113 (6.09%)|
|T2||35099 (16.03%)||219 (11.81%)|
|T3||124422 (56.82%)||1246 (67.17%)|
|T4||28372 (12.94%)||277 (14.93%)|
|7th M stage||M0||203532 (84.83%)||1739 (92.60%)|
|M1||36400 (15.17%)||137 (7.29%)|
|Total no. of nodes retrieved||Median (IQR)||12 (7, 18)||10 (5, 14)|
|No. of negative nodes (nN)||Median (IQR)||10 (6, 16)||8 (4, 13)|
|No. of positive nodes (pN)||Median (IQR)||0 (0, 2)||0 (0, 2)|
|7th N stage (7th pN)||N0||141131 (58.59%)||1131 (60.22%)|
|N1||58625 (24.33%)||496 (26.41%)|
|N2||41142 (17.07%)||251 (13.37%)|
|LODDS||Median (IQR)||-2.51 (-3.3, -1.21)||-2.20 (-3.13, -1.10)|
|LODDS classification||≤ -2.18||141403(58.70%)||1031 (54.90%)|
|-2.18 - -0.23||69821 (28.98%)||616 (32.80%)|
|> -0.23||29674 (12.32%)||231 (12.30%)|
|Follow-up (months)||Median (IQR)||65 (26, 116)||48 (21, 75)|
LODDS: log odds of positive lymph nodes; NA: not available; IQR: interquartile range.
The X-tile analysis finally identified optimal thresholds of LODDS. The novel LODDS group classified by the cut-off values of -2.18, -0.23 showed the highestχ2 value for the CSS. Therefore, a novel LODDS classification subgroup was determined in this study using the above LODDS cut-off points: LODDS1 (-2.18 or less), LODDS2 (more than -2.18 to -0.23) and LODDS3 (more than -0.23).
We explored association between LODDS classification subgroup and clinical and histopathological characteristics. Results (Table 2) showed positive correlation of LODDS classification with T stage (P< 0.001), N stage (P< 0.001), M stage (P< 0.001), pN (P< 0.001) and negative correlation with nN (P< 0.001), which supported rationality of the novel LODDS group. Of 240,898 patients analyzed, 141,403 (58.70%) patients were classified as LODDS1 group with 5-year CSS of 83.8% (83.6%-84.0%), 69,821 (28.98%) patients were classified as LODDS2 group with 5-year CSS of 57.4% (57.0%- 57.8%), 29,674 (12.32%) patients were classified as LODDS3 group with 5-year CSS of 24.4% (23.9%-24.9%). Therefore, increased LODDS classification had significant positive association with poor CSS (Figure 1A, P< 0.001). Besides, increased LODDS classification had significant positive association with poor OS (Figure 1B, P< 0.001) and higher cumulative probability of cancer-specific death (Figure 1C, P< 0.001).
Comparison of log odds of positive lymph nodes distribution with histopathological parameters in the SEER database and international database.
|SEER database||International multicenter database|
|Total||≤ -2.18||-2.18 - -0.23||> -0.23||P||Total||≤ -2.18||-2.18 - -0.23||> -0.23||P|
|N (%)||N (%)||N (%)||N (%)||N (%)||N (%)||N (%)||N (%)|
|T stage||< 0.001||< 0.001|
|N stage||< 0.001||< 0.001|
|rN||12(7,18)||14(9,20)||11(5,16)||10(6,15)||< 0.001||10(5,14)||11(7,15)||8(3,13)||7(4,11)||< 0.001|
|pN||0(0,2)||0(0,0)||2(1,3)||7(4,10)||< 0.001||0(0,2)||0(0,0)||1(0,3)||4(3,7)||< 0.001|
|nN||10(6,16)||14(9,20)||8(4,13)||3(1,5)||< 0.001||8(4,13)||11(7,14)||6(3,11)||2(1,4)||< 0.001|
|M stage||< 0.001||< 0.001|
SEER: Surveillance, Epidemiology, and End Results; rN: number of retrieved lymph nodes; pN: number of positive lymph node; nN: number of negative lymph node.
Cancer-specific survival (A), overall survival (B) and cumulative probability of Cancer-specific death (C) of 240, 898 patients in the Surveillance, Epidemiology, and End Results database and overall survival (D) of 1, 878 patients in the international multicenter cohort stratified according to the log odds of positive lymph nodes.
We next validated the novel LODDS classification in the international multicenter cohort. As is shown in the Table 2, LODDS classification also showed positive correlation with T stage (P< 0.001), N stage (P< 0.001), M stage (P< 0.001), pN (P< 0.001) and negative correlation with nN (P< 0.001) in the international multicenter cohort, which was consistent with findings in SEER database. Of 1,878 patients analyzed, 1,031 (54.90%) patients were classified as LODDS1 group with 5-year OS of 77.2% (74.4%-80.1%), 616 (32.80%) patients were classified as LODDS2 group with 5-year OS of 59.2% (54.3%-64.5%), 231 (12.30%) patients were classified as LODDS3 group with 5-year OS of 45.9% (39.0%-54.2%). Therefore, increased LODDS classification had significant positive association with poor OS (Figure 1D, P< 0.001).
We further explored whether the established LODDS classification could classify patients into groups with homogeneous survival. As is shown in the Table 3, there were no patients with N0 disease had an LODDS larger than -0.23. However, within the N0 subgroups, one can see a difference in 5-year OS between patients with LODDS1 (72.0% in the SEER database and 77.1% in the international multicenter cohort) and patients with LODDS2 (64.6% in the SEER database and 62.9% in the international multicenter cohort). These difference were highlighted in Table 3 and show the importance of the stratification of patients by our novel established LODDS classification.
Five-Year Survival Rates by LODDS
|SEER database||International multicenter database|
|Total||≤ -2.18||-1.06 - -0.23||> -0.23||Total||≤ -2.18||-1.06 - -0.23||> -0.23|
As is shown in the Figure 2, multivariate Cox model, which included LODDS classification and all potential risk factors, identified the LODDS classification (P< 0.001), sex (P< 0.001), race (P< 0.001), age (P< 0.001), tumor location (P< 0.001), grade (P< 0.001), histology (P< 0.001), T stage (P< 0.001), M stage (P< 0.001), and tumor size (P< 0.001) as independent prognostic factors. Similar results could be obtained using Multivariate Cox analysis with OS as outcome (Supplementary Figure 2) and multivariate regression modeling of subdistribution functions in competing risks (Supplementary Table 1). As is shown in the Figure 3, it was validated in the international multicenter cohort that LODDS classification, and all prognostic factors were identified as independent prognostic factors.
We next analyzed whether LODDS classification was also an independent risk factors in different subgroups using multivariate Cox regression in the SEER database and the international multicenter database. As is shown in Figure 4A, LODDS classification was identified as an independent risk factor in CRC with number of examined lymph nodes >=12, number of examined lymph nodes <12, 7th TNM stage III, colon cancer, rectal cancer or cancer without lymph node involvement. Similar results could be obtained in the international multicenter cohort (Figure 4B).
Forest plot showing results of multivariate Cox regression model for exploring potential risk factors with inclusion of covariate log odds of positive lymph nodes for cancer-specific survival in 240, 898 patients of the Surveillance, Epidemiology, and End Results database.
Forest plot showing results of multivariate Cox regression model for exploring potential risk factors for overall survival in 1,878 patients of the international multicenter cohort.
Forest plot showing subgroup analyses results of multivariate Cox regression model stratified by different characteristics in the Surveillance, Epidemiology, and End Results database and international multicenter database.
In this study, we presented a population-based analysis of 240,898 patients in SEER database and international multicenter analysis of 1,878 patients in three medical centers. Our analyses showed that LODDS was a powerful prognostic factor for CSS or OS in patients with CRCs in both SEER database and international multicenter cohort. We identified cut-off values -2.18 and -0.23 for LODDS classification. We demonstrated that the novel LODDS classification had significant prognostic impact on CSS or OS in SEER database and the present study was the first study to validate prognostic impact of the novel LODDS classification on survival in an independent cohort from 3 medical centers.
Although pN classification of AJCC TNM classification is the most commonly used staging system for CRCs, it only relies on the number of positive lymph node without the number of retrieved lymph node or the number of negative lymph node, which are also associated with survival [7, 13, 29]. Therefore, only when the rN is 12 or more, pN category could be regarded as accurate staging [30, 31]. However, case with less than 12 rN are not unusual in clinical practice, which lead to development of new lymph node staging schemes incorporating all the two lymph node information in one single variable. Among the schemes, LNR and LODDS are most promising classifications [13, 14]. During the last one decade, multiple studies have poured out that LNR was comparable and even superior to that of well-established prognostic factors, such as TNM classification, in CRCs [13, 15]. Unfortunately, LNR has some drawbacks: it do not provide any meaningful information in node-negative CRCs; it do not predict survival well in patients without adequate rN ; it also cannot discriminate survival difference among patients with all lymph nodes invaded. The other scheme LODDS could solve the above mentioned drawbacks of LNR.
To date, several groups have reported the prognostic impact of LODDS in colorectal cancer (Supplementary Table 2) [14, 20-23]. Of them, 3 studies used statistical methods to calculate cut-off values of LODDS for optimal discrimination. The first study  used running log-rank statistics to calculate using OS as primary outcome for CRCs in Chinese single-center cohort of limited number of 1297 patients. Our previous study  used log-rank test for optimization also using OS in only colon cancers in single-center cohort of limited number of 258 patients. The last study used regression trees technique for classification also using OS in CRCs in Chinese single-center cohort of limited number of 192 patients . The other 2 studies [20, 22] even used arbitrary cut-off values for optimization. None of LODDS cut-off values in these studies were validated in another independent cohort. Therefore, there is still lack of proper and accurate LODDS classification. This study was the first study to use the largest number of CRCs for optimization of LODDS using minimal P approach on X-tile software  with additionally external validation of determined LODDS cut-off values in an independent international cohort. Different from the above mentioned studies, our study used CSS as primary outcome instead of OS, since prognostic risk factors for CSS could more truly reflect death due to CRCs. Besides, we also tested our cut-off values for OS and CSS under competing risk model with positive results.
One of reason why LODDS is superior to pN or LNR is its prognostic classification of node-negative CRCs patients (pN0 or LNR0). In our study, we found our determined LODDS cut-off values could classify patients with node-negative CRCs into two homogeneous groups with significant prognostic difference, which were consistent with results in other studies [14, 22]. In the future, we will evaluate the three lymph node schemes in predicting survival in patients with CRCs to explore whether LODDS is superior to pN or LNR and potential mechanism deeply. Besides, we will try to build a new TNM stage system using our determined LODDS classification for survival optimization of CRCs patients.
Limitation should be discussed in this study. Firstly, it was a retrospective exploratory study based on SEER database and an independent multicenter cohort, clinical and histological characteristics may differ among different registers or hospitals. However, it was actually representative of clinical practice in the real world. Secondly, the follow-up time and number of patients in the independent multicenter cohort were shorter than those in SEER database. It would be better to externally validate our findings in another large multicenter-based cohort or population-based register with longer follow-up time. Thirdly, the study includes patients between 1988 and 2010 when the standard of care for these patients has improved and thus the prognosis has changed. However, we did a subgroup analysis stratified by the time of diagnosis, and results showed patients with LODDS2 or LODDS3 still had poorer prognosis than patients with LODDS1, which indicated that time of diagnosis had limited impact on LODDS classification for prognosis of CRCs. However, our study was different from other studies about LODDS classification in CRCs of which only three [14, 21, 23] used the statistical method to find the optimal cut-off values for LODDS and none tested whether their LODDS classification still had significant impact on prognosis in the other independent validation datasets. We used the largest number of CRCs for optimization of LODDS using minimal P approach on X-tile software. We also used the international multicenter cohort to test whether our established LODDS classification still had significant impact on prognosis in the other independent validation datasets with positive results. In the future, we would also develop a novel prediction model based on our established LODDS classification.
In summary, the present study involved the largest number of CRCs to identify the optimal thresholds of LODDS and was the first study to evaluate the determined cut-off values of LODDS in an independent multicenter cohort. The LODDS classification, with cut-off values -2.18, and -0.23, was an independent prognostic factor in patients with CRCs regardless of tumor location, number of retrieved lymph node, stage III and node-negative cancers. LODDS could improve the prognostic power of current staging systems and should be documented additionally for cancer staging of CRCs.
Supplementary figures and tables.
The authors acknowledge the efforts of the SEER program in the creation of the SEER database.
This work was supported by grants from the National Natural Science Foundation of China (No.81670505, 81772519), Shanghai municipal education commission-Gaofeng clinical medicine grant support (DLY201501), Incubating Program for Clinical Research and Innovation of Ren Ji Hospital, School of Medicine, Shanghai Jiao Tong University (Grant No. PYMDT-001), Science and Technology Commission of Shanghai Municipality (Grant No. 16441906903), Three-year action plan for Shin Kang of Shanghai (16CR4005A, 16CR3113B), Shanghai Municipal Key Clinical Specialty (Grant No. shslczdzk05902).
The authors have declared that no competing interest exists.
1. Compton CC, Fielding LP, Burgart LJ, Conley B, Cooper HS, Hamilton SR. et al. Prognostic factors in colorectal cancer. College of American Pathologists Consensus Statement 1999. Archives of pathology & laboratory medicine. 2000;124:979-94
2. Watanabe T, Muro K, Ajioka Y, Hashiguchi Y, Ito Y, Saito Y. et al. Japanese Society for Cancer of the Colon and Rectum (JSCCR) guidelines 2016 for the treatment of colorectal cancer. International journal of clinical oncology. 2018;23:1-34
3. Kahi CJ, Boland CR, Dominitz JA, Giardiello FM, Johnson DA, Kaltenbach T. et al. Colonoscopy Surveillance After Colorectal Cancer Resection: Recommendations of the US Multi-Society Task Force on Colorectal Cancer. Gastroenterology. 2016;150:758-68 e11
4. Weiser MR. AJCC 8th Edition: Colorectal Cancer. Annals of surgical oncology. 2018;25:1454-5
5. Prandi M, Lionetto R, Bini A, Francioni G, Accarpio G, Anfossi A. et al. Prognostic evaluation of stage B colon cancer patients is improved by an adequate lymphadenectomy: results of a secondary analysis of a large scale adjuvant trial. Annals of surgery. 2002;235:458-63
6. Tepper JE, O'Connell MJ, Niedzwiecki D, Hollis D, Compton C, Benson AB 3rd. et al. Impact of number of nodes retrieved on outcome in patients with rectal cancer. Journal of clinical oncology: official journal of the American Society of Clinical Oncology. 2001;19:157-63
7. Johnson PM, Porter GA, Ricciardi R, Baxter NN. Increasing negative lymph node count is independently associated with improved long-term survival in stage IIIB and IIIC colon cancer. Journal of clinical oncology: official journal of the American Society of Clinical Oncology. 2006;24:3570-5
8. Chang GJ, Rodriguez-Bigas MA, Skibber JM, Moyer VA. Lymph node evaluation and survival after curative resection of colon cancer: systematic review. Journal of the National Cancer Institute. 2007;99:433-41
9. Kim HL, Puymon MR, Qin M, Guru K, Mohler JL. NCCN clinical practice guidelines in oncology™. 2014.
10. Feinstein AR, Sosin DM, Wells CK. The Will Rogers phenomenon. Stage migration and new diagnostic techniques as a source of misleading statistics for survival in cancer. The New England journal of medicine. 1985;312:1604-8
11. Baxter NN, Virnig DJ, Rothenberger DA, Morris AM, Jessurun J, Virnig BA. Lymph node evaluation in colorectal cancer patients: a population-based study. Journal of the National Cancer Institute. 2005;97:219-25
12. Wong SL, Ji H, Hollenbeck BK, Morris AM, Baser O, Birkmeyer JD. Hospital lymph node examination rates and survival after resection for colon cancer. Jama. 2007;298:2149-54
13. Berger AC, Sigurdson ER, LeVoyer T, Hanlon A, Mayer RJ, Macdonald JS. et al. Colon cancer survival is associated with decreasing ratio of metastatic to examined lymph nodes. Journal of clinical oncology: official journal of the American Society of Clinical Oncology. 2005;23:8706-12
14. Persiani R, Cananzi FC, Biondi A, Paliani G, Tufo A, Ferrara F. et al. Log odds of positive lymph nodes in colon cancer: a meaningful ratio-based lymph node classification system. World journal of surgery. 2012;36:667-74
15. Ceelen W, Van Nieuwenhove Y, Pattyn P. Prognostic value of the lymph node ratio in stage III colorectal cancer: a systematic review. Annals of surgical oncology. 2010;17:2847-55
16. Qiu HB, Zhang LY, Li YF, Zhou ZW, Keshari RP, Xu RH. Ratio of metastatic to resected lymph nodes enhances to predict survival in patients with stage III colorectal cancer. Annals of surgical oncology. 2011;18:1568-74
17. Vather R, Sammour T, Kahokehr A, Connolly AB, Hill AG. Lymph node evaluation and long-term survival in Stage II and Stage III colon cancer: a national study. Annals of surgical oncology. 2009;16:585-93
18. Kim YS, Kim JH, Yoon SM, Choi EK, Ahn SD, Lee SW. et al. lymph node ratio as a prognostic factor in patients with stage III rectal cancer treated with total mesorectal excision followed by chemoradiotherapy. International journal of radiation oncology, biology, physics. 2009;74:796-802
19. Ricciardi R, Madoff RD, Rothenberger DA, Baxter NN. Population-based analyses of lymph node metastases in colorectal cancer. Clinical gastroenterology and hepatology: the official clinical practice journal of the American Gastroenterological Association. 2006;4:1522-7
20. Wang J, Hassett JM, Dayton MT, Kulaylat MN. The prognostic superiority of log odds of positive lymph nodes in stage III colon cancer. Journal of gastrointestinal surgery: official journal of the Society for Surgery of the Alimentary Tract. 2008;12:1790-6
21. Fang HY, Yang H, He ZS, Zhao H, Fu ZM, Zhou FX. et al. Log odds of positive lymph nodes is superior to the number- and ratio-based lymph node classification systems for colorectal cancer patients undergoing curative (R0) resection. Molecular and clinical oncology. 2017;6:782-8
22. Arslan NC, Sokmen S, Canda AE, Terzi C, Sarioglu S. The prognostic impact of the log odds of positive lymph nodes in colon cancer. Colorectal disease: the official journal of the Association of Coloproctology of Great Britain and Ireland. 2014;16:O386-92
23. Song YX, Gao P, Wang ZN, Tong LL, Xu YY, Sun Z. et al. Which is the most suitable classification for colorectal cancer, log odds, the number or the ratio of positive lymph nodes?. PloS one. 2011;6:e28937
24. Schmoll HJ, Van Cutsem E, Stein A, Valentini V, Glimelius B, Haustermans K. et al. ESMO Consensus Guidelines for management of patients with colon and rectal cancer. a personalized approach to clinical decision making. Annals of oncology: official journal of the European Society for Medical Oncology. 2012;23:2479-516
25. Camp RL, Dolled-Filhart M, Rimm DL. X-tile: a new bio-informatics tool for biomarker assessment and outcome-based cut-point optimization. Clinical cancer research: an official journal of the American Association for Cancer Research. 2004;10:7252-9
26. Zhang Z. Univariate description and bivariate statistical inference: the first step delving into data. Annals of translational medicine. 2016;4:91
27. Fine JP, Gray RJ. A proportional hazards model for the subdistribution of a competing risk. Journal of the American statistical association. 1999;94:496-509
28. Huh JW, Kim YJ, Kim HR. Ratio of metastatic to resected lymph nodes as a prognostic factor in node-positive colorectal cancer. Annals of surgical oncology. 2010;17:2640-6
29. Wang J, Kulaylat M, Rockette H, Hassett J, Rajput A, Dunn KB. et al. Should total number of lymph nodes be used as a quality of care measure for stage III colon cancer?. Annals of surgery. 2009;249:559-63
30. Benson AB, Venook AP, Al-Hawary MM, Cederquist L, Chen Y-J, Ciombor KK. et al. NCCN guidelines insights: colon cancer, version 2.2018. Journal of the National Comprehensive Cancer Network. 2018;16:359-69
31. Benson AB, Venook AP, Al-Hawary MM, Cederquist L, Chen Y-J, Ciombor KK. et al. Rectal cancer, version 2.2018, NCCN clinical practice guidelines in oncology. Journal of the National Comprehensive Cancer Network. 2018;16:874-901
Corresponding author: Ou-Min Shi, email: shioumincom, phone: (021) 63846590. Zhi-Zheng Ge, email: zhizhenggecom, phone: (021) 58752345. Xiao-Bo Li, email: lxb_1969com, phone: (021) 58752345.