Skip to main content

Is remnant preservation in anterior cruciate ligament reconstruction superior to the standard technique? An overview of systematic reviews

Abstract

Background

Anterior cruciate ligament injury is a common knee joint injury. Anterior cruciate ligament reconstruction is a common surgical treatment to treat anterior cruciate ligament injury. It may have certain advantages to retain the ligament stump during the operation, but the results of systematic evaluation on whether to retain the ligament stump are different. The conclusion is still controversial, and the quality needs to be strictly evaluated.

Objective

To evaluate the methodological quality, risk of bias, reporting quality and evidence quality of the systematic review of remnant preservation in anterior cruciate ligament reconstruction, and to provide reference for clinical work.

Methods

We systematically searched the system evaluations in 8 electronic databases, the languages were limited to Chinese and English, and the time limit was from the establishment of the database to June 2023. Two reviewers independently screened literature and extracted data. The methodological quality, risk of bias, reporting quality and quality of evidence were evaluated by AMSTAR-2, ROBIS, PRISMA and GRADE tools.

Results

A total of 14 systematic reviews were included. The evaluation of results showed that the methodological quality of the included systematic reviews was relatively low, of which 5 were low quality and 9 were critically low quality. A small number of systematic reviews were low risk of bias. The system evaluation reports are relatively complete, but the lack of program registration is a common problem. A total of 111 pieces of clinical evidence were extracted from the included 14 systematic reviews. The quality of evidence was generally low, with only 7 pieces of high-quality evidence, 45 pieces of medium-quality evidence, and the rest were low and very low-quality evidence. Among the reasons for relegation, imprecision is the most common, followed by inconsistency and indirectness. The existing evidence shows that patients after anterior cruciate ligament reconstruction with remnant preservation have certain advantages in knee joint function, joint stability and proprioception recovery, which may be a more effective surgical method. However, it may also increase the incidence of postoperative complications and adverse reactions.

Conclusion

Compared with Standard Technique, Remnant Preservation in Anterior Cruciate Ligament Reconstruction has more advantages in restoring joint function and stability and proprioception. But the potential risks should also be considered by surgeons. At present, the quality of evidence is generally low, and the reliability of the conclusion is insufficient. It still needs to be verified and further in-depth research is needed.

Peer Review reports

Background

The anterior cruciate ligament (ACL) is an important ligament structure in the knee joint, which plays an important role in maintaining the stability of the knee joint, especially in the forward and anteromedial rotation of the knee joint [1,2,3]. ACL injury is a common knee joint injury, which is more common in young people [4, 5]. ACL injury may affect the normal flexion and extension of the knee joint, may affect the stability of the knee joint, may cause meniscus and articular cartilage injury, and even may have a negative impact on the proprioceptive function of the knee joint. [6, 7]. Studies have confirmed that ACL injury can greatly increase the risk of knee osteoarthritis [8, 9]. After complete rupture of the ACL, the ACL stump is gradually wrapped by synovial tissue. Although there is currently evidence to support that the injured ligament has a self-healing tendency under the action of cells and blood vessels, it is difficult to reconnect the two ends of the broken ligament because the ACL is surrounded by joint fluid, which causes great difficulties for cell invasion and remodeling. Therefore, the self-healing of ACL injury is poor. Anterior cruciate ligament reconstruction (ACLR) is a common surgical treatment [10]. Ligament reconstruction can restore the continuity of the ligament to the greatest extent, make the motor function of the knee joint recover faster, and reduce the risk of long-term secondary meniscus injury [4, 11]. In order to better expose the visual field and more accurately determine the location of the bone marrow canal, the surgeon generally chooses to thoroughly clean the ligament stump. However, in recent years, the preservation of ACL stump ACLR has received extensive attention. More and more studies have found that retaining ACL stump can promote the revascularization of grafts, obtain higher quadriceps muscle strength, and promote the recovery of joint stability and function [12,13,14,15,16,17]. Studies have also shown that preserving the ACL stump can promote tendon-bone healing and proprioceptive nerve remodeling after ACLR [18,19,20,21]. At present, there is still controversy about whether ACL stump should be retained and the relationship between ACL stump retention and tibial tunnel and cyclops lesion [22, 23]. Therefore, whether remnant preservation is superior to standard techniques in anterior cruciate ligament reconstruction requires higher-quality clinical evidence to guide clinical practice.

Systematic review and Meta-analysis (SR) are currently considered to be the highest grade of clinical evidence and play a guiding role in clinical practice. At present, there are several SRs to analyze the advantages of retaining ACL stump compared with standard surgery [24,25,26]. However, the methodological defects of SR may affect the final analysis results, and the risk of bias may also affect the credibility of the evidence. At the same time, the value of low-quality SR evidence may also be affected by exaggerating the effectiveness of interventions or selective reporting of adverse reactions [27]. Therefore, when we refer to the SR report, we should not only pay attention to the results, but also pay attention to its methodological quality, bias risk and report quality.

At present, there is still a lack of systematic evaluation overview of whether anterior cruciate ligament reconstruction with remnant preservation is superior to standard surgery. Therefore, we summarize the existing SRs on ACLR with remnant preservation, comprehensively summarize and review the methodological quality, bias risk, outcome indicators and evidence grade of existing SRs, in order to provide reference for clinicians, guideline makers and patients, and guide future high-quality SRs.

Methods

Protocol and registration

The protocol of this overview was registered on the International Prospective Register of Systematic Reviews (PROSPERO) (http://www.crd.york.ac.uk/prospero), registration number: CRD42023433774.

Search strategy

We searched the Cochrane Library, Embase, Web of science, Medline (PubMed), China National Knowledge Infrastructure (CNKI), WanFang database, VIP database and Chinese Biology Medicine (CBM) database by computer. The search time range was from the establishment of the database to June 2023, and the search language was limited to Chinese and English. We also searched the research registry and grey literature, such as academic papers and conference reports. We used population (P), intervention (I), comparison (C) and study design (S) strategies for overview. Narrative reviews, SR summaries and comments are excluded. The specific retrieval strategies are as follows:

  • P: Anterior Cruciate Ligament Injuries OR Anterior Cruciate Ligament Injury OR Anterior Cruciate Ligament Tear OR ACL Injury OR ACL Tear

  • I: remnant preservation OR remnant OR stump OR ACL augmentation OR selective ACLR

  • C: Anterior Cruciate Ligament Reconstruction OR ACLR OR ACL-R

  • S: systematic review OR Meta-analysis

The detailed search strategy of PubMed is shown in Fig. 1.

Fig. 1
figure 1

The search strategy of PubMed

Study selection and extraction

Two independent reviewers imported all retrieved studies into Endnote (X9), filtered duplicate studies, and filtered titles and abstracts. After cross-checking, the full text of the qualified study was further independently evaluated by two evaluators. If there were differences, the third reviewer participated.

Two reviewers independently extracted data, including: study characteristics (first author, year of publication, and country), subject characteristics (sample size), methodological characteristics (included study type, quality assessment tool, sensitivity analysis and subgroup analysis, publication bias) and results (number of studies included in SR, outcome indicators, adverse events, such as tibial tunnel enlargement and Cyclops lesions), and contacted study authors to obtain missing data. If there is a disagreement, the third examiner is involved.

Assessment of methodological quality

A Measurement Tool to Assess Systematic Reviews 2 (AMSTAR 2) is an important assessment tool for systematic reviews, which can perform rapid and repeatable quality assessment of systematic reviews of randomized controlled trials, including defects that may be caused by improper review, and the items in AMSTAR 2 that deal with risk of bias identify domains specified in the Cochrane risk of bias instruments for randomized studies [28, 29]. Two reviewers independently assessed the methodological quality of SR inclusion. AMSTAR 2 was developed by AMSTAR and consists of 16 items, including 7 key projects (projects 2, 4, 7, 9, 11, 13, 15], which are used to conduct a critical assessment of the effectiveness of SR. According to the compliance with the standard, each project is evaluated as ‘yes’ (meeting the standard), ‘partly yes’ (partly meeting the standard) and ‘no’ (not meeting the standard) [28, 30].

Assessment of risk of bias

The risk of bias for inclusion in SR was independently assessed by two reviewers using the Risk of Bias in Systematic reviews (ROBIS). The tool is divided into three stages to help determine the risk of bias in the review process, results and conclusions [31].

Assessment of reporting quality

The quality of the reports included in the SR was independently assessed by two reviewers using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA). PRISMA contains items critical to the transparent and complete reporting of SRs and is considered to be an evolution of the original Quality of Reporting of Meta-Analyses (QUOROM) guidelines. The PRISMA statement list covers 27 items in seven parts of SR: title, abstract, introduction, method, result, discussion and funding. Each item is described as ‘yes ', ‘partial yes’ and ‘no’, representing complete report, partial or incomplete report and missing report, respectively [32, 33].

Assessment of evidence quality

The quality of evidence was independently assessed by two qualified reviewers using the Grades of Recommendations, Assessment, Development and Evaluation (GRADE) system (www.gradeworkinggroup.org), a widely used evidence quality rating tool. The quality of evidence was divided into ‘high’, ‘medium’, ‘low’ or ‘very low’. Evidence quality grading may be compromised due to five main aspects: the limitations of the study; inconsistency of the results, indirectness of the evidence, inaccuracy, and reporting bias [34].

Data synthesis and presentation

A narrative synthesis was used in this overview. The characteristics and results of each SR as well as the results of AMSTAR 2, ROBIS and the PRISMA were summarized by tabulation and figures. The GRADE evidence profile and summary of findings table were generated by using the GRADE pro GDT online software (http://www.guidelinedevelopment.org/).

Results

Article selection results

According to the above search strategy, 130 articles were initially retrieved, 32 duplicate articles were excluded by using the literature management software Endnote X9, 78 unrelated articles were excluded by reviewing the title and abstract, and 6 articles were excluded by reading the full text of the literature. Finally, 14 SRs were included [24,25,26, 35,36,37,38,39,40,41,42,43,44,45]. The specific article retrieval and exclusion process is shown in Fig. 2.

Fig. 2
figure 2

PRISMA flow chart for study selection

Basic characteristics of selected articles

Of the 14 SRs, 7 were reported in English and 7 in Chinese. All SRs were published between 2016 and 2023. The authors are from China, Singapore and Italy. The 14 SRs included 5 to 15 original studies each. Four of the original research literatures included in SR were RCTs [26, 35,36,37]. All 14 SRs assessed the risk of bias in the original studies included in their analysis. One SR used PEDro [35], another used the JADAD scale [40], one used the modified Coleman methodology score (CMS) [24], one used the ROBINS-I [39], one used the Newcastle-Ottawa scale [38], and one used both the Newcastle-Ottawa scale (NOS) and the Cochrane bias risk assessment tool [25], Other SRs used the Cochrane Collaboration bias risk assessment tool [26, 36, 37, 42,43,44,45]. All 14 SRs included meta-analysis, and six of them performed sensitivity analysis [26, 35, 37, 40, 44, 45]. Furthermore, seven SRs included subgroup analysis [24, 25, 35, 37, 38, 40, 44]. Postoperative adverse reactions and complications were reported in 12 SRs [24,25,26, 35,36,37,38, 40,41,42,43, 45], 6 SRs assessed publication bias [26, 35, 37,38,39, 44], Sources of funding were reported in 7 SRs [25, 35, 40,41,42,43, 45]. The basic characteristics of all 14 SRs are shown in Table 1.

Table 1 Characteristics of included systematic reviews (SRs)

Methodological quality of included SRs

Of the 14 SRs, 9 SRs were rated as critically Low quality [24, 25, 36, 39,40,41,42,43, 45], 5 SRs were rated as low quality [26, 35, 37, 38, 44]. The results of the methodological quality assessment using the AMSTAR 2 tool are shown in Table 2.

Table 2 Results of AMSTAR 2

Risk of bias of included SRs

According to ROBIS, all SRs (100 %) were at low risk in Phase I(assessment of relevance) and in Domain 1 (study eligibility criteria). For domain 2 (identification and selection of assessment studies), all SRs (100 %) were rated as high risk. 13 SRs (92.9 %) were rated as low risk in Domain 3 (data collection and research evaluation). [24,25,26, 35,36,37, 39,40,41,42,43,44,45]. 10 SRs ( 71.4 % ) were rated as low risk in Domain 4 ( synthesis and results ) [26, 35, 37, 38, 40,41,42,43,44,45], Eight cases ( 57.1 % ) were rated as low risk in Phase III ( risk of bias in review ) [26, 35, 37, 38, 40,41,42, 44]. The specific results are shown in Table 3.

Table 3 Results of Risk of Bias in Systematic reviews (ROBIS)

Reporting quality of included SRs

Overall, the systematic reviews are comprehensive, but some reports have flaws. We found that some SRs did not report or did not fully report research programs and registrations (12/14, 85.7%), complete search strategy (11 / 14,78.6 %), sources of funding for included studies (14/14,100%), risk of publication bias (5/14, 35.7%), additional analysis (5/14, 35.7%) and funds (7/14, 50%). Only 2 SRs reported the design and registration of research programs in advance [38, 39]. At the same time, only two SRs reported a complete search strategy for a database, and reported other literature collection methods in addition to searching electronic databases [37, 41]. Most SRs did not report the risk of bias for research and additional analysis well, and only 7 SRs reported sources of funding and other funding [25, 35, 40,41,42,43, 45]. The PRISMA checklist for all SRs is shown in Table 4 and Fig. 3.

Table 4 Results of PRISMA
Fig. 3
figure 3

Results of PRISMA. ( Y: Yes PY: Partially Yes N: No)

Evidence quality

A total of 20 outcome indicators were extracted from the included 14 SRs. We divided the outcome indicators into 6 categories: Clinical score, Joint function and stability, Postoperative proprioceptive sense, Graft status, Postoperative complications and adverse reactions, and operation time.

Clinical score: Postoperative Lysholm score, postoperative Tegner score, postoperative IKDC score, postoperative IKDC grade. Joint function and stability: postoperative KT1000 / 2000 joint measurement results, postoperative arthrometry side-to-side difference, postoperative Pivot shift test results, postoperative Lachman test results, postoperative knee flexion and extension activity (ROM). Postoperative proprioceptive sense: postoperative Proprioceptive sense difference, postoperative passive activity perception threshold (TTDPM), postoperative joint position sensation, postoperative passive angle regeneration test results, postoperative graft synovial coverage, postoperative tibial tunnel enlargement. Postoperative complications and adverse reactions: postoperative Cyclops lesions, postoperative complications, postoperative reinjury rate.

Clinical score

The evidence grade of all Clinical scores is shown in Table 5.

Table 5 Overview of clinical scoring evidence level

A total of 14 SRs were included in the meta-analysis of postoperative Lysholm score. A total of 19 pieces of clinical evidence were formed, including 3 pieces in the high grade of evidence, 8 pieces in the low grade of evidence, and 8 pieces in the very low grade of evidence. The reasons for the degradation of the evidence grade are mainly due to the indirectness (100 %) of the outcome evaluation of the Lysholm score as the outcome index, the large heterogeneity (43.8 %) when merging the data, and the inaccuracy (50 %) caused by the failure to reach the minimum sample size or the excessive confidence interval.

Meta-analysis of postoperative Tegner score was performed in 4 SRs [25, 38, 39, 45]. A total of 4 pieces of clinical evidence were formed, all of which were low-grade evidence. The reasons for the degradation of the evidence grade are mainly due to the indirectness of the Tegner score (100 %) and the inaccuracy caused by the failure to reach the minimum sample size or the excessive confidence interval (100 %).

There were 10 SRs for meta-analysis of postoperative IKDC scores [24, 26, 35,36,37,38, 41, 42, 44, 45], and a total of 14 pieces of clinical evidence were formed, including 10 pieces of low-grade evidence (71.4 %) and 4 pieces of very low-grade evidence (28.6 %). The reasons for the degradation of the evidence grade are mainly due to the indirectness (100 %) of the IKDC score, the large heterogeneity (50 %) when merging the data, and the inaccuracy (50 %) caused by the failure to reach the minimum sample size or the excessive confidence interval.

6 SRs performed a meta-analysis of postoperative IKDC grade [24, 25, 35,36,37,38]. A total of 6 pieces of clinical evidence were formed, including 5 pieces of low-grade evidence (83.3 %) and 1 piece of very low-grade evidence (16.7 %). The reasons for the downgrading of the evidence grade are mainly due to the indirectness of the IKDC grade (100 %), the large heterogeneity (50 %) when merging the data, and the inaccuracy (83.3 %) caused by the failure to reach the minimum sample size or the excessive confidence interval.

Joint function and stability

The evidence grade of postoperative knee joint stability and function are summarized in Table 6.

Table 6 Overview of evidence levels related to joint function and stability

A total of 12 SRs conducted a meta-analysis of the postoperative KT1000 / 2000 arthrometer measurement results [24,25,26, 35, 36, 39,40,41,42,43,44,45], and a total of 16 pieces of clinical evidence were formed, including 3 pieces of high-grade evidence (18.9 %), 6 medium-grade data (37.5 %), and 7 pieces of low-grade evidence (43.8 %). The main reasons for the downgrading of the evidence grade are the large heterogeneity (50 %) when merging the data and the inaccuracy (75 %) caused by the failure to reach the minimum sample size or the excessive confidence interval.

Meta-analysis of postoperative arthrometry side-to-side difference was performed in 2 SRs [37, 38], resulting in 2 pieces of clinical evidence, including 1 piece of high-grade evidence (50 %) and 1 piece of very low-grade evidence (50 %). The main reasons for the degradation of very low-grade evidence are the large heterogeneity when merging data and the inaccuracy caused by not reaching the minimum sample size or too large confidence interval.

8 SRs performed a meta-analysis of the postoperative Pivot shift test results [24, 26, 35,36,37,38, 41, 44], and a total of 8 pieces of clinical evidence were formed, including 1 piece of high-grade evidence (12.5 %), 6 pieces of medium-grade evidence (75 %), and 1 piece of low-grade evidence (12.5 %). The main reasons for the degradation of the evidence grade are the large heterogeneity (12.5 %) when merging the data and the inaccuracy (87.5 %) caused by the failure to reach the minimum sample size or the excessive confidence interval.

Meta-analysis of postoperative Lachman test results was performed in 9 SRs [25, 26, 35,36,37,38, 41, 44, 45]. A total of 9 pieces of clinical evidence were formed, all of which were medium-grade evidence. The reason for the degradation of the evidence grade is the inaccuracy (100 %) caused by the failure to reach the minimum sample size or the excessive confidence interval.

Meta-analysis of postoperative knee flexion and extension activity (ROM) was performed in 3 SRs [25, 36, 41]. A total of 3 pieces of clinical evidence were formed, all of which were medium-grade evidence. The reason for the degradation of the evidence grade is the inaccuracy (100 %) caused by the failure to reach the minimum sample size or the excessive confidence interval.

Postoperative proprioceptive sense

An overview of the evidence grade for postoperative proprioceptive sense is shown in Table 7.

Table 7 Overview of the level of evidence related to postoperative proprioceptive sense

3 SRs conducted a meta-analysis of postoperative Proprioceptive sense [26, 40, 43]. A total of 4 pieces of clinical evidence were formed, including 2 pieces of medium-grade evidence (50 %), 1 piece of low-grade evidence (25 %), and 1 piece of very low-grade evidence (25 %). The main reasons for the degradation of the evidence grade are the large heterogeneity (100 %) and the inaccuracy (50 %) caused by the failure to reach the minimum sample size or the excessive confidence interval.

2 SRs conducted a meta-analysis of postoperative passive motion perception threshold (TTDPM) to form two pieces of clinical evidence [42, 45], both of which were medium-grade evidence. The reason for the downgrading of the evidence grade is that there is a large heterogeneity (100 %) when merging data.

1 SR performed a meta-analysis of postoperative joint position sensation [42], and a total of 1 piece of clinical evidence was formed, which was medium-grade evidence. The reason for the degradation of the grade of evidence is the imprecision (100 %) caused by not reaching the minimum sample size or too large confidence interval.

1 SR conducted a meta-analysis of the results of postoperative passive angle regeneration test [42], and a total of 1 piece of clinical evidence was formed, which was high-grade evidence.

Graft status

The evidence grade of postoperative Graft status is shown in Table 8.

Table 8 Overview of evidence level related to graft status

3 SRs performed a meta-analysis of postoperative graft synovial coverage [25, 43, 45]. A total of 3 pieces of clinical evidence were formed, including 2 pieces of medium-grade evidence (66.7 %) and 1 piece of very low-grade evidence (33.3 %). The reasons for the degradation of the evidence grade are mainly due to the large heterogeneity (25 %) when merging the data, and the inaccuracy (100 %) caused by the failure to reach the minimum sample size or the excessive confidence interval.

Meta-analysis of postoperative tibial tunnel enlargement was performed in 7 SRs [25, 26, 35, 36, 43, 45]. A total of 7 pieces of clinical evidence were formed, including 4 pieces of medium-grade evidence (57.1 %) and 3 pieces of low-grade evidence (42.9 %). The main reasons for the degradation of the evidence grade are the inaccuracy (100 %) caused by the failure to reach the minimum sample size or the excessive confidence interval and the large heterogeneity (42.9 %) when merging the data.

1 SR performed a meta-analysis of graft status [24]. A total of 1 piece of clinical evidence was formed, which was low-grade evidence. The reason for the degradation of the evidence grade is the inaccuracy caused by the failure to reach the minimum sample size or the excessive confidence interval and the large heterogeneity when merging the data.

Postoperative complications and adverse reactions

The evidence grade of postoperative complications and adverse reactions are shown in Table 9.

Table 9 The level of evidence related to postoperative complications and adverse reactions

Meta-analysis of the incidence of postoperative Cyclops lesions was performed in 5 SRs [25, 35, 36, 40, 43], A total of 5 pieces of clinical evidence were formed, including 4 pieces of medium-grade evidence (80 %) and 1 piece of low-grade evidence (20 %). The main reasons for the degradation of the evidence grade are the inaccuracy (100 %) caused by the failure to reach the minimum sample size or the excessive confidence interval and the large heterogeneity (20 %) when merging the data.

3 SRs performed a meta-analysis of postoperative complications [24, 37, 38], A total of 3 pieces of clinical evidence were formed, including 2 pieces of medium-grade evidence (66.7 %) and 1 piece of low-grade evidence (33.3 %). The main reason for the degradation of the evidence grade is the inaccuracy (100 %) caused by the failure to reach the minimum sample size or the excessive confidence interval and the large heterogeneity (33.3 %) when merging the data.

1 SR conducted a meta-analysis of postoperative re-injury rate [25]. A total of 1 piece of clinical evidence was formed, which was medium-grade evidence. The main reason for the degradation of the evidence grade is the inaccuracy (100 %) caused by the failure to reach the minimum sample size or the excessive confidence interval.

Operation time

The evidence grade of postoperative complications and adverse reactions is shown in Table 10.

Table 10 Overview of evidence level of operation time

2 SRs conducted a meta-analysis of postoperative re-injury rate [25, 40]. A total of 2 pieces of clinical evidence was formed, including 1 piece of high-grade evidence, and 1 piece of very low-grade data (50 %). The reason for the degradation of very low-grade evidence is the inaccuracy caused by the failure to reach the minimum sample size or the excessive confidence interval and the large heterogeneity when merging data.

Discussion

With the development of evidence-based medicine, many SRs have made a positive evaluation of the clinical effect of anterior cruciate ligament reconstruction with remnant preservation. However, the quality of SR seriously affects the reliability of its evidence, so the review of existing SR is of great significance for us to draw on its clinical evidence. At present, AMSTAR-2, ROBIS, PRISMA and GRADE are widely used in the review of SR to comprehensively review the methodological quality, bias risk, reporting quality and evidence quality of SR, respectively. The rigor of the review are widely recognized. By systematically summarizing and reviewing the existing SRs, we can effectively summarize the existing clinical evidence and provide targeted guidance for higher-quality SRs in the future. At the same time, the existing clinical evidence is summarized to improve the credibility of clinical evidence, and to better provide reference for the clinical practice of surgeons, so as to formulate a more scientific, rigorous and effective surgical treatment plan.

Our study systematically reviewed the existing 14 SRs on the clinical effect of anterior cruciate ligament reconstruction with remnant preservation. We found that according to the clinical evidence provided by the existing SR, there are certain advantages in retaining the stump in the anterior cruciate ligament reconstruction. Retaining the stump can effectively enhance the stability of the knee joint and promote the recovery of the proprioception of the knee joint. But it also has the disadvantages of high incidence of postoperative complications and adverse events and long operation time. However, the quality of the existing SR is generally low, the grade of evidence is not high, and there are still many problems. It is challenging to find clinical evidence that is truly convincing. Therefore, we cannot make an accurate judgment on the clinical effect of anterior cruciate ligament reconstruction with remnant preservation.

AMSTAR-2 is an internationally recognized and most widely used SR methodological quality evaluation tool. Its developers recommend focusing on whether there are methodological defects in key items and evaluating the overall quality of SR accordingly [28]. After evaluating the methodological quality of the included SRs through the AMSTAR-2 scale, we found that the included SRs had the following common problems: (1) Most of the SRs did not formulate pre-programs and register programs; (2) Most of the SR literature retrieval methods are single, and there is no supplementary retrieval and gray literature retrieval; (3) All SRs described the sources of funding for the included studies. (4) Most SRs did not test for publication bias. The final methodological quality evaluation results showed that all SRs were low or critically low quality studies.

ROBIS is currently the most advanced SR bias risk assessment tool. It can not only assess the risk of bias in the process of SR production and result interpretation, but also evaluate the correlation between SR and the practical problems to be solved by its users [31]. After evaluating the bias risk of the included SRs, we found that all SRs clearly studied the problem according to the PICOS principle and matched the problem to be solved with the target problem. At the same time, most SRs try to avoid the risk of bias in the process of research data extraction and quality evaluation. The source of bias risk was mainly that no other methods other than electronic database retrieval were used to determine the relevant research in the process of research retrieval and screening, which was consistent with the review results of AMSTAR-2 tool. In addition, the lack of sensitivity analysis is also a major problem in the risk of bias in some SRs during data synthesis.

The PRISMA checklist provides a reference for standardized writing and reporting of systematic reviews and meta-analyses [27, 33]. Standardized reporting can reduce the bias between actual research results and published results and increase the transparency of articles. Comparing the reporting specifications of the PRISMA checklist, we found that the lack of program registration, insufficient retrieval methods, insufficient extraction of data items, and lack of reporting of funding sources are the main reasons for insufficient reporting.

GRADE evidence classification is a common and popular method for evaluating the quality of evidence, which divides the quality of evidence group into four categories: high, medium, low and very low [34]. After evaluating the evidence by using the GRADE evidence grading system, we found that the grade of evidence for outcome indicators ranged from high to very low. The main reasons for the generally low grade of evidence are the indirectness of the outcome indicators, the large heterogeneity when merging the data, and the inaccuracy caused by the failure to reach the minimum sample size or the excessive confidence interval. The fundamental reason is that the original studies included in SR have defects in sample size calculation, random allocation method, allocation concealment, blind method and core outcome index setting.

Based on the above review results, we recommend that in the future, we should strictly design large-sample, multi-center randomized controlled trials in strict accordance with the requirements of the CONSORT statement. We suggest that we should improve the scientific nature of the research design, strengthen the understanding of the sample size, carry out large sample and multi-center clinical research, pay attention to the use of blind method and the use of objective outcome indicators in the research process, and ensure the representativeness of the participants. In addition, strict inclusion and exclusion criteria, stratified design analysis, control of the combined effects of confounding factors, and reduction of bias in clinical studies are also crucial.

At the same time, we should also recommend that researchers should follow the requirements of AMSTAR-2, ROBIS, PRISMA and GRADE when performing SR, especially to register or publish research programs on PROSPERO (http://www.crd.york.ac.uk/prospero) or Cochrane in advance to achieve transparency in the SR production process. In addition, attention should be paid to mentioning conflicts of interest or financial issues in the report. It is also necessary to conduct subgroup analysis or meta-regression analysis in the case of significant heterogeneity.

The existing evidence shows that patients after anterior cruciate ligament reconstruction with remnant preservation have certain advantages in knee joint function, joint stability and proprioception recovery, which may be a more effective surgical method. However, it may also increase the incidence of postoperative complications and adverse reactions. These potential risks should also be considered by surgeons.

Limitations

There are some limitations in this study. (1) This study only includes Chinese and English literature, which may miss some research in other languages, and there may be language bias. (2) The evaluation process of this study is subjectively evaluated by researchers according to the evaluation criteria, so the evaluation results may be affected by the grade of researchers and the differences in understanding; (3) At present, there is no clear specification and standard for the evaluation method of SR, so our evaluation may not be comprehensive and accurate.

Conclusions

Compared with standard technique, remnant preservation in anterior cruciate ligament reconstruction has more advantages in restoring joint function and stability and proprioception. However, it may also increase the incidence of postoperative complications and adverse reactions. These potential risks should also be considered by surgeons. At present, the quality of evidence is generally low, and the reliability of the conclusion is insufficient. It still needs to be verified and further research is needed.

Availability of data and materials

All data generated or analyzed during this study are included in this published article.

Abbreviations

ACL:

Anterior cruciate ligament

ACLR:

Anterior cruciate ligament reconstruction

SR:

Systematic review

References

  1. Takeda Y, Xerogeanes JW, Livesay GA, Fu FH, Woo SL. Biomechanical function of the human anterior cruciate ligament. Arthroscopy. 1994;10(2):140–7.

    Article  CAS  PubMed  Google Scholar 

  2. Petersen W, Tillmann B. [Anatomy and function of the anterior cruciate ligament]. Der Orthopade. 2002;31(8):710–8.

    Article  CAS  PubMed  Google Scholar 

  3. Duthon VB, Barea C, Abrassart S, Fasel JH, Fritschy D, Ménétrey J. Anatomy of the anterior cruciate ligament. Knee Surg Sports Traumatol Arthrosc. 2006;14(3):204–13.

    Article  CAS  PubMed  Google Scholar 

  4. Kohn L, Rembeck E, Rauch A. [Anterior cruciate ligament injury in adults: diagnostics and treatment]. Der Orthopade. 2020;49(11):1013–28.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Monk AP, Davies LJ, Hopewell S, Harris K, Beard DJ, Price AJ. Surgical versus conservative interventions for treating anterior cruciate ligament injuries. Cochrane Database Syst Rev. 2016;4(4):Cd011166.

    PubMed  Google Scholar 

  6. Diermeier TA, Rothrauff BB, Engebretsen L, Lynch A, Svantesson E, Hamrin Senorski EA, et al. Treatment after ACL injury: panther symposium ACL treatment consensus group. Br J Sports Med. 2021;55(1):14–22.

    Article  PubMed  Google Scholar 

  7. Relph N, Herrington L, Tyson S. The effects of ACL injury on knee proprioception: a meta-analysis. Physiotherapy. 2014;100(3):187–95.

    Article  CAS  PubMed  Google Scholar 

  8. Wang LJ, Zeng N, Yan ZP, Li JT, Ni GX. Post-traumatic osteoarthritis following ACL injury. Arthritis Res Ther. 2020;22(1):57.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Webster KE, Hewett TE. Anterior cruciate ligament Injury and knee osteoarthritis: an Umbrella systematic review and Meta-analysis. Clin J Sport Med. 2022;32(2):145–52.

    Article  PubMed  Google Scholar 

  10. Murray MM, Fleming BC. Biology of anterior cruciate ligament injury and repair: Kappa delta Ann Doner Vaughn award paper 2013. J Orthop Res. 2013;31(10):1501–6.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Lien-Iversen T, Morgan DB, Jensen C, Risberg MA, Engebretsen L, Viberg B. Does Surgery reduce knee osteoarthritis, meniscal injury and subsequent complications compared with non-surgery after ACL rupture with at least 10 years follow-up? A systematic review and meta-analysis. Br J Sports Med. 2020;54(10):592–8.

    Article  PubMed  Google Scholar 

  12. Choi S, Kim MK, Kwon YS, Kang H. Clinical and arthroscopic outcome of single bundle anterior cruciate ligament reconstruction: comparison of remnant preservation versus conventional technique. Knee. 2017;24(5):1025–32.

    Article  PubMed  Google Scholar 

  13. Lee JH, Bae DK, Song SJ, Cho SM, Yoon KH. Comparison of clinical results and second-look arthroscopy findings after arthroscopic anterior cruciate ligament reconstruction using 3 different types of grafts. Arthroscopy: The Journal of Arthroscopic & Related Surgery : Official Publication of the Arthroscopy Association of North America and the International Arthroscopy Association. 2010;26(1):41–9.

    Article  Google Scholar 

  14. Takahashi T, Kimura M, Hagiwara K, Ohsawa T, Takeshita K. The Effect of Remnant tissue preservation in anatomic double-bundle ACL Reconstruction on knee Stability and Graft Maturation. J Knee Surg. 2019;32(6):565–76.

    Article  PubMed  Google Scholar 

  15. Igdir V, Gencer B, Dogan O, Caliskan E, Orhan A, Demir Ozbudak S. The effects of remnant-preserving anterior cruciate ligament reconstruction on proprioception: a prospective comparative study. Acta Orthop Traumatol Turc. 2023;57(3):109–15.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Ahn JH, Son DW, Ahn JH, Park DW, Park JH. Remnant preservation of the primary vertical graft in revision anterior cruciate ligament reconstruction. Orthop J Sports Med. 2023;11(3):23259671221143996.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Sato D, Inoue M, Kasahara Y, Hamano H, Suzuki R, Kondo E, et al. Effects of preserving anatomically positioned and adequate remnant ACL tissue in Double-Bundle ACL Reconstruction. Orthop J Sports Med. 2023;11(4):23259671231162388.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Li B, Wang YT, Bai LH, Wen Y. Changes of mechanoreceptors in different-state remnants of ruptured anterior cruciate ligament. Int Orthop. 2018;42(11):2613–8.

    Article  PubMed  Google Scholar 

  19. Wu B, Zhao Z, Li S, Sun L. Preservation of remnant attachment improves graft healing in a rabbit model of anterior cruciate ligament reconstruction. Arthroscopy. 2013;29(8):1362–71.

    Article  PubMed  Google Scholar 

  20. Matsumoto T, Kubo S, Sasaki K, Kawakami Y, Oka S, Sasaki H, et al. Acceleration of tendon-bone healing of anterior cruciate ligament graft using autologous ruptured tissue. Am J Sports Med. 2012;40(6):1296–302.

    Article  PubMed  Google Scholar 

  21. Cho E, Chen J, Xu C, Zhao J. Remnant preservation may improve proprioception after anterior cruciate ligament reconstruction. J Orthop Traumatol. 2022;23(1):22.

    Article  PubMed  PubMed Central  Google Scholar 

  22. de Padua VBC, Saithna A, Chagas EFB, Zutin TLM, Piazzalunga LF, Patriarcha LF, et al. Rate of tibial tunnel malposition is not changed by drilling entirely within the stump of preserved remnants during ACL Reconstruction: a prospective comparative 3D-CT study. Orthop J Sports Med. 2021;9(10):23259671211037324.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Hishimura R, Kondo E, Suzuki Y, Matsuoka M, Iwasaki K, Onodera T, et al. Occurrence rate of cyclops lesion after anatomic double-bundle ACL reconstruction: comparison between remnant tissue preservation and resection methods. Orthop J Sports Med. 2022;10(10):23259671221130690.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Wang H, Liu Z, Li Y, Peng Y, Xu W, Hu N, et al. Is remnant preservation in anterior cruciate ligament reconstruction superior to the standard technique? A systematic review and Meta-analysis. Biomed Res Int. 2019;2019:1652901.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Xie H, Fu Z, Zhong M, Deng Z, Wang C, Sun Y, et al. Effects of remnant preservation in anterior cruciate ligament reconstruction: a systematic review and meta-analysis. Front Surg. 2022;9: 952930.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Honghui H, Huashan P, Chunbai L. Arthroscopic reconstruction of anterior cruciate ligament with and without remnant preservation: a meta-analysis of prospective, randomized, and controlled studies. Chin J Tissue Eng Res. 2021;25(32):5227–31.

    Google Scholar 

  27. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009;6(7):e1000100.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Shea BJ, Reeves BC, Wells G, Thuku M, Hamel C, Moran J, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ (Clinical Research ed). 2017;358:j4008.

    Article  PubMed  Google Scholar 

  29. Gates A, Gates M, Duarte G, Cary M, Becker M, Prediger B, et al. Evaluation of the reliability, usability, and applicability of AMSTAR, AMSTAR 2, and ROBIS: protocol for a descriptive analytic study. Syst Rev. 2018;7(1):85.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7(1):10.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Whiting P, Savović J, Higgins JP, Caldwell DM, Reeves BC, Shea B, et al. ROBIS: a new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol. 2016;69:225–34.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ (Clinical Research ed). 2009;339:b2535.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. J Clin Epidemiol. 2021;134:178–89.

    Article  PubMed  Google Scholar 

  34. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ (Clinical Research ed). 2008;336(7650):924–6.

    Article  PubMed  Google Scholar 

  35. Tie K, Chen L, Hu D, Wang H. The difference in clinical outcome of single-bundle anterior cruciate ligament reconstructions with and without remnant preservation: a meta-analysis. Knee. 2016;23(4):566–74.

    Article  PubMed  Google Scholar 

  36. Ma T, Zeng C, Pan J, Zhao C, Fang H, Cai D. Remnant preservation in anterior cruciate ligament reconstruction versus standard techniques: a meta-analysis of randomized controlled trials. J Sports Med Phys Fit. 2017;57(7–8):1014–22.

    Google Scholar 

  37. Wang H-D, Wang F-S, Gao S-J, Zhang Y-Z. Remnant preservation technique versus standard technique for anterior cruciate ligament reconstruction: a meta-analysis of randomized controlled trials. J Orthop Surg Res. 2018;13:13.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  38. Yeo MHX, Seah SJS, Gatot C, Yew A, Lie D. Selective bundle versus complete anterior-cruciate ligament reconstruction: a systematic review and meta-analysis. J Orthop. 2022;33:124–30.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Bosco F, Giustra F, Crivellaro M, Giai Via R, Lavia AD, Capella M, et al. Is augmentation the best solution in partial anterior cruciate ligament tears? A literature systematic review and meta-analysis. J Orthop. 2023;36:11–7.

    Article  PubMed  Google Scholar 

  40. Rui-Peng Z, Xiao-Jian W, Kun Y. A meta-analysis on remnant preserving versus removing in anterior cruciate ligament reconstruction. Orthop J China. 2017;25:18.

  41. Chen JY, Yang J, Li JR, Wang HJ, Zha ZG. Efficacy of Remnant-preserving Anterior Cruciate Ligament Reconstruction versus Standard Anterior Cruciate Ligament Reconstruction by Arthroscopy:A Meta-analysis. Chin J Evid-Based Med. 2016;16:02.

  42. Tai-Liang Z, Lei Z, Zhi-Ming L, Guang-Zhong Y. Effect of remnant preservation on recovery of knee proprioception in arthroscopic anterior cruciate ligament reconstruction: a meta-analysis. Chin J Tissue Eng Res. 2017;21:03.

  43. Zhang L, Xie CX, Bai JP. Preserving-remnant versus removing-remnant for arthroscopic anterior cruciate ligament reconstruction: A Meta-analysis.  Chin J Tissue Eng Res. 2016;20:20.

  44. Yi S, Xin-Nan M, Xin W, Song-Cen L. Meta-analysis of arthroscopic anterior cruciate ligament reconstruction with or without preservation of tibial stump. Chin J Sports Med. 2016;35(1):87–93.

    Google Scholar 

  45. Liu-Wei G, Dong-Xue L, De-Sen L, Yu-Qi W, Si-Yuan R, Hong C. Meta analysis on the postoperative efficacies of reconstruction of the injured anterior cruciate ligament with and without remnant preservation. J Reg Anta Oper Surg. 2022;31(12):1077–83.

    Google Scholar 

Download references

Funding

This study was funded by Jilin Provincial Traditional Chinese Medicine Science and Technology Project (Funder name: Jicheng Han, China, Authorization No. :2022022).

Author information

Authors and Affiliations

Authors

Contributions

YS Z and XY X were used for literature retrieval and data extraction. YS Z and XY X wrote manuscripts. JY W, HWG and WD contributed to the revision of the manuscript. YS Z, XY X and JC H conceived and designed this study. All authors have read and approved the final version of the manuscript.

Corresponding author

Correspondence to Jicheng Han.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Y., Xiao, X., Deng, W. et al. Is remnant preservation in anterior cruciate ligament reconstruction superior to the standard technique? An overview of systematic reviews. BMC Musculoskelet Disord 24, 910 (2023). https://doi.org/10.1186/s12891-023-07030-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12891-023-07030-4

Keywords