Comments on Research Trends of Macrophage Polarization: A Bibliometric Analysis
The field of macrophage polarization research has garnered significant attention over the past decade, reflecting its critical role in immunology, disease mechanisms, and therapeutic development. A recent bibliometric analysis by Gao et al. aimed to map research trends in this domain using data from the Web of Science Core Collection (WoSCC). However, methodological concerns raised in a commentary by Yuh-Shan Ho highlight limitations in the original study’s approach and underscore the importance of refining bibliometric methodologies to ensure accuracy and relevance.
Methodological Concerns in the Original Study
Gao et al. extracted data from the Science Citation Index Expanded (SCI-E) database within WoSCC using the search query TS = (macrophage AND polarization), restricted to English-language articles published between 2007 and 2016. This approach yielded 3,064 articles. While this method appears straightforward, Ho’s critique emphasizes that WoSCC is primarily designed for literature retrieval rather than bibliometric analysis. The database’s inherent biases, such as incomplete keyword indexing and inconsistent terminology, can skew results. For instance, the TS (topic search) function retrieves articles where terms appear anywhere in the text, including references or supplementary materials, leading to overinclusion of irrelevant studies.
To address this limitation, Ho’s group proposed the “front page” filter, which restricts analysis to terms appearing in the article title, abstract, or author keywords. This refinement reduces noise by focusing on content directly relevant to the research topic. Applying this method to Gao et al.’s dataset revealed significant discrepancies. A reanalysis using the same search parameters retrieved 3,079 articles, but only 1,557 (51%) contained both macrophage and polarization in their front pages. Notably, 390 articles (13%) lacked either term entirely, indicating poor alignment with the study’s focus.
Impact of Terminology Variations
Another critical issue is the handling of terminology variations. The original study’s search query did not account for plurals (macrophages) or verb forms (polarize, polarized), potentially excluding relevant articles. For example, polarize and polarized are frequently used in mechanistic studies describing macrophage functional states. Similarly, macrophages is a common plural form in titles and abstracts. Ho’s analysis suggests that expanding the search to include these variants could improve retrieval accuracy. This oversight in the original study likely contributed to the inclusion of marginally related papers, such as highly cited works by Wu et al. and Fujisaka et al., which focus on adipose tissue macrophages and metabolic homeostasis but lack explicit emphasis on polarization mechanisms.
Case Studies Highlighting Methodological Flaws
The commentary cites two high-impact articles to illustrate the consequences of an overly broad search strategy. Wu et al.’s Science paper, “Eosinophils sustain adipose alternatively activated macrophages associated with glucose homeostasis,” and Fujisaka et al.’s Diabetes article, “Regulatory mechanisms for adipose tissue M1 and M2 macrophages in diet-induced obese mice,” collectively received over 100 citations by 2016. While these studies explore macrophage phenotypes in metabolic contexts, they do not center on polarization as a primary theme. Their inclusion in Gao et al.’s dataset demonstrates how topic searches may capture tangentially related research, diluting the specificity of bibliometric findings.
Recommendations for Improved Bibliometric Practices
Ho advocates for a tiered approach to bibliometric analysis. First, researchers should employ the “front page” filter to prioritize articles where key terms are prominently featured. Second, search queries must account for morphological variations in terminology (e.g., macrophage/macrophages, polarization/polarize). Third, manual validation of high-impact articles is essential to verify their relevance to the research question. These steps enhance precision and ensure that trends reflect genuine thematic focus rather than database artifacts.
Quantitative Insights from Reanalysis
The reanalysis of Gao et al.’s data using the “front page” filter yielded several key findings:
- 72% of articles (2,224/3,079) mentioned macrophage in the front page.
- 66% (2,022/3,079) included polarization.
- 51% (1,557/3,079) contained both terms.
- 30% (928/3,079) featured the exact phrase macrophage polarization.
These figures contrast sharply with the original study’s claim of 3,064 relevant articles. The lower overlap (51%) between macrophage and polarization underscores the risk of false positives in topic-based searches. Furthermore, the 13% of articles lacking both terms suggest that WoSCC’s indexing practices may inadvertently incorporate unrelated research.
Implications for Macrophage Polarization Research Trends
Despite methodological shortcomings, the original study identified growing interest in macrophage polarization, particularly in contexts like cancer, inflammation, and metabolic disorders. However, Ho’s critique implies that these trends may be overstated due to inclusion of peripheral studies. For instance, cancer-related papers might discuss tumor-associated macrophages without explicitly addressing polarization mechanisms. Refining the analysis to exclude such cases would provide a clearer picture of the field’s evolution.
Broader Lessons for Bibliometric Studies
This case study offers generalizable lessons for bibliometric research:
- Database Limitations: WoSCC and similar platforms are optimized for literature discovery, not bibliometrics. Researchers must acknowledge and adjust for inherent biases.
- Search Strategy Optimization: Precision-focused strategies, such as the “front page” filter, improve dataset quality.
- Terminology Sensitivity: Accounting for linguistic variations ensures comprehensive retrieval of relevant articles.
- Validation: Manual checks of high-impact or outlier articles safeguard against misinterpretation.
Conclusion
The commentary by Ho illuminates critical gaps in the application of bibliometric methods to macrophage polarization research. By refining search strategies and validating results, future studies can produce more accurate and actionable insights. As the field continues to expand, rigorous methodologies will be essential to distinguish genuine trends from database-driven noise.
doi.org/10.1097/CM9.0000000000000499
Was this helpful?
0 / 0