基于多視圖舌象特征融合的中醫(yī)證型辨識(shí)

打開文本圖片集

關(guān)鍵詞：舌診；證型辨識(shí)；特征融合；多視圖

中圖分類號(hào)：TP183 文獻(xiàn)標(biāo)志碼：A 文章編號(hào)：1001-3695（2025）07-026-2116-07

doi：10.19734/j. issn.1001-3695.2024.11.0471

Abstract：Fortongue diagnosis inTCM（traditional Chinese medicine），clinical physiciansobservethequality，coating，and baseof the tongue to understand the patient’s health status and pathologicalchanges.Existing tongue diagnosis auxiliary syndromediferentiation modelslack comprehensiveanalysisand ignore thecomplementarycharacteristicsofthe tonguesurface and tongue base.To solvethe problem，thispaper proposedasyndrome identification model basedon multi-view tongue featurefusion（SI-MTF）.Bycolecting3348tonguesurfaceandtonguebaseimagesandrequestingtraditional Chinese medicine physicianstolabeltheimages with syndrome types，thispaperconstructedatongueimagedatasetand proposedSI-MTF.Firstly，this methodextractedthetongue surfaceand tongue base regions basedon Mask R-CNNand NanoDet，andthenconstructedaconvolutional neural network with denseconnectionsto extractandfusetonguesurfaceandtonguebase features.SI-MTF extractedcolor，shape，andtexturefeaturesof the tongue image throughchannelmeanof HSVcolormodel，localbinarypatternalgorithm，andGaborfilter.Duringthetrainingstage，thismethodusedateacher-studentnetwork toimprovetheability offusingtonguesurfaceandtonguebase.Finall，itusedfullyconnectedlayersandsoftmaxfunctiontolearntherelationship between fusion features and syndrome types for achieving TCM syndrome identification.Basedonthe tongue image dataset， this paper conductedcomparative experiment，parameter discussion，ablation experiment，and robustness experiment，and then the method obtained an accuracy of 76.75% ，improved by 7.51 percentage points compared to the baseline method. Theexperimentalresultsshowthat thecomprehensiveanalysisofthetonguesurfaceandtonguebasebasedonmultiviewcaneffectively improve theperformanceof the tongue diagnosis auxiliary syndrome diferentiation model.

Keywords：tongue diagnosis；syndrome identification；feature fusion；multi-view

0 引言

望診是中醫(yī)四診之首，其中舌診作為望診中的關(guān)鍵流程，醫(yī)師通過觀察舌質(zhì)、舌苔和舌底變化了解人體生理功能和病理變化，是中醫(yī)學(xué)獨(dú)具特色的診法之一[1]。（剩余16306字）