================================================================================
MCP-DBLP EXPERIMENT EVALUATION
================================================================================

Loading data files...
Loaded 104 test citations
Loaded 104 ground truth entries
Loaded 104 ground truth mappings
Loaded 58 control output entries
Loaded 100 treatment output entries

Evaluating all 104 citations...
================================================================================

WARNING: Ground truth key journals/algorithms/HammadZOG25 not found in BibTeX file
WARNING: Ground truth key conf/acmrep/ZhengS24 not found in BibTeX file
WARNING: Ground truth key journals/algorithms/Dronyuk25 not found in BibTeX file
WARNING: Ground truth key conf/ei-mlsi/GuoSBGVLAL22 not found in BibTeX file
WARNING: Ground truth key journals/algorithms/DabekMMVC25 not found in BibTeX file
WARNING: Ground truth key conf/iccai/TangZ22 not found in BibTeX file
WARNING: Ground truth key conf/iscas/0002YCC25 not found in BibTeX file
WARNING: Ground truth key conf/assets/DuvalVSLW23 not found in BibTeX file
WARNING: Ground truth key conf/bigdataconf/ZhengSCKPSMFK24 not found in BibTeX file
WARNING: Ground truth key journals/algorithms/LuqueHernandezAAG25 not found in BibTeX file
WARNING: Ground truth key journals/algorithms/KarousosPVV25 not found in BibTeX file
WARNING: Ground truth key conf/aaaiss/NirenburgKM23 not found in BibTeX file
WARNING: Ground truth key journals/cor/UzunogluGT25 not found in BibTeX file
WARNING: Ground truth key conf/icmlt/JonesRM22 not found in BibTeX file
WARNING: Ground truth key journals/eaai/XieTMH25 not found in BibTeX file
WARNING: Ground truth key conf/IEEEscc/AkterSIHKCV23 not found in BibTeX file
WARNING: Ground truth key journals/algorithms/LoudikiK25 not found in BibTeX file
WARNING: Ground truth key conf/ukci/NaikN23a not found in BibTeX file
WARNING: Ground truth key conf/icarm/Ji0HCYZWGS24 not found in BibTeX file
WARNING: Ground truth key journals/algorithms/ShaoZLFJ25 not found in BibTeX file
WARNING: Ground truth key journals/algorithms/SittijukPT25 not found in BibTeX file
WARNING: Ground truth key journals/algorithms/ZhabinetsTLNMK25 not found in BibTeX file
WARNING: Ground truth key conf/isdfs/OzpolatK23 not found in BibTeX file
WARNING: Ground truth key conf/iui/ChiangY22 not found in BibTeX file
WARNING: Ground truth key journals/anor/JiangJCC22 not found in BibTeX file
WARNING: Ground truth key journals/idt/SivalingamK25 not found in BibTeX file
WARNING: Ground truth key conf/sigcse/MikeR21 not found in BibTeX file
WARNING: Ground truth key journals/iet-qtc/DharaAR25 not found in BibTeX file
WARNING: Ground truth key conf/educon/AlatawiBKC25 not found in BibTeX file
WARNING: Ground truth key conf/kes/Mosqueira-ReyAB21 not found in BibTeX file
WARNING: Ground truth key journals/nca/YaghoubiYKV24 not found in BibTeX file
WARNING: Ground truth key journals/algorithms/PanZXPGLLMZL25 not found in BibTeX file
WARNING: Ground truth key conf/cmsc/LehnerL24 not found in BibTeX file
WARNING: Ground truth key journals/ires/GaohuiWL25 not found in BibTeX file
WARNING: Ground truth key journals/eaai/ChengW25 not found in BibTeX file
WARNING: Ground truth key conf/aaaiss/KursuncuGS20 not found in BibTeX file
WARNING: Ground truth key journals/algorithms/WernerHGV22 not found in BibTeX file
WARNING: Ground truth key conf/fat/Benbouzid23 not found in BibTeX file
WARNING: Ground truth key conf/aaaiss/000321 not found in BibTeX file
WARNING: Ground truth key journals/cais/KuhlHBSS21 not found in BibTeX file
WARNING: Ground truth key journals/bib/ShenHWZZWYXCH21 not found in BibTeX file
WARNING: Ground truth key conf/igarss/GuigalBCVBMM24 not found in BibTeX file
WARNING: Ground truth key journals/idt/LichodeK25 not found in BibTeX file
WARNING: Ground truth key journals/access/EssaCH23 not found in BibTeX file
WARNING: Ground truth key conf/aaai/HoagD18 not found in BibTeX file
WARNING: Ground truth key journals/biodb/SharmaCSDCKS18 not found in BibTeX file
WARNING: Ground truth key journals/biodb/AgarwalKJRS16 not found in BibTeX file
WARNING: Ground truth key journals/biodb/BiggsPGG20 not found in BibTeX file
WARNING: Ground truth key conf/csoc/GovenderKL20 not found in BibTeX file
WARNING: Ground truth key journals/biodb/SinghBJMS18 not found in BibTeX file
WARNING: Ground truth key conf/cata/RahimiMG20 not found in BibTeX file
WARNING: Ground truth key journals/jms/ShahriIM16 not found in BibTeX file
WARNING: Ground truth key conf/aaaiss/Schmid19 not found in BibTeX file
WARNING: Ground truth key conf/cn/UstebayTA19 not found in BibTeX file
WARNING: Ground truth key journals/biodb/RosikiewiczKKCK17 not found in BibTeX file
WARNING: Ground truth key journals/biodb/CortazarOAL17 not found in BibTeX file
WARNING: Ground truth key conf/uss/SunSZPGJ18 not found in BibTeX file
WARNING: Ground truth key journals/ijaec/GhoshD16 not found in BibTeX file
WARNING: Ground truth key conf/siie/FreitasGS20 not found in BibTeX file
WARNING: Ground truth key conf/worldcist/ShahriM16 not found in BibTeX file
WARNING: Ground truth key journals/biodb/WangYXHXJW18 not found in BibTeX file
WARNING: Ground truth key conf/IEEEares/MontefuscoCKS16 not found in BibTeX file
WARNING: Ground truth key journals/entropy/DemongeotJHMST18 not found in BibTeX file
WARNING: Ground truth key conf/cdmake/HolzingerKWT18 not found in BibTeX file
WARNING: Ground truth key conf/aaaiss/Federmann13 not found in BibTeX file
WARNING: Ground truth key conf/soict/BanD14 not found in BibTeX file
WARNING: Ground truth key conf/bwcca/LeuHC12 not found in BibTeX file
WARNING: Ground truth key journals/tnn/ChengHLTZW11 not found in BibTeX file
WARNING: Ground truth key journals/na/LamourM11 not found in BibTeX file
WARNING: Ground truth key journals/biodb/EvansJLBCPM13 not found in BibTeX file
WARNING: Ground truth key conf/ifip11-8/NiekerkG11 not found in BibTeX file
WARNING: Ground truth key journals/almob/PolyanovskyRT11 not found in BibTeX file
WARNING: Ground truth key conf/re/GiacaloneMMPPS14 not found in BibTeX file
WARNING: Ground truth key journals/tnn/SunZCXDW10 not found in BibTeX file
WARNING: Ground truth key journals/biodb/VellozoVBHCFCRDGSCC11 not found in BibTeX file
WARNING: Ground truth key conf/aaai/LindauerHHS15 not found in BibTeX file
WARNING: Ground truth key conf/hais/YannibelliA13 not found in BibTeX file
WARNING: Ground truth key journals/asc/AfanehZA13 not found in BibTeX file
WARNING: Ground truth key journals/re/BeckersCFHH13 not found in BibTeX file
WARNING: Ground truth key journals/eaai/GhasemiGRRF14 not found in BibTeX file
WARNING: Ground truth key conf/siguccs/YamanoueFSMOM13 not found in BibTeX file
WARNING: Ground truth key journals/tnn/XiaoZ11 not found in BibTeX file
WARNING: Ground truth key conf/futsec/HynesP12 not found in BibTeX file
WARNING: Ground truth key conf/nspw/ParkinMIS10 not found in BibTeX file
WARNING: Ground truth key journals/nca/KantSGTCNK13 not found in BibTeX file
WARNING: Ground truth key journals/biodb/MathiasHYZBUO13 not found in BibTeX file
WARNING: Ground truth key conf/isica/LiLML10 not found in BibTeX file
WARNING: Ground truth key journals/biodb/StoverPBDC12 not found in BibTeX file
WARNING: Ground truth key conf/miwai/DapaLVP13 not found in BibTeX file
WARNING: Ground truth key journals/nn/MinnettSLH11 not found in BibTeX file
WARNING: Ground truth key conf/socpros/OjhaN14 not found in BibTeX file
WARNING: Ground truth key journals/nn/CarrilloHMPCMM12 not found in BibTeX file
WARNING: Ground truth key conf/icuimc/MusaSA13a not found in BibTeX file
WARNING: Ground truth key journals/algorithms/MarschallR11 not found in BibTeX file
WARNING: Ground truth key journals/tnn/ZhaoG11 not found in BibTeX file
WARNING: Ground truth key conf/hci/SugiuraSO15 not found in BibTeX file
WARNING: Ground truth key journals/nn/HuangCZW11 not found in BibTeX file
WARNING: Ground truth key conf/sp/RuhrmairD13 not found in BibTeX file
WARNING: Ground truth key conf/aaaiss/SilverYL13 not found in BibTeX file
WARNING: Ground truth key journals/nn/WoodwardFI15 not found in BibTeX file
WARNING: Ground truth key conf/icis/JenkinsDB11 not found in BibTeX file
WARNING: Ground truth key conf/icitst/AmankwaLK14 not found in BibTeX file
WARNING: Ground truth key conf/cec/ChengQWSZ15 not found in BibTeX file
WARNING: Ground truth key conf/sp/BecherFHHUW11 not found in BibTeX file
================================================================================
SUMMARY STATISTICS
================================================================================

Frequency Distribution:

Category   Description                    Control    Treatment 
----------------------------------------------------------------------
NF         Not Found                      0          0         
WP         Wrong Paper                    0          0         
FP         Fabricated Paper               0          0         
FM         Fabricated Metadata            0          0         
CM         Corrupted Metadata             0          0         
IA         Incomplete Author              0          0         
IM         Incomplete Metadata            0          0         
PM         Perfect Match                  0          0         
----------------------------------------------------------------------
TOTAL                                     0          0         

Key Metrics:
  Coverage Rate (found/104):
    Control:   104/104 = 100.0%
    Treatment: 104/104 = 100.0%

  Quality Rate (PM/found):
    Control:   0/104 = 0.0%
    Treatment: 0/104 = 0.0%

Detailed results saved to: /Users/szeider/git/mcp-dblp/evaluation/data/full_evaluation_results.txt

