Guidelines for Method ComparisonRead the first pre-print from the Small Molecule Steering Committee

Result

polaris/pkis1-kit-wt-mut-c-1_DGLGraphTransformer_PNAModel

DGLGraphTransformer + PNAModel

Submitted on: December 08, 2023ID: 94S8caboAxAB1paHAvlq4

Quick Links

Tags

baseline

null model

Contributors

Related benchmark

Detailed Results

Test set	Target label	Metric	Score
test	CLASS_KIT	f1	0.5499999999999999
test	CLASS_KIT	mcc	0
test	CLASS_KIT	pr_auc	0.3793103448275862
test	CLASS_KIT	roc_auc	0.5
test	CLASS_KIT	accuracy	0.3793103448275862
test	CLASS_KIT	cohen_kappa	0
test	CLASS_KIT_(T6701_mutant)	f1	0.2772277227722772
test	CLASS_KIT_(T6701_mutant)	mcc	0
test	CLASS_KIT_(T6701_mutant)	pr_auc	0.16091954022988506
test	CLASS_KIT_(T6701_mutant)	roc_auc	0.5
test	CLASS_KIT_(T6701_mutant)	accuracy	0.16091954022988506
test	CLASS_KIT_(T6701_mutant)	cohen_kappa	0
test	CLASS_KIT_(V560G_mutant)	f1	0.2456140350877193
test	CLASS_KIT_(V560G_mutant)	mcc	0.05290502621624715
test	CLASS_KIT_(V560G_mutant)	pr_auc	0.14821200510855684
test	CLASS_KIT_(V560G_mutant)	roc_auc	0.5383333333333333
test	CLASS_KIT_(V560G_mutant)	accuracy	0.5057471264367817
test	CLASS_KIT_(V560G_mutant)	cohen_kappa	0.03557617942768765