Your cart is currently empty!
What is the Validation Score?
The model Validation Score is a calculation of the probability that the model is fit for purpose and functions properly. Ref: Coyle DH, A; Lee, K. CADTH Health Technology Review: The development of a model validation tool to assist in the conduct of economic evaluations. Canadian Journal of Health Technologies. 2024;4(3).
How is the Validation Score calculated?
The validation score, as currently calculated for the CDA-AMC (CADTH) model validation tool, is a percentage of criteria met (that is, it is a measure of the % of “yeses” [is in agreement with each item]), not including items marked “N/A” of the 53 items included in the instrument.
Planned Phase II Updates
In Phase II, as paid services, we plan to allow for further categorization of the degree of model validity, unveil the subcategory scoring of the model validation, and allow for further model robustness assurances via additional model validation tools (e.g., AdViSHE), enabling end-users to have further confidence in deposited models.
Further Plans for Phase II Validation
We will use an agentic method that can orchestrate multiple steps, including running a model context protocol (MCP) for the deterministic/quantitative aspects and generation of virtual experts (LLM) to perform model validation according to published criteria by automating aspects of the Analytical Hierarchy Process (AHP), a subset of multi-criteria decision analysis, including criteria ranking, pairwise comparisons, and generating alternative evaluation.
Want to know more?
Please feel free to reach out to us by clicking on Contact Us. We will get back to you within a 24 to 48 hour timeframe.