The Rubric

Exactly How We Read Your Work

This is the full 600-point rubric a nipcr reviewer scores against. Nothing here is applied differently behind the scenes — if you can meet this checklist, you already know what your report will say.

How Scoring Works

Every manuscript is read by two or three reviewers. They score it independently against this rubric — none of them can see another's scores or notes until their own are submitted — and your score is the mean of what they give each section. The report names the spread between them, so you can see how much they agreed.

The finished Review Report — scores, section breakdown, and every reviewer's written notes — is downloadable by anyone from the public Review Log. That is what makes a result checkable rather than something you have to take our word for. Reviewers write knowing this, and are named in it only as “Reviewer 1/2/3”.

A score of 520 out of 600 (86.6%) clears our threshold for methodological rigor. Below that, the report is still detailed and useful — it means the reviewers found real, specific gaps worth fixing. A failure in Section 1 (formatting) caps the maximum possible score at 500, since basic reproducibility and structure come before anything else.

Manuscripts without a working link to open-source code and accessible data score very low here, regardless of how novel the idea is. This is the single most common reason for a low score.

§1Formatting & Structural Integrity

100 pts
1
Typography & Margins
25 pts max
1-inch margins, 12pt Times New Roman or 11pt Arial. Double-spaced. ‒25 if grossly violated.
2
Structural Architecture
25 pts max
Adherence to IMRAD format (Introduction, Methods, Results, Discussion). ‒25 if absent.
3
Pagination & Line Numbers
25 pts max
Continuous line numbering and sequential pagination. ‒10 for missing line numbers.
4
Citation Adherence
25 pts max
Vancouver/AMA superscript formatting. No APA. ‒25 for incorrect style.

§2Computational Reproducibility

150 pts
5
Open Source Codebase
50 pts max
Code available via a public repository. ‒50 if code is hidden or proprietary.
6
Data Availability
50 pts max
Raw/training data accessible or clearly cited public datasets. ‒50 if data is proprietary and un-auditable.
7
Environment Documentation
50 pts max
Explicit declaration of software versions, libraries, and hardware used. ‒25 for ambiguous environments.

§3Methodological Rigor

150 pts
8
Statistical Integrity
50 pts max
Appropriate statistical tests, reporting of 95% CIs and standard deviations. ‒50 for relying solely on raw accuracy.
9
Validation Mechanisms
50 pts max
Control groups, cross-validation, or external validation sets. ‒50 for testing on training data.
10
Biological Grounding
50 pts max
The model demonstrates clinical or biological rationale. ‒50 if treated as a purely abstract math exercise.

§4Results & Scientific Validity

150 pts
11
Logical Consistency
75 pts max
Data and results logically support the stated conclusions. ‒75 for exaggerated or unsupported claims.
12
Limitation Disclosure
75 pts max
Honest disclosure of model limitations, biases, and failing edge-cases. ‒75 for claiming flawless perfection.

§5Impact & Novelty

50 pts
13
Contribution to Field
50 pts max
Originality of the computational approach or unique dataset aggregation. Scaled 0–50 based on novelty.
Right now, reviews are read by nipcr's founder, working directly from this rubric — we're upfront that this is a single-reader process today, not a multi-person editorial board. Strong submitters are invited to become readers themselves over time. More on how to reach us.