shouldiuse.io

Categories

VERDICT

PeerReviewAI Review

Depends

Should I use PeerReviewAI?

[PeerReviewAI](/) - peerreviewai.org

· 5 hours ago

Fine as a cheap pre-submission feedback tool for individual researchers who first confirm their journal and funder allow AI assistance. Avoid it for real peer review or confidential manuscripts — evidence is thin (low confidence) and its own security page 404s.

Confidence

Low. Based on ~35 public sources; only 3 directly cover PeerReviewAI itself — most evidence describes the AI-peer-review category, hence low confidence.

Ratings

  • Value for moneyNo verified pricing evidence
  • Ease of useNo user feedback found
  • Feature depthNo feature documentation in sources
  • Support qualityNo support evidence found
  • Security posture

Pricing

$0

Free (unverified)

ModelNot disclosed
Monthly feesNot disclosed
HardwareNot disclosed

Best for

  • Researchers wanting fast pre-submission feedback
  • PhD students polishing manuscripts
  • Authors at journals without AI restrictions

Not for

  • Reviewers producing official peer reviews — ICMJE 2026 rules restrict AI
  • Funded researchers under bans like Foundation for Food & Agriculture Research's
  • Anyone handling confidential unpublished manuscripts
  • Buyers needing proven tools with real user reviews

Gotchas - check before you buy

high

Its own security page 404s — no encryption, retention, or privacy details anywhere

high

Unpublished manuscripts are confidential; uploading to an unvetted AI service risks exposure

medium

Using it to generate reviews you submit can breach journal and funder policies

medium

Pricing murky: 'Free $0 with 3 reviews' on its comparison page may describe Jenni AI

Pros and cons

Pros

  • Targets a documented pain: slow, overloaded academic peer review
  • Category research suggests AI can improve review efficiency when supervised
  • Publishes head-to-head comparisons with rivals like Jenni AI

Cons

  • Category under fire: ICML caught 497 AI-cheating reviewers
  • Some funders explicitly ban AI tools in peer review
  • ICMJE 2026 adds new rules restricting AI use by reviewers

Sources & method

- 10 sources - No known vulnerabilities found in the sources reviewed, but the product's own /security page returns a 404 — no data-handling disclosures.

official x3review x1security x1news x5
  • Security page returns 404, renders '404 Page not found'; no privacy, encryption, or data-retention documentation found.

Key stats

  • Security posture: 2/5

    Rating

  • $0

    Starting price

  • 10

    Sources

  • Analyzed

  • Value for money. No verified pricing evidence
  • Ease of use. No user feedback found
  • Feature depth. No feature documentation in sources
  • Support quality. No support evidence found
  • Security posture: 2/5. Own security page 404s; no disclosures
  • Likely $0 Free tier per its Jenni AI comparison page — unverified
  • 404 Security page peerreviewai.org/security not found
  • None found Independent reviews no G2/Capterra/user reviews in sources reviewed

Pricing

Free (unverified)

$0

  • Guess: ~3 reviews before payment
  • Comparison page may describe rival Jenni AI instead

Security

No known vulnerabilities found in the sources reviewed, but the product's own /security page returns a 404 — no data-handling disclosures.

  • Security page returns 404renders '404 Page not found'; no privacy, encryption, or data-retention documentation found.²

What users say

No product-specific user reviews found; discussion covers AI peer review broadly and skews skeptical about integrity.

Companies that could

  • ICML⁴ Uses OpenReview (human review with AI-cheating detection) instead
Full analysis

Based on ~35 public sources; only 3 directly cover PeerReviewAI itself — most evidence describes the AI-peer-review category, hence low confidence.

Thin-evidence AI manuscript reviewer: no user reviews, murky pricing, 404 security page. Draft feedback maybe; real review no.

Methodology

Based on ~35 public sources; only 3 directly cover PeerReviewAI itself — most evidence describes the AI-peer-review category, hence low confidence.

Read how a report is made.

Sources

  1. PeerReviewAI homepagepeerreviewai.org
    official
  2. PeerReviewAI security page (404)peerreviewai.org
    security
  3. PeerReviewAI vs Jenni AI comparisonpeerreviewai.org
    official
  4. ICML caught 497 AI-cheating reviewers with a hidden trapaiforautomation.io
    news
  5. Policy on Prohibiting AI Tools in Peer Review (FFAR)foundationfar.org
    news
  6. AI Peer Review After ICMJE 2026: New Reviewer Rulespubrica.com
    news
  7. Artificial Intelligence in Peer Review: Enhancing Efficiencypmc.ncbi.nlm.nih.gov
    news
  8. Science Is Drowning in AI Slop (Reddit)reddit.com
    review
  9. SciSpace: AI agent peer review with novelty checkscispace.com
    news
  10. ManuscriptMind for Economicsmanuscriptmind.com
    official

Rate this review

Anonymous. You can change your vote.

Loading votes…

Comments

One queue. No nested comments. Give a display name first. Limit: 200 words per comment and 7 comments per day. You can edit or delete yours.

Save a name to write a comment.

0 / 200 words

No comments yet.