shouldiuse.io

Comparison

Arthur vs LangSmith

Arthur and LangSmith both land on Depends.

Arthur versus LangSmith
CompareArthurLangSmith
VerdictDependsDepends
Best forTeams running LLM agents in productionTeams shipping LLM agents to production
Who it's not forSmall teams without dedicated ML staffHobby projects or simple chatbots . heavy overkill
PrivacyNo public breach or open vulnerability found in reviewed sources; June 2026 release notes remediate CVE-2026-4871, and the product security page currently 404s.³Two critical 2026 vulnerabilities disclosed: an auth bypass (CVE-2026-25750) and an SDK deserialization flaw (CVE-2026-40190).
Support qualityNo support evidence foundNo support evidence in sources
Public sentimentNo trustworthy independent reviews of Arthur AI surfaced; review-site results were polluted by unrelated products named Arthur.⁸Users praise detailed tracing and debugging but grumble about new pricing, reliability, and ecosystem lock-in.10
Biggest gotchacurrently 404s; request security documentation directly from sales⁴Reddit users report Plus tier in Europe makes you non-compliant14

Pick Arthur when

  • Teams running LLM agents in production
  • Regulated enterprises needing AI governance
  • ML platform teams monitoring model drift

When Arthur is not a fit

  • Small teams without dedicated ML staff
  • Anyone without AI models in production
  • Buyers needing transparent self-serve pricing
  • Early-stage startups on a budget

Pick LangSmith when

  • Teams shipping LLM agents to production
  • LangChain/LangGraph developers
  • Agent debugging and eval workflows
  • AI platform teams at scale

When LangSmith is not a fit

  • Hobby projects or simple chatbots . heavy overkill
  • EU teams on Plus tier with strict compliance needs
  • Budget-constrained teams wanting self-hosted open source
  • Apps with negligible agent traffic or no eval needs

Sources

  1. official
  2. official
  3. security
  4. security
  5. official
  6. official
  7. news
  8. review
  9. review
  10. review
  11. review
  12. review
  13. review
  14. review
  15. official
  16. official