shouldiuse.io

Report

Should I Use W&B (Weights & Biases)?

wandb.ai·Analyzed 18 hours ago··Based on 10 sources

Weights & Biases, developer tools for machine learning

Depends

Depends

Buy if you run serious ML training or LLM app workloads — it's the category default with deep tracking and eval features.

Industry-standard ML experiment tracking; buy for serious AI teams, skip for casual projects — pricing gets rigid fast.

Confidence: Medium

4.9/5

G2 rating

26 reviews (W&B Models)

~$60/mo

Starting price

per seat, paid tiers

Yes

Free tier

freemium plan available

$250M

Total funding

across five rounds

Value for money3

Users call pricing rigid; usage billing compounds

Ease of use4

4.9/5 G2; praised intuitive UI

Feature depth5

End-to-end: tracking, evals, inference, artifacts

Security posture3

One high-severity CVE in Weave server

Pros

  • Category-standard experiment tracking with strong visualizations
  • Weave adds LLM evaluation, monitoring, and tracing²
  • Praised for an intuitive UI
  • 4.9/5 on G2
  • Free tier plus up to $3,000 in startup credits

Cons

  • Users call the pricing model 'very rigid'
  • Tracked-run caps (~500) on lower plans
  • ~$60/mo per seat adds up on larger teams
  • Larger teams report months of problems and are switching away

Gotchas

  • highTracked-run caps (~500) on lower tiers push teams into paid plans quickly
  • highSelf-hosted Weave server had CVE-2024-7340, high-severity arbitrary file read; patch before deploying
  • mediumWeave data ingestion, W&B Inference, and storage are billed by usage — costs surprise at scale¹
  • mediumGuess: deep SDK instrumentation creates lock-in; migrating to MLflow or Braintrust means code rewrites

Best for

  • ML teams tracking training runs
  • LLM app teams needing eval + tracing
  • Research labs comparing many experiments
  • AI startups scaling up (credits program)

Not for

  • Casual users logging a handful of runs
  • Teams wanting free self-hosted tracking — use MLflow
  • Non-engineers; requires SDK code integration
  • Cost-sensitive buyers — seats plus usage billing compound

Companies that use it

  • Canva
  • Harvard Kempner Institute
  • Earthmover

Pricing

Free

$0

  • Individual experiment tracking
  • Limited tracked runs

Team / Pro

~$60/mo per seat

  • Usage-based Weave ingestion and storage
  • Collaboration features

Enterprise

Not disclosed

  • Self-hosting, SSO, security controls

Security

One high-severity 2024 CVE affected the self-hosted Weave server; the managed cloud service was not implicated.

  • CVE-2024-7340 — W&B Weave Server arbitrary file readRemote arbitrary file leak via path traversal in the self-hosted Weave server; rated high severity (JFSA-2024-00103924).

What users say

Users love the tracking UX but increasingly gripe about rigid pricing, run limits, and enterprise growing pains.

W&B pricing model is very rigid.
Reddit, r/mlops
Over the six months or so, my team has had problems
Reddit, r/MachineLearning
I've been evaluating Weights and Biases recently
Reddit, r/mlops

Alternatives

Compare W&B (Weights & Biases) with each alternative.

MLflow

Free, open-source, self-hosted experiment tracking; less polished UI

Langfuse

Open-source LLM observability and tracing, self-hostable

Full analysis

Based on ~15 public sources; unrelated 'W&B' aviation and service businesses excluded from analysis.

Sources

  1. official
  2. review
  3. review
  4. review
  5. review
  6. review
  7. news
  8. security
  9. news
  10. news

Rate this review

Anonymous. You can change your vote.

Loading votes…

Ask a follow-up

Ask if a use case fits. Answers stay inside this report and its sources.

    Comments

    One queue. No replies. Give a display name first. Limit: 7 comments per day.

    Save a name to write a comment.

    No comments yet.