How we assess vendors

Why there’s no numeric score

Most comparison sites give every product a number out of 5 or 10. We don’t, for a simple reason: nobody on this site has run every one of these systems hands-on in a live lab, so a precise numeric score would imply a level of tested confidence we don’t have. Instead, each fiche carries an assessment by dimension: a qualitative reading of the publicly available, sourced evidence, shown as color-coded cards rather than a bar chart.

There’s also no aggregate star rating anywhere on this site, and no aggregateRating in the page’s structured data. That kind of rating is meant for real user reviews, not editorial reading of vendor documentation.

The three levels

Each dimension is marked one of three ways:

Every card also carries a short rationale explaining specifically why it landed where it did, with a link back to the fiche’s sources for anyone who wants to check the underlying evidence themselves.

On full profiles backed by an evidence file, a dimension with no independent evidence is left out and listed as not assessed, rather than given a level. Short profiles carry no assessment at all.

Independent coverage

Each full profile also states how much independent material backs it: Broad, Moderate or Limited. This measures what third parties have published about the product (public contracts, institutions describing their own use, peer-reviewed papers, user reviews), not our opinion of the vendor or of the product. A well-established product can have limited independent coverage simply because its customers rarely write about the software they use. Each profile gives the reason for its level at the top of its independent sources section.

The six dimensions

Each level follows the same written criteria on every fiche, so that two vendors with the same public record get the same level.

Compliance evidence levels, specifically

Because compliance is the dimension most likely to matter for a regulated lab, it gets its own table on every fiche, standard by standard, using four levels:

For an electronic lab notebook, two of these matter more than the rest. 21 CFR Part 11 and EU Annex 11 govern whether notebook entries and electronic signatures can stand as regulated records, which is the whole point of replacing a paper notebook in a GxP environment. ISO 27001 and SOC 2 matter because an ELN usually holds a lab’s unpublished research data in a vendor’s cloud. Where a vendor documents an audit trail and signature workflow specifically, that’s called out on the fiche.

See Methodology for the sourcing rules behind all of this.