Rankings
Rating criteria
What exactly users rate: all areas and criteria on one page.
You rate each site with the same short list of "yes / no / don't know" questions and one trust rating from 1 to 10. The questions concern practices that are visible on the site, not the quality of the software itself.
3 areas and 9 criteria. Users rate each on a scale from 1 to 10. Alongside the ratings, the author describes their experience in three sections (pros, cons, summary), and reviews are moderated.
Ranking rules and transparency
You answer only about what you can check on the site. "Don't know" is a fully valid answer and does not lower the rating.
Does the site state clear criteria by which it orders its positions?
Whether you can find on the site what earns a product points or a place.
To choose from: Yes, No, Don't know. The answer affects the rating.
Does it describe how it calculates the score (e.g. weights, sources of ratings, dates)?
A list of criteria alone is not enough: this is about the method of calculation.
To choose from: Yes, No, Don't know. The answer affects the rating.
Does it clearly mark paid or sponsored placements or affiliate links?
Yes, if the marking is visible without searching for it. If paid placements do not exist and the site says so, also answer "yes".
To choose from: Yes, No, Don't know. The answer affects the rating.
Does the "editor's choice" or first place have a justification that can be checked?
A justification based on data, tests or reviews, not just on a statement.
To choose from: Yes, No, Don't know. The answer affects the rating.
Are user reviews on this site verified?
E.g. by proof of purchase, a customer account or confirmation of use.
To choose from: Yes, No, Don't know. The answer affects the rating.
Is the vendor unable to delete or hide a critical review?
The site has rules that rule this out, or states when a review may disappear.
To choose from: Yes, No, Don't know. The answer affects the rating.
Who runs the site
A ranking rated by the vendor of its own product is not the same as a ranking from an independent publisher. We ask whether this is visible.
Does the site disclose who runs it and how it makes money?
Information about the owner, the revenue model or ties to the rated products.
To choose from: Yes, No, Don't know. The answer affects the rating.
Who do you think the site's publisher is?
Answer statistics only: it does not affect the rating.
To choose from: The vendor of one of the rated products, A publisher unrelated to the rated products, A directory or comparison site with user reviews, Don't know. Answer statistics only, with no effect on the rating.
Trust
Your overall impression after viewing the site.
How much do you trust this site when choosing software?
The simplest measure of trust in a ranking.
1 I don't trust it at all10 I trust it fully