We test and score water filters using a battery of 6 data-driven tests. Our tests are a mix of objective testing and subjective assessment. This testing process applies to all water filters, including reverse osmosis (RO) systems, pitchers, tanks, countertop units, under-sink systems, in-fridge systems, and other types of home water filtration.
Our 6 testing and scoring categories include:
In addition, we also test and/or analyze the following non-scoring categories.
- Filters
- Size & Dimensions
Regarding filters, needless to say, the filter performance on any water filter is mission critical. Instead of attempting to test filters in our studio, we utilize an external 3rd party laboratory for all water testing. As a result, the purification performance section of our reviews is focused on filter performance. The specific filter section of our water filter reviews is a general assessment of filter types and their purposes.
Purification Performance Test
Scoring Weight – 80%
Our purification performance test is based on 3 objective factors. Two of those factors contribute to the overall score, with one of them having no weight.
The 3 tests include:
We perform all of these tests using a 3rd party water laboratory testing service (TapScore / Simple Lab). We send them water samples for testing. They send us a detailed report on the contaminants found in the water and what impact those contaminants can have.
We consolidate the data and provide an analysis of how these contaminants may impact you.
Health Risk – examines the contaminants found in the water and analyzes how they could impact the health of the drinker over a long period of time.
Aesthetic Risk – examines contaminants found in the water and analyzes how they impact the taste and feel of the water.
Plumbing Risk – examines contaminants found in the water and analyzes how they impact the plumbing in the home of the user. Due to the nature of the products we test, the filtered water seldom moves through the pipes in the home. Because of this, the water will have little to no impact on the plumbing, therefore this is not a scoring factor.
Filtration Speed
Score Weight – 5%
Our filtration speed test is an objective test. Using a stopwatch, we fill the water reservoir and measure the time it takes for the water to be filtered. The faster the water is filtered, the better the score.
Certain water filtration systems (ex. under sink RO system) require a more customized measurement and/or assessment. In some cases, we utilize the manufacturer’s reported specifications.
Build Quality Test
Score Weight – 5%
Our build quality test is a subjective test. We examine and assess the major material and design components of the water filter and its container, rating the build quality of each element.
Specifically, we are looking for build and design issues that are more likely to break and/or be difficult to use. Our assessment follows our standard 7-level tier system (exceptional, excellent, very good, good, fair, poor, and very poor).
Usability Test
Score Weight – 5%
Our usability score is based on 2 factors. The 2 tests are weighted based on their relative importance.
The 2 testing and scoring factors include:
In addition, we also record the specific parts and accessories included within the box. This is a non-scoring factor.
Setup
Score Weight – 30%
Our setup test is a subjective assessment. We set up the device, recording the length of time required to set up the device as well as the difficulty of the setup process. Our assessment follows our standard 7-level tier system (exceptional, excellent, very good, good, fair, poor, and very poor).
On-going
Score Weight – 70%
Our on-going test is a subjective assessment. We analyze the experience of using the water filter and its container / reservoir / tank. We check to see how simple and convenient the product is to use on a day-to-day basis. Our assessment follows our standard 7-level tier system (exceptional, excellent, very good, good, fair, poor, and very poor).
Maintenance Test
Score Weight – 5%
Our maintenance test is based on 2 factors, with 1 being an objective test and the other a subjective assessment.
The objective factor is:
- Recurring Costs
The subjective factor is:
- Maintaining Tasks
Recurring Costs
Score Weight – 80%
Our recurring costs test is an objective test. We calculate the cost of each filter per gallon of purified water it produces and the estimated annual cost of replacing the filters based on the manufacturer’s specifications of the filter. Filters that are able to purifier more water for a low cost are better performers.
Maintaining Tasks
Score Weight – 20%
Our maintaining tasks test is a subjective test. We examine the tasks required to maintain a water filter, taking note of their relative difficulty and time requirements. Our assessment follows our standard 7-level tier system (exceptional, excellent, very good, good, fair, poor, and very poor).
Filters
Scoring Weight – 0%
Our filter test is a subjective test. We examine the filters used in the device. We check the type of filters used, assess the quality of the filters, assess the quantity of filter material, and perform other subjective filter analyses.
Size & Dimension Tests
Score Weight – 0%
Our size and dimension test is a report of size, weight, and water tank capacity.
This is not a scoring factor.