We test and score cordless vacuum cleaners using a battery of 7 data-driven tests. Our tests are a mix of objective testing and subjective assessment. This testing process applies to only cordless vacuums. See here for how we test robot vacuums and see here for how we test all other vacuums.
Our 6 testing and scoring categories include:
In addition, we also test the following non-scoring categories.
- Noise
- Size & Dimensions
Cleaning Performance Test
Scoring Weight – 55%
Our cleaning performance score is based on a series of 5 objective cleaning tests. The 5 tests are weighted based on their relative importance.
The 5 tests include:
Debris Test
Scoring Weight – 55%
Our debris test is an objective cleaning test. We complete a total of 12 debris tests using 3 different floor types (hardwood, low pile carpet, and high pile carpet) and 4 different debris types (cereal, rice, kitty litter, and sugar).
We place 0.5 oz. of each debris on our testing lanes in straight lines. We complete a single forward and backward pass with the cordless vacuum on the highest power and/or ideal cleaning mode (ex. bare floor mode for hardwoods).
We measure the amount of debris left on the testing lane to determine the cleaning performance for each type of debris and each floor type.
The debris test score is determined by how much debris by weight the cordless vacuum was able to remove on each floor type.
Long Hair Test
Score Weight – 10%
Our long hair test is an objective cleaning test. We place 1.0 grams of long synthetic hair onto our high pile carpet testing lane. We complete a single forward and backward pass on the highest power and/or ideal cleaning mode.
We measure the amount of long hair remaining on the hardwood floor and measure the amount of hair that got tangled in the brushroll. We compare these amounts to the starting amounts to determine performance.
This test examines how well the cordless vacuum can remove long hair without the hair tangling around the brushroll.
Pet Hair Test
Score Weight – 25%
Our pet hair test is an objective cleaning test. We place 1.0 grams of dog hair and embed it into the high pile carpet test lane. We complete a single forward and backward pass on the highest power and/or ideal cleaning mode.
We measure the amount of remaining pet hair in the carpet fibers and measure any hair that tangles in the brushroll. We compare these amounts to the starting amounts to determine performance.
This test examines how well the cordless vacuum can remove the pet hair.
Edge Test
Score Weight – 5%
Our edge test is an objective cleaning test. We place 0.3 oz of sugar, 0.1 oz of kitty litter, and 0.1 oz of rice directly along the edge of the wall, extending out 4.0″ from the wall. We run the vacuum towards the wall on the highest power mode, cleaning as close to the wall as possible with a single forward and backward pass.
We measure the distance from the wall the cordless vacuum was able to clean and measure, by weight, how much of the debris remained after cleaning.
This test examines how well the cordless vacuum can remove debris when in close proximity to the wall / edge / room perimeter.
Crevice Test
Score Weight – 5%
Our crevice test is an objective cleaning test. We use a specially built cleaning lane that has 3 distinct crevices of varying depths. We fill the crevices with 0.075 oz. (shallow) / 0.10 oz. (medium) / 0.150 oz. (deep) of sugar and run the vacuum over each crevice on the highest suction power with a single forward and backward pass.
We measure the amount of debris remaining in each crevice by weight and compare it to the starting amounts to determine performance.
This test examines how well the cordless vacuum can remove debris from crevices / gaps / cracks with the standard cleaning head.
Sealed System Test
Score Weight – 15%
Our sealed system test is a subjective performance test. We set up a fog machine and place the extension wand of the cordless vacuum directly in front of the output nozzle of the fog machine. We turn the vacuum on and release bursts of smoke into the vacuum.
With the test running, we subjectively assess how well the cordless vacuum contains the smoke, ultimately falling into 1 of 3 tiers:
- Completely Sealed
- Partially Sealed
- Not Sealed
This test examines how well the cordless vacuum contains ultra fine particulates while cleaning. Vacuums that are not properly sealed may redistribute the dust and debris back into the air / room while cleaning.
Build Quality Test
Score Weight – 5%
Our build quality test is a subjective test. We examine and assess the major material and design components of the cordless vacuum, rating the build quality of each element.
Specifically, we are looking for build and design issues that are more likely to break and/or be difficult to use. Our assessment follows our standard 7 level tier system (exceptional, excellent, very good, good, fair, poor, and very poor).
Run Time Test
Scores Weight – 10%
Our run time test is an objective test. We fully charge the battery of the cordless vacuum, attach the extension wand and standard cleaning head, and run the vacuum on a single mode until the battery depletes. We time the run time with a stop watch and repeat this process for each power mode available.
This test examines how long a cordless vacuum can run on each power mode. Vacuums with longer run times score better.
Usability Test
Score Weight – 10%
Our usability score is based on 4 factors. The 4 tests are weighted based on their relative importance.
The 4 testing and scoring factors include:
In addition, we also record the specific parts and accessories included within the box. This is a non-scoring factor.
Setup
Score Weight – 20%
Our setup test is a subjective assessment. We set up the device, recording the length of time required to set up the device as well as the difficulty of the setup process.
Accessories
Score Weight – 40%
Our accessories test is a subjective assessment. We analyze and use each of the included accessories, taking notes on how the accessories impact the cordless vacuum’s cleaning performance and usability.
Maneuverability
Score Weight – 35%
Our maneuverability test is a subjective assessment consisting of 3 factors.
The 3 factors include:
- Lay Flat Ability
- Turning Ability
- Weight
Lay Flat – 40%
Our lay flat test is a subjective assessment. We measure the angle at which the cordless vacuum can lay down and still clean.
These measurements fall in 3 tiers:
- Completely Flat (0-10 degrees)
- Mostly Flat (10-30 degrees)
- Not Flat (30+ degrees)
Turning Ability – 40%
Our turning ability test is a subjective assessment. We measure the turning ability of the cordless vacuum’s cleaning head while in operation.
Weight – 20%
Our weight test is an objective test. We measure the weight of the vacuum and determine the score. Lighter weight vacuums score better than heavier weight vacuums.
Controls & Display
Score Weight – 5%
Our controls & display test is a subjective assessment. We examine and use the controls and display of the cordless vacuum taking notes of how they are to use and how they impact the cleaning experience.
In Box
Score Weight – 0%
Our in box test is a report of what items can be found in the box when unpacking the cordless vacuum. Due to the this test being an itemized report, this is not a scoring factor.
Maintenance Test
Score Weight – 5%
Our maintenance test is based on 2 factors, with 1 being an objective test and the other a subjective assessment.
The objective factor is:
- Recurring Costs
The subjective factor is:
- Maintaining Tasks
Recurring Costs
Score Weight – 50%
Our recurring costs test is an objective test. We calculate the estimated annual costs of maintaining the cordless vacuum and its various parts.
Maintaining Tasks
Score Weight – 50%
Our maintaining tasks test is a subjective test. We examine the tasks required to maintain a cordless vacuum, taking note of their relative difficulty and time requirements.
Noise Test
Score Weight – 0%
Our noise test is an objective test. We use a sound meter to measure the level of noise generated by the cordless vacuum. We keep the meter about 3 feet away from the vacuum and run the vacuum on each power mode. We also measure the ambient noise levels of the room without a vacuum running to use as a comparison.
This test examines the noise levels created by the cordless vacuum. Vacuums are loud devices and while noise can be important to some, it ultimately doesn’t impact the vacuum’s ability to clean. In our view, noise levels aren’t a contributing factor to a cordless vacuum’s overall quality and cleaning performance.
As a result, this is not a scoring factor.
Size & Dimension Tests
Score Weight – 0%
Our size and dimension test is a report of size, weight, and dust bin capacity of the vacuum.
This is not a scoring factor.