Back-to-back rolling resistance testing: MTB versus Cyclocross tyres

Last year, in October 2023, I published the results from some tyre rolling resistance tests (see blog post here) in which I tested my cyclocross bike with 33mm cyclocross tyres.

Those tests showed that my cyclocross (CX) tyres were much slower than my Schwalbe Thunder Burt mountain bike (MTB) tyres. The CX tyres had a CRR value nearly double the CRR of the MTB tyres, which was a huge difference.

However, the two tyres were tested on different days, with different bikes and different power meters, so there were a number of factors that cast doubt upon that comparison.  Since doing that test, and especially as the results were so surprising, I've wanted to repeat the test by testing both tyres on the same day, with same power meter, thereby improving the quality of the test.  This blog post describes my latest test results, and thereby allows me to conclude, with much more certainty, which of my two bikes is faster for dry cyclocross races.

Recap of previous test results

The previous results are shown in the plot to the left.

The data points shown in red are the CRR values obtained from my hardtail mountain bike tested in June 2022.  The CRR values reach impressively low values (~0.015), much lower than the two sets of cyclocross tyres plotted in blue and green.

As noted in the plot, the Challenge Grifo/Baby Limus tyre test was done a day when the ground was softer.  This will have certainly caused the CRR values to be higher, although it's not clear how much the softer ground accounted for the differences.  Note also that the softness of the ground was only determined qualitatively by me, with no measurements etc of the firmness.

New test setup

The new test is better in several ways:

• Three different sets of tyres, all tested back-to-back on the same day.
• Same power meter for all tests: Favero Assioma Pro MX-2 power meter pedals.
• The power meter pedals are a dual-sided power meter, rather than single sided power meter that I've used in the past for most of the previous testing.

The use of a dual-sided power meter ensures total power is measured, whereas single-sided power meters measure only one side (one leg) and then assume the other leg is producing the same power in order to infer total power. Dual-sided power meters are therefore superior, especially since I have discovered that my left leg/right leg balance is not 50/50 (it's more like 53% left, 47% right).  Also, and more importantly, I've also discovered that my left/right leg imbalance is not fixed, and it varies with power, so there is inconsistency and inaccuracy whenever I use my single-sided powered meter. 

Test order:

1. Drop Bar MTB with 2.35" (60 mm) Schwalbe Thunder Burt Super Race tyres @16 psi
2. Cyclocross bike with 33 mm Challenge Baby Limus HTLR tyres @20 psi
3. Drop Bar MTB with 2.35" (60 mm) Schwalbe Rocket Ron Super Race tyres @16 psi

The test was performed in my usual way (see Chung method description here), with the exception that I tested only one pressure per tyre/bike this time, using pressures that I know from previous testing give good rolling resistance results but without negative drawbacks like pinch flat risks.

Speeds were measured using a hub-based speed sensor, with the diameter in my Garmin head unit set to a fixed value of 2115 mm.  Measured speeds were then scaled in the analysis based on measured diameters to give the correct speeds:

  - Schwalbe Thunder Burt:  Speed scaling factor = 2228 / 2115
  - Challenge Baby Limus:  Speed scaling factor = 2110 / 2115
  - Schwalbe Rocket Ron:  Speed scaling factor = 2245 / 2115

Results

I performed the Chung method (virtual elevation) analysis using a fixed CdA or 0.40 m^2.  It's obviously wrong to use the same value for both bikes, because it's likely that the CX bike with a lower frontal area (narrower tyres, etc) will have a slightly lower CdA.  However, in the same way that I've done it previously (see here), by using this fixed value of CdA, any performance differences between the three setups, whether those performance differences comes from aero, rolling resistance or something else, will be attributed to CRR.  Hence, whichever setup has the lowest CRR using this style of analysis will be the fastest bike.

Results with Fixed CRR

Using a fixed CRR value of 0.0261, the virtual elevation plots show that the three setups are reasonably similar.

Note that the variations in the measured elevation (the green line), should be ignored because this is simply a drift caused by changes to ambient pressure during the test (note that a one metre elevation difference measured by the Garmin barometer is equivalent to just a 0.12 millibar change in ambient pressure).  The tests were done riding laps of a grass field, so the actual elevation always returned to the same value, in reality.

The variation in the orange virtual elevation profiles show which setup is fastest.  The CX bike with 33 mm Baby Limus tyres is fractionally slower than the drop bar MTB with Thunder Burts, because it's VE profile rises slightly.  The fastest setup is actually the third one tested, the MTB with Rocket Rons, since the VE profile falls slightly for that third test.

Results with adjusted CRR values

The CRR values can be adjusted to 'flatten' the VE profiles, as shown below.

This plot shows that the three setups have the following CRR values:

• Drop Bar MTB with 2.35" (60 mm) Schwalbe Thunder Burt tyres:  CRR = 0.0261
• Cyclocross bike with 33 mm Challenge Baby Limus HTLR tyres:  CRR = 0.0263
• Drop Bar MTB with 2.35" (60 mm) Schwalbe Rocket Ron tyres:    CRR = 0.0251

Note that difference between the Rocket Ron CRR of 0.0251 and the Baby Limus CRR of 0.0263 is equivalent to 6.7 Watts of rolling resistance for a 85 kg bike+rider travelling at 15 mph.  These differences aren't significant, but they aren't particularly large differences either.

It's also interesting to note the average speeds, although it's more difficult to conclude which setup is faster form these speed, because the average power are not exactly the same.

• Drop Bar MTB + Schwalbe Thunder Burt tyres:  Avg speed = 13.79 mph @203W avg
• Cyclocross bike + Challenge Baby Limus tyres:  Avg speed = 13.33 mph @193W avg
• Drop Bar MTB + Schwalbe Rocket Ron tyres:    Avg speed = 13.60 mph @195W avg

Incidentally, one of the benefits of the virtual elevation method is that it's not necessary, as a tester, to hold a fixed power.  That's a really inconvenient constraint that many testers put upon themselves if they don't use a virtual elevation method and try to hold a fixed power.

Finally, it's interesting to note that the final two laps for the Rocket Ron have a significantly rising profile, even though the first four laps were flat.  Those last two laps would have a measured CRR of 0.0271, which is strange.  I have no explanation for these weird results during the last couple of laps.

Conclusions

I set out to see repeat my previous tests but with a better standard of testing, to see whether my previous conclusion that MTB tyres are faster for cyclocross still holds true.

The conclusions from this test aren't quite so clear.  The MTB tyres are still slightly faster, but not significantly so this time.  The MTB tyres are only about 1-7 Watts faster.  Therefore, I'll likely use my cyclocross bike if there is any chance of mud, since my CX bike has much better mud clearance and is less likely to get jammed up from sticky mud.

Perhaps the most surprising result of this test is that the Rocket Ron tyres were actually faster than the Thunder Burt tyres, despite being how knobbly they are compared with the Burts, and considering the tyres are similar in every other respect.  This goes against what I'd expect and is contrary to Bicycle Rolling Resistance tests (although the Rocket Ron performs quite well on BRR).  This is a test result that would be worth trying to reproduce at some point.