I think it happens because that 20% applies to your skill base dmg (not counting the other trait increase/item final amount). So for example:
Desolation hits for 3000 base dmg (just to make numbers...