I make sure to stock up on potions and mage water at the beginning of the third task. Also equip yourself with the strongest gems. But I actually found that using the rock throwing one repeatedly as he switches from side to side while you stay in the same place wears him down.