Here's how I reasoned it to myself - it's not that he can't mold chakra, it's that he has no talent at ninjitsu or genjitsu.
So, while he can't create illusions or blow shit up, he can still do whatever the hell it is that lets ninjas do all their crazy jumping shit. I mean, he can't be doing that on muscle alone.
At least, I hope he isn't.