Simply don't use your Phatasm at the moment the enemy is upon you. Use it while they are getting close. And use clones to distract them.
However this should not be an excuse for unintended delay.
Regardless of how useful or useless it might be in a certain situation, the delay in not an intended functionality and therefore a bug.
But they have already stated that are aware of this issue and are working on a fix, so that is OK with me.