Yeah, I was thinking about it more, and the initial delay is due to communication from the client to the server and back again. The skill starts flashing as soon as the button is pressed, but the skill doesn't activate until the server tells the client that it activated. When the game was first released and the starting areas were all extremely crowded, it was not uncommon to press the skill button and have it flashing for several seconds before the skill activated due to the lag.
So i redid all the cast times for Eles with my new method. Before i would chain 5 skills and the cast time would be way faster than what i had. Now the cast time is perfect so i guess it's correct. Thanks for the info.