There is a rate limit for the chat servers. See the Command & Message Limit section here: https://github.com/justintv/Twitch-API/blob/master/IRC.md and this article: http://help.twitch.tv/customer/portal/articles/1302780-twitch-irc
There was also some discussion here: Join rate limits on AWS servers