It really won't affect anything, it just made it difficult to transfer the followers, but it's all done now.
If you want to reconnect it, you can from the Jetpack section of the Dashboard. If you hover over "Connected to WordPress.com," it'll switch to a disconnect option.