Have you set the name servers as detailed at http://en.support.wordpress.com/domains/map-existing-domain/#instructions-for-mapping-an-existing-domain ?
NS1.WORDPRESS.COM
NS2.WORDPRESS.COM
NS3.WORDPRESS.COM
If you have, I recommend contact your domain registrar about this, as it's still broadcasting your registrar's name servers.