Yes, every time you change the name servers you do "restart the clock" on the time it takes for the DNS to propagate again. :-)
If you still can't see your site after 24-72 hours have passed after the latest name server update, you can try flushing the DNS cache by using the first Terminal command here, under "OS X Mountain Lion or Lion"