Someone named haithembelhaj has written a script for getting all this set up, and it includes apt-cyg! One command and cygwin is (almost) fully configured.

Awesome:
https://github.com/haithembelhaj/oh-my-cygwin/