Create directory structure matching package name

Currently the tooling doesn't work very well when we place files directly into the "kotlin" directory.