Yes, you can install Windows 11 directly on a fresh build without using a pre-installed version.
It seems like you're saying that everything is fine, so there shouldn't be any issues.