PC is definitely the better version. It's not only the game itself, but also the massive amount of freedom it gives you to 'tinker' and extend the game with your own ideas and stuff. Things like datapacks for example can be really exciting.
And that's not even mentioning stuff such as mods which can really add cool new things into the game.
Still, if you want a controller then the Windows 10 edition is probably better suitable. However, that's basically the version you're playing now but this time running on PC ;) I personally like the Java edition the most, and that could become tricky with a controller.
I recently started messing around with a so called "steam controller" and have managed to get some results with the Win10 edition but not so much with the Java edition.
Still... you could always consider giving the keyboard & mouse a try ;) Minecraft is decently simple, you don't need that many controls. Basically w,s,a and d to move. And then a button to jump, sneak/crouch, drop stuff and swap items between your hands.