Taming is the act of domesticating a horse which will make it listen to you and be controllable while riding it.
You can do this by approaching a horse and once you're close enough you can press 'F' when it prompts you to mount the horse.
After you've mounted the horse you will be prompted to press 'G' to tame it.
You can use hay bait to attract horses.