How do I get my horse to go forward?

We saddle him and but on the bridle and bit, but when I get on him, he wont even move. when I get off, he walks around. When I tey to get back on, he just stands there.