I see the issue now. I am performing more than one action in the walk states. Currently I am using the State paradigm with four states: BANK, MINE, WALK_TO_BANK, and WALK_TO_MINE.
I guess Ill have to expand the WALK_TO_MINE state to WALK_TO_UPPER_LADDERS, GO_DOWN_UPPER_LADDERS, and WALK_TO_MINE, and a similar expansion for the WALK_TO_BANK state.
Thanks you all for the help. I'll try implementing this and see if it works.