We will be staying at the Hyatt before our June 2nd cruise. About 5 blocks from Canada Place where most (not all) cruise ships depart from.
You might want to go to this site for more info about Ballantyne. A quote follows.
http://www3.telus.net/cruise_watch/info.htm#PIER
"Unfortunately, Ballantyne is a little remote and the area between the pier and the city center is the worst part of Vancouver. It is essential to stay in a downtown hotel and take a taxi to or from Ballantyne. You are advised to not to walk. It is a 15 minute taxi ride from downtown to Ballantyne and it costs about $9.00. "