You can't miss the Parliament Building in downtown Victoria. It's a beautiful domed building overlooking the Inner Harbor on Belleville Street. Lit up at night, it becomes quite a sight and you can't leave Victoria without taking a picture of it. However, don't just look at the outside. Be sure to take one of their free tours, which are offered regularly throughout the day.
The second most photographed building in town is next door: The Empress Hotel. The hotel is so named because the city's namesake, Queen Victoria, called herself the Empress of India. If you're in the mood to play British Imperialist, there's no better place in town than the Bengal Lounge inside the Empress. For the price of a pint of beer, you can sit on a leather couch under a lazily turning ceiling fan and pretend you're in India by saying things like, "Well, my good man, I hear Allister was eaten by a tiger. He owed me five quid too. How very unsporting." While beer is not too unreasonable, be warned that everything else on the menu is rather expensive.