Personally, we liked Montreal more than Toronto, but not as much as Ottawa. Our favorite part of Montreal was Old Montreal. The basilica was lovely.
One thing we learned from visiting the cities in Canada is that our "sweet spot" for city size is between 500,000 and 700,000 people. If it's much bigger, it's overwhelming to both of us. Smaller cities may not have as much culture. There's our two cents!