If you're downtown during downtown hours, the Library is a restaurant/bar in the basement of the Robinson Renissance building. It is the best place downtown to sit down and talk to someone over a meal.
It gets kind of packed right at noon, so you need to get there a little early if you want a booth. Even when it is packed it only gets just loud enough to prevent people at other tables from hearing what you are talking about