Honestly, I think the best thing you can do is just put a lot of thought into it. When drawing a character, what is he doing? Is he sitting on a bench? Is it in a park, are there trees? Is she in a library? What did the last library you saw look like? What things are in there, besides books? Imagine the surroundings and create a kind of mental map, which you can then fill in, using references to similar-looking places. Imagine it as if you were an architect, or an interior decorator - where the doors are, what color the walls are, how high the shelves go.
The mental map really helps, especially with consistency if you are making a series of related drawings, or a comic strip. Don't worry that you're overthinking it. Even if every detail you imagine doesn't make it into your picture, there's still value in visualizing it. Just ask Ernest Hemingway.
Hope this helps.
BoiledMilkz
Get references, draw what you see.
RTaru
Yeah, that's definitely it. I always have problems with references and drawing from reference, I'll definitely try working on that. Thank you.