Maybe you're in the wrong place.
Did you go through the ratway(the tunnels under the city) to get there?
You should also turn the quest "on"(in case you didnt) so that the game will lead u there
Yeah I did. It's not letting me. The quest says to talk to Brynjolf and he says me him there and he isn't there and the people say to talk to him.