Dedicated Server: Cant join via IP but can join via steam

[kurikaktus]

Hey there. I've hit a road block. I've already setup a dedicated server but I cant seem to make people join via IP. I let the host join locally (127.0.0.1) then we joined him through steam (right clicking steam friend and selecting join game). This method works but if he isnt in the game, none of us would be able to get in the server. We've already portforwarded and I am unsure what else to do.