Connect your laptop/PC to the router (wired or wirelessly)
In Windows you open up a DOS prompt (Windows Button + R -> type cmd -> hit return)
You should see a print out like below that shows you the IP address of the router you're connected to.
On Mac OSX, follow instructions given here.
Missing command in the above... type the following in the cmd prompt