From what it sounds like, Both are infact behind the router.... If you plug your machines into the router, they are infact "behind" the router.... If you connect your machine directly into the modem then you are NOT behind a router.
Hope that makes sense, wrote it kinda fast.