I have done this many times, but will need more info to help you.
I am guessing the video is a falsh player, are you using a custom player or a common (jw, flow, utube, brightcove etc). can you share the code where the clipis clicked... I am guessing you are doing this part with jquery...
Also what do you actually want to happen when you "link directly to the video" open the page the video is setup on. or play that video on the page you see.
can you point me to your test page?