blog for internet video and audio conferencing
RSS icon Email icon Home icon
  • Pseudo-3D Video Conferencing with a Generic Webcam (Chris Harrison, Scott Hudson) – ISM ’08

    Posted on March 18th, 2009 25 comments
    chrisharrisoncmu asked:


    www.chrisharrison.net When conversing with someone via video conference, you are provided with a virtual window into their space. However, this currently remains both flat and fixed, limiting its immersiveness. Previous research efforts have explored the use of 3D in telecommunication, and show that the additional realism can enrich the video conference experience. However, existing systems require complex sensor and cameras setups that make them infeasible for widespread adoption. We present a method for producing a pseudo-3D experience using only a single generic webcam at each end. This means nearly any computer currently able to video conference can use our technique, making it readily adoptable. Although using comparatively simple techniques, the 3D result is convincing.

    Kim

     

    25 responses to “Pseudo-3D Video Conferencing with a Generic Webcam (Chris Harrison, Scott Hudson) – ISM ’08” RSS icon

    • Scott

      cool, but unnecessary, i see no practical use for this, other than to show off to friends.

    • artifactingreality

      Herman

      that’s quite smart.

      Completely pointless, but smart.

    • Elmer

      Yes, and that would be find for desktops, but with a laptop, you would have to take a new picture every time you move it. I wouldn’t want to move out of the way every time I want to chat.

    • Ana

      The background, being semi-static, could be sent as a JPG beforehand and then only the foreground with the black background could be streamed. You could also have it stream as it normally would, then only have any processing occur on the viewer’s side. This way you get lower latency.

    • SterlingSadler

      Bryan

      Nice try. Keep it up check out esteembpo + com for social media marketing. gnhkm

    • Christopher

      Platinum euro babes love ‘em toys – VOYEURXXXPORN(.)COM

    • Loretta

      The hands would not be floating around in the foreground. They would still be on the clock. The only problem is the left side of the clock may have been captured at a different time than the right side of the clock. When these two images are merged you will get something funky. Probably two second hands, maybe two minute hands, and one hour hand.

    • Alicia

      I don’t think the black background can be avoided without adding more cameras. At some point there is going to be information on the sides and above and below that is unavailable to the program. This is simply because the webcam on the remote users computer is not capturing the whole room, only a square frame. You are simulating changing the viewers perspective without actually changing the camera’s perspective.

    • Bobby

      Great Example!
      I love the Simple approach!

    • SevenSixTwoNato

      Fernando

      It’s an excellent simulation for true 3D, and certainly great considering its simplicity.

      5 stars!

    • Rick

      This is insane! Really nice work! Any example code?

    • Herman

      I’m not sure I see the point of this. the only person I know of who moves around incessantly is Ozzy Osbourne and I doubt I will ever video conference with him.

    • Roland

      Nice technique, but I can’t imagine anyone swaying his head around that much when video conferencing. Also, with just the one webcam you’ll never get a “true” 3D effect, limiting the effect to a flat layer of the person on a flat layer of the background.

      Having two equally spaced cameras could give a more true 3D effect because you can get real depth/offset data, but then again that would be custom/more hardware.

    • Maurice

      sounds really complex
      but really basic techniques

    • Mitchell

      The “immersion” offered by telepresence (short of connecting wires to your nervous system) has, to me, always seemed a little silly. Who wants that much immersion? The homesick! Potential applications: Holding up a sentimental trinket to the web cam and rotating it. On the other end, a 3D model of the locket/stuff animal/toy/etc. can be saved and viewed any time or used in Second Life-type games.

    • Theodore

      “Real 3D” (or stereoscopy as it’s usually called) could be applied to this technique very easily.

    • Glenn

      Excellent demo !!! When can I get this software ???

    • Ana

      useless

    • Lois

      To get the clock ‘proper’, you’d have to remove the hands from it while taking the background picture.
      Furthermore, you’d have to set the movement detection to ‘extremely sensitive’ in order to catch the hands’ slow movement. (Marking them manually would probably be a better solution.)
      I think it would look rather funny having the hands move about in the foreground, floating around in a ghostly manner, like creatures who have escaped from Disney’s Beauty and the Beast…

    • TheLaughingImp

      Tim

      Perhaps they’re hoping that by wiggling about like that, no one will notice how bad their hair is.

    • Dan

      Everyone talking about the black background and why it should be removed by stretching the background…this is a demo video and you need that black background to demonstrate how it follows your heads movement. In a commercial application it likely the background would be stretched.

    • spazmaster1000

      Christina

      neat idea :D

    • Ana

      Sweet tech, good implementation of different projects.
      I would say to the other person “quit movin your damn head already, wiggly bastard”

    • Eric

      Actually wrong, a 3D game has twice the amount of information to represent a meta-3D environment, this is total BS. Go figure, I should have known better thant to trust a slashdot article. This is clearly NOT 3D..Geeez…

    • Cindy

      Parallax is not REAL 3D!!!
      It only LOOKS 3D in the camera.

      It’s as much 3D as a 3D game.
      Not as in 3D glasses!


    Leave a reply

    You must be logged in to post a comment.