Print 56 comment(s) - last by mlembeck.. on Mar 12 at 11:38 AM

New research into "mixed reality states" promises Matrix-like "whoa"

Real-time model-based feedback is something that is far from commonplace in today's world.  The basic concept of real-time feedback is to take a physical system, modeled by mathematic equations, and then couple it with a computer as a virtual system. 

Sensor monitoring gives the processing logic an idea of how well the real world system is conforming to the theoretical model.  The results are processed and yield adjustments (feedback) to the real world system to make it in tune with the theoretical model.  The result is that the virtual and real world models converge into a single "mixed reality" system, bridging a the virtual (theoretical) and physical world.

Such an approach holds large benefits for everything from car handling and fuel economy, to better aircraft dynamics and smoother robotic control.  To accomplish such useful applications, researchers working on mixed reality had to start simple -- real simple. 

Researchers at the University of Illinois created a virtual pendulum and a real world counterpart that behaves as the world's first mixed reality system.  Bidirectional instantaneous coupling, adjustments both to the real world pendulum by motor feedback and the virtual pendulum by tweaking mathematical parameters, yielded a single system in which both systems' are synchronized.  The result is two pendulums swinging as one.

The experiment, the first fully successful one of its kind, sounds simple but raises mind-blowing questions about reality.  According to Illinois physicist Alfred Hubler, "In a mixed reality state there is no clear boundary between the real system and the virtual system.  The line blurs between what’s real and what isn’t."

Hubler describes the pendulums synchronization, stating, "[The pendulums] suddenly noticed each other, synchronized their motions, and danced together indefinitely."

Two physical mechanical systems have been previously coupled, but never before has a real world and virtual one been mixed.  Such a breakthrough was only possible thanks to ultra-fast computing, which allowed real-time processing of the pendulum data, and real-time response.  Hubler states, "Computers are now fast enough that we can detect the position of the real pendulum, compute the dynamics of the virtual pendulum, and compute appropriate feedback to the real pendulum, all in real time."

Hubler thinks that eventually coupling of the real and virtual worlds, may lead to it being hard to tell what is real and what is fake -- a topic immortalized by generations of science fiction writers.   Hubler worries people may become defensive and paranoid in the real world, based on threats in the virtual world.

The research was funded by the National Science Foundation and will be presented by Hubler at the annual American Physical Society meeting, which will be held in New Orleans, March 10-14, 2008.

Comments     Threshold

This article is over a month old, voting and posting comments is disabled

RE: Say What
By DASQ on 3/10/2008 4:38:06 PM , Rating: 5
The computer pendulum constantly adjusted for the position of the real pendulum. The concept is that if they're indistinguishable in terms of what IS happening and what SHOULD be happening, how do you know which one is the 'real' one?

RE: Say What
By DASQ on 3/10/2008 4:41:16 PM , Rating: 2
And vice versa. The physical system can mimic the computer system, and the computer system can mimic the physical system.

RE: Say What
By BoxCutterLou on 3/10/2008 4:54:01 PM , Rating: 2
"The physical system can mimic the computer system"

AHH I SEE! Well after staring at this phraze for a few moments. This is incredible. Who's in control should be the question at hand, not which one is real.

RE: Say What
By DASQ on 3/10/2008 10:33:03 PM , Rating: 2
You have a point, but following that thought, it doesn't matter which is real, because whoever is controlling it can make each alternatively real or "unreal" at any given time. "He" can essentially switch the two back and forth, if the two systems will synchronize as well as it should.

If you can't tell the difference between the two, does it matter which is "real" or not? Because if the physical system is real, it's simply mimicking the 'virtual' system. If the 'virtual' system is what you are perceiving, then it's simply mimicking the physical system anyway. It doesn't matter.

The only constant is the control.

RE: Say What
By JustTom on 3/11/2008 12:39:20 AM , Rating: 5
You'd be able to tell the difference easily; stand in front of both pendulums, the one that smacks you in the nose is the real one.

RE: Say What
By paydirt on 3/11/2008 9:10:39 AM , Rating: 2
Sounds like mental masturbation to me.

RE: Say What
By bhieb on 3/10/2008 5:09:16 PM , Rating: 5
So if I unplug the computer does the real world pendulum stop? How about disappear in front of my eyes, since the virtual one has been destroyed is the physical one. If not then this is no more than a computer controlled pendulum.

RE: Say What
By bhieb on 3/10/2008 5:12:56 PM , Rating: 2
Let me clear up that last part it is either a computer controlled pendulums, or a real time pundulum monitor. Either way they did not...
"suddenly noticed each other, synchronized their motions, and danced together indefinitely."

No they did not you idiot the hours of programming is what made them interact, nothing happened suddenly or indefinately.

RE: Say What
By DASQ on 3/10/2008 11:10:16 PM , Rating: 2
Before we resort to name calling, let me try and clarify the article some:

A motor was attached to the real pendulum. Software controlled the other.

If you told the software to speed up the pendulum slowly, the motorized pendulum would follow along precisely. Obviously a pendulum does not speed up without external stimuli, so you'd notice something was wrong. But you can't tell which pendulum is real or not.

The 'hours of programming' can be thought of as the computer version of the brain keeping track of the two pendulums and updating each perfectly, synchronously. The programming is 'smart' enough to know when one has change, and will adjust the other in real time to match it. I think that's just a short sighted comment :/

RE: Say What
By DASQ on 3/10/2008 10:41:29 PM , Rating: 2
If you told the computer pendulum to stop, the real world pendulum would stop as quickly (slowly) as the electronic one would.

The "disappearing" pendulum is kind of irrelevant. The point is, as long as someone cannot tell the difference between the "computer" pendulum and the "physical" pendulum (for instance, in a room with two small boxes with viewing windows, one is a real pendulum, and one is a hyper-realistic computer monitor displaying a 'perfect' render), then they are both as real as you, standing there staring at the two pendulums. You can't tell which is real or not.

The pendulums simply represent systems in which reality or illusion are displayed. To maintain the illusion, we have to assume that if your pendulum 'disappeared' for some reason, the computer would somehow make it disappear that followed our rules of physics, so you wouldn't realize that it wasn't "real". Of course, like in the Matrix, this is sometimes impossible, resulting in the person "plugged in" rejecting the Matrix, and "waking up".

RE: Say What
By bhieb on 3/11/2008 9:34:12 AM , Rating: 2
Ok first if you attach a motor to a pendulum it is no longer a pendulum by definition a pendulum swings freely. So now you have created a computer controlled robotic arm.

Secondly if all you are talking about is if it is real visually then yes looking at two in a box, one could not tell the difference. However that is not how we judge reality, if I reach into said box and cannot touch it then it is not real.

All I am trying to say here is that this is not reality, it is just a mimic of it. Simple 2-way robotics if you will. The computer adjusts an image based on inputs from a physical device, it is a mimic not reality.

RE: Say What
By DASQ on 3/11/2008 10:40:09 AM , Rating: 2
... the fact that the physical pendulum has a motor is irrelevant. You're utterly missing the entire point of the experiment. The viewer has no idea the pendulum has a motor attached to it.

Forget it, I give up, re-read the comments in this article and the article itself, if you still don't get it, then either you're not old enough to get it, or you're just not going to get it at all.

RE: Say What
By BoxCutterLou on 3/10/2008 4:44:57 PM , Rating: 2
"how do you know which one is the 'real' one?"

Thats the part I'm not getting. Unless there creating a virtual pendulem in real life, I'd say the one in the moniters the fake one.

Thats what it is isn't it? Theres no moniter?

RE: Say What
By Cygni on 3/10/2008 5:16:42 PM , Rating: 3

RE: Say What
By Parhel on 3/10/2008 4:58:30 PM , Rating: 2
I'm not following you. The 'real' pendulum is the one that physically exists and has physical properties such as mass.

And how is this categorically different from the kind of software that already exists to monitor automobiles, production line equipment, etc.? Software adjusts the behavior of the real (physical) system to make it behave like a simulated one.

The excitable physicist reminds me of a recent trip I made to the art museum. There was a canvas painted entirely black, with a three page explanation attached to tell you why you should think that it's significant. I bet someone paid a lot of money for that painting too.

RE: Say What
By BoxCutterLou on 3/10/2008 5:10:05 PM , Rating: 2
I know this is a stretch, but you could potentially pick something up in the computer environment( say your very heavy dresser or fridge) and move it with out ever touching the real physical thing. Well thats where I percieve this kinda tech is headed. but what do i know. I still don't understand how we won't beable to tell whats real and whats not unless its used for vr. And all i want in life is a vr helmet. They have 50 yrs to make one before I'm probably dead. Get on it!

RE: Say What
By Silver2k7 on 3/10/2008 6:13:33 PM , Rating: 2
Yeah bring on the vr =)

It just need some sensor(s) to detect the real world then add some layer of vr into the real world.. only visible for the ones wearing the helmet/glasses of course.. then you can have mixed reality vr games :D

RE: Say What
By DASQ on 3/10/2008 11:04:55 PM , Rating: 2
Okay, think of it this way: (this will seem kind of ridiculous, but just read it to the end :))

Your skin is biomechanical (like the Terminator). At the same time you feel sensation (and the electricity races up to your brain through the appropriate nerve clusters), the same 'feeling' is sent to a computer. If the computer has some kind of infinite bandwidth and CPU power, it can essentially duplicate everything you see, feel, smell, taste and hear (information). Like a super realistic video game, except you 'play' it with your own body.

Following me so far?

Now, if the computer instead 'hijacks' your senses, and says, creates the image and smell of a pie (let's say blueberry) on a windowsill, how can you tell if that pie is real or not? The computer is telling your eyes there is a blueberry pie on the windowsill. You see steam rising from the little holes in the top, and you smell it's flaky delicious crust and hot filling. But as you walk forward to pick up the pie, the computer tells your hands (brain) that you have a hot pie in your hands that weighs 1.3lbs, and otherwise perfectly obeys our known laws of physics.

How can you tell if the pie is real or not?
Kind of a basic example of how the illusion can be translated into our reality.

I think the usages listed in the article are pretty basic and nowhere near as 'whoah' as the Matrix comparison.

Think of a robot arm. It welds two pieces of metal together. Simple. Now the computer program is following along, movement for movement, tracking the arm. If the computer program detects the physical robot arm has gone off by 1nm (say, a gear is getting slightly rusty, or one side is lubricated better than the other), the computer can correct it in real time and put the arm back on track. The mistake will be still be there, but it was caught almost as soon as it started (far more efficient than human error correction). The arm doesn't realize it is off by such a tiny amount because it can't actively track everything. It think it's okay. A human brain can tell if his drawing looks 'off' ever so slightly, but a computer would normally need time to analyze the differences between the source and the actual output.

It's not that it was "omg impossible" before, it was simply never accurate to this level. Meaning we can now start mimicking the experience of the Matrix.

RE: Say What
By JustTom on 3/11/2008 11:32:29 AM , Rating: 2
How can you tell if the pie is real or not?

I could tell when I bit into it and the blueberry goodness does not end up in my belly.

mmmmmmmmmmmmmmmmmmmmmm pie.....

RE: Say What
By KristopherKubicki on 3/11/2008 1:36:17 AM , Rating: 2
And how is this categorically different from the kind of software that already exists to monitor automobiles, production line equipment, etc.? Software adjusts the behavior of the real (physical) system to make it behave like a simulated one.

Software that monitors cruise control, for example, is typically just a mechanical system. If its not a mechanical system, its some sort of analog transform that just compensates for jitter.

What they're doing here is actually simulating what should occur (in this instance, where the pendulum should be without friction) and what actually does occur, and then compensating for it.

"We don't know how to make a $500 computer that's not a piece of junk." -- Apple CEO Steve Jobs

Copyright 2016 DailyTech LLC. - RSS Feed | Advertise | About Us | Ethics | FAQ | Terms, Conditions & Privacy Information | Kristopher Kubicki