backtop

Print E-mail del.icio.us 37 comment(s) - last by TomZ.. on Dec 19 at 1:10 PM
NIST and University of Texas scientists a working on an open source project that can weed out program bugs much faster than current techniques.

Conventional programming wisdom has long said that most software failures result from a mere two variables colliding in an unforeseen way. Finding these possible bugs can be an arduous and expensive undertaking for large programs. Computer scientists and mathematicians at the National Institute of Standards and Technology (NIST) and the University of Texas, Arlington are developing a new, open source application that can test for these bugs quickly and inexpensively.

Though their research shows that most of these program bugs are caused by only two variables interacting, faults caused by the interaction of six variables or more are not unseen. The application under development by the NIST-University of Texas team takes this into consideration, using a technique more commonly used in the chemistry field known as combinatorial testing.

Trying all combinations of 10 variables in a given program would take 1,024 tests. The software, however, would be able to generate smarter tests, making the count for every combination of three of the variables interacting just 13 tests. Using the combinatorial approach, it can test 120 of the three-way combinations simultaneously. The tool has no problem generating efficient tests for combinations of six or more variables and does so quickly.

Given that many software programs -- even a simple web browser -- can have many more than 10 variables interacting in interesting ways in many different combinations, the approach would be a boon for bug testing for many programmers and software engineers. The researchers are looking to release the open source application next year.

The team is currently inviting developers to use the software in beta testing. The application could be useful for programming in everything from e-commerce to robotic assembly lines.

Comments     Threshold


This article is over a month old, voting and posting comments is disabled
Neat idea
By bhieb on 12/18/2007 11:43:57 AM , Rating: 5
Here I thought the cheapest way to test for software bugs was just to release the product and let your paying customers find them for you at no charge (cough EA, MS, ...)




RE: Neat idea
By omnicronx on 12/18/2007 12:07:55 PM , Rating: 5
Windows is probably tested more than anything you can think of. So many pieces of hardware and so many things can go wrong, its nearly impossible to fix everything. I find MAC OSX has just as many bugs, yet they get to chose their hardware, drivers, so its essentially a closed system.

Nobody else markets their product in the Billions so you have to cut them some slack. don't get me wrong MS is far from perfect, but they are also far from the 'Let the User fix our bugs' attitude you are presenting.

EA does just what you say though, BF2142 is a nightmare.


RE: Neat idea
By amanojaku on 12/18/07, Rating: -1
RE: Neat idea
By Oregonian2 on 12/18/2007 1:05:00 PM , Rating: 2
Yes, and that way Microsoft can move their OS sales number to match Linux too!!!!!


RE: Neat idea
By FITCamaro on 12/18/2007 1:08:38 PM , Rating: 5
The average person doesn't want to think about what their OS comes with and have to worry about downloading extra packages and installing them. They want to turn it on and use it.


RE: Neat idea
By amanojaku on 12/18/2007 1:43:51 PM , Rating: 1
True. That's why software installers come with the "include all" option. For those of us who know what we're doing it would be nice not to have to rely on nLite or vLite. I can see Microsoft one day refusing to support stripped Windows installs.

Don't get me wrong, I'm not advocating Linux; package dependencies are atrocious. But being forced to install all of creation when the basics don't work (Explorer and memory leaks) is ridiculous.


RE: Neat idea
By Inkjammer on 12/18/2007 2:04:24 PM , Rating: 2
It would be nice if Windows came with a minimal install. No IE, no Media Player, no other useless apps. It's good for the average consumer, but I use VCL Lan Player for my video and Firefox for my browser.

Alone half the other basic apps it has that I never use like Windows Movie Maker. I can go through and remove/customize things on my own, but it would be nice to have a "basic" install that just incorporates the bare necessities.


RE: Neat idea
By TomZ on 12/18/2007 2:10:30 PM , Rating: 2
quote:
But being forced to install all of creation when the basics don't work (Explorer and memory leaks) is ridiculous.

You're thinking of FireFox I believe - IE doesn't really have any serious memory problems.

Also, with as fast as Vista installs, and as cheap as HDD space is, I find it hard to get enthused about stripped down installs. That just means more different combinations of OS install variants to install, which will lead to more bugs. I therefore don't think that's a very good idea.


RE: Neat idea
By amanojaku on 12/18/2007 2:34:22 PM , Rating: 2
While I love the security of FireFox, the memory leaks (both from internal code and add-ons) is simply annoying. I connect to work through a VPN for 8 hours a day and witness physical RAM peaking at 200MB and virtual memory peaking at 350MB. Eh?!?

I meant Windows Explorer, not IE. Funny thing about Windows, the longer you leave it running the more memory Explorer uses. Even after you close apps and leave the system alone for an hour the memory doesn't free up. The same is true for rundll32 and svchost. If MS spent less time developing trivial applications in Windows it might get the core components to work properly.

As for Windows branches, I don't believe that's an issue. First of all, optional components won't create branches. And if the focus is on the Windows core there will be less bugs are more opportunities to make optional components that are stable, fast, and secure. In other words, MS should win a battle at a time in order to win the war.


RE: Neat idea
By FITCamaro on 12/18/2007 2:59:39 PM , Rating: 2
I leave my 1GB RAM MCE2005 video box on for weeks (only restart for updates that require it) at a time with no memory issues. Yes ME had massive memory issues but XP does not. Nor does Vista.

And its not like it just sits there serving video. I use Firefox and AIM on it nearly daily as well as rip and encode video on it.


RE: Neat idea
By shamgar03 on 12/18/2007 2:38:58 PM , Rating: 2
Firefox doesn't have memory leaks. It actually stores EVERY website you have been to in a cache. Everything that uses lots of memory doesn't have memory leaks. I believe you can also turn this off.

As for Vista installs....I literaly laughed out loud when you said "as fast as vista installs." Was that a joke...seriously, it took forever to install vista on my dual raptor, dvd dual, core opteron with 8800GTX. I don't know how long, but it was definitely twice or more as long as XP. Additionally your point about HDD space is useless. People who don't want the "extras" in Vista don't want to save HDD space they just don't want to have freaken services for said extras running in the background....all the time. Memory and CPU time are not as cheap has harddisk space. If Windows were (intelligently) modularly designed then cutting stuff would decrease bugs. When every part has a well defined interface then you tend to get far less bugs and far fewer security problems. Instead you have the most monolithic of monolithic OS's Vista where you can't go to the proverbial golf course without the proverbial kitchen sink or the proverbial 60 inch TV. In short I don't think you had anything good to say...I'm sorry.


RE: Neat idea
By TomZ on 12/18/07, Rating: 0
RE: Neat idea
By Alexstarfire on 12/18/2007 5:33:58 PM , Rating: 1
100-200 GB? That's it? My games take up more pace than that. And that doesn't include my movies, music, and anime. Heck, my anime takes up nearly 300 GB.

Vista really installs in under 10 minutes? I find that hard to believe, but if it's true then I'm really impressed. Even my cut down version of XP takes 15-20 minutes to install. I can say that I use compression on the stuff I put on it, which slows it down a bit, but I don't think it's by THAT much. I know that XP is pretty compressed on the CD. Perhaps it just needs more decompressing whereas Vista doesn't. IDK, but faster install times are always a good thing.


RE: Neat idea
By TomZ on 12/18/07, Rating: 0
RE: Neat idea
By FITCamaro on 12/18/2007 3:07:20 PM , Rating: 2
On my friends system Vista installed in about 5 minutes. Q6600, 4GB RAM, 250GB hard drive. Was 64-bit Ultimate.

When I installed it on P4 3.0GHz, 1GB RAM, 80GB HDD machines in Beta 2 it took about 10 minutes. Was more than reasonable considering how many GB it is. Was 32-bit Ultimate.

Yes I do agree that it would be nice if it was more modularized. As far as a lot of the background services you don't use, you can disable them from startup. You just open up msconfig and turn them off. That won't stop them from starting if something uses them, just won't be on at startup.

Honestly the biggest feature I'm not a fan of in Vista is SuperFetch. But people yelling at Microsoft for having it also need to yell at Apple then since they do the same thing.


RE: Neat idea
By imperator3733 on 12/19/2007 10:30:35 AM , Rating: 2
When Vista is installed on a new drive, it does install faster since it's image based. I believe it takes longer when you upgrade, but I haven't done that so I can't know for sure.


RE: Neat idea
By TomZ on 12/19/07, Rating: 0
RE: Neat idea
By rcc on 12/18/2007 1:59:22 PM , Rating: 2
Damn, you let the cat out of the bag. Now the EU will sue MS to force them to remove all those "optional" elements and sell them to us on separate discs.


RE: Neat idea
By bhieb on 12/18/2007 12:46:43 PM , Rating: 2
Yeah I am a MS fan boy, I just listed them right off the top of my head. Fact is everyone does it, but your right games are the worst. I cannot tell you how many times I have reinstalled BF2, SF, or BF2142. It just boggles my mind what they will release these days as a "complete" product, and charge you $50 to work the bugs out.

Oh well look on the bright side at least the patches