Subject: Re: What are all the tests about ?
From: Dale E Martin (dmartin@clifton-labs.com)
Date: Thu Jun 14 2001 - 08:27:22 MDT
> I downloaded the pre2 version of savant and I saw there was the results
> of tests.
What specifically are you referring to? (What file in the distribution?)
> Is there a way to get the source of these tests ? Or, at least a
> description of the functionality tested by each file ? In fact, I would
> like to know the functionalities which are tested and fail.
I suspect you mean the regression test numbers, and as usual it's not a
simple answer :-) We were running the Billowitch VHDL regression suite on a
nightly basis. But then we had problems due to an ext2 bug in Linux 2.4.2
on SMP hardware, and it ended up corrupting a filesystem on our test
platform. I'm just now getting to fixing this problem. While the tests
were running, the results were getting pushed almost daily to:
http://www.cliftonlabs.com/savant/testresult/
The intention is that this will start again over the next few days. In the
long term, we've contacted everyone involved in creating Billowitch test
suite and we have permission to GPL the test suite, which we intend to do.
We also will include our testing system/scripts as part of this
distribution. However, the catch is that there was money from the Air
Force involved in creating this test suite, and they want the contract
number to be part of the distribution (which is a standard request in such
situations.) But the work was done so long ago noone knows what the
contract number was any more :-) So that's been holding this up for the
moment.
Billowitch covers a wide berth of VHDL constructs, but the examples are
small and mostly flat - not heirarchical and generally are contained in a
single file. So our long term plan is to take other redistributable models
(like the Free Model Foundation models, RAASP models, possibly the examples
from Peter Ashenden's excellent book, and other stuff like that) and add it
to the test suite. As well as models that we write, and anything anyone
wants to contribute - the more the merrier :-)
So, is that a longer answer than you wanted? ;-)
Thanks,
Dale
-- Dale E. Martin, Clifton Labs, Inc. Senior Computer Engineer dmartin@cliftonlabs.com http://www.cliftonlabs.com pgp key available
This archive was generated by hypermail 2b25 : Mon Mar 18 2002 - 13:00:02 MST