All the mail mirrored from lore.kernel.org
 help / color / mirror / Atom feed
* Regression testing?
       [not found] <19990120031127Z157444-8100+9173@vger.rutgers.edu>
@ 1999-01-20 16:41 ` Dan Kegel
  0 siblings, 0 replies; only message in thread
From: Dan Kegel @ 1999-01-20 16:41 UTC (permalink / raw
  To: linux-kernel

Does anyone have access to some hefty benchmarks
suites like SPEC's, or regression tests
like the POSIX compliance test?
It might be a good idea to run 2.2.0-pre-x
through these to look for suprises
before going final with it.

The Posix test suite is downloadable from
http://www.itl.nist.gov/div897/ctg/posix_form.htm
See also http://www.standards.ieee.org/regauth/posix/
Even if we didn't actually pass all the tests,
it'd be good to know that we didn't oops.

The SPEC benchmarks can be purchased at
http://www.spec.org/cgi-bin/osgorder
for $700 or so.  The hard part is
actually having the patience to run them.
(I suspect if Linux or Alan asked nicely, they'd
donate a benchmark or two.   Or we could take
up a collection.  Or Alan's boss could pay.)
Three of the SPEC tests look interesting:

SPECweb96 stresses out HTTP networking.
SPEC SFS97 stresses out NFS networking.
SPEC SDM (System Development: Multitasking) 
stresses the kernel by simulating a large number of 
users running make, cp, diff, etc.

The point of running these benchmarks is not really
to say we're fast, but to see whether we can
actually get all the way through the benchmark
(which might take a day to run) without having
a functional error or a crash.
- Dan

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.rutgers.edu
Please read the FAQ at http://www.tux.org/lkml/

^ permalink raw reply	[flat|nested] only message in thread

only message in thread, other threads:[~1999-01-21  2:45 UTC | newest]

Thread overview: (only message) (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
     [not found] <19990120031127Z157444-8100+9173@vger.rutgers.edu>
1999-01-20 16:41 ` Regression testing? Dan Kegel

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.