<b>SPEC</b> JVM Client98 Help

Using the Benchmarks

Initial Window






The diagram below shows the initial window of the benchmark program. The window contains three URL fields, controls for how the benchmark driver program operates, and an "OK" button to accept your selections and proceed to the main window.

error-file:tidyout.log

The first field is the URL for a property file describing specific characteristics of your client system. You would normally name this file according to the model/configuration of the system under test. E.g., Sun-Ultra2-2200, IBM-Aptiva233MMX, Digital-AlphaStation600. By entering defaults in this file you can save yourself a lot of typing in the configuration editing window later on, if tests are to be run several times. Typically you would create these files in the 'props' subdirectory of your SPECjvm98 installation directory on the server. However, this is an arbitrary URL and the file may be located anywhere. For example, the SPECjvm98 software may be installed on one server shared by multiple test groups, each of which maintains its' own collection of client property files describing systems tested by that group.

The second field is the URL for a property file describing specific characteristics of your server system. Its' use is analagous to that of the client property file. The third field is the URL for a text file of "tuning notes" which you use to document miscellaneous information regarding your test configuration. Refer to the run rules for more explanation.

Benchmark Sets

A choice item selects which set of benchmarks you will use. Normally for reportable SPECjvm98 results this will be "All". However, for test purposes you may define your own subset(s) of benchmarks in any order you wish. You may also add additional benchmarks to create your own sets, for test purposes only, not for reportable results. See Advanced Topics for information on interfacing programs to the SPEC tool harness.

The "Check" benchmark set comprises two tests to help ensure that your Java Virtual Machine and your installation of the SPEC benchmarks are suitable for producing valid results.

 

Test Mode

error-file:tidyout.log

If you check the "SPEC compliant" radio button then certain choices will be removed which do not comply with the run and reporting rules. For instance, all benchmarks are selected for execution and there is no way to change that selection and run a subset. And the single-execution Start Button described later is disabled. Instead you must use the multiple-execution Autorun Button. If you select "Test mode" then all the controls are enabled. It is still possible to perform a SPEC compliant run in "Test mode" but the chances for error are greater.

If you select "SPEC compliant" mode and are not executing the benchmarks from a web server, as required by the run rules, then a warning will be displayed.

Getting Help

error-file:tidyout.log

If you are running in a web browser which supports the AppletContext.showDocument method, e.g. most web browsers, you may display help information in a new browser window for convenience in reading and navigating the topics. You make this election by checking the appropriate button in the initial SPEC JVM Client98 window. If you choose instead to use the console, then help will be displayed in plain text on your Java console. Some, but not all, of the HTML tags will be removed. For appletviewer on UNIX the Java console is the command line window. For Netscape Communicator, it is a window opened from the "Java Console" item of the "Communicator" menu. For some JVM's there appears to be no way to view the Java console. Unfortunately there is no way for a Java applet to determine whether its' surrounding JVM is capable of displaying HTML pages or not, so we have to ask you which is most appropriate.

Continue to Main Window

error-file:tidyout.log When you're finished entering your choices on this window, press the "OK" button to continue into the main window. The "Help" button gives you help on the initial window (this help file). The "Cancel" button terminates the benchmark program, and is only appears when you are executing in application mode since applets may not exit.




error-file:tidyout.logNext topic: Main Window