SPECapc committee rules v1.23

The Application Performance Characterization Project Committee Rules

V1.23

Last Updated: 10/20/2004

SPECapc Benchmark Specific Rules and Procedures, Retired Benchmarks
1. Pro/Engineer* Release 20.0
  1. The benchmark must be run using the datecode version of Pro/ENGINEER� specified on the SPECapc website two weeks prior to the submission deadline.
  2. The config.pro file must be used as-is and may not be modified or overridden.
  3. The color depth in the 3D graphics windows used by Pro/ENGINEER� must be at least 24 bits (true color).
  4. The displayed raster resolution must be at least 1280 pixels by 1024 pixels.
  5. The monitor refresh rate must be at least 75Hz. This requirement does not apply to digital flat panel displays.
  6. The border width of the windows created during the benchmark shall not exceed 10 pixels.
  7. The submission must contain the HTML results page as well as the corresponding "trailfile" that resulted from running the benchmark.
  8. The directory structure of the submission must be as follows:
    .../<Company-name/<system_1/proe/results.htm(l)
    .../<Company-name/<system_1/proe/trail.txt (may be compressed)
    .../<Company-name/<system_2/proe/results.htm(l)
    .../<Company-name/<system_2/proe/trail.txt (may be compressed)
    etc...
  9. Compression may be accomplished using UN*X compress(1), tar -Z or zip. The reviewer may ask the submitter to supply an uncompressed version of the trail file(s).
  10. The submission file must be named company_apc_proe20_vN.zip or company_apc_proe20_vN.tar.z where company is the member company or organization name in lower case and vN is the file version (e.g. sgi_apc_proe20_v0.tar.z and intel_apc_proe20_v0.zip.) The initial submission is v0. Resubmitted files must have the version number incremented.
2. Pro/Engineer* 2000i
  1. The benchmark must be run using the datecode version of Pro/ENGINEER� specified on the SPECapc website two weeks prior to the submission deadline.
  2. The config.pro file must be used as-is and may not be modified or overridden.
  3. The color depth in the 3D graphics windows used by Pro/ENGINEER� must be at least 24 bits (true color).
  4. The displayed raster resolution must be at least 1280 pixels by 1024 pixels.
  5. The monitor refresh rate must be at least 75Hz. This requirement does not apply to digital flat panel displays.
  6. The border width of the windows created during the benchmark shall not exceed 10 pixels.
  7. The submission must contain the HTML results page as well as the corresponding "trailfile" that resulted from running the benchmark.
  8. The directory structure of the submission must be as follows:
    .../<Company-name/<system_1/proe2000/results.htm(l)
    .../<Company-name/<system_1/proe2000/trail.txt (may be compressed)
    .../<Company-name/<system_2/proe2000/results.htm(l)
    .../<Company-name/<system_2/proe2000/trail.txt (may be compressed)
    etc...
  9. Compression may be accomplished using UN*X compress(1), tar -Z or zip. The reviewer may ask the submitter to supply an uncompressed version of the trail file(s).
  10. The submission file must be named company_apc_proe2000_vN.zip or company_apc_proe2000_vN.tar.z where company is the member company or organization name in lower case and vN is the file version (e.g. sgi_apc_proe2000_v0.tar.z and intel_apc_proe20_v0.zip.) The initial submission is v0. Resubmitted files must have the version number incremented.
3. Pro/Engineer* 2000i²
  1. The benchmark must be run using the datecode version of Pro/ENGINEER 2000i² specified on the SPECapc website two weeks prior to the submission deadline.
  2. The config.pro file must be used as-is and may not be modified or overridden.
  3. The color depth in the 3D graphics windows used by Pro/ENGINEER must be at least 24 bits (true color).
  4. The displayed raster resolution must be at least 1280 pixels by 1024 pixels.
  5. The monitor refresh rate must be at least 75Hz. This requirement does not apply to digital flat panel displays.
  6. The border width of the windows created during the benchmark shall not exceed 10 pixels.
  7. The submission must contain the proe_results.txt file (generated by the proe_score program) as well as the corresponding "trailfile" that resulted from running the benchmark.
  8. The directory structure of the submission must be as follows:
    .../<Company-name/<system_1/proe2000i2/proe_result.txt
    .../<Company-name/<system_1/proe2000i2/trail.txt (may be compressed)
    .../<Company-name/<system_2/proe2000i2/proe_result.txt
    .../<Company-name/<system_2/proe2000i2/trail.txt (may be compressed)
    etc...
  9. Compression may be accomplished using UN*X compress(1), tar -Z or zip. The reviewer may ask the submitter to supply an uncompressed version of the trail file(s).
  10. The submission file must be named company_apc_proe2000i2_vN.zip or company_apc_proe2000i2_vN.tar.z where company is the member company or organization name in lower case and vN is the file version (e.g. sgi_apc_proe2000i2_v0.tar.z and intel_apc_proe2000i2_v0.zip.) The initial submission is v0. Resubmitted files must have the version number incremented.
4. Solidworks98Plus*
  1. The benchmark must be run using the datecode version of Solidworks98Plus� specified on the SPECapc website two weeks prior to the submission deadline.
  2. The color depth in the windows used by Solidworks 98Plus� must be at least 24 bits (true color).
  3. The displayed raster resolution must be at least 1280 pixels x 1024 pixels.
  4. The monitor refresh rate must be at least 75Hz. This requirement does not apply to digital flat panel displays.
  5. The border width of the windows created during the benchmark shall not exceed 10 pixels.
  6. The submission must contain the HTML results page.
  7. The directory structure of the submission must be as follows:
    .../<Company-name/<system_1/sw98plus/results.htm
    .../<Company-name/<system_2/sw98plus/results.htm
    etc...
  8. The submission file must be named company_apc_sw98plus_vN.zip where company is the member company or organization name in lower case and vN is the file version (e.g. fujitsu_apc_sw98plus_v0.zip.) The initial submission is v0. Resubmitted files must have the version number incremented.
5. Solidworks99*
  1. The benchmark must be run using the datecode version of Solidworks99 specified on the SPECapc website two weeks prior to the submission deadline.
  2. The color depth in the windows used by Solidworks99 must be at least 24 bits (true color).
  3. The displayed raster resolution must be at least 1280 pixels x 1024 pixels.
  4. The monitor refresh rate must be at least 75Hz. This requirement does not apply to digital flat panel displays.
  5. The border width of the windows created during the benchmark shall not exceed 10 pixels.
  6. The submission must contain the HTML results page.
  7. The directory structure of the submission must be as follows:
    .../<Company-name/<system_1/sw99/results.htm
    .../<Company-name/<system_2/sw99/results.htm
    etc...
  8. The submission file must be named company_apc_sw99_vN.zip where company is the member company or organization name in lower case and vN is the file version (e.g. compaq_apc_sw99_v0.zip.) The initial submission is v0. Resubmitted files must have the version number incremented.
6. Unigraphics V15.0.2
  1. The benchmark must be run using Unigraphics V15.0.2.
  2. The color depth in the windows used by Unigraphics must be at least 24 bits (true color).
  3. The displayed raster resolution must be at least 1280 pixels x 1024 pixels.
  4. The monitor refresh rate must be at least 75Hz. This requirement does not apply to digital flat panel displays.
  5. The border width of the windows created during the benchmark shall not exceed 10 pixels.
  6. The application windows will be visible as specified:
    1. The "Unigraphics V15.0.2 � Gateway" window fills the screen. No desktop is visible. However, note that the "maximize" button on the title bar is still enabled � the window has restored to a nearly maximized size.
    2. The "Graphics" window now is contained entirely within the top level "Unigraphics V15.0.2 � Gateway" window.
    3. The "Graphics" window fills the height of the "Unigraphics V15.0.2 � Gateway" window between the toolbar and the information bar.
    4. The "Graphics" window does not fill the width of the "Unigraphics V15.0.2 � Gateway" window.
    5. The "Graphics" window now has a border on all four sides � including the right border.
  7. The submission must contain the XLS results page.
  8. The directory structure of the submission must be as follows:
    .../<Company-name/<system_1/ug15/results.xls
    .../<Company-name/<system_2/ug15/results.xls
    etc...
  9. The submission file must be named company_apc_ug15_vN.zip where company is the member company or organization name in lower case and vN is the file version (e.g. compaq_apc_ug15_v0.zip.) The initial submission is v0. Resubmitted files must have the version number incremented.
7. 3ds max 3.1*
  1. The benchmark is supported on Windows NT 4.0 only.
  2. The color depth in the 3D graphics windows used by 3ds max 3.1� must be at least 24 bits (true color).
  3. The displayed raster resolution must be at least 1280 pixels by 1024 pixels.
  4. The monitor refresh rate must be at least 75Hz. This requirement does not apply to digital flat panel displays.
  5. The border width of the windows created during the benchmark shall not exceed 10 pixels.
  6. The application windows will be visible as specified:
    1. The "3D Studio MAX R3.1" window is maximized and fills the screen
      (The window is not occluded by any other windows.)
    2. The command panel is visible and docked on the right.
      (The command panel is in the default UI position).
  7. Drivers and custom drivers must be configured (explicitly or implicitly) to use:
    1. GL_TEXTURE_MIN_FILTER = GL_LINEAR_MIPMAP_LINEAR
      GL_TEXTURE_MAG_FILTER = GL_LINEAR
    2. Textures cannot be touched, i.e. not reduced in size or depth.
    3. Wireframe objects must NOT be drawn using triangle strips.
    4. Wireframe objects must be drawn with anti-aliased lines.
  8. The following Viewport parameters must be checked in the Viewport tab found in the 3ds max 3.1 Customize -> Preferences menu:
    1. Backface cull on object creation
    2. Mask viewport to safe region
    3. Update background while playing
    4. Display world axis
  9. The following Viewport parameters must NOT be checked in the Viewport tab found in the 3ds max 3.1 Customize -> Preferences menu
    1. Attenuate lights
    2. Filter environment backgrounds
  10. The submission must contain the results file "generic.txt" as well as the corresponding jpeg image "land.jpg" that resulted from running the benchmark.
  11. The directory structure of the submission must be as follows:
    .../<Company-name/<system_1/3dsmax/generic.txt
    .../<Company-name/<system_1/3dsmax/land.jpg
    .../<Company-name/<system_2/3dsmax/generic.txt
    .../<Company-name/<system_2/3dsmax/land.jpg
    etc...
  12. The submission file must be named company_apc_3ds_max_31_vN.zip where company is the member company or organization name in lower case and vN is the file version (e.g. ibm_apc_3dsmax_v0.zip.) The initial submission is v0. Resubmitted files must have the version number incremented.
8. Solid Edge* V9
  1. The benchmark must be run using Solid Edge V9.
  2. The benchmark machine must have Microsoft Excel installed.
  3. The color depth in the 3D graphics windows used by Solid Edge must be at least 24 bits (true color).
  4. The displayed raster resolution must be at least 1280 pixels by 1024 pixels.
  5. Application settings must not be changed from the defaults set by the benchmark installation. Settings that must not be changed include, but are not limited to:
    1. Culling
    2. Wireframe display in Move Part command
    3. Minimum Number of Lines representing an arc (8)
  6. The monitor refresh rate must be at least 75Hz. This requirement does not apply to digital flat panel displays.
  7. The border width of the windows created during the benchmark shall not exceed 10 pixels.
  8. The submission must contain the SolidEdge_Result.txt and the 1532Times.xls files that are generated during the benchmark process.
  9. The directory structure of the submission must be as follows:
    .../<Company-name/<system_1/SEV9/SolidEdge_Result.txt
    .../<Company-name/<system_1/SEV9/1532Times.xls
    .../<Company-name/<system_2/SEV9/SolidEdge_Result.txt
    .../<Company-name/<system_2/SEV9/1532Times.xls
    etc...
  10. The submission file must be named company_apc_SolidEdge_vN.zip where company is the member company or organization name in lower case and vN is the file version (e.g. hp_apc_SolidEdgeV10_v0.zip.) The initial submission is v0. Resubmitted files must have the version number incremented.
9. Unigraphics V17
  1. The benchmark must be run using Unigraphics V17.0.1
  2. The color depth in the windows used by Unigraphics must be at least 24 bits (true color).
  3. The displayed raster resolution must be at least 1280 pixels x 1024 pixels.
  4. The monitor refresh rate must be at least 75Hz. This requirement does not apply to digital flat panel displays.
  5. The border width of the windows created during the benchmark shall not exceed 10 pixels.
  6. The submission must contain both the XLS results page and the .TXT file that it generates
  7. The directory structure of the submission must be as follows:
    .../<Company-name/<system_1/ug17/results.xls
    .../<Company-name/<system_1/ug17/results.txt
    .../<Company-name/<system_2/ug17/results.xls
    .../<Company-name/<system_2/ug17/results.txt
    etc...
  8. The submission file must be named company_apc_ug17_vN.zip where company is the member company or organization name in lower case and vN is the file version (e.g. compaq_apc_ug17_v0.zip.) The initial submission is v0. Resubmitted files must have the version number incremented.
  9. For submissions using Windows operating systems:
    1. Each submission must disclose the value of the horizontal and vertical dimensions in millimeters as reported by the Microsoft Windows devcaps structure. A utility for obtaining these dimensions will be provided to any submitter requiring it.
    2. The minimum acceptable horizontal dimension for a nominal 17" diagonal 4:3 ratio CRT monitor is 320mm. The minimum acceptable vertical dimension for a nominal 17" diagonal 4:3 ratio CRT monitor is 240mm. For other monitors, the horizontal and vertical dimensions reported by the devcaps structure must be no smaller than 10% less than the calculated dimensions based on the monitor aspect ratio and stated diagonal dimension.
    3. The formula to calculate the minimum horizontal dimension H, based on aspect ratio R, (calculated as height/width), and diagonal dimension D is: H = 0.9 * D * cos( arctan(R) ). The formula to calculate the minimum vertical dimension V, based on aspect ratio R, (calculated as height/width), and diagonal dimension D is: V = 0.9 * D * sin( arctan(R) ). If D is expressed in inches, H and V must be converted to millimeters by multiplying them by 25.4. The final dimension must be rounded to the nearest millimeter. Thus for a 15" screen with a 4:3 aspect ratio, the minimum horizontal dimension would be calculated as 0.9 * 25.4 * 15 * cos(arctan( 3/4)), which rounds to 274mm, and the minimum vertical dimension would be 0.9 * 25.4 * 15 * sin(arctan( 3/4)), which rounds to 206mm.
10. Solidworks2001�
  1. The benchmark must be run using the version of Solidworks2001� specified on the SPECapc website two weeks prior to the submission deadline.
  2. The color depth in the windows used by Solidworks2001� must be at least 24 bits (true color).
  3. The displayed raster resolution must be at least 1280 pixels x 1024 pixels.
  4. The monitor refresh rate must be at least 75Hz. This requirement does not apply to digital flat panel displays.
  5. The border width of the windows created during the benchmark shall not exceed 10 pixels.
  6. The submission must contain the results.txt file generated by running the benchmark..
  7. The directory structure of the submission must be as follows:
    .../<Company-name/<system_1/sw2001/results.txt
    .../<Company-name/<system_2/sw2001/results.txt
    etc...
  8. The submission file must be named company_apc_sw2001_vN.zip where company is the member company or organization name in lower case and vN is the file version (e.g. compaq_apc_sw2001_v0.zip.) The initial submission is v0. Resubmitted files must have the version number incremented.
11. Solid Edge V10
  1. The benchmark must be run using Solid Edge V10.0.0.50
  2. The benchmark machine must have Microsoft Excel installed.
  3. The color depth in the 3D graphics windows used by Solid Edge must be at least 24 bits (true color).
  4. The displayed raster resolution must be at least 1280 pixels by 1024 pixels.
  5. The application can be run with "Tools->Options->Application Display" set to either "Backing store," or "Graphics card driven." The choice must be documented in the notes portion of the results.
  6. Application settings must not be changed from the defaults set by the benchmark installation. Settings that must not be changed include, but are not limited to:
    1. Culling
    2. Wireframe display in Move Part command
    3. Arc smoothness (3)
  7. The monitor refresh rate must be at least 75Hz. This requirement does not apply to digital flat panel displays.
  8. The border width of the windows created during the benchmark shall not exceed 10 pixels.
  9. The submission must contain the SolidEdge_Result.txt and the 1532Times.xls files that are generated during the benchmark process.
  10. The directory structure of the submission must be as follows:
    .../<Company-name/<system_1/SEV10/SolidEdge_Result.txt
    .../<Company-name/<system_1/SEV10/1532Times.xls
    .../<Company-name/<system_2/SEV10/SolidEdge_Result.txt
    .../<Company-name/<system_2/SEV10/1532Times.xls
    etc...
  11. The submission file must be named company_apc_SolidEdgeV10_vN.zip where company is the member company or organization name in lower case and vN is the file version (e.g. hp_apc_SolidEdgeV10_v0.zip.) The initial submission is v0. Resubmitted files must have the version number incremented.
12. 3ds max 4.2.6*
  1. The benchmark is supported on Windows 2000 only.
  2. The benchmark must be run using 3ds max 4.2.6.
  3. The color depth in the 3D graphics windows used by 3ds max 4.2.6 must be at least 24 bits (true color).
  4. The displayed raster resolution must be at least 1280 pixels by 1024 pixels.
  5. The monitor refresh rate must be at least 75Hz. This requirement does not apply to digital flat panel displays.
  6. The border width of the windows created during the benchmark shall not exceed 10 pixels.
  7. The application windows will be visible as specified:
    1. The "3D Studio MAX R4.2.6" window is maximized and fills the screen
      (The window is not occluded by any other windows.)
    2. The command panel is visible and docked on the right.
      (The command panel is in the default UI position).
  8. Drivers and custom drivers must be configured (explicitly or implicitly) to use:
    1. GL_TEXTURE_MIN_FILTER = GL_LINEAR_MIPMAP_LINEAR
      GL_TEXTURE_MAG_FILTER = GL_LINEAR
    2. Textures cannot be touched, i.e. not reduced in size or depth.
    3. Wireframe objects must NOT be drawn using triangle strips.
    4. Wireframe objects must be drawn with anti-aliased lines.
  9. The following Viewport parameters must be checked in the Viewport tab found in the 3ds max 4.2.6 Customize -> Preferences menu:
    1. Backface cull on object creation
    2. Mask viewport to safe region
    3. Update background while playing
    4. Display world axis
  10. The following Viewport parameters must NOT be checked in the Viewport tab found in the 3ds max 4.2.6 Customize -> Preferences menu
    1. Attenuate lights
    2. Filter environment backgrounds
  11. The submission must contain the results file "generic.txt" as well as the corresponding jpeg image "land.jpg" that resulted from running the benchmark.
  12. The directory structure of the submission must be as follows:
    .../<Company-name/<system_1/3dsmax426/generic.txt
    .../<Company-name/<system_1/3dsmax426/land.jpg
    .../<Company-name/<system_2/3dsmax426/generic.txt
    .../<Company-name/<system_2/3dsmax426/land.jpg
    etc...
  13. The submission file must be named company_apc_3ds_max_426_vN.zip where company is the member company or organization name in lower case and vN is the file version (e.g. ibm_apc_3dsmax426_v0.zip.) The initial submission is v0. Resubmitted files must have the version number incremented.
13. Solid Edge V11
  1. The benchmark must be run using Solid Edge V11.0.0.50
  2. The benchmark machine must have Microsoft Excel installed.
  3. The color depth in the 3D graphics windows used by Solid Edge must be at least 24 bits (true color).
  4. The displayed raster resolution must be at least 1280 pixels by 1024 pixels.
  5. The application can be run with Tools-Options-Application Display set to either Backing store or Graphics card driven. The choice must be documented in the notes portion of the results.
  6. Application settings must not be changed from the defaults set by the benchmark installation. Settings that must not be changed include, but are not limited to:
    1. Culling
    2. Wireframe display in Move Part command
    3. Arc smoothness (3)
  7. The monitor refresh rate must be at least 75Hz. This requirement does not apply to digital flat panel displays.
  8. The border width of the windows created during the benchmark shall not exceed 10 pixels.
  9. The submission must contain the SolidEdge_Result.txt and the 1532Times.xls files that are generated during the benchmark process.
  10. The directory structure of the submission must be as follows:
    .../<Company-name/<system_1/SEV11/SolidEdge_Result.txt
    .../<Company-name/<system_1/SEV11/1532Times.xls
    .../<Company-name/<system_2/SEV11/SolidEdge_Result.txt
    .../<Company-name/<system_2/SEV11/1532Times.xls
    etc...
  11. The submission file must be named company_apc_SolidEdgeV11_vN.zip where company is the member company or organization name in lower case and vN is the file version (e.g. hp_apc_SolidEdgeV11_v0.zip.) The initial submission is v0. Resubmitted files must have the version number incremented.
14. Solidworks2001Plus�
  1. The benchmark must be run using Solidworks2001Plus� service pack 0.
  2. The color depth in the windows used by Solidworks2001� must be at least 24 bits (true color).
  3. The displayed raster resolution must be at least 1280 pixels x 1024 pixels.
  4. The monitor refresh rate must be at least 75Hz. This requirement does not apply to digital flat panel displays.
  5. The border width of the windows created during the benchmark shall not exceed 10 pixels.
  6. The submission must contain the results.txt file generated by running the benchmark..
  7. The directory structure of the submission must be as follows:
    .../<Company-name/<system_1/sw2001plus/results.txt
    .../<Company-name/<system_2/sw2001plus/results.txt
    etc...
  8. The submission file must be named company_apc_sw2001plus_vN.zip where company is the member company or organization name in lower case and vN is the file version (e.g. compaq_apc_sw2001plus_v0.zip.) The initial submission is v0. Resubmitted files must have the version number incremented.
15. Solid Edge V12
  1. The benchmark must be run using Solid Edge V12.0.0.66
  2. The benchmark machine must have Microsoft Excel installed.
  3. The color depth in the 3D graphics windows used by Solid Edge must be at least 24 bits (true color).
  4. The displayed raster resolution must be at least 1280 pixels by 1024 pixels.
  5. The application can be run with Tools-Options-Application Display set to either Backing store or Graphics card driven. The choice must be documented in the notes portion of the results.
  6. Application settings must not be changed from the defaults set by the benchmark installation. Settings that must not be changed include, but are not limited to:
    1. Culling
    2. Wireframe display in Move Part command
    3. Arc smoothness (3)
  7. The monitor refresh rate must be at least 75Hz. This requirement does not apply to digital flat panel displays.
  8. The border width of the windows created during the benchmark shall not exceed 10 pixels.
  9. The submission must contain the SolidEdge_Result.txt and the 1532Times.xls files that are generated during the benchmark process.
  10. The directory structure of the submission must be as follows:
    .../<Company-name/<system_1/SEV12/SolidEdge_Result.txt
    .../<Company-name/<system_1/SEV12/1532Times.xls
    .../<Company-name/<system_2/SEV12/SolidEdge_Result.txt
    .../<Company-name/<system_2/SEV12/1532Times.xls
    etc...
  11. The submission file must be named company_apc_SolidEdgeV12_vN.zip where company is the member company or organization name in lower case and vN is the file version (e.g. hp_apc_SolidEdgeV12_v0.zip.) The initial submission is v0. Resubmitted files must have the version number incremented.

Adoption: Adopted 20 October 2004

Standard Performance Evaluation Corporation