Frequently Asked Questions (FAQ)
About the SPECjbb2000 Benchmark

    General Information

  1. What is SPECjbb2000?
  2. Who will use SPECjbb2000 and how will they use it?
  3. Why is the benchmark important for vendors?
  4. Why did SPEC decide to develop SPECjbb2000?
  5. Does this benchmark measure end-to-end Java performance?
  6. Does SPECjbb2000 represent real applications?
  7. What specific aspects of performance does SPECjbb2000 measure?
  8. What factors affecting Java performance are not measured by SPECjbb2000?
  9. Why doesn't SPECjbb2000 cover AWT/graphics performance?
  10. Is this benchmark suitable for measuring client performance?
  11. Does SPECjbb2000 use Enterprise Java Beans (EJBs), Servlets or Java Server Pages (JSPs)?
  12. Why doesn't the benchmark measure network and database performance?
  13. Does this benchmark replace any other benchmark?
  14. Can I compare my SPECjbb2000 results with my TPC-C results?
  15. Can SPECjbb2000 results be compared to results from other SPEC benchmarks?
  16. Is this related to any of IBM's BOB benchmarks?
  17. Can I use this application for non-benchmarking purposes?
  18. Do you provide source code for the benchmark?
  19. Does floating point precision matter for this benchmark?
  20. Are SPECjbb2000 results repeatable?
  21. Where can I find out more about the benchmark?
  22. What metrics does SPECjbb2000 use to report performance?

    Setting up SPECjbb2000

  23. What are the requirements for running SPECjbb2000?
  24. What other software do I need? Web server, database, proxy server?
  25. Can SPECjbb2000 run under Java 2?
  26. Can I use this benchmark for embedded processor platforms?
  27. Can I run SPECjbb2000 on a uni-processor?
  28. Can I run SPECjbb2000 on a shared memory processor (SMP) configuration and will it scale?
  29. How long does it take to run the SPECjbb2000 benchmarks?
  30. How much JVM heap memory is required?
  31. How much system memory is needed to run the benchmarks?
  32. Why can't I recompile this benchmark?

    Running SPECjbb2000

  33. What do you mean by warehouses, points and threads?
  34. Is there a warm-up period before each measured point?
  35. Where can official SPECjbb2000 results be obtained?
  36. Can I run SPECjbb2000 on a cluster configuration and compare results with SMP configurations? If not, why?
  37. Can SPECjbb2000 help users compare Java and C++ performance?
  38. Does garbage collection affect SPECjbb2000 results?
  39. I see a lot of paging and disk I/O but I had a compliant run. Can I publish my results?
  40. Why is it necessary to look at the SPECjbb2000 graph to get a good idea of performance?
  41. My graph looks strange. Are there two graph formats?

    Ordering SPECjbb2000

  42. What do you get when you order SPECjbb2000?
  43. What is the price of a SPECjbb2000 license and when will it be available?
  44. How do I contact SPEC for more information?

General Information


Q1: What is SPECjbb2000? Q2: Who will use SPECjbb2000 and how will they use it? Q3: Why is the benchmark important for vendors? Q4: Why did SPEC decide to develop SPECjbb2000? Q5: Does this benchmark measure end-to-end Java performance? Q6: Does SPECjbb2000 represent real applications? Q7: What specific aspects of performance does SPECjbb2000 measure? Q8: What factors affecting Java performance are not measured by SPECjbb2000? Q9: Why doesn't SPECjbb2000 cover AWT/graphics performance? Q10: Is this benchmark suitable for measuring client performance? Q11: Does SPECjbb2000 use Enterprise Java Beans (EJBs), Servlets or Java Server Pages (JSPs)? Q12: Why doesn't the benchmark measure network and database performance? Q13: Does this benchmark replace any other benchmark? Q14: Can I compare my SPECjbb2000 results with my TPC-C results? Q15: Can SPECjbb2000 results be compared to results from other SPEC benchmarks? Q16: Is this related to any of IBM's BOB benchmarks? Q17: Can I use this application for non-benchmarking purposes? Q18: Do you provide source code for the benchmark? Q19: Does floating point precision matter for this benchmark? Q20: Are SPECjbb2000 results repeatable? Q21: Where can I find out more about the benchmark? Q22: What metrics does SPECjbb2000 use to report performance?

Setting up SPECjbb2000


Q23: What are the requirements for running SPECjbb2000?

Q24: What other software do I need? Web server, database, proxy server? Q25: Can SPECjbb2000 run under Java 2? Q26: Can I use this benchmark for embedded processor platforms? Q27: Can I run SPECjbb2000 on a uni-processor? Q28: Can I run SPECjbb2000 on a shared memory processor (SMP) configuration and will it scale? Q29: How long does it take to run the SPECjbb2000 benchmarks? Q30: How much JVM heap memory is required? Q31: How much system memory is needed to run the benchmarks? Q32: Why can't I recompile this benchmark?

Running SPECjbb2000


Q33: What do you mean by warehouses, points and threads?

Q34: Is there a warm-up period before each measured point? Q35: Where can official SPECjbb2000 results be obtained? Q36: Can I run SPECjbb2000 on a cluster configuration and compare results with SMP configurations? If not, why? Q37: Can SPECjbb2000 help users compare Java and C++ performance? Q38: Does garbage collection affect SPECjbb2000 results? Q39: I see a lot of paging and disk I/O but I had a compliant run. Can I publish my results? Q40: Why is it necessary to look at the SPECjbb2000 graph to get a good idea of performance? Q41: My graph looks strange. Are there two graph formats?

Ordering SPECjbb2000


Q42: What do you get when you order SPECjbb2000?

Q43: What is the price of a SPECjbb2000 license and when will it be available? Q44: How do I contact SPEC for more information?
This FAQ document was prepared by:

and others.


Last Modification 10/04/2001 - Chris Beer