Skip to content

Benchmarks

dr2chase edited this page Aug 29, 2017 · 10 revisions

These are (some) benchmarks with the following desirable properties:

  • they matter; someone cares, perhaps in a dollars-and-cents way, that they run well
  • they are go-gettable and don't require customized steps for building the benchmark
  • they run relatively quickly, ideally a single "run" takes less than a second (there should perhaps be a separate set of longer-running benchmarks)
  • their timings are not gratuitously noisy
  • they run cleanly in a restricted environment, such as a Docker or rkt container
  • they're not gratuitously redundant with other benchmarks already in the list; we don't need ten microbenchmarks of Go transcendental functions

Information for each benchmark includes (or should include):

  • a short name for the benchmark
  • the path to go get the benchmark
  • a regexp for the benchmark suite excluding individual benchmarks that might be noisy, long-running, or redundant
  • (ideally) a contact person for questions about the benchmarks
short name notes github path benchmark regexp contact
ethereum_bitutil github.com/ethereum/go-ethereum/common/bitutil Benchmark(BaseTest2KB|FastTest2KB|Encoding4KBVerySparse)
ethereum_storage github.com/ethereum/go-ethereum/swarm/storage BenchmarkJoin_8
ethereum_ethash github.com/ethereum/go-ethereum/consensus/ethash BenchmarkHashimotoLight
ethereum_core github.com/ethereum/go-ethereum/core BenchmarkChainRead_full_10k
ethereum_sha3 github.com/ethereum/go-ethereum/crypto/sha3 BenchmarkSha3_224_MTU
ethereum_ecies github.com/ethereum/go-ethereum/crypto/ecies BenchmarkGenSharedKeyP256
ethereum_corevm github.com/ethereum/go-ethereum/core/vm BenchmarkOpDiv128
ethereum_trie github.com/ethereum/go-ethereum/trie Benchmark
eolian_dsp buddin.us/eolian/dsp Benchmark
spexs2 github.com/egonelbre/spexs2/_benchmark/ BenchmarkRun/10k/1
minio github.com/minio/minio/cmd BenchmarkGetObject5MbFS
gonum_blas_native github.com/gonum/blas/native Benchmark(DasumMediumUnitaryInc|Dnrm2MediumPosInc)
gonum_lapack_native github.com/gonum/lapack/native BenchmarkDgeev/Circulant10
gonum_matrix_mat64 github.com/gonum/matrix/mat64 Benchmark(MulWorkspaceDense1000Hundredth|ScaleVec10000Inc20)
semver github.com/Masterminds/semver BenchmarkValidateVersionTildeFail
hugo_helpers github.com/gohugoio/hugo/helpers Benchmark(StripHTML|ReaderContains)
hugo_hugolib github.com/gohugoio/hugo/hugolib BenchmarkParsePage
hugo_hugolib_sitebuilding github.com/gohugoio/hugo/hugolib BenchmarkSiteBuilding/YAML,num_pages=10,num_tags=10,tags_per_page=20,shortcodes,render-12
k8s_api k8s.io/kubernetes/pkg/api BenchmarkEncodeCodecFromInternalProtobuf
k8s_schedulercache k8s.io/kubernetes/plugin/pkg/scheduler/schedulercache BenchmarkList1kNodes30kPods
uber_zap needs thinning github.com/uber-go/zap/benchmarks Benchmark
uuid needs thinning github.com/satori/go.uuid/ Benchmark
Clone this wiki locally