Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

One step #7

Open
wants to merge 5 commits into
base: master
Choose a base branch
from
Open

One step #7

wants to merge 5 commits into from

Conversation

bdholt1
Copy link
Member

@bdholt1 bdholt1 commented Sep 4, 2011

According to the Joel test, we should be able to make the build in one step. Ideally, we would want the documentation to be updated automatically after running the benchmark scripts (and not have to copy/paste values into a .py file and run that). This PR is a first step in that direction.

These changes support easy generation of timing graphs. It works by using a common interface to print the timing result and scores, which also stores these values and finally saves them to file (using pickle). Once the benchmark file (for a task, e.g. "svm") has been run on all the datasets, the user (and in the future the buildbot) can run $ python plot.py task to generate the plot in one step.

To use, run
$ python bench_svm.py arcene
$ python bench_svm.py madelon
$ python plot.py svm

The next step is to integrate the scores and timings directly into the documentation.

@bdholt1
Copy link
Member Author

bdholt1 commented Sep 7, 2011

The timings and the scores rst table is generated automatically, which I think is much more convenient for updating the documentation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant