Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Add script to run benchmarks and script to download data#39

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Merged
eriknw merged 1 commit intopython-graphblas:mainfromeriknw:benchmark_scripts
Dec 3, 2022

Conversation

@eriknw
Copy link
Member

Example usage:

$ python scripts/bench.py -b graphblas -f pagerank -d amazon0302

Example usage:```$ python scripts/bench.py -b graphblas -f pagerank -d amazon0302```
@codecov-commenter
Copy link

Codecov Report

Base:72.67% // Head:72.67% // No change to project coverage 👍

Coverage data is based on head(8c9d530) compared to base(83bfa40).
Patch has no changes to coverable lines.

Additional details and impacted files
@@           Coverage Diff           @@##             main      #39   +/-   ##=======================================  Coverage   72.67%   72.67%           =======================================  Files          69       69             Lines        2569     2569             Branches      475      475           =======================================  Hits         1867     1867             Misses        531      531             Partials      171      171

Help us with your feedback. Take ten seconds to tell ushow you rate us. Have a feature suggestion?Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment?Let us know in this issue.

@eriknw
Copy link
MemberAuthor

Here's the help:

$ python scripts/bench.py --helpusage: bench.py [-h] [-b {graphblas,networkx,scipy}] [-t TIME] [-n N] -d DATA [-j] -f FUNC [--extra EXTRA]Example usage: python scripts/bench.py -b graphblas -f pagerank -d amazon0302options:  -h, --help            show this help message and exit  -b {graphblas,networkx,scipy}, --backend {graphblas,networkx,scipy}  -t TIME, --time TIME  Target minimum time to run benchmarks  -n N                  The number of times to run the benchmark (the default is to run according to time)  -d DATA, --data DATA  The path to a mtx file or one of the following data names: {amazon0302, as-Skitter,                        caidaRouterLevel, citationCiteseer, coAuthorsDBLP, coPapersCiteseer, coPapersDBLP, dblp-2010,                        email-Enron, preferentialAttachment, soc-Pokec, web-Google}; data will be downloaded if necessary  -j, --json            Print results as json instead of human-readable text  -f FUNC, --func FUNC  Which function to benchmark  --extra EXTRA         Extra string to add to the function call

And here example output:

$ python scripts/bench.py -b graphblas -f pagerank -d amazon0302Downloading data/amazon0302.mtx from https://sparse.tamu.edu/MM/SNAP/amazon0302.tar.gz===========================================================Backend = graphblas, function = pagerank, data = amazon0302-----------------------------------------------------------Number of runs: 256first:  12.1 msmedian: 10.2 msmean:   10.6 msstdev:  1.39 msmin:    9.99 msmax:    18.6 ms===========================================================

and

$ python scripts/bench.py -b networkx -f pagerank -d amazon0302 -n 5 --json{"backend": "networkx", "function": "pagerank", "data": "amazon0302", "n": 5, "first": 3.455940272193402, "median": 3.430417278315872, "mean": 3.419718873221427, "stdev": 0.028473827004063253, "min": 3.3903320101089776, "max": 3.455940272193402}

This is as far as I can take things for now--I'm going to merge. Comments/feedback welcome--especially in the form of PRs! What other datasets would be good to benchmark against?

I'll figure out where to post benchmark processing scripts and results later.

@eriknweriknw merged commit6eaab4c intopython-graphblas:mainDec 3, 2022
@eriknw
Copy link
MemberAuthor

Hmm, we should probably list the available functions to benchmark in the help message.

Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@eriknw@codecov-commenter

[8]ページ先頭

©2009-2025 Movatter.jp