NotificationsYou must be signed in to change notification settings
Fork351
Star747

[WIP] benchmark different ast parsers#6802

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Jump to bottom

Draft

rochdev wants to merge9 commits intomaster

base:master

Choose a base branch

fromast-bench

Draft

[WIP] benchmark different ast parsers#6802

rochdev wants to merge9 commits intomasterfromast-bench

+150 −29

Conversation

Copy link

Member

rochdev commentedOct 30, 2025

What does this PR do?

Motivation

Plugin Checklist

Unit tests.
Integration tests.
Benchmarks.
TypeScriptdefinitions.
TypeScripttests.
APIdocumentation.
CIjobs/workflows.

Additional Notes

rochdev added the semver-patch label

Oct 30, 2025

Copy link

github-actionsbot commentedOct 30, 2025•
edited
Loading

Overall package size

Self size: 13.19 MB
Deduped: 117.25 MB
No deduping: 119.45 MB

Dependency sizes

| name | version | self size | total size ||------|---------|-----------|------------|| @datadog/libdatadog | 0.7.0 | 35.02 MB | 35.02 MB || @datadog/native-appsec | 10.3.0 | 20.73 MB | 20.74 MB || @datadog/native-iast-taint-tracking | 4.0.0 | 11.72 MB | 11.73 MB || @datadog/pprof | 5.12.0 | 11.19 MB | 11.57 MB || @opentelemetry/core | 1.30.1 | 908.66 kB | 7.16 MB || protobufjs | 7.5.4 | 2.95 MB | 5.82 MB || @datadog/wasm-js-rewriter | 4.0.1 | 2.85 MB | 3.58 MB || @opentelemetry/resources | 1.9.1 | 306.54 kB | 1.74 MB || @datadog/native-metrics | 3.1.1 | 1.02 MB | 1.43 MB || @opentelemetry/api-logs | 0.207.0 | 201.39 kB | 1.42 MB || @opentelemetry/api | 1.9.0 | 1.22 MB | 1.22 MB || jsonpath-plus | 10.3.0 | 617.18 kB | 1.08 MB || import-in-the-middle | 1.15.0 | 127.66 kB | 856.24 kB || lru-cache | 10.4.3 | 804.3 kB | 804.3 kB || @datadog/openfeature-node-server | 0.1.0-preview.13 | 106.46 kB | 424.36 kB || opentracing | 0.14.7 | 194.81 kB | 194.81 kB || source-map | 0.7.6 | 185.63 kB | 185.63 kB || pprof-format | 2.2.1 | 163.06 kB | 163.06 kB || @datadog/sketches-js | 2.1.1 | 109.9 kB | 109.9 kB || lodash.sortby | 4.7.0 | 75.76 kB | 75.76 kB || ignore | 7.0.5 | 63.38 kB | 63.38 kB || istanbul-lib-coverage | 3.2.2 | 34.37 kB | 34.37 kB || rfdc | 1.4.1 | 27.15 kB | 27.15 kB || dc-polyfill | 0.1.10 | 26.73 kB | 26.73 kB || @isaacs/ttlcache | 1.4.1 | 25.2 kB | 25.2 kB || tlhunter-sorted-set | 0.1.0 | 24.94 kB | 24.94 kB || shell-quote | 1.8.3 | 23.74 kB | 23.74 kB || limiter | 1.1.5 | 23.17 kB | 23.17 kB || retry | 0.13.1 | 18.85 kB | 18.85 kB || semifies | 1.0.0 | 15.84 kB | 15.84 kB || jest-docblock | 29.7.0 | 8.99 kB | 12.76 kB || crypto-randomuuid | 1.0.0 | 11.18 kB | 11.18 kB || ttl-set | 1.0.0 | 4.61 kB | 9.69 kB || mutexify | 1.4.0 | 5.71 kB | 8.74 kB || path-to-regexp | 0.1.12 | 6.6 kB | 6.6 kB || module-details-from-path | 1.0.4 | 3.96 kB | 3.96 kB || escape-string-regexp | 5.0.0 | 3.66 kB | 3.66 kB |

_{🤖 This report was automatically generated byheaviest-objects-in-the-universe}

Copy link

codecovbot commentedOct 30, 2025•
edited
Loading

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.35%. Comparing base (40b1880) to head (05781f4).
⚠️ Report is 14 commits behind head on master.

Additional details and impacted files

@@             Coverage Diff             @@##           master    #6802       +/-   ##===========================================- Coverage   83.79%   71.35%   -12.45%===========================================  Files         506      111      -395       Lines       21270     4060    -17210     ===========================================- Hits        17824     2897    -14927+ Misses       3446     1163     -2283

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report?Share it here.

🚀 New features to boost your workflow:

❄️Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
📦JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

This comment has been minimized.

rochdev force-pushed theast-bench branch fromf5b2620 to3f537b2Compare

October 30, 2025 20:59

add sirun benchmark of ast parsers

9365ac9

rochdev force-pushed theast-bench branch fromfa82f99 to9365ac9Compare

November 3, 2025 20:46

rochdev added8 commits

November 3, 2025 16:14

add dependencies in dockerfile instead and fix parsing

0b89388

remove benchmarked modules from dependencies

291c570

fix lint

9763c3e

add group

d7c3198

code cleanup

74613e5

code cleanup

9281738

add missing dependencies for ci

7a02ec1

fix typo

05781f4

Copy link

pr-commenterbot commentedNov 4, 2025

Benchmarks

Benchmark execution time: 2025-11-04 15:59:17

Comparing candidate commit05781f4 in PR branchast-bench with baseline commit40b1880 in branchmaster.

Found 3 performance improvements and 8 performance regressions! Performance is the same for 1601 metrics, 58 unstable metrics.

scenario:plugin-bluebird-with-tracer-18

🟥cpu_user_time [+21.183ms; +26.427ms] or [+5.836%; +7.281%]
🟥execution_time [+21.938ms; +26.628ms] or [+5.203%; +6.315%]

scenario:plugin-bluebird-with-tracer-20

🟥cpu_user_time [+16.158ms; +20.251ms] or [+5.282%; +6.620%]
🟥execution_time [+19.611ms; +22.356ms] or [+5.493%; +6.262%]

scenario:plugin-bluebird-with-tracer-22

🟥cpu_user_time [+18.564ms; +22.739ms] or [+5.961%; +7.301%]
🟥execution_time [+21.159ms; +24.209ms] or [+5.641%; +6.454%]

scenario:plugin-bluebird-with-tracer-24

🟥cpu_user_time [+18.088ms; +22.858ms] or [+6.263%; +7.914%]
🟥execution_time [+22.253ms; +26.417ms] or [+6.274%; +7.448%]

scenario:runtime-metrics-with-runtime-metrics-24

🟩cpu_user_time [-49.941ms; -25.830ms] or [-13.608%; -7.038%]

scenario:scope-manager-base-22

🟩cpu_user_time [-7.332ms; -3.047ms] or [-16.108%; -6.694%]

scenario:shimmer-startup-asyncarrow-baseline-18

🟩cpu_user_time [-3.703ms; -1.389ms] or [-14.084%; -5.284%]

Labels

semver-patch

Movatterモバイル変換

[WIP] benchmark different ast parsers#6802

Are you sure you want to change the base?

[WIP] benchmark different ast parsers#6802

Conversation

rochdev commentedOct 30, 2025

What does this PR do?

Motivation

Plugin Checklist

Additional Notes

Uh oh!

github-actionsbot commentedOct 30, 2025• editedLoading Uh oh!There was an error while loading.Please reload this page.

Uh oh!

Overall package size

Uh oh!

codecovbot commentedOct 30, 2025• editedLoading Uh oh!There was an error while loading.Please reload this page.

Uh oh!

Codecov Report

Uh oh!

This comment has been minimized.

pr-commenterbot commentedNov 4, 2025

Benchmarks

scenario:plugin-bluebird-with-tracer-18

scenario:plugin-bluebird-with-tracer-20

scenario:plugin-bluebird-with-tracer-22

scenario:plugin-bluebird-with-tracer-24

scenario:runtime-metrics-with-runtime-metrics-24

scenario:scope-manager-base-22

scenario:shimmer-startup-asyncarrow-baseline-18

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

github-actionsbot commentedOct 30, 2025•
edited
Loading

codecovbot commentedOct 30, 2025•
edited
Loading