Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

sea: add support for V8 bytecode-only caching#48191

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Merged
nodejs-github-bot merged 27 commits intonodejs:mainfromRaisinTen:sea-V8-code-cache
Jul 26, 2023

Conversation

RaisinTen
Copy link
Member

@RaisinTenRaisinTen commentedMay 26, 2023
edited
Loading

This improves the startup performance of SEAs.

For example, the comparison of the startup performance benchmarks of a Node.js SEA built using the CJS bundle of Yarn's source code shows a 24% improvement on myx86_64 macOS:

$hyperfine-N-w30-Lcmd'with_code_cache/yarn help','without_code_cache/yarn help''{cmd}'Benchmark1:with_code_cache/yarnhelpTime(mean±σ):210.8ms±1.3ms[User:224.0ms,System:25.2ms]Range(minmax):209.0ms213.4ms14runsBenchmark2:without_code_cache/yarnhelpTime(mean±σ):279.1ms±2.3ms[User:284.9ms,System:30.1ms]Range(minmax):276.6ms284.4ms10runsSummary'with_code_cache/yarn help'ran1.32±0.01timesfasterthan'without_code_cache/yarn help'

Fixes:nodejs/single-executable#73

cc@kvakil

JakobJingleheimer and lin72h reacted with hooray emojikvakil, lin72h, H4ad, MoLow, and deniszitu reacted with rocket emoji
@nodejs-github-bot
Copy link
Collaborator

Review requested:

  • @nodejs/loaders
  • @nodejs/modules
  • @nodejs/single-executable
  • @nodejs/startup

@nodejs-github-botnodejs-github-bot added c++Issues and PRs that require attention from people who are familiar with C++. lib / srcIssues and PRs related to general changes in the lib or src directory. needs-ciPRs that need a full CI run. labelsMay 26, 2023
RaisinTen added a commit to RaisinTen/node that referenced this pull requestMay 27, 2023
It expresses the intent in a clearer way.Refs:nodejs#48191 (comment)Signed-off-by: Darshan Sen <raisinten@gmail.com>
RaisinTen added a commit to RaisinTen/node that referenced this pull requestMay 27, 2023
Refs:nodejs#48191 (comment)Signed-off-by: Darshan Sen <raisinten@gmail.com>
@RaisinTenRaisinTen added the commit-queue-squashAdd this label to instruct the Commit Queue to squash all the PR commits into the first one. labelMay 27, 2023
RaisinTen added a commit to RaisinTen/node that referenced this pull requestMay 29, 2023
Refs:nodejs#48191 (comment)Signed-off-by: Darshan Sen <raisinten@gmail.com>
RaisinTen added a commit to RaisinTen/node that referenced this pull requestJun 1, 2023
Refs:nodejs#48191 (comment)Signed-off-by: Darshan Sen <raisinten@gmail.com>
Copy link
Member

@joyeecheungjoyeecheung left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

I don't think this includes any tests for the new feature? We should at least have some to exercise the code paths..

@RaisinTen
Copy link
MemberAuthor

I don't think this includes any tests for the new feature? We should at least have some to exercise the code paths..

This change generates the code cache and uses it by default, so the existing E2E SEA tests should already be exercising the added code paths, right?

RaisinTen added a commit to RaisinTen/node that referenced this pull requestJun 2, 2023
Refs:nodejs#48191 (comment)Signed-off-by: Darshan Sen <raisinten@gmail.com>
@RaisinTenRaisinTen added the single-executableIssues and PRs related to single-executable applications labelJun 2, 2023
RaisinTen added a commit to RaisinTen/node that referenced this pull requestJun 8, 2023
Refs:nodejs#48191 (comment)Signed-off-by: Darshan Sen <raisinten@gmail.com>
Copy link
Contributor

@kvakilkvakil left a comment
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Thanks, this is great! I left some nits

(One last note wrt startup time: it's unfortunate that we store the source code as UTF8 because then we need to transcode/copy it into Latin1/UTF16 in order to actually put it into V8. Ideally we'd use external strings instead. That's not really related to this diff, but thought I'd note it since we're one the subject. :)

anonrig reacted with thumbs up emoji
@joyeecheung
Copy link
Member

joyeecheung commentedJun 10, 2023
edited
Loading

it's unfortunate that we store the source code as UTF8 because then we need to transcode/copy it into Latin1/UTF16 in order to actually put it into V8

I think this could be made configurable because storing the strings as UTF8 could save quite some space if the source actually contains two-byte characters, which may be more important to users than the startup cost depending on their use case.

RaisinTen added a commit to RaisinTen/node that referenced this pull requestJun 27, 2023
Original commit message:    [compiler] fix CompileFunction ignoring kEagerCompile    v8::ScriptCompiler::CompileFunction was ignoring kEagerCompile. Unlike    the other functions in v8::ScriptCompiler, it was not actually    propagating kEagerCompile to the parser. The newly updated test fails    without this change.    I did some archeology and found that this was commented out since the    original CL inhttps://crrev.com/c/980944.    As far as I know Node.js is the main consumer of this particular API.    This CL speeds up Node.js's overall startup time by ~13%.    Change-Id: Ifc3cd6653555194d46ca48db14f7ba7a4afe0053    Reviewed-on:https://chromium-review.googlesource.com/c/v8/v8/+/4571822    Commit-Queue: Marja Hölttä <marja@chromium.org>    Reviewed-by: Marja Hölttä <marja@chromium.org>    Cr-Commit-Position: refs/heads/main@{#87944}Refs:v8/v8@cb00db4Refs:nodejs#48191 (comment)Signed-off-by: Darshan Sen <raisinten@gmail.com>
RaisinTen added a commit to RaisinTen/node that referenced this pull requestJun 27, 2023
It expresses the intent in a clearer way.Refs:nodejs#48191 (comment)Signed-off-by: Darshan Sen <raisinten@gmail.com>
RaisinTen added a commit to RaisinTen/node that referenced this pull requestJun 27, 2023
Refs:nodejs#48191 (comment)Signed-off-by: Darshan Sen <raisinten@gmail.com>
RaisinTen added a commit to RaisinTen/node that referenced this pull requestJun 27, 2023
Refs:nodejs#48191 (comment)Signed-off-by: Darshan Sen <raisinten@gmail.com>
@RaisinTenRaisinTen added author readyPRs that have at least one approval, no pending requests for changes, and a CI started. commit-queueAdd this label to land a pull request using GitHub Actions. labelsJul 26, 2023
@nodejs-github-botnodejs-github-bot removed the commit-queueAdd this label to land a pull request using GitHub Actions. labelJul 26, 2023
@nodejs-github-botnodejs-github-bot merged commit6cd6789 intonodejs:mainJul 26, 2023
@nodejs-github-bot
Copy link
Collaborator

Landed in6cd6789

@RaisinTenRaisinTen deleted the sea-V8-code-cache branchJuly 26, 2023 10:25
Ceres6 pushed a commit to Ceres6/node that referenced this pull requestJul 27, 2023
Refs:nodejs/single-executable#73Signed-off-by: Darshan Sen <raisinten@gmail.com>PR-URL:nodejs#48191Fixes:nodejs/single-executable#73Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>Reviewed-By: Stephen Belanger <admin@stephenbelanger.com>Reviewed-By: Joyee Cheung <joyeec9h3@gmail.com>
pluris pushed a commit to pluris/node that referenced this pull requestAug 6, 2023
Refs:nodejs/single-executable#73Signed-off-by: Darshan Sen <raisinten@gmail.com>PR-URL:nodejs#48191Fixes:nodejs/single-executable#73Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>Reviewed-By: Stephen Belanger <admin@stephenbelanger.com>Reviewed-By: Joyee Cheung <joyeec9h3@gmail.com>
pluris pushed a commit to pluris/node that referenced this pull requestAug 7, 2023
Refs:nodejs/single-executable#73Signed-off-by: Darshan Sen <raisinten@gmail.com>PR-URL:nodejs#48191Fixes:nodejs/single-executable#73Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>Reviewed-By: Stephen Belanger <admin@stephenbelanger.com>Reviewed-By: Joyee Cheung <joyeec9h3@gmail.com>
Ceres6 pushed a commit to Ceres6/node that referenced this pull requestAug 14, 2023
Refs:nodejs/single-executable#73Signed-off-by: Darshan Sen <raisinten@gmail.com>PR-URL:nodejs#48191Fixes:nodejs/single-executable#73Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>Reviewed-By: Stephen Belanger <admin@stephenbelanger.com>Reviewed-By: Joyee Cheung <joyeec9h3@gmail.com>
Ceres6 pushed a commit to Ceres6/node that referenced this pull requestAug 14, 2023
Refs:nodejs/single-executable#73Signed-off-by: Darshan Sen <raisinten@gmail.com>PR-URL:nodejs#48191Fixes:nodejs/single-executable#73Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>Reviewed-By: Stephen Belanger <admin@stephenbelanger.com>Reviewed-By: Joyee Cheung <joyeec9h3@gmail.com>
UlisesGascon pushed a commit to UlisesGascon/node that referenced this pull requestAug 14, 2023
Refs:nodejs/single-executable#73Signed-off-by: Darshan Sen <raisinten@gmail.com>PR-URL:nodejs#48191Fixes:nodejs/single-executable#73Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>Reviewed-By: Stephen Belanger <admin@stephenbelanger.com>Reviewed-By: Joyee Cheung <joyeec9h3@gmail.com>
RafaelGSS pushed a commit that referenced this pull requestAug 15, 2023
Refs:nodejs/single-executable#73Signed-off-by: Darshan Sen <raisinten@gmail.com>PR-URL:#48191Fixes:nodejs/single-executable#73Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>Reviewed-By: Stephen Belanger <admin@stephenbelanger.com>Reviewed-By: Joyee Cheung <joyeec9h3@gmail.com>
@UlisesGasconUlisesGascon mentioned this pull requestAug 15, 2023
RafaelGSS pushed a commit that referenced this pull requestAug 17, 2023
Refs:nodejs/single-executable#73Signed-off-by: Darshan Sen <raisinten@gmail.com>PR-URL:#48191Fixes:nodejs/single-executable#73Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com>Reviewed-By: Stephen Belanger <admin@stephenbelanger.com>Reviewed-By: Joyee Cheung <joyeec9h3@gmail.com>
codebytere added a commit to electron/electron that referenced this pull requestNov 6, 2023
codebytere added a commit to electron/electron that referenced this pull requestNov 14, 2023
codebytere added a commit to electron/electron that referenced this pull requestNov 15, 2023
codebytere added a commit to electron/electron that referenced this pull requestNov 16, 2023
codebytere added a commit to electron/electron that referenced this pull requestNov 21, 2023
codebytere added a commit to electron/electron that referenced this pull requestNov 22, 2023
codebytere added a commit to electron/electron that referenced this pull requestNov 28, 2023
codebytere added a commit to electron/electron that referenced this pull requestNov 29, 2023
jkleinsc pushed a commit to electron/electron that referenced this pull requestNov 30, 2023
* chore: upgrade to Node.js v20* src: allow embedders to override NODE_MODULE_VERSIONnodejs/node#49279* src: fix missing trailing ,nodejs/node#46909* src,tools: initialize cppgcnodejs/node#45704* tools: allow passing absolute path of config.gypi in js2cnodejs/node#49162* tools: port js2c.py to C++nodejs/node#46997* doc,lib: disambiguate the old term, NativeModulenodejs/node#45673* chore: fixup Node.js BSSL tests*nodejs/node#49492*nodejs/node#44498* deps: upgrade to libuv 1.45.0nodejs/node#48078* deps: update V8 to 10.7nodejs/node#44741* test: use gcUntil() in test-v8-serialize-leaknodejs/node#49168* module: make CJS load from ESM loadernodejs/node#47999* src: make BuiltinLoader threadsafe and non-globalnodejs/node#45942* chore: address changes to CJS/ESM loading* module: make CJS load from ESM loader (nodejs/node#47999)* lib: improve esm resolve performance (nodejs/node#46652)* bootstrap: optimize modules loaded in the built-in snapshotnodejs/node#45849* test: mark test-runner-output as flakynodejs/node#49854* lib: lazy-load deps in modules/run_main.jsnodejs/node#45849* url: use private properties for brand checknodejs/node#46904* test: refactor `test-node-output-errors`nodejs/node#48992* assert: deprecate callTrackernodejs/node#47740* src: cast v8::Object::GetInternalField() return value to v8::Valuenodejs/node#48943* test: adapt test-v8-stats for V8 updatenodejs/node#45230* tls: ensure TLS Sockets are closed if the underlying wrapclosesnodejs/node#49327* test: deflake test-tls-socket-closenodejs/node#49575* net: fix crash due to simultaneous close/shutdown on JS Stream Socketsnodejs/node#49400* net: use asserts in JS Socket Stream to catch races in futurenodejs/node#49400* lib: fix BroadcastChannel initialization locationnodejs/node#46864* src: create BaseObject with node::Realmnodejs/node#44348* src: implement DataQueue and non-memory resident Blobnodejs/node#45258* sea: add support for V8 bytecode-only cachingnodejs/node#48191* chore: fixup patch indices* gyp: put filenames in variablesnodejs/node#46965* build: modify js2c.py into GN executable* fix: (WIP) handle string replacement of fs -> original-fs* [v20.x] backport vm-related memoryfixesnodejs/node#49874* src: make BuiltinLoader threadsafe and non-globalnodejs/node#45942* src: avoid copying string in fs_permissionnodejs/node#47746* look upon my works ye mightyand dispair* chore: patch cleanup* [api] Remove AllCan Read/Writehttps://chromium-review.googlesource.com/c/v8/v8/+/5006387* fix: missing include for NODE_EXTERN* chore: fixup patch indices* fix: fail properly when js2c fails in Node.js* build: fix js2c root_gen_dir* fix: lib/fs.js -> lib/original-fs.js* build: fix original-fs file xforms* fixup! module: make CJS load from ESM loader* build: get rid of CppHeap for now* build: add patch to prevent extra fs lookup on esm load* build: greatly simplify js2c modificationsMoves our original-fs modifications back into a super simple python script action, wires up the output of that action into our call to js2c* chore: update to handle moved internal/modules/helpers file* test: update @types/node test* feat: enable preventing cppgc heap creation* feat: optionally prevent calling V8::EnableWebAssemblyTrapHandler* fix: no cppgc initialization in the renderer* gyp: put filenames in variablesnodejs/node#46965* test: disable single executable tests* fix: nan tests failing on node headers missing file* tls,http2: send fatal alert on ALPN mismatchnodejs/node#44031* test: disable snapshot tests*nodejs/node#47887*nodejs/node#49684*nodejs/node#44193* build: use deps/v8 for v8/toolsNode.js hard depends on these in their builtins* test: fix edge snapshot stack tracesnodejs/node#49659* build: remove js2c //base dep* build: use electron_js2c_toolchain to build node_js2c* fix: don't create SafeSet outside packageResolveFixes failure in parallel/test-require-delete-array-iterator:=== release test-require-delete-array-iterator ===Path: parallel/test-require-delete-array-iteratornode:internal/per_context/primordials:426    constructor(i) { super(i); } // eslint-disable-line no-useless-constructor                     ^TypeError: object is not iterable (cannot read property Symbol(Symbol.iterator))    at new Set (<anonymous>)    at new SafeSet (node:internal/per_context/primordials:426:22)* fix: failing crashReporter tests on LinuxThese were failing because our change from node::InitializeNodeWithArgs tonode::InitializeOncePerProcess meant that we now inadvertently calledPlatformInit, which reset signal handling. This meant that our intentionalcrash function ElectronBindings::Crash no longer worked and the renderer processno longer crashed when process.crash() was called. We don't want to use Node.js'default signal handling in the renderer process, so we disable it by passingkNoDefaultSignalHandling to node::InitializeOncePerProcess.* build: only create cppgc heap on non-32 bit platforms* chore: clean up util:CompileAndCall* src: fix compatility with upcoming V8 12.1 APIsnodejs/node#50709* fix: use thread_local BuiltinLoader* chore: fixup v8 patch indices---------Co-authored-by: Keeley Hammond <vertedinde@electronjs.org>Co-authored-by: Samuel Attard <marshallofsound@electronjs.org>
MrHuangJser pushed a commit to MrHuangJser/electron that referenced this pull requestDec 11, 2023
* chore: upgrade to Node.js v20* src: allow embedders to override NODE_MODULE_VERSIONnodejs/node#49279* src: fix missing trailing ,nodejs/node#46909* src,tools: initialize cppgcnodejs/node#45704* tools: allow passing absolute path of config.gypi in js2cnodejs/node#49162* tools: port js2c.py to C++nodejs/node#46997* doc,lib: disambiguate the old term, NativeModulenodejs/node#45673* chore: fixup Node.js BSSL tests*nodejs/node#49492*nodejs/node#44498* deps: upgrade to libuv 1.45.0nodejs/node#48078* deps: update V8 to 10.7nodejs/node#44741* test: use gcUntil() in test-v8-serialize-leaknodejs/node#49168* module: make CJS load from ESM loadernodejs/node#47999* src: make BuiltinLoader threadsafe and non-globalnodejs/node#45942* chore: address changes to CJS/ESM loading* module: make CJS load from ESM loader (nodejs/node#47999)* lib: improve esm resolve performance (nodejs/node#46652)* bootstrap: optimize modules loaded in the built-in snapshotnodejs/node#45849* test: mark test-runner-output as flakynodejs/node#49854* lib: lazy-load deps in modules/run_main.jsnodejs/node#45849* url: use private properties for brand checknodejs/node#46904* test: refactor `test-node-output-errors`nodejs/node#48992* assert: deprecate callTrackernodejs/node#47740* src: cast v8::Object::GetInternalField() return value to v8::Valuenodejs/node#48943* test: adapt test-v8-stats for V8 updatenodejs/node#45230* tls: ensure TLS Sockets are closed if the underlying wrapclosesnodejs/node#49327* test: deflake test-tls-socket-closenodejs/node#49575* net: fix crash due to simultaneous close/shutdown on JS Stream Socketsnodejs/node#49400* net: use asserts in JS Socket Stream to catch races in futurenodejs/node#49400* lib: fix BroadcastChannel initialization locationnodejs/node#46864* src: create BaseObject with node::Realmnodejs/node#44348* src: implement DataQueue and non-memory resident Blobnodejs/node#45258* sea: add support for V8 bytecode-only cachingnodejs/node#48191* chore: fixup patch indices* gyp: put filenames in variablesnodejs/node#46965* build: modify js2c.py into GN executable* fix: (WIP) handle string replacement of fs -> original-fs* [v20.x] backport vm-related memoryfixesnodejs/node#49874* src: make BuiltinLoader threadsafe and non-globalnodejs/node#45942* src: avoid copying string in fs_permissionnodejs/node#47746* look upon my works ye mightyand dispair* chore: patch cleanup* [api] Remove AllCan Read/Writehttps://chromium-review.googlesource.com/c/v8/v8/+/5006387* fix: missing include for NODE_EXTERN* chore: fixup patch indices* fix: fail properly when js2c fails in Node.js* build: fix js2c root_gen_dir* fix: lib/fs.js -> lib/original-fs.js* build: fix original-fs file xforms* fixup! module: make CJS load from ESM loader* build: get rid of CppHeap for now* build: add patch to prevent extra fs lookup on esm load* build: greatly simplify js2c modificationsMoves our original-fs modifications back into a super simple python script action, wires up the output of that action into our call to js2c* chore: update to handle moved internal/modules/helpers file* test: update @types/node test* feat: enable preventing cppgc heap creation* feat: optionally prevent calling V8::EnableWebAssemblyTrapHandler* fix: no cppgc initialization in the renderer* gyp: put filenames in variablesnodejs/node#46965* test: disable single executable tests* fix: nan tests failing on node headers missing file* tls,http2: send fatal alert on ALPN mismatchnodejs/node#44031* test: disable snapshot tests*nodejs/node#47887*nodejs/node#49684*nodejs/node#44193* build: use deps/v8 for v8/toolsNode.js hard depends on these in their builtins* test: fix edge snapshot stack tracesnodejs/node#49659* build: remove js2c //base dep* build: use electron_js2c_toolchain to build node_js2c* fix: don't create SafeSet outside packageResolveFixes failure in parallel/test-require-delete-array-iterator:=== release test-require-delete-array-iterator ===Path: parallel/test-require-delete-array-iteratornode:internal/per_context/primordials:426    constructor(i) { super(i); } // eslint-disable-line no-useless-constructor                     ^TypeError: object is not iterable (cannot read property Symbol(Symbol.iterator))    at new Set (<anonymous>)    at new SafeSet (node:internal/per_context/primordials:426:22)* fix: failing crashReporter tests on LinuxThese were failing because our change from node::InitializeNodeWithArgs tonode::InitializeOncePerProcess meant that we now inadvertently calledPlatformInit, which reset signal handling. This meant that our intentionalcrash function ElectronBindings::Crash no longer worked and the renderer processno longer crashed when process.crash() was called. We don't want to use Node.js'default signal handling in the renderer process, so we disable it by passingkNoDefaultSignalHandling to node::InitializeOncePerProcess.* build: only create cppgc heap on non-32 bit platforms* chore: clean up util:CompileAndCall* src: fix compatility with upcoming V8 12.1 APIsnodejs/node#50709* fix: use thread_local BuiltinLoader* chore: fixup v8 patch indices---------Co-authored-by: Keeley Hammond <vertedinde@electronjs.org>Co-authored-by: Samuel Attard <marshallofsound@electronjs.org>
Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment
Reviewers

@jasnelljasnelljasnell left review comments

@kvakilkvakilkvakil left review comments

@QardQardQard approved these changes

@anonriganonriganonrig approved these changes

@joyeecheungjoyeecheungjoyeecheung approved these changes

@aymen94aymen94aymen94 approved these changes

Assignees
No one assigned
Labels
author readyPRs that have at least one approval, no pending requests for changes, and a CI started.c++Issues and PRs that require attention from people who are familiar with C++.commit-queue-squashAdd this label to instruct the Commit Queue to squash all the PR commits into the first one.lib / srcIssues and PRs related to general changes in the lib or src directory.needs-ciPRs that need a full CI run.single-executableIssues and PRs related to single-executable applications
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

bytecode-only SEA caching?
8 participants
@RaisinTen@nodejs-github-bot@joyeecheung@Qard@jasnell@anonrig@aymen94@kvakil

[8]ページ先頭

©2009-2025 Movatter.jp