- Notifications
You must be signed in to change notification settings - Fork30
YUITest wrapper for PhantomJS
License
yui/grover
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
A little command line tool for runningYUITest htmlfiles inside of PhantomJS.
This release supports exiting with the proper exit code to fail a build.
You must have thephantomjs command line tool installed prior to running this.
npm -g install groverThis works on Windows too, just make sure yourphantomjs.exe executable is in your path.
Latest code coverage report is available here
grover app/tests/app.html yui/tests/index.html loader/tests/index.html editor/tests/editor.htmlStarting Grover on 4 files with PhantomJS@1.5.0 Running 15 concurrent tests at a time.✔ [Loader Automated Tests]: Passed: 60 Failed: 0 Total: 60 (ignored 0)✔ [App Framework]: Passed: 269 Failed: 0 Total: 269 (ignored 0)✔ [Editor]: Passed: 31 Failed: 0 Total: 31 (ignored 0)✔ [YUI Core Test Suite]: Passed: 50 Failed: 0 Total: 51 (ignored 1)----------------------------------------------------------------✔ [Total]: Passed: 410 Failed: 0 Total: 411 (ignored 1) [Timer] 8.928 secondsgrover <paths to yuitest html files> -v, --version Print version -h, --help Print this stuff -s, --silent Print no output, only use exit code -q, --quiet Only print errors and use exit code -f, --fail Fail on first error -c, --concurrent Number of tests to run concurrently, default: 15 -t, --timeout Specify a timeout (in seconds) for a test file to be considered as failed. -i, --import <path to js file> - Require this file and use the exports (array) as the list of files to process. -p, --prefix <string> String to prefix to all urls (for dynamic server names) -S, --suffix <string> String to add to the end of all urls (for dynamic server names) -o, --outfile <path to export file> You can specify an export type with the following: --tap TAP export (default) --xml XML export --json JSON export --junit JUnit XML export --server Starts a static file server in the CWD, tests should be relative to this directory --port <Number> The port to start the server on --phantom-bin <path to phantomjs executable> A non-PATH location for the phantomjs executable --no-run Do not execute the tests, just prep the server (for other testing)Coverage Options --coverage Generate a coverage report and print it to the screen (you must instrument your own files first) --coverage-warn <Number> The percentage to highlight as low coverage: default is 80 --istanbul-report <Path> Generate an Istanbul coverage report into this directory -co --coverageFileName <path to export coverage file> The coverage data in lcov format. -sp --sourceFilePrefix <path to sourcefile> The relative path to the original source file for use in the coverage results.Grover supports the 4 ways that YUITest exports it's tests results so you can import theminto another system.
grover ./tests/*.html -o ./results/results.json --jsongrover ./tests/*.html -o ./results/results.xml --xmlgrover ./tests/*.html -o ./results/results.tap --tapgrover ./tests/*.html -o ./results/results.junit.xml --junitUsing the--server command will fire up a server in theprocess.cwd() and serve anythingunder it as static content. Then when you select the tests to be run, they are converted to URL'sunder the hood and fetched from the static server instead of the file system.
Combine this with-S options like this:
grover --server --port 5000 -S '?filter=coverage' ./tests/foo.htmlThis will create a URL like:
http://127.0.0.1:5000/tests/foo.html?filter=coverageYou can add--no-run to havegrover fire up the server and prep everything, but not execute the tests.This way you can access thegrover server from another location (browser). If you want to continuerunning the tests after launching this way, simply send the process aSIGCONT signal (kill -s SIGCONT [PID])andgrover will start executing the tests like it normally would. This is handy if you have CLI tests that youwant to execute against the server before you want the Phantom tests to execute.
Grover also supports myechoecho module by default.
If you instrument your files with theIstanbul Coverage Tool, you canhavegrover show you your coverage report:
grover --coverage --coverage-warn 70 ./tests/*.htmlWill print something like this:
Starting Grover on 1 files with PhantomJS@1.6.1 Running 15 concurrent tests at a time. starting grover server assuming server root as /home/yui/src/yui3✔ [FOO]: Passed: 8 Failed: 0 Total: 8 (ignored 0) 97%----------------------------------------------------------------✔ [Total]: Passed: 8 Failed: 0 Total: 8 (ignored 0) [Timer] 1.114 secondsGenerating Coverage Report┏━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━┓┃ path ┃ lines ┃ % ┃ statements ┃ % ┃ functions ┃ % ┃ branches ┃ % ┃┣━━━━━━━━━━━━━━━━━━━━━━╋━━━━━━━━━╋━━━━━━━━━━╋━━━━━━━━━━━━━━╋━━━━━━━━━━╋━━━━━━━━━━━━━╋━━━━━━━━╋━━━━━━━━━━━━╋━━━━━━━━━━┫┃ ✖ build/foo/foo.js ┃ 45/46 ┃ 97.83% ┃ 45/46 ┃ 97.83% ┃ 6/6 ┃ 100% ┃ 26/34 ┃ 76.47% ┃┗━━━━━━━━━━━━━━━━━━━━━━┻━━━━━━━━━┻━━━━━━━━━━┻━━━━━━━━━━━━━━┻━━━━━━━━━━┻━━━━━━━━━━━━━┻━━━━━━━━┻━━━━━━━━━━━━┻━━━━━━━━━━┛YOU MUST INSTRUMENT YOUR OWN COVERAGE FILES, GROVER JUST GATHERS THE REPORT.
If you instrument your files with theYUITest Coverage Tool, you canhavegrover show you your coverage report:
grover --coverage --coverage-warn 70 ./tests/*.htmlWill print something like this:
Starting Grover on 1 files with PhantomJS@1.6.1 Running 15 concurrent tests at a time. starting grover server assuming server root as /home/yui/src/yui3✔ [FOO]: Passed: 8 Failed: 0 Total: 8 (ignored 0) 97%----------------------------------------------------------------✔ [Total]: Passed: 8 Failed: 0 Total: 8 (ignored 0) [Timer] 1.114 secondsGenerating Coverage Report┏━━━━━━━━━━━━━━━━━━┳━━━━━━━━┳━━━━━━┳━━━━━━━━━━━━┳━━━━━━━┓┃ path ┃ lines ┃ % ┃ functions ┃ % ┃┣━━━━━━━━━━━━━━━━━━╋━━━━━━━━╋━━━━━━╋━━━━━━━━━━━━╋━━━━━━━┫┃ ✔ /tests/foo.js ┃ 45/46 ┃ 97% ┃ 6/6 ┃ 100% ┃┗━━━━━━━━━━━━━━━━━━┻━━━━━━━━┻━━━━━━┻━━━━━━━━━━━━┻━━━━━━━┛YOU MUST INSTRUMENT YOUR OWN COVERAGE FILES, GROVER JUST GATHERS THE REPORT.
This tool is dedicated toRyan Grove for all his work on YUI over the last year.I told him that my next command line tool would be named "grover" after "rgrove".