All notable changes to this project will be documented in this file. See standard-version for commit guidelines.
7.5.2 (2019-11-25)
7.5.1 (2019-07-29)
- make executeJS method work properly with arrow function (514fc1b)
7.5.0 (2019-07-25)
- config: add support for workers config option (d7b7710)
7.4.1 (2019-03-20)
- error maximum call stack size exceeded from looks-same (0e18704)
7.4.0 (2019-03-13)
- notice about deprecated option replacement (b066b16)
- add diff clusters (f80cf09)
7.3.0 (2019-01-29)
- build diff image with using "antialiasingTolerance" prop (7ff6e2a)
- add option "buildDiffOpts" to configure building diff image (2c672df)
7.2.0 (2019-01-24)
- use ref image from looks-same (3a1a3f3)
7.1.2 (2019-01-10)
- do not fall by memory in looks-same (67b432e)
7.1.1 (2018-12-26)
- use gemini-core with stable looks-same (9f8e97b)
7.1.0 (2018-12-26)
- pass diff bounds to error from looks-same (bdb3aab)
7.0.1 (2018-12-14)
7.0.0 (2018-12-13)
- do not convert ref image file to base64 to get size (99c767f)
- drop node versions previous to 8 (2eeddbb)
- now supported version of node >= 8.0.0
6.0.0 (2018-11-29)
- emits image sizes on test execution events (09b4318)
- now on test execution events (TEST_RESULT, UPDATE_RESULT, RETRY, ERROR) emited image info (object) with path and size instead of only emit image path
5.9.1 (2018-10-02)
5.9.0 (2018-09-11)
- add "antialiasingTolerance" option (de7cc86)
5.8.1 (2018-09-04)
- 'changeOrientation' action waits for screen rotate (4e42d7e)
5.8.0 (2018-08-14)
- set default browser orientation before each test (8348d7a)
5.7.2 (2018-06-09)
5.7.1 (2018-05-21)
- vflat: verbose reporter does not show session id (187f8e8)
5.7.0 (2018-05-07)
- introduce hermione.halt method (da68965)
5.6.2 (2018-03-26)
- move set option to commander global options (85d7d04)
5.6.1 (2018-03-23)
- child suites retries not called (a141462)
5.6.0 (2018-03-20)
- "skip" and "only" methods for tests API (7b1853a)
5.5.2 (2018-03-13)
- suite clone does not clone fullUrl (4d9bc62)
5.5.1 (2018-02-26)
- child suite retries not called (6268b62)
5.5.0 (2018-02-14)
- config: introduce shouldRerty config option (pull/878)
5.4.1 (2018-02-12)
- ignoreElements fail if outside viewport (0f8b2c7)
5.4.0 (2018-02-04)
- stats: move part of the logic to the gemini-core (99e7e0c)
5.3.0 (2018-01-30)
- introduce option to specify delay before a screenshot is made (ec52a5e)
- use new versions of glob-extra and gemini-coverage (74ae6bf)
5.2.1 (2018-01-14)
- update gemini-core to 2.3.2 (d74403d)
5.2.0 (2018-01-12)
5.1.2 (2017-12-20)
- coverage: support webpack sourcemaps format (1794e13)
5.1.1 (2017-12-07)
- allow unknown options before parsing config file (98a5d5f)
5.1.0 (2017-12-06)
- allow to extend cli parser via CLI event (81fb51f)
5.0.1 (2017-12-05)
- validate timeout type in wait element actions (007a836)
5.0.0 (2017-12-01)
- Fixed not checking if dragTo is a valid element (13566a1)
- emit async INIT event instead of async plugins load (b21aa58)
- remove backwards compatibility for passing grep to readTests (ed4ece5)
- remove bluebird-q compatibility layer (7844620)
- remove deprecated BEGIN_SESSION and END_SESSION events (2c22d1d)
- remove deprecated CAPTURE event (d06a913)
- remove deprecated END_TEST event (9c7c8e2)
- remove deprecated WARNING event (c906b1f)
- remove q-promise-utils (67b3682)
5.0.0-alpha.12 (2017-11-02)
- load plugins only once (a56e39b)
5.0.0-alpha.11 (2017-11-01)
5.0.0-alpha.10 (2017-10-31)
5.0.0-alpha.9 (2017-10-19)
- errors: stacktraces of custom errors should include error message (63eb59b)
- pass current image path to reference image error (968fe9a)
5.0.0-alpha.8 (2017-08-31)
- errors: stacktraces of custom errors should include error message (63eb59b)
- pass current image path to reference image error (968fe9a)
5.0.0-alpha.7 (2017-08-28)
5.0.0-alpha.6 (2017-08-02)
5.0.0-alpha.5 (2017-07-11)
- tests statistic should listen events on main runner (e676c3a)
5.0.0-alpha.4 (2017-07-04)
- incorrect .js config resolving (db6b539)
- add method 'shouldSkip(browserId)' to suite instance (bad551c)
- provide the ability to modify retries count from plugins (deafd55)
5.0.0-alpha.3 (2017-06-08)
5.0.0-alpha.2 (2017-06-06)
- bug with count of failed tests in the statistic (ef550c5)
5.0.0-alpha.0 (2017-05-25)
- make setUrl work like url.resolve (dcf6f17)
4.19.3 (2017-05-03)
- lazy load of images in HTML report for retries (754368a)
4.19.2 (2017-03-27)
- enable correct suite through suite collection api (60c1147)
4.19.1 (2017-02-15)
- method "fullUrl" should resolve url in runtime (e796dce)
- Prevented EMFILE error (too many open files) (e8e4dca)
4.19.0 (2017-02-10)
- Pass suiteCollection on BEGIN event to allow to modify it (7d04923)
4.18.2 (2017-02-02)
- prevent endless loop when suitesPerSession is set to infinity (2b399b6)
4.18.1 (2017-01-25)
- Make clickable reason-links for skipped results in html report (d266665)
4.18.0 (2017-01-23)
- add method 'gemini.ctx' to tests API (66f2aa6)
4.17.1 (2017-01-18)
- roll back striptags version without breaking changes (cd4e26e)
4.17.0 (2017-01-16)
- Add test filename to html report's metaInfo section (0311f6d)
4.16.0 (2016-12-23)
- log a path to an HTML report after tests finish (86a8466)
- set default reporter for command 'update' (feb72bc)
- Add extended WebDriver error data in output (73a26ed)
4.15.0 (2016-12-21)
- Allow to ignore every element, matching selector (c36ed78)
- html-reporter: add ability to specify output path for each report (b25409e)
4.14.4 (2016-12-12)
- correct implementation of doubleClick action (f8746a9)
- emit browser start/stop events in correct places (e8a427e)
- IE9 does not include pseudo-element styles (906988b)
- Remove session id console output for skipped tests (6aa92e1)
4.14.3 (2016-12-05)
- correct implementation of doubleClick action (f8746a9)
4.14.2 (2016-11-24)
- emit browser start/stop events in correct places (e8a427e)
- IE9 does not include pseudo-element styles (906988b)
4.14.1 (2016-11-22)
- fix invalid urls to reference images (85a426d)
- fix invalid urls to reference images (ed2ac15)
- remove polyfill-service dependency (364bcbf), closes #673 #635
4.14.0 (2016-11-16)
- documentation: update information about using gemini options (251329b)
- correct exit on 'SIGHUP', 'SIGINT' or 'SIGTERM' (1f0ffbe)
- Implement advanced verification for suites with same names (2572af5)
- html-reporter: add ability to copy suite name and open suite urls (6219b74)
- Use reference images instead of actual(current) in HTML report (ef198bc)
4.13.4 (2016-11-07)
- config: throw error if value contain not valid json string (60cc4f0)
- config: use JSON.parse for plugins values from cli/env (6039fd1)
4.13.3 (2016-11-03)
- glob-extra: replace isMasks to isMask (830be2e)
- html-reporter: don't store ref when it equal with current image (3183c21)
- test: improve some tests (c56bdcb)
4.13.2 (2016-10-26)
4.13.1 (2016-10-25)
- do not show skipped tests in retries (799dc80)
4.13.0 (2016-10-19)
- cli: Add command 'list' to show list of browsers or sets from config (b5e4b4a)
- Implement readRawConfig static API method (b269b0b)
- Fix
startRunnerandendRunnerto correctly wait for promises, returned from plugins. - Various fixes related to
bluebirdmigration. All "is not a function" errors now should be gone. - Fix assignment to const error in html report.
- Restore 4.10 plugin loading order — plugins now loaded before any tests files are read.
- Internal promises library changed
bluebird. This should make gemini a little bit faster.
- Added the ability to specify exclude paths in which the gemini tests will not be searched, see documentation
- Fixed bug which causes skip errors which might be occur in listeners of
START_RUNNERandEND_RUNNERevents
- Second attempt of fixing order of file read events
- Fixed bug which causes emitting
beforeFileReadafter the file has already been read in GeminiFacade
Identical to 4.11, published by mistake
## 4.11.0 - 2016-09-23- Do not delay retry failed tests until all tests finish. Retry ASAP
- Added
eventsfield forgeminiinstance in plugins, see documentation for more details. - Updated
Quick startsection in documentation
- Lodash updated to v4.x
- Clone suite tree for each browser runner
- Use
catchmethod instead offailin q
- Fixed
Out of the boundserror (see #543)
- Updated third party libraries, so Array.prototype methods won't be overwritten anymore
- Fixed abort of the broken session on test error
- Fixed incorrect creation of set with empty files
- Updated version of glob-extra
- Close browser session after error in a test
- Set left button as default for mouse button actions
- Fixed wrong validation of
grepoption from cli
- Fixed bug which causes
Cannot find files by mask geminierror if sets in config are not specified (see #569) - Fixed bug which causes
/nullurl in meta-info - Displaying the number of updated images via command
gemini updatein flat reporter
- Correctly display the images in the html report in case suite names contain non-urlsafe characters.
- Fixed critical bug which causes failing of browser requests
beforeFileReadandafterFileReadAPI events were added. This allows plugins to be notified when gemini is about to read a test file and when it was readCAPTUREandEND_TESTevents were declared as deprecated.UPDATE_RESULTandTEST_RESULTevents should be used instead of them respectively- Added the ability to see in flat reporter which states were really updated via gemini update command
- Added
sessionQuitTimeoutoption which allows to change timeout for session termination - Disallowed usage of empty names for suites
- Added nodejs@6.x support
- Added
GEMINI_SKIP_BROWSERSenvironment variable support - Added the ability to log config for each browser using
DEBUG=gemini:configenvironment variable - Fix: escape special symbols in HTML report
- Fix: correct displaying of test url in meta-info of an HTML report
- Retry only failed states on fail instead of all states of the suite
- Add ability to set file masks for test paths in a
setsoption - Add ability to implement custom source path resolving for CSS files in coverage
- Fix: keep original stack when cloning error
- Revert code changes made for version 4.4.3
- Fix bug with resolving source paths in gemini coverage module
- Fixed retry of individual states (error with 'isCoverageEnabled on undefined')
- Support
changeOrientationforappiumbelow 1.5.x - Back to upstream of
uglify-js
- Froze uglify-js version at v2.6.4
- Fixed bug with suites per browser limit
- Fixed ignoring of a caret for devices with pixel ratio different from 1
- Output path to html report to a console
- Updated version of looks-same dependency to 3.0.0
- Added option
compositeImagewhich allows to test areas with height larger than viewport one, see documentation for more details. - Capture a viewport instead of a full page for all browsers.
⚠️ Tests in firefox will fail after updating to this version if you test areas which bottom bounds are outside of a viewport height. - Removed the hack for IE browsers related with two-step movement to
(0, 0)on browser reset. - Fix: do not fail test if a hidden element was added to method
ignoreElements. - Fix displaying of retries in HTML report after adding of
sessionIdin meta-info of HTML reporter.
- Added new browser option
screenshotModewhich allows to set an image capture mode, see the documentation for more details. - Added new action
changeOrientationto tests API which allows to change orientation on touch enabled device, see the documentation for more details. - Supported displaying of
sessionIdin meta-info of HTML reporter. - Fix: do not emit an error if
browser.quitfails, warning will be logged. - Fix: support passing of
sessionIdto an error if launching of a browser fails.
- Added option
sessionRequestTimeoutwhich sets a timeout for getting of browser sessions
- Supported displaying of meta-info in HTML reporter which contains suite/state url
- Supported displaying of retry reasons in reporters
- Supported passing of a suite error to all states of this suite
- Dropped throwing of critical errors in states, this means that a state failure always emits an
errevent - Fix: browser sessions will be freed immediately if there are no states to run instead of waiting for the end of all remaining running states in other browser sessions
- Fix: use top level windowSize
- Fix error object instance after serializing
- Fix image processing: use pixel ratio in subprocesses
- Fix failed suites count in summary line
- Throw error on image validation fail
- Show page screenshot on image validation error
- Fix documentation
- Fix: require default config by absolute path
- Fixed hang in browser pool queue when using
parallelLimitoption - Image processing moved to workers (test speed increased, memory usage decreased)
- Added ability to set
tempDiroption from cli - Do not retry failed test if it hasn't reference image
BREAKING CHANGES:
- Do not support node lower than 4.0
- Changed suite declaration. You don't need now to require gemini for each suite file
- Removed
gather command. Useupdatecommand instead - Now error data will be extended with path to image instead of image itself:
error.image=>error.imagePath
- Fix: Child suite context should have same data as parent has (@j0tunn)
- Fixed element find caching (@j0tunn)
- Fixed
CLIENT_STOPPED_SESSIONbug when performing setWindowSize in post actions (@j0tunn) - Suite.browsers: ability to set browsers, in which suite should be run (@egavr)
- Added ability to use .js/.json config files (@j0tunn)
- Android support:
- Do zoom reset after page load instead of before screenshot (@SwinX)
- Fixed calibration for android emulators (@SwinX)
- Fixed image crop for big pixelRatio (@SwinX)
- Enable uncaughtException logging (@SwinX)
- Fix coverage (@benedfit):
- pass in all original options when processing media rules
- check length of selector after pseudo-elements have been removed
BREAKING CHANGES:
- Removed skip method for actions (@j0tunn)
- Accumulate "before" and "after" actions for nested suites (@j0tunn)
- Fix: specified name for NoRefImageError (@SwinX)
- Fixed bug in enable/disable logic in suite collection - may not work properly when disabling all suites and enabling only some states in specific suite (@j0tunn)
- Added possibility to enable/disable suites by full name (@j0tunn)
- Added possibility to specify
grepcondition forreadTestsAPI method (@SwinX)
- Fix update command called without any options (@sipayRT)
- Limited pool fix: push defer queue if failed to free browser (@j0tunn)
- Add editor files to the .npmignore (@j0tunn)
gemini updatecommand: ability to update only new and changed references (@sipayRT)SuiteCollection: new API to run separate suites and states (@j0tunn)- Fix: free browser when reset failed (@j0tunn)
- Fix: provide image for errors during actions chain execution (@leonsabr)
- Run heavy operations in separate processes (@j0tunn)
- Force quit on second Ctrl+C (@j0tunn)
- Do not get browser session for suites without states (@j0tunn)
- Do not get browser session and do not perform any pre-actions for skipped suite (@j0tunn)
BREAKING CHANGES:
- New skip method API (@leonsabr)
- Browser now can be specified only by browser id matcher (string or RegExp)
- skip now accepts optional second parameter - reason, which will be displayed in reporters
- Deprecated options removed:
strictComparison,referenceImageAbsence(@SevInf, @j0tunn) - Deprecated API method
gemini.buildDiffremoved (@j0tunn) - Russian documentation removed (@j0tunn)
gemini.readTestsnow returnsSuiteCollectioninstance instead ofrootSuiteobject (@j0tunn)gemini gatherdeprecated in favor ofgemini update(@sipayRT)
- Remove restirction for maximum open concurrent sockets (@j0tunn)
- Show reference image if test failed due to lack of it (@sipayrt)
- Fixed result in HTML report for sibling states appear several times on retry (@SwinX)
- Fix: in LimitedPool next browser request will be triggered if failed to receive browser from underlying pool (@SwinX)
- Implemented TestCounter class for reporters (@SwinX)
- Fixed undefined session id in vflat reporter (@SwinX)
- Immediately quit browser if failed to create it (@SwinX)
- Fix: wrong initial-scale meta data (@sipayrt)
- Fix: build crashed on 'gather' command (@SwinX)
- Fix: html reporter correctly handles
errorevent if no data about state passed
- Implemented suite retry on compare diff and critical errors (@SwinX)
- Only maximize PhantomJS browser if windowSize is not configured (@davidchin)
- Allow tests to skip by browser id (@davidchin)
- Do not fail tests on error from grid-side (@sipayrt)
- Fix: run 'afterHook' if some state failed (@j0tunn)
- Fix: run 'postActions' if state or 'afterHook' failed (@j0tunn)
- Fix: free browser after cancel (@j0tunn)
- Fix: keep original error if 'afterHook' or 'postActions' failed (@j0tunn)
- Show error message + whole page screenshot on test fail (@sipayrt)
- Fix: clean browsers pool after finalization (@SwinX)
- Fix: check for global window variable on client-side (@eroshinev)
- Do not fail tests if browsers specified from env does not exists in config (@sipayrt)
- Fix counting of skipped test by flat reporter (@sipayrt)
- Pass sessionId on events for correctly TC work (@sipayrt)
- Fix: return correct exit code on test failing (@sipayrt)
- Fix handling of END_RUNNER event (@sipayrt)
- Fix: END_RUNNER event delivered to plugins in case of critical error (@SwinX)
- Fix: make screenshot after prepareScreenshot() has been executed (@sipayrt)
- Remove spaces from env GEMINI_BROWSERS (@sipayrt)
-
Add Android support (@SevInf)
-
Fix: return same config object for each config.forBrowser request (@j0tunn)
-
Fix "undefined" output instead of browser name in the flat reporter (@scf2k)
-
Show current image for tests which have no reference images (@hatroman)
-
Screenshot whole page when gemini can't find a selector (@scf2k)
-
Add
retryoption. See docs (@sipayrt) -
Fix: fire END_SUITE event when nested suites are done (@scf2k)
- Added the
vflatreporter (@unlok)
<
F0C8
/ul>
-
Path to the plugin configuration fixed (@SevInf)
-
Sets support (@j0tunn)
-
mouseUp action: make element argument optional (@just-boris).
-
Print browserId and sessionId in critical error reports (@SevInf).
-
html report: load report images in lazy mode (@scf2k).
- Fix: correct handling of no-ref-image error (@j0tunn).
-
Inline sourcemaps support in coverage calculation (@j0tunn).
-
Create HTML report dir before copying files (@SevInf).
-
API: do not override options with CLI flags and env vars by default (@SevInf).
-
Fail when removed option is detected and warn if removed env var is detected (@SevInf).
-
Reports now always will be generated, even when there is a critical error (@zumra6a).
-
Correctly cancel queued tests after critical error (@SevInf).
-
Produce more debug information in various modules (@SevInf).
-
In case of a critical error, try to print what test was executed when it happened (@SevInf).
-
Corrected updates (@maximerassi).
Previous version was published without a tarball once again. Republishing.
## 0.13.0-beta — 2015-07-29-
BREAKING CHANGE: new config format. See docs.
New config allows to set many previously global options on per-browser basis. The following things have changed in this config:
-
rootUrl,gridUrl,tolerance,strictComparison,screenshotsDir,windowSizeoptions can now be set separately for each browser:gridUrl: http://grid.example.com browsers: firefox: # Uses gridUrl from top level desiredCapabilities: ... chrome: # Overrides top-level value gridUrl: http://chrome.example.com desiredCapabilities: ...
-
projectRoot,sourceRoot,plugins,debug,parallelLimit,diffColor,referenceImageAbsenceare moved intosystemsection and can not be set per-browser.system: debug: true diffColor: #ff0000 plugins: teamcity: true ...
-
browsersare no longer default tophantomjs. If you've used this default, set up the browser explicitly:browsers: phantomjs: desiredCapabilities: browserName: phantomjs
-
coverage settings are now grouped under
system.coveragesection:- to enable coverage, set
system.coverage.enabledto true. coverageExcludeis moved tosystem.coverage.exclude.coverageNoHtmlis replaced bysystem.coverage.html. Set it to false to disable html report generaion.
- to enable coverage, set
-
--noCalibratecustom capability is replaced bycalibrateoption which can be set for every or any particular browser. -
browser capabilites are set in
desiredCapabilitesoption.browsers: chrome: desiredCapabilities: browserName: 'chrome', version: '45'
-
top-level
capabilitiesoption is replaced bydesiredCapabilitesoption. -
httpsettings are removed. Use new optionhttpTimeoutto set timeout. Setting retires is no longer possible. -
sessionModeis replaced by more flexiblesuitesPerSessionsetting (see below).
-
-
The way config options are overriden by CLI flags and environment variables are now unified (option path is converted to
--option-pathfor cli andgemini_option_pathfor environment variables). Due to this change, some old flags and environment variables won't work:-
--sorce-rootandGEMINI_SOURCE_ROOTbecomes--system-source-rootandgemini_system_source_rootrespectively. -
--debugandGEMINI_DEBUGbecomes--system-debug=trueandgemini_system_debugrespectively. -
--coverageandGEMINI_COVERAGEbecomes--system-coverage-enabled=trueandgemini_system_coverage_enabledrespecitvely. -
--coverage-no-htmlandGEMINI_COVERAGE_NO_HTMLbecomes--system-coverage-html=falseandgemini_system_coverage_htmlrespectively. -
GEMINI_ROOT_URLbecomesgemini_root_url. -
GEMINI_GRID_URLbecomesgemini_grid_url. -
GEMINI_SCREENSHOTS_DIRbecomesgemini_screenshots_dir. -
GEMINI_WINDOW_SIZEbecomesgemini_window_size.
-
-
API:
Geminiconstuctor does not accepts overrides object anymore. -
sessionModeis replaced bysuitesPerSessionoption which specifies number of test suites to run in a single WebDriver session. Value of.infis equivalent toperBrowsersession mode and value of1is equivalent toperSuite. This option can be set globally or separately for each browser. -
New option
sessionsPerBrowserallows to launch multiple session for each browser and run tests in parallel.
- Correctly restore window size when
setWindowSizeis called inbeforecallback (@SevInf).
- Correctly calculate element position if WebDriver returns screenshot thinner then document (@SevInf).
-
More clear error when capture are is hidden (@hatroman).
-
Mouse cursor is moved to (0,0) before the first test (@j0tunn).
Republish 0.12.4 due to another npm bug.
## 0.12.4 - 2015-05-28-
Fix calibration to work in Chrome 43+ (@SevInf).
-
Original window size is restored after suite with
setWindowSizeaction is finished (@scff). -
windowSizeoption is ignored in Opera Presto browsers (@SevInf).
- Sizzle: work with selectors ending with space (@SevInf).
- Fix client bridge script injection (@SevInf).
CRITICAL BUG WAS INTRODUCED IN THIS VERSION.
Version was deleted from npm, use 0.12.2 instead.
-
If CSS3 selectors are not supported by particular browser, Sizzle.js will be used for all queries in that browser (@SevInf).
-
Coverage now correctly detects intersection of the elements and capture area (@scff).
- When capturing element is visible compltely in the viewport do not scroll to element's location while taking the screenshot (@scff).
- Fix calibration in IE8 and add functional tests for it (@SevInf).
- Calibration affects only top and left sides of the screenshot (@scff).
-
Take into account horizontal scrolling when validating capture area for viewport screenshot (@scf2k).
-
Add missing pollyfills for IE8. This allows to gather coverage in ie8 (@SevInf).
-
Correctly report execptions, thrown during coverage gathering (@SevInf).
- Republish 0.11.1 due to npm registry bug.
- Fix crash after all tests are finished (@SevInf).
-
Plugins support (@Saulis).
Check out documentation and some plugin examples:
-
Add
flickaction for touch devices (@scf2k). -
Add
sessionModeproperty which allows to choose when new WebDriver session is created (@SevInf). -
Automatically kill browser session on
SIGHUP,SIGINTandSIGTERM(@j0tunn). -
Allow to switch image background in HTML reoport (@unlok).
-
url.resolveis not used anymore for computing absolute URLs fromrootUrland suite URL. It is now just joined with a single/in between (@j0tunn). -
Update
png-imageso it can be built withgcc4.6 (@j0tunn). -
Correctly expose
__geminivariable in client scripts (@vlkosinov). -
Grep pattern now checked when suites load, not when they are executed (@hatroman).
-
HTML report refactoring (@hatroman).
-
Fix calibration to work in IE8 again (@SevInf)
-
Client scripts which gemini injects into page are now bundled together and minified (@scf2k).
-
Update
png-imgversion bringing support for nodev0.12andiojs(@j0tunn). -
Don't inject main client script twice (@scf2k)
-
Ported 0.9.9 changes (@SevInf)
- Use document height instead of body height to determine whether webdriver returns document or viewport screenshot (@SevInf)
-
Basic support for IE8 browser (@SevInf).
This change required a large rewrite of the all client-side scripts which can cause some breaking changes. For example, bounds of a capture region are calculated more precisely now. You'll probably need to re-gather your screenshots.
-
Calibration now correctly works in IE9 (@SevInf).
-
Added an option
referenceImageAbsence(@hatroman).This option allows to change default behaviour of the tests to produce the warning if there is no reference image. Default behaviour is still the test failure.
-
Re-add
tolerancesetting, which now sets max allowed CIEDE2000 difference between image colors. It is now configurable on 3 levels:-
toleranceoption in config -
setTolerancemethod for a suite -
optional parameter to
capturemethod:suite.capture('name', {tolerance: 20}, function() {});
-
-
Programmatic API method
buildDiffis now deprecated: it has access only to global tolerance, so diff it produces might not show exactly what caused test to fail. Method is kept for backward compatibility, but users of a programmatic API now encouraged to usesaveDiffTomethod of test result (passed to reporter) instead. -
Warn if coverage for CSS file cannot be calculated due to same-origin policy (@SevInf)
- Adds new option
--browserto the CLI andbrowsersto the API which allows to run tests in a subset of browsers (@SevInf).
-
Work correctly if WebDriver implementation returns screenshot with a browser chrome. This is done via calibration step after first launch of the browsers (@scf2k).
-
Add ability to ignore certain elements when comparing screenshots. Use
suite.ignoreElements(selector1, selector2, ...)to specify the selectors to ignore (@SevInf). -
Add
tapaction for touch devices (@scf2k). -
geminiis now works correctly if page changes during the test (@scf2k). -
Correctly handle missing timeout in waitForElementXXX (@SevInf).
-
Correctly report image path in
gatherAPI (@SevInf).
-
Add new wait methods (@SevInf):
-
waitForElementToShow -
waitForElementToHide -
waitForJSCondition
-
- Work on a pages that modify
Array.prototype(@SevInf).
- Works on Windows again (@SevInf).
-
Add
sendFileaction which now should be used instead ofsendKeysto set a file toinput[type=file]elements (@SevInf). -
Correctly parse box-shadow in IE9 (@scf2k).
-
Fail only single test if reference image is not found (@SevInf).
- Coverage generator now follows symlinks while resolving the paths to CSS files. So the final report will have real paths but not pointing to symlinks.
-
Move the coverage HTML templating code to separate module (gemini-coverage).
-
Detailed error message when capture region exceeds screenshot area. Such error also will now fail only single state instead of a whole testing process (@SevInf).
- Ignore
@keyframesat-rule while collecting coverage (@scf2k).
-
Replace
GraphicsMagickwith lightweightpng-imglibrary (@j0tunn). As for this version,geminino longer requires any external tool for image processing. -
CSS coverage now supports source maps (@scf2k).
If your CSS has the sourcemap, coverage report will show original files.
You can use
sourceRootoption to tellgeminiwhere are your sources located on a filesystem. -
CSS coverages statistics will now also be written to
coverage.jsonfile (@scf2k). -
Add
coverageExcludeoption to allow exclude certain files from coverage report (@scf2k). -
Add index page to coverage report and improve appearance of a the coverage pages (@scf2k).
-
Restructure documentation and add quick start guide in russian and english (@jk708).
- Reset cursor position before reloading the page. When resetting it just after page load, old cursor position may trigger some transitions which will not be finished before first screenshot.
testcommand will exit with correct codes
-
New image comparison algorithm is implemented:
-
gm comparereplaced with custom diff. For now, GraphicsMagick is still required for other image manipulations. -
tolerancesetting is removed in favor of "strict mode": by default, only noticable changes (according to ciede2000 metric) will be treated as failure, to treat all changes that way user can enablestrictComparisonoption. -
in case if some element in focus during test can potentially have blinking caret displayed, diff will try to ignore caret.
-
-
Remove built-in TeamCity reporter. If you really want it, you can adapt 0.7.x reporter to the current version of
geminiand publish it in separate package. -
Remove legacy ability to specify browsers as array which was deprecated since 0.4.0.
-
Add experimental programmatic API.
-
Add
--grepoption togatherandtestcommands, which allows to execute only suites, matching the pattern (@scf2k). -
Show required dimensions in error message when origin does not fir to full-page screenshot (@scf2k)
-
Show meaningful error when capture area origin does not fit to full-page screenshot. This change can break some of your tests (@scf2k).
-
Add experimental CSS-coverage report. Enable with
--coverageCLI flag orcoverage: truein config (@scf2k). -
Add ability to override
gridUrl,rootUrl,screenshotsDir,debugconfig options by their respective CLI options or environment variables (@arikon). -
Add config option
windowSizeto specify default size of the browser windows (@scf2k). -
Add action
setWindowSizeto specify browser window size during the tests (@scf2k).
Was republished as 0.7.0 due to a breaking change.
## 0.6.4 - 2014-08-13-
Add command line completion (@unlok).
-
Show an error, when config file has unknown options.
-
Add
focus(element)action (@arikon).
- Allow to use empty string with
sendKeys. It can be used to focus on an element without changing states.
- Reset mouse position for each suite. Previously, cursor may stay at the position left from a previous suite and some elements was captured with hover effect when there shouldn't be any.
- Fix incorrect capture region rounding, causing bottom row of the element to be cropped sometimes.
-
:beforeand:afterpseudo-elements outline and shadow are now taken into account when calculating capture region(@incorp).This change can break some of your tests. Re-gather reference images to fix the problem.
-
Added
toleranceconfig option which can be used to specify maximum error rate before images will be treated as unequal. Default tolerance to 0. This is stricter then previous versions: now every, even slightest difference between reference and current images will fail tests.Set
toleranceto 0.001 in.gemini.ymlto restore 0.5.x behavior. -
Coordinates of capture region are now rounded to capture maximal area. Previously, border pixels could be cropped, due to rounding error. This change can break some of your tests. Re-gather reference images to fix the problem.
-
Added ability to change diff highlight color in config file.
-
Change diff highlight style
-
Global installations of
gemininow runs local one, if available.
-
Browsers are now launched once for each run (previously, they were launched once per suite). This greatly reduces total tests run time, but can break some of your code, i.e. each
mouseDownshould always be closed bymouseUp.Previously, this was not required if
mouseDownwas used once for suite.It will show warning if versions of the modules does not match.
-
flatreporter replacestree. Tree reporter can not work with new browser launch model. -
Add
parallelLimitoption that allows to limit number of browsers run in parallel. -
Add
suite.after()which can be used to perform some action after all of the states without taking screenshot. -
Unknown errors, returned by Selenium have more detailed report.
-
Fix
--versionoption.
- Fix missing images in html report.
- Correctly detect crop region in Firefox
-
Crop region for screenshots is calculated via client script inside browser instead of
gemini. This allows to issue fewer requests to Selenium Server speeding up total tests run time. This feature breaks compatibility with old browsers (IE< 9). -
New config format, which allows to specify full set of capabilities for browsers:
browsers: phantomjs: phantomjs opera12: browserName: opera version: '12.06' platform: 'WINDOWS' firefox28: browserName: firefox version: '28.0' firefox27: browserName: firefox version: '27.0'
-
Correctly capture screenshots of regions out of initial browser viewport in browsers, that can't capture full page (
OperaandChromeat the time of writing). -
outline-widthof an elements is now also taken into account when calculating crop region. -
Add
debugoptions to config file. If set totrue,geminiwill print debug logs to STDOUT. (@arikon). -
Add
httpsection to config file which allows to configure HTTP timeout (http.timeout) retry count (http.retries) and delay between retries (http.retryDelay). (@arikon). -
Asynchronous errors stacktraces in browser actions (such as not found element) will point to users code.
-
More HTTP requests to Selenium will run in parallel speeding up
gather/testcommands (@arikon). -
If
geminiis run without subcommand, help text will be shown.
-
Enhanced html report:
-
suites are now collapsible;
-
all but failed suites are collapsed by default;
-
buttons to expand all, collapse all and expand only errors are added;
-
stats of total numbers of tests run, failed, succeeded and skipped are shown at the top.
-
-
Allow to use multiple reporters in
testcommand. -
Throw error when creating multiple suites of the same name within the same parent.
-
Throw error when creating multiple states of the same name within the suite.
-
Throw error when creating suite that will be unable to run ( has states and hasn't url or capture region);
-
Check argument types of
SuiteBuildermethods. -
Check argument types of all actions methods.
-
Shorter stacktraces for invalid elements errors.
-
Correctly handle offsets in
mouseMoveactions. -
Fix error when
gridUrlwas required even if there is onlyphantomjsbrowser.
-
Allow to override
gridUrlandrootUrlsettings with cli options--grid-urland--root-url. -
Correctly report error, when wrong argument passed to an action.
-
Ability to set additional capabilities for all browsers, using
capabilitiesoption in.gemini.yml:capabilities: option1: value, option2: value
-
Non-existent directories, passed to
gatherandtestcommands will be filtered out -
If fatal error occurs,
geminiwill always exit with 1 status code -
If test fails or state error occurs,
geminiwill always exit with 2 status code. -
When
geminiis unable to launch browser, more clearer error message will be displayed.
-
Elements to take screen shots of and elements to perform action on are now defined differently.
setElementsandsetDynmaicElementsmethods removed.New way to define elements for screenshot:
suite.setCaptureElements('.selector1', '.selector2', ...)
Or using array:
suite.setCaptureElements(['.selector1', '.selector2', ...])
To get element to perform action on, you can now pass selectors directly to the actions:
suite.capture('state', function(actions, find) { actions.click('.button'); });
To avoid multiple lookups for the same element you can use
findfunction which is now passed to the state callback:suite.capture('state', function(actions, find) { var button = find('.button'); actions.mouseMove(button); .click(button); });
-
Add
suite.before(function(action, find))which can be used to perform some actions before the first state. Context is shared between before hook and all of suite's state callbacks.You can use
beforeto look for element only once for the state:suite.before(function(actions, find) { this.button = find('.buttons'); }) .capture('hovered', function(actions, find) { actions.mouseMove(this.button); }) .capture('pressed', function(actions, find) { actions.mouseDown(this.button); });
Or to perform some actions before first state without taking screenshot:
suite.before(function(actions, find) { actions.click('.button'); });
-
Add
suite.skip()method which allows to skip suite in some set of browsers:-
suite.skip()- skip in all browsers. -
suite.skip('chrome')- skip in all versions of Chrome. -
suite.skip({name: 'chrome', version: '33.0'})- skip in Chrome 33.0 -
suite.skip(['chrome', 'opera'])- skip in Chrome and Opera
-
-
Public API now has constants for special keys to use in
sendKeysactions (i.e.gemini.CONTROLforCTRLkey).
- Fix a bug with incorrect reference to the suite in states. Because of this bug dynamic elements was not updated properly.
-
New test suites API. Plans are replaced by test suites defined by explicit call.
Old version:
module.exports = function(plan) { plan.setName('some name') .setElements(...) .setDynamicElements(...) .capture(...) };
New API:
var gemini = require('gemini'); gemini.suite('some name', function(suite) { suite.setElements(...) .setDynamicElements(...) .capture(...) };
Suites also can be nested. In this case, child suite inherits all properties from the parent.
gemin.suite('parent', function(suite) { gemini.suite('child', function(child) { gemini.suite('grandchild', function(grandchild) { }); }); });
-
.reload()method is removed. Use nested suite if you need to reload browser. -
Added action to run any JS code in browser context:
actions.executeJS(function(window) { window.alert('Hello!'); });
-
sendKeysaction can optionally take an receive an element to send keys to.actions.sendKeys(elements.someInput, 'hello');
-
Added ability to specify browser version in
.gemini.ymlbrowsers: - {name: 'phantomjs', version: '1.9'}
-
Tree reporter is now used for
gathercommand.
-
phantomjsalways starts maximized. This fixes the error, when some shadows didn't fit in crop rectangle. -
Action on dynamic element that does not currently exists causes non-fatal error. Such error will fail only one state, the rest will continue running.
-
gathercommand now reports browser name. -
browsers are always closed, even if there was an error.
- Initial release