puppeteer/utils/testrunner
Andrey Lushnikov 14fb3e38db
chore(firefox): mark all Puppeteer tests that are failing on FF (#3924)
This patch:
- introduces new testRunner methods `addTestDSL` and `addSuiteDSL`
  to add annotated test / suite.
- introduces new test/suite declaration methods: `it_fails_ffox` and
  `describe_fails_ffox`. These are equal to `it`/`describe` for chromium
  tests and to `xit`/`xdescribe` for firefox.
- marks all unsupported tests with `it_fails_ffox`
- adds a new command-line flag `'--firefox-status'` to `//test/test.js`.
  This flag dumps current amount of tests that are intentionally skipped
  for Firefox.

End goal: get rid of all `it_fails_ffox` and `describe_fails_ffox`
tests.

Drive-By: remove cookie tests  "afterEach" hook that was removing
cookies - it's not needed any more since every test is run in a
designated browser context.

References #3889
2019-02-05 22:32:41 -08:00
..
examples chore: testrunner's ".not" should print appropriate message (#2459) 2018-04-26 11:13:22 -07:00
.npmignore chore: add .npmignore for testrunner (#3290) 2018-09-21 17:27:10 -07:00
index.js tests: drop jasmine test runner (#1519) 2017-12-07 16:37:22 -08:00
LICENSE chore: prepare testrunner to be published to npm (#3289) 2018-09-21 14:51:22 -07:00
Matchers.js feat: introduce puppeteer/Errors (#3056) 2018-08-09 16:51:12 -07:00
Multimap.js tests: drop jasmine test runner (#1519) 2017-12-07 16:37:22 -08:00
package.json chore(testrunner): bump version to v0.5.0-post (#3291) 2018-09-21 15:25:17 -07:00
README.md chore(testrunner): fix readme description (#3293) 2018-09-21 20:44:43 -07:00
Reporter.js chore(testrunner): nicer colors for test reporter (#3921) 2019-02-05 19:02:29 -08:00
TestRunner.js chore(firefox): mark all Puppeteer tests that are failing on FF (#3924) 2019-02-05 22:32:41 -08:00

TestRunner

This test runner is used internally by Puppeteer to test Puppeteer itself.

  • testrunner is a library: tests are node.js scripts
  • parallel wrt IO operations
  • supports async/await
  • modular
  • well-isolated state per execution thread

Installation

npm install --save-dev @pptr/testrunner

Example

Save the following as test.js and run using node:

node test.js
const {TestRunner, Reporter, Matchers} = require('@pptr/testrunner');

// Runner holds and runs all the tests
const runner = new TestRunner({
  parallel: 2, // run 2 parallel threads
  timeout: 1000, // setup timeout of 1 second per test
});
// Simple expect-like matchers
const {expect} = new Matchers();

// Extract jasmine-like DSL into the global namespace
const {describe, xdescribe, fdescribe} = runner;
const {it, fit, xit} = runner;
const {beforeAll, beforeEach, afterAll, afterEach} = runner;

// Test hooks can be async.
beforeAll(async state => {
  state.parallelIndex; // either 0 or 1 in this example, depending on the executing thread
  state.foo = 'bar'; // set state for every test
});

describe('math', () => {
  it('to be sane', async (state, test) => {
    state.parallelIndex; // Very first test will always be ran by the 0's thread
    state.foo; // this will be 'bar'
    expect(2 + 2).toBe(4);
  });
});

// Reporter subscribes to TestRunner events and displays information in terminal
const reporter = new Reporter(runner);

// Run all tests.
runner.run();