puppeteer/test
Jack Franklin d8e0557d18
chore: update Travis to run latest macOS and fix HTTPS test (#5903)
* chore: fix invalid SSL assertion on Catalina

The error Chrome gives with an invalid cert changes between older Mac
versions and Catalina as detailed here:
https://support.google.com/chrome/thread/18125056?hl=en.

This PR changes Travis to run Catalina (and we think most devs run up to
date OS versions) so this fix ensures the test behaviour is consistent
locally and on Travis.

For those on older Mac versions I've left a comment by the tests to
hopefully save them debugging!

Co-authored-by: Mathias Bynens <mathias@qiwi.be>
2020-05-21 15:36:59 +01:00
..
assets chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
fixtures chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
golden-chromium test: add page.screenshot viewport clipping test (#5079) 2019-10-24 14:05:13 +02:00
golden-firefox test: add page.screenshot viewport clipping test (#5079) 2019-10-24 14:05:13 +02:00
accessibility.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
assert-coverage-test.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
browser.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
browsercontext.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
CDPSession.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
chromiumonly.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
click.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
cookies.spec.js feat(chromium): roll Chromium to r756035 (#5879) 2020-05-18 11:06:42 +02:00
coverage-utils.js chore: error if coverage couldn't find the given class (#5863) 2020-05-20 11:00:29 +02:00
coverage.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
defaultbrowsercontext.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
dialog.spec.js chore: fix async dialog specs when they fail (#5859) 2020-05-14 11:34:22 +02:00
diffstyle.css Implement FrameManager 2017-06-21 14:11:52 -07:00
elementhandle.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
emulation.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
evaluation.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
fixtures.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
frame.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
golden-utils.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
headful.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
ignorehttpserrors.spec.js feat: add securityDetails.subjectAlternativeNames() #5628 (#5881) 2020-05-18 12:59:57 +02:00
input.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
jshandle.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
keyboard.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
launcher.spec.js chore: fetch Firefox from JSON source instead of RegExp (#5864) 2020-05-13 15:48:39 +02:00
mocha-utils.js Warn when given unsupported product name. (#5845) 2020-05-12 10:30:24 +01:00
mouse.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
navigation.spec.js chore: update Travis to run latest macOS and fix HTTPS test (#5903) 2020-05-21 15:36:59 +01:00
network.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
oopif.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
page.spec.js chore: restore page.setUserAgent test (#5868) 2020-05-14 10:24:30 +01:00
queryselector.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
README.md chore: add running TSC to test README (#5852) 2020-05-13 09:20:33 +01:00
requestinterception.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
run_static_server.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
screenshot.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
target.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
touchscreen.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
tracing.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
utils.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00
waittask.spec.js fix: support async functions as an argument for waitForFunction (#5682) 2020-05-19 09:09:31 +02:00
worker.spec.js chore: add Prettier (#5825) 2020-05-07 12:54:55 +02:00

Puppeteer unit tests

Unit tests in Puppeteer are written using Mocha as the test runner and Expect as the assertions library.

Test state

We have some common setup that runs before each test and is defined in mocha-utils.js.

You can use the getTestState function to read state. It exposes the following that you can use in your tests. These will be reset/tidied between tests automatically for you:

  • puppeteer: an instance of the Puppeteer library. This is exactly what you'd get if you ran require('puppeteer').
  • puppeteerPath: the path to the root source file for Puppeteer.
  • defaultBrowserOptions: the default options the Puppeteer browser is launched from in test mode, so tests can use them and override if required.
  • server: a dummy test server instance (see utils/testserver for more).
  • httpsServer: a dummy test server HTTPS instance (see utils/testserver for more).
  • isFirefox: true if running in Firefox.
  • isChrome: true if running Chromium.
  • isHeadless: true if the test is in headless mode.

If your test needs a browser instance, you can use the setupTestBrowserHooks() function which will automatically configure a browser that will be cleaned between each test suite run. You access this via getTestState().

If your test needs a Puppeteer page and context, you can use the setupTestPageAndContextHooks() function which will configure these. You can access page and context from getTestState() once you have done this.

The best place to look is an existing test to see how they use the helpers.

Skipping tests for Firefox

Tests that are not expected to pass in Firefox can be skipped. You can skip an individual test by using itFailsFirefox rather than it. Similarly you can skip a describe block with describeFailsFirefox.

There is also describeChromeOnly which will only execute the test if running in Chromium. Note that this is different from describeFailsFirefox: the goal is to get any FailsFirefox calls passing in Firefox, whereas describeChromeOnly should be used to test behaviour that will only ever apply in Chromium.

Running tests

Despite being named 'unit', these are integration tests, making sure public API methods and events work as expected.

  • To run all tests:
npm run unit
  • Important: don't forget to first run TypeScript if you're testing local changes:
npm run tsc && npm run unit
  • To run a specific test, substitute the it with it.only:
  ...
  it.only('should work', async function() {
    const {server, page} = getTestState();
    const response = await page.goto(server.EMPTY_PAGE);
    expect(response.ok).toBe(true);
  });
  • To disable a specific test, substitute the it with xit (mnemonic rule: 'cross it'):
  ...
  // Using "xit" to skip specific test
  xit('should work', async function({server, page}) {
    const {server, page} = getTestState();
    const response = await page.goto(server.EMPTY_PAGE);
    expect(response.ok).toBe(true);
  });
  • To run tests in non-headless mode:
HEADLESS=false npm run unit
  • To run tests with custom browser executable:
BINARY=<path-to-executable> npm run unit