thunderstrike/puppeteer
thunderstrike/puppeteer
2
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2,898 Commits 2 Branches 0 Tags 31 MiB
2d50ec5b38
Commit Graph

542 Commits

Author SHA1 Message Date
Alex Rudenko
f52b37a3aa docs: fix a typo in waitForSelector (#8701) 2022-08-02 13:18:48 +00:00
Alex Rudenko
6f81b23728 fix: address flakiness in frame handling (#8688) 
When we attach to a frame, we send a call to get
the page frame tree from CDP. Based on the tree data
we look up the parent frame if parentId is provided.
The problem is that the call to get the page frame
tree could take arbitrary time and the calls for the
parent and child frames might happen at the same time.
So the situation where the frame tree for the child frame
is resolved before the parent frame is known is fairly
common.

This PR addresses the issue by awaiting for the parent
frame id before attempting to register a child frame.
 2022-08-02 13:18:47 +00:00
Alex Rudenko
2cbfdeb0ca feat: use CDP's auto-attach mechanism (#8520) 
* feat: use CDP's auto-attach mechanism

In this PR, we refactor Puppeteer to make use of the CDP's auto-attach mechanism. This allows the backend to pause
new targets and give Puppeteer a chance to configure them properly. This fixes the flakiness related to dealing with
OOPIFs and should fix some other issues related to the network interception and navigations. If those are not fixed completely by this PR, the PR serves a solid base for fixing them.

Closes https://github.com/puppeteer/puppeteer/issues/8507, https://github.com/puppeteer/puppeteer/issues/7990
Unlocks https://github.com/puppeteer/puppeteer/issues/3667

BREAKING CHANGE: With Chromium, Puppeteer will now attach to page/iframe targets immediately to allow reliable configuration of targets.
 2022-08-02 13:18:07 +00:00
release-please[bot]
a654607c74
chore(main): release 15.5.0 (#8683) 
* chore(main): release 15.5.0

* chore: generate versioned docs

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-07-21 14:25:48 +00:00
Alex Rudenko
f1b8ad3269
feat(chromium): roll to Chromium 105.0.5173.0 (r1022525) (#8682) 2022-07-21 13:16:47 +00:00
release-please[bot]
a43965a4b6
chore(main): release 15.4.2 (#8681) 
* chore(main): release 15.4.2

* chore: generate versioned docs

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-07-21 12:22:40 +00:00
Alex Rudenko
2abb9f0c14
fix: taking a screenshot with null viewport should be possible (#8680) 
Closes #8673
 2022-07-21 10:34:18 +02:00
release-please[bot]
d734c14813
chore(main): release 15.4.1 (#8678) 
* chore(main): release 15.4.1

* chore: generate versioned docs

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-07-21 09:35:51 +02:00
jrandolf
34ab5ca503
fix: import URL (#8670) 2022-07-21 08:20:51 +02:00
release-please[bot]
f0c28085c0
chore(main): release 15.4.0 (#8668) 
* chore(main): release 15.4.0

* chore: generate versioned docs

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-07-13 15:52:23 +02:00
Alex Rudenko
af08c5c903
feat: expose the page getter on Frame (#8657) 
* feat: expose the page getter on Frame

Closes #8654

* test: add a test
 2022-07-11 21:06:35 +02:00
release-please[bot]
dd27559090
chore(main): release 15.3.2 (#8647) 
* chore(main): release 15.3.2

* chore: generate versioned docs

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-07-08 09:58:30 +02:00
Asen Bozhilov
b47f066c2c
fix(page): fix page.#scrollIntoViewIfNeeded method (#8631) 
This patch fixes page.#scrollIntoViewIfNeeded, so that it works with devtools protocol.
Now it blocks the main thread and waits until the scrolling action finishes in Chrome.
Fallbacks to the old implementation if `DOM.scrollIntoViewIfNeeded` is not supported for Firefox.

Issues: #8627, #1805
 2022-07-08 06:53:45 +00:00
Alex Rudenko
1de0383abf
fix: cache dynamic imports (#8652) 2022-07-07 21:09:07 +02:00
Alex Rudenko
d0c4291995
fix: expose a RemoteObject getter (#8642) 
Closes #8639
 2022-07-07 13:04:28 +00:00
release-please[bot]
ec8c750383
chore(main): release 15.3.1 (#8635) 
* chore(main): release 15.3.1

* chore: generate versioned docs

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-07-06 09:24:46 +02:00
jrandolf
5ff205dc8b
fix: extends ElementHandle to Nodes (#8552) 
* fix: extends `ElementHandle` to `Node`s (#8552)
 2022-07-06 09:05:37 +02:00
release-please[bot]
01c76b7eb1
chore(main): release 15.3.0 (#8606) 
* chore(main): release 15.3.0

* chore: generate versioned docs

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-07-01 17:02:54 +02:00
jrandolf
066f440ba7
feat: add documentation (#8593) 2022-07-01 11:52:39 +00:00
release-please[bot]
51ae338acd
chore(main): release 15.2.0 (#8585) 
* chore(main): release 15.2.0

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-06-29 14:25:40 +02:00
Alex Rudenko
468ea8fca1
chore: expose Connection methods relevant for extension (#8594) 2022-06-28 14:48:29 +02:00
Levi Pesin
79e11985ba
feat: add fromSurface option to page.screenshot (#8496) 2022-06-27 12:37:37 +00:00
jrandolf
e499515fd6
chore: add type tests (#8588) 2022-06-27 10:57:31 +02:00
jrandolf
7001322cd1
feat: export public types only (#8584) 2022-06-27 09:24:23 +02:00
Pablo Matías Gomez
9787a1d8df
fix: clean up tmp profile dirs when browser is closed (#8580) 
* fix: clean up tmp profile dirs when browser is closed
 2022-06-27 07:40:30 +02:00
release-please[bot]
5849c9beb4
chore(main): release 15.1.1 (#8577) 
* chore(main): release 15.1.1

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-06-25 13:33:44 +02:00
Randolf J
e0198a79e0 fix: export ElementHandle 2022-06-25 13:28:50 +02:00
release-please[bot]
5fda494543
chore(main): release 15.1.0 (#8573) 
* chore(main): release 15.1.0

* chore: freeze version on docs

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-06-24 18:42:31 +02:00
Alex Rudenko
fb7d31e369
feat(chromium): roll to Chromium 104.0.5109.0 (r1011831) (#8569) 
* feat(chromium): roll to Chromium 104.0.5109.0 (r1011831)

* test: update a11y test expectations
 2022-06-24 14:13:31 +00:00
release-please[bot]
a23cac77f5
chore(main): release 15.0.2 (#8571) 
* chore(main): release 15.0.2

* chore: freeze version on docs

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-06-24 15:30:28 +02:00
Alex Rudenko
383e855847
fix: CSS coverage should work with empty stylesheets (#8570) 
Closes #8535
 2022-06-24 14:17:16 +02:00
release-please[bot]
d15f2239b9
chore(main): release 15.0.1 (#8565) 
* chore(main): release 15.0.1

* chore: freeze version on docs

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-06-24 09:42:02 +02:00
jrandolf
8100cbb295
fix: infer unioned handles (#8562) 2022-06-24 06:40:08 +00:00
release-please[bot]
9705797a02
chore(main): release 15.0.0 (#8555) 
* chore(main): release 15.0.0

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-06-23 13:38:28 +02:00
jrandolf
ec79f3a58a
feat: add experimental client to HTTPRequest (#8556) 2022-06-23 13:20:42 +02:00
jrandolf
ebcb8a2760
chore: split JSHandle.ts (#8551) 2022-06-23 11:31:43 +02:00
jrandolf
26c3acbb07
feat!: type inference for evaluation types (#8547) 
This PR greatly improves the types within Puppeteer:

- **Almost everything** is auto-deduced.
  - Parameters don't need to be specified in the function. They are deduced from the spread.
  - Return types don't need to be specified. They are deduced from the function. (More on this below)
  - Selections based on tag names correctly deduce element type, similar to TypeScript's mechanism for `getElementByTagName`.
- [**BREAKING CHANGE**] We've removed the ability to declare return types in type arguments for the following reasons:
  1. Setting them will indubitably break auto-deduction.
  2. You can just use `as ...` in TypeScript to coerce the correct type (given it makes sense).
- [**BREAKING CHANGE**] `waitFor` is officially gone.

To migrate to these changes, there are only four things you may need to change:
- If you set a return type using the `ReturnType` type parameter, remove it and use `as ...` and `HandleFor` (if necessary).
⛔ `evaluate<ReturnType>(a: number, b: number) => {...}, a, b)`
✅ `(await evaluate(a, b) => {...}, a, b)) as ReturnType`
⛔ `evaluateHandle<ReturnType>(a: number, b: number) => {...}, a, b)`
✅ `(await evaluateHandle(a, b) => {...}, a, b)) as HandleFor<ReturnType>`
- If you set any type parameters in the *parameters* of an evaluation function, remove them.  
⛔ `evaluate(a: number, b: number) => {...}, a, b)`
✅ `evaluate(a, b) => {...}, a, b)`
- If you set any type parameters in the method's declaration, remove them.
⛔ `evaluate<(a: number, b: number) => void>((a, b) => {...}, a, b)`
✅ `evaluate(a, b) => {...}, a, b)`
 2022-06-23 11:29:46 +02:00
jrandolf
347101883f
chore: split Launcher.ts (#8544) 2022-06-23 00:13:39 +02:00
jrandolf
70c7f64a58
chore: freeze revisions (#8543) 2022-06-22 15:56:43 +02:00
jrandolf
84712cbc28
chore: use Google's TS style guide's format config (#8542) 2022-06-22 15:25:44 +02:00
release-please[bot]
3d1ec573fb
chore(main): release 14.4.1 (#8523) 2022-06-17 15:29:28 +02:00
James Diefenderfer
6cd5cd0439
fix: avoid instanceof Object check in isErrorLike (#8527) 2022-06-17 15:26:18 +02:00
jrandolf
ce0dd25349
chore: use braces in function bodies (#8525) 2022-06-15 12:42:21 +02:00
jrandolf
570087ea94
chore: use strict typing in tests (#8524) 
* The testing tsconfig.json inherits from the base TS config.
  * A lot of type assertions have been inserted...a lot.
* All testing utilities have migrated to TS.
* text-diff is being replaced with diff for TS compatibility.
* ProtocolError has been added to PuppeteerErrors and PuppeteerErrors is no longer a record (it's been frozen).
* Fixes a small bug where null was an allowable media type in emulation (should be undefined).
 2022-06-15 12:09:22 +02:00
jrandolf
80373f7a12
chore: use composite builds for tests (#8522) 2022-06-15 12:05:25 +02:00
Randolf J
cba58a12c4 fix: export devices, errors, and more 
This commits exports `devices`, `errors`, and `networkConditions`.
 2022-06-14 20:56:14 +02:00
jrandolf
e6442dd767
chore: use curly (#8519) 2022-06-14 13:55:35 +02:00
jrandolf
0678343b53
chore: move helper.js to util.js (#8510) 2022-06-14 13:16:21 +02:00
release-please[bot]
e0c537408e
chore(main): release 14.4.0 (#8512) 
* chore(main): release 14.4.0

* chore: freeze version on docs

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-06-13 23:05:56 +02:00
jrandolf
6c960115a3
chore: use private fields (#8506) 2022-06-13 11:16:25 +02:00
jrandolf
4d359906a4
fix: use error-like (#8504) 2022-06-10 15:27:42 +02:00
jrandolf
bfd4e68f25
fix: use OS-independent abs. path check (#8505) 2022-06-10 14:34:57 +02:00
jrandolf
465a7c405f
feat: export puppeteer methods (#8493) 2022-06-09 19:00:50 +02:00
jrandolf
b30f3f44cd
fix: parse empty options in <select> (#8489) 2022-06-09 13:27:34 +02:00
jrandolf
f64ec2051b
feat: support node-like environments (#8490) 2022-06-09 13:03:44 +02:00
release-please[bot]
4b05a8454e
chore(main): release 14.3.0 (#8471) 
* chore(main): release 14.3.0

* chore: freeze version on docs

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-06-07 16:21:47 +02:00
jrandolf
e8378666c6
fix: don't throw on bad access (#8472) 2022-06-07 16:17:21 +02:00
Alex Rudenko
e14256010d
feat: use absolute URL for EVALUATION_SCRIPT_URL (#8481) 
Closes #8424
 2022-06-07 15:36:51 +02:00
James Diefenderfer
7dc8e37a23
fix: Kill browser process when killing process group fails (#8477) 
Fixes #8476. Similar fix to #8352 which only covered Windows.
 2022-06-07 15:25:45 +02:00
jrandolf
b54dc55f76
fix: robustly check for launch executable (#8468) 2022-06-07 15:25:04 +02:00
Randolf J
1b025b4c84 fix: only lookup localhost for DNS lookups 2022-06-04 01:04:38 +02:00
release-please[bot]
d5cd41686c
chore(main): release 14.2.1 (#8462) 
* chore(main): release 14.2.1

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
Co-authored-by: jrandolf <101637635+jrandolf@users.noreply.github.com>
 2022-06-02 15:38:51 +02:00
jrandolf
2615c1c3d6
fix: use null instead of undefined (#8463) 2022-06-02 15:38:13 +02:00
Alex Rudenko
5c9050aea0
fix: use isPageTargetCallback in Browser::pages() (#8460) 2022-06-02 13:27:31 +02:00
release-please[bot]
b3b62b35f3
chore(main): release 14.2.0 (#8457) 
* chore(main): release 14.2.0

* chore: freeze version on docs

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
 2022-06-01 22:11:58 +02:00
jrandolf
f2d8276d6e
feat: support node 18 (#8447) 2022-06-01 13:53:17 +02:00
jrandolf
30438e6532
chore: use ts-doc and factor out importFSModule (#8449) 2022-06-01 11:11:09 +02:00
jrandolf
3f4451eff7
chore: extract puppeteer launch options to type (#8448) 2022-05-31 17:54:25 +00:00
jrandolf
9f9a1a4dd5
chore: update deps (#8446) 2022-05-31 19:04:30 +02:00
Yutaka Hirano
2219eed386
chore: fix network-service related chromium feature settings (#8350) 2022-05-31 17:32:54 +02:00
jrandolf
b4e751f29c
feat: use strict typescript (#8401) 2022-05-31 16:34:16 +02:00
Junyan
92110151d9
fix: multiple same request event listener (#8404) 2022-05-30 20:34:08 +00:00
Alex Rudenko
54efc2c949
feat(chromium): roll to Chromium 103.0.5059.0 (r1002410) (#8410) 2022-05-30 19:38:38 +02:00
Alex Rudenko
c96c915b53
fix: do not use loaderId for lifecycle events (#8395) 
This PR works around the upstream bug crbug.com/1325782. Previously Puppeteer relied on the presence of the loaderId to determine the kind of navigation and expected events. It does not look like there is a reason to do so: instead, we could see what events we get and proceed accordingly.
 2022-05-30 10:30:30 +02:00
Alex Rudenko
256223a7b1
chore: strict-mode TS for DOMWorld (#8398) 2022-05-25 15:34:11 +02:00
Alex Rudenko
af92a24ba9
fix: use strict TS in Input.ts (#8392) 2022-05-24 14:28:36 +00:00
Alex Rudenko
b349d71dcd
chore: fix strict-mode TS in LifecycleWatcher (#8387) 2022-05-24 11:14:19 +00:00
Alex Rudenko
aa014d8f5f
chore: fix TS issues in NetworkManager (#8386) 2022-05-23 17:41:11 +02:00
Alex Rudenko
0ca60a7ff0
chore(release): mark v14.1.1 (#8374) 2022-05-19 14:54:39 +00:00
Alex Rudenko
04dbd8f39a
Revert "fix: do not use loaderId for Lifecycle events (#8353)" (#8369) 
This reverts commit 7107d2d300.
 2022-05-19 12:05:33 +00:00
Alex Rudenko
7107d2d300
fix: do not use loaderId for Lifecycle events (#8353) 2022-05-17 13:27:21 +00:00
jrandolf
74380303ac
fix: only check loading iframe in lifecycling (#8348) 2022-05-17 12:15:44 +00:00
Simon
dccfadb90e
fix: kill browser process when 'taskkill' fails on Windows (#8352) 2022-05-16 13:32:29 +00:00
Alex Rudenko
eec2bf882b
chore: set up daily jobs for latest Chromium builds (#8344) 2022-05-13 12:15:12 +00:00
Alex Rudenko
1441fb84d8
chore(release): mark v14.1.0 (#8339) 2022-05-13 07:31:25 +00:00
Alex Rudenko
3b66a2c47e
feat: allow handling other targets as pages internally (#8336) 
Co-authored-by: jrandolf <101637635+jrandolf@users.noreply.github.com>
 2022-05-13 08:04:46 +02:00
Pirikara
a61144d437
fix: If currentNode and root are the same, do not include them in the result (#8332) 
* fix: If currentNode and root are the same, do not include them in the result

* fix: Tests that only child element is included in the result

Co-authored-by: jrandolf <101637635+jrandolf@users.noreply.github.com>
 2022-05-11 12:17:02 +00:00
Alex Rudenko
4854ad5b15
fix: disable AvoidUnnecessaryBeforeUnloadCheckSync to fix navigations (#8330) 2022-05-11 09:41:53 +02:00
Alex Rudenko
7eaadafe19
feat: add waitForXPath to ElementHandle (#8329) 2022-05-10 12:45:20 +02:00
jrandolf
6841bd68d8
feat: support ES modules (#8306) 2022-05-09 11:17:24 +00:00
Ergün Erdoğmuş
be4c930c60
feat(chromium): roll to Chromium 102.0.5002.0 (r991974) (#8319) 2022-05-09 08:58:48 +00:00
Valentin Semirulnik
baa017db92
feat: add support for Apple Silicon chromium builds (#7546) 
Google has published Chromium builds for Apple Silicon so we can fetch it now

Related to #6622
 2022-05-05 07:33:19 +00:00
Alex Rudenko
2804ae8cdb
fix!: strict mode fixes for HTTPRequest/Response classes (#8297) 
Solves type issues in HTTPRequest/Response with some slight changes in the behaviour and API.

Issues #6769
 2022-05-05 06:48:03 +00:00
Alex Rudenko
553959884f
fix: make sure inner OOPIFs can be attached to (#8304) 2022-05-04 07:46:38 +02:00
Alex Rudenko
e841d7f9f3
fix: tests failing in headful (#8273) 
* fix: test failing in headful

* fix: install Firefox for headful tests

* fix: skip favicon.ico requests in test

* fix: auth test in headful

* fix: disable NetworkTimeServiceQuerying

* fix: filter more favicon requests

* fix: network test with favicon

* fix: improve fixes
 2022-05-02 11:37:21 +02:00
Darío Kondratiuk
f39eb70f2f
test: run Frame.evaluate tests on Firefox (#8296) 2022-05-02 08:21:19 +02:00
jrandolf
7a51bff47f
feat: add back and forward mouse buttons (#8284) 2022-04-27 21:00:07 +00:00
Alex Rudenko
1308d9aa6a
feat: support chrome headless mode (#8260) 
* feat: support chrome headless mode

Co-authored-by: Ergün Erdoğmuş <erdogmusergun@gmail.com>
 2022-04-25 13:11:23 +02:00
Darío Kondratiuk
4b786c904c
fix: forget request will be sent from the _requestWillBeSentMap list. (#8226) 
That forget looked wrong to me. Let me know if this change is correct.
 2022-04-19 14:46:40 +00:00
Henrik Skupin
b6504d7186
fix: also kill Firefox when temporary profile is used (#8233) 
* fix: also kill Firefox when temporary profile is used

* fix: use separate tests for Puppeteer.launch should filter out ignored default arguments
 2022-04-19 12:09:23 +00:00