8,100 questions
0
votes
0
answers
14
views
Generating PDF with Puppeteer: View Not Fully Captured and Leaflet Tiles Not Fully Loaded
I have an Angular application that contains only a Leaflet map. I've built an Express.js server using Puppeteer to capture the map and generate a PDF.
I pass the zoom level and map layer as URL ...
0
votes
1
answer
19
views
Puppeteer not injecting pageNumbers and totalPages using TailwindCSS
I have a TailwindCSS footer. I am trying to use the classes to inject pageNumber and TotalPages on a pdf printed, but I am not getting it right.
I have the Puppeteer API created it display the Vuetify ...
-2
votes
0
answers
25
views
i need a puppeteer script to download rendered CSS on a page [closed]
I have limited coding skills but with the help of ChatGPT I have installed Python and Puppetteer and used a ChatGPT rest script to return the page title.
However all attempts by ChatGPT to write a ...
- 27
0
votes
1
answer
58
views
Puppeteer executing the first click action in an array immediately, regardless of delay
I'm facing a seriously weird issue with puppeteer, running on Chrome.
I have an array of click actions I want to execute on a webpage, which has a pdf.js based slideshow. Each action consists of ...
-2
votes
0
answers
28
views
Write and fill Excel file with scraped data using Puppeteer and Node.js [closed]
I have a bunch of data stored in an array of objects and now want to fill it into an already existing Excel file. Each property has its column where it needs to be filled into and it should start ...
0
votes
0
answers
29
views
Puppeteer fails to find Chrome in Vercel serverless environment [duplicate]
I'm trying to run Puppeteer in a Next.js application deployed on Vercel, but I'm encountering this error:
Error: Could not find Chrome (ver. 121.0.6167.85). This can occur if either
1. you did not ...
0
votes
0
answers
22
views
Using puppeteer cluster with multiple tabs per chrome?
My website with 100s of users needs the ability to launch headless puppeteer instances, load data into it, and take a screenshot. This works fine with one chrome at a time, but if I need to scale this ...
- 606
-1
votes
0
answers
81
views
Puppeteer Error : Could not find Chrome (ver. 131.0.6778.204)
I am using puppeteer to generate pdf. Also i am using selenium for zerodha automation. i need to configure the docker file to work fine for both selenium and puppeteer.
This is docker file
FROM node:...
- 25
1
vote
0
answers
67
views
How to switch to "puppeteer-real-browser" from default puppeteer? [closed]
i want to change my scraper's "puppeteer" library with "puppeteer-real-browser". I tried so many ways but i got bunch of errors and i dont want to ask all in here to make process ...
- 11
0
votes
1
answer
44
views
Node.js script hangs after saving documents to MongoDB with Mongoose, despite successful document saves
I have a Node.js script that uses Puppeteer to scrape job vacancy IDs from a website and Mongoose to save those IDs to a MongoDB database. Each vacancy is saved correctly, but the script hangs after ...
- 75
0
votes
1
answer
16
views
How to use puppeteer in streamdeck sdk?
I want to create a streamdeck plugin using Streamdeck SDK.
I created the example counter project and it works fine on Windows 11, node 23.8, Streamdeck 6.8.1.
The project is written in typescript and ...
- 66.8k
0
votes
0
answers
31
views
Error: net::ERR_TUNNEL_CONNECTION_FAILED when using proxy with puppeteer on Debian
I am trying to use a proxy with puppeteer on Debian 12.
I purchased the proxy from the froxy service. I also copied the test code from their integration documentation:
import puppeteer from 'puppeteer'...
- 143
0
votes
0
answers
27
views
How to fill an input and select an option from the dropdown using Puppeteer?
I am working on a project with JavaScript and chose Puppeteer to perform web scraping on various websites. One of the websites I need to scrape is this one Mapas SII, from which I plan to obtain ...
0
votes
0
answers
14
views
pkg package failed after upgrade puppeteer version from 1.20.0 to 24.0.0
Build command:
"scripts": {
"pre_build_andata": "rm -rf build",
"_build_andata": "pkg src/startup.js --targets node18-macos-arm64 --output build/...
2
votes
1
answer
77
views
Puppeteer Scraping: See XHR response data before request completes for real time data
I am using puppeteer to scrape a website for real time data in nodejs. Instead of scraping the page, I am watching the backend requests and capturing the JSON/TEXT responses so I have more structured ...
- 21
0
votes
0
answers
53
views
How to scrape searched youtube videos with puppeteer
I am trying to use nodeJs with puppeteer to scrape for YouTube video information from the search results. Unfortunately, for some reason, the scrape doesn't load the elements via the document query ...
0
votes
1
answer
49
views
Puppeteer - Unable to select an input box based on -p-aria and -p-text
I am automating an web application and I need to type in a value in an input text box.
My plan is to develop an friendly function, where in if I pass the label associated with the text , I should be ...
- 1,957
0
votes
0
answers
21
views
access cdp from client
Without having read too much about cdp (only the main cdp page and the getting started guide) - is it possible at all to get a nodeId on the client?
My use case would be roughly this
const handle = ...
- 520
1
vote
0
answers
51
views
Javascript puppeteer code works in debug mode, but not when running using node js
const puppeteer = require('puppeteer');
(async () => {
// Launch a new browser instance
const browser = await puppeteer.launch({ headless: false }); // Set headless to false to see the browser
...
- 11
-6
votes
1
answer
70
views
Without variable works, with variable error [closed]
I have this NODE JS code, the problem is that when I try to pass a variable from “mynew” to ‘userPrompt’ then ai gives the error “no body”. If I just substitute the value without the variable, ...
- 1
0
votes
1
answer
89
views
Issue with Puppeteer on Docker after Deployment
I am using puppeteer in sveltekit project to convert the html into pdf file. In local machine if i run sveltekit project then its working fine without any issue, but after the deployment in server its ...
-1
votes
1
answer
128
views
Efficiently utilizing puppeteers headless browser's in google cloud?
I have a nodejs codebase deployed on google cloud, using an ubuntu image. This code will open a headless browser using puppeteer, render some HTML and save an image. This is currently taking about 4-6 ...
- 606
1
vote
1
answer
171
views
[email protected]/[email protected] fail to GET basic auth pages with ERR_BLOCKED_BY_CLIENT
[email protected]/[email protected] (headless: true)
fail to GET pages with basic auth.
net::ERR_BLOCKED_BY_CLIENT
I've encountered this problem while test crawling
our customer service site.
The ...
- 11
0
votes
0
answers
47
views
Custom Font Not Applying in Puppeteer browser on Firebase Functions
I'm using puppeteer-core with chrome-aws-lambda in a Firebase Cloud Function to scrape a webpage and apply a custom font. However, despite injecting the @font-face rule via page.addStyleTag, the font ...
- 163
0
votes
1
answer
37
views
Puppeteer MediaRecorder API error: NotReadableError when capturing display media on Ubuntu Linux
I'm encountering an issue with Puppeteer and the MediaRecorder API when trying to capture display media on Ubuntu Linux. On Windows it works well it captures screen and video chunks are generated ...
0
votes
0
answers
33
views
Heroku Nodejs Puppeteer page.goto behaviour is different on different browsers
I'm using puppeteer to create customer pdfs, this involves logging in, going to a page with customer report (has css, javascript, charts etc) information - see below.
in Duck Duck go this works as ...
- 19
0
votes
2
answers
57
views
Form filling popup assertion failure
I'm working on a program to automate the entry of information into an on-line form using Puppeteer. The fields appear to fill correctly until I get to the #club section.
I'm thinking I'm not ...
1
vote
1
answer
45
views
Puppeteer-core works fine locally but fails when deployed to vercel
I have trying to scrape using pupperter in Nextjs App router. it worked fine when i did it locally but when deployed to vercel it failed.
here is the corresponding code:
import puppeteer, { ...
- 11
0
votes
0
answers
32
views
Puppeteer not working with Django Viewset
I am trying to write a Django REST endpoint which will convert the HTML content to PDF and then return the Streaming file response to download the report. For this purpose, I am using Puppeteer, which ...
- 2,710
1
vote
1
answer
40
views
How to navigate Angular routes without full reload in Puppeteer
I'm taking screenshot from a Angular website with Puppeteer and want to navigate routes without triggering a full page reload. Using page.goto() causes a reload, but Angular's client-side router ...
- 443
0
votes
1
answer
71
views
Troubleshooting Playwright Navigation Timeout Error with Pre-Loaded Page
When automating a website using Playwright where the target page is already open in the browser, you may encounter a page.waitForNavigation() timeout error, even though the page loads quickly (under 5 ...
- 43
0
votes
0
answers
50
views
Running puppeteer in podman container
I'm trying to launch puppeteer inside a podman container but as I read online this isn't really straightforward. I mainly followed this guide but I get the following error which seems pretty ...
- 330
0
votes
1
answer
52
views
'this' is Undefined in Instance Methods when Importing Puppeteer Inside a Module
I am running into an issue with Puppeteer where 'this' is undefined within the Puppeteer class instance methods when Puppeteer is imported into a module.
When I import Puppeteer directly in my main ...
1
vote
0
answers
41
views
How to click an element using a node ID from the accessibility tree in Puppeteer?
I’m working with Puppeteer to automate interactions on a webpage. I have retrieved information from the accessibility tree using Puppeteer’s page.accessibility.snapshot() method. The snapshot provides ...
- 11
1
vote
1
answer
62
views
puppeteer:browsers:launcher Trying to kill
puppeteer is killing my page when I call setContent.
How can I debug why this is happening?
code:
chrome = await puppeteer.launch();
page = await chrome.newPage();
await page.setUserAgent(ua);
await ...
- 464
0
votes
0
answers
33
views
Data Privacy in Puppeteer: Does Any Data Survive Chrome Restart?
If I:
Launch Chrome via Puppeteer (puppeteer.launch()) and load some HTML (e.g., to create a PDF),
Then close the browser (browser.close()),
Then repeat the whole process (launch the browser again, ...
- 1
3
votes
2
answers
81
views
How to write scrapers which will not ask to log in
I want to scrape data from https://csfloat.com/search?def_index=4727 and I'm using Puppeteer.
const puppeteer = require("puppeteer");
(async () => {
const browser = await puppeteer....
- 183
0
votes
1
answer
68
views
Puppeteer "Target Close" crash at random points
I have this little puppeteer script that should scrape the specific website, get some info from it, navigate through pagination and then print the data. But for some reason, it keeps crashing at a ...
1
vote
1
answer
73
views
Error: Error: Node is either not visible or not an HTMLElement
I need help locating the freeriderhd.com HTML login element because in my code it says: Error: Error: Node is either not visible or not an HTMLElement
Basically I need help inspecting the page and ...
- 11
1
vote
0
answers
29
views
How to use strapi's log in puppeteer?
I want to use strapi's log in puppeteer.
The strapi configuration is complete, and it is used well in the strapi internal code.
But even though I passed the log function to puppeteer, it does not work....
- 317
0
votes
1
answer
58
views
puppeter click method not work for mobile device toolbar
when i use click method in normal browser screen_resolution then it is work but when i set in mobile device mode with the help of browser mobile screen toolbar then this method not work
My high-...
- 43
0
votes
0
answers
60
views
Docker Puppeteer with Firefox: Error "no DISPLAY environment variable specified" when running in headless mode
I am trying to run Puppeteer using Firefox in a Docker container. Below is my Dockerfile:
# Use the official Node.js Docker image as the base image
FROM node:slim
# We don't need the standalone ...
0
votes
1
answer
253
views
Puppeteer js stuck on infinite CloudFlare Human captcha
I can't solve the Cloudflare "am i human" captcha, in my puppeteer headful browser, either manually or with a bypass extension, it used to work perfectly with the bypass chrome extension ...
0
votes
0
answers
36
views
Display SVG string in the React frontend
I have encountered an issue while displaying a scraped SVG string on the frontend in a React application. Here's a brief overview of the process:
I used Node.js and Puppeteer to scrape a price chart (...
0
votes
1
answer
39
views
Puppeteer Cluster Error: "Unable to launch browser, error message: kill EACCES" on Ubuntu 24.04 Noble
I'm facing an issue while trying to launch a Puppeteer Cluster on Ubuntu 24.04 Noble. The error message I get is:
Error creating puppeteer cluster Unable to launch browser, error message: kill EACCES
...
- 73
0
votes
1
answer
215
views
Error Running Puppeteer on Google App Engine
I need some help running puppeteer on the app engine standard environment to generate pdfs. I have tried several configurations and followed the documentation but I can't get it to work.
Below is my ...
0
votes
1
answer
92
views
Chrome Docker image works locally but fails on server
I am building a Docker image that includes Chrome.
The image works perfectly on my local machine, but when deployed to a server, Chrome fails to start with the following error:
[301:301:1224/210431....
- 986
0
votes
1
answer
47
views
Puppeteer, why are Chrome cookies lost after closing the browser and reopening?
I’m working on a Puppeteer script where I need the browser to retain cookies across sessions. However, I've noticed that after closing the browser and reopening it, the cookies are lost.
Here’s a ...
3
votes
1
answer
66
views
Can't find keyword using Playwright & Pyppeteer [closed]
When using all kinds of Python automation tools (such as Playwright and Pyppeteer), I can't seem to grab the "Continue with Google" button on https://dropbox.com/login. When I do this ...
- 105
1
vote
0
answers
39
views
How can I programmatically obtain the PageSpeed Insights report ID using Node.js (without web scraping)?
I’m trying to get the unique report URL (like https://pagespeed.web.dev/analysis/https-example-com/djlqz3yt2f) for a PageSpeed Insights analysis programmatically using Node.js. I know it's possible to ...
