The goal is to use an extension to bypass GPDR cookie consent popups. In this article I’ll show how you can run and configure puppeteer inside a docker container, with an extension enabled. There are all kinds of extensions available that can help you with this. The same goes for all the adverts you might one to block and not handle individually. If you want to write a scraper it quickly becomes very annoying to add all these extra steps to your puppeteer scripts. When you live in the EU, you know about the ‘Cookie Consent’ popups shown in many, many, many pages. For instance you can’t use extensions when running in this mode. Not all the features of Chrome, however, are available when running in this mode.
That way you won’t see a browser window popping up, and chrome just runs as headless background process. For a lot of scenarios you can run puppeteer, which wraps Chrome, using Chrome’s headless mode. Puppeteer ( ) is a great way to write scrapers, integration tests, or automate boring tasks and web forms.
RUN apt-get update & apt-get install -y gconf-service libasound2 libatk1.0-0 libc6 libcairo2 libcups2 libdbus-1-3 libexpat1 libfontconfig1 libgcc1 libgconf-2-4 libgdk-pixbuf2.0-0 libglib2.0-0 libgtk-3-0 libnspr4 libpango-1.0-0 libpangocairo-1.0-0 libstdc++6 libx11-6 libx11-xcb1 libxcb1 libxcomposite1 libxcursor1 libxdamage1 libxext6 libxfixes3 libxi6 libxrandr2 libxrender1 libxss1 libxtst6 ca-certificates fonts-liberation libappindicator1 libnss3 lsb-release xdg-utils wgetĪDD. # uncomment the following lines to have `dumb-init` as PID 1 # If running Docker >= 1.13.0 use docker run's -init arg to reap zombie processes, otherwise
& apt-get install -y google-chrome-stable fonts-ipafont-gothic fonts-wqy-zenhei fonts-thai-tlwg fonts-kacst fonts-freefont-ttf libxss1 \ & sh -c 'echo "deb stable main" > /etc/apt//google.list' \ # Note: this installs the necessary libs to make the bundled version of Chromium that Puppeteer # Install latest chrome dev package and fonts to support major charsets (Chinese, Japanese, Arabic, Hebrew, Thai and a few others) Please see Dockerfile below, it works fine: FROM node:16-slim Solutionĭocker container’s base image does have GUI system. While running puppeteer with Non-headless mode in a docker container, a bug occurs: Unable to open X display in docker.
0 kommentar(er)
