ERROR: No module named 'playwright'

[Stolz]

Describe the bug
When trying to use Playwright as fetcher, error No module named 'playwright' is shown in both UI and logs.

Version
v0.39.19.1

To Reproduce

1. Add a new watch for URL https://www.origin.com/hkg/en-us/store/browse?fq=gameType:freegames (Site listing Free games available in Origin)
2. Chose Playwright Chromium/Javascript as fetch method
3. Wait until change detection tries to fetch the URL
4. See error in the logschange-detection

   Processing UUID f1917fe0-0b4a-47ec-8cbf-25bf28b6b956 Priority 1 URL https://www.origin.com/hkg/en-us/store/browse?fq=gameType:freegames
   ERROR:changedetectionio:Exception reached processing watch UUID: f1917fe0-0b4a-47ec-8cbf-25bf28b6b956 - No module named 'playwright'

Additional context
I can successfully access Playwright web debugger so I know the container is up an running. Here is my Docker compose file

version: '3.8'
networks:
  reverseProxy:
    external: true
services:
  changeDetection:
    container_name: change-detection
    environment:
      BASE_URL: https://changedetection.example.com
      PLAYWRIGHT_DRIVER_URL: ws://change-detection-fetcher:3000/?token=redacted
      PGID: 1000
      PUID: 1000
    hostname: change-detection
    image: ghcr.io/dgtlmoon/changedetection.io
    labels:
      - traefik.enable=true
    networks:
      - reverseProxy
    restart: unless-stopped
    volumes:
      - ./config:/datastore
  headlessBrowser:
    container_name: change-detection-fetcher
    environment: # See https://docs.browserless.io/docs/docker.html for more options
      DEFAULT_IGNORE_HTTPS_ERRORS: 'true'
      TOKEN: redacted
      WORKSPACE_DELETE_EXPIRED: 'true'
      WORKSPACE_EXPIRE_DAYS: 7
    hostname: playwright-chrome
    image: browserless/chrome:latest
    labels:
      - traefik.enable=true
    networks:
      - reverseProxy
    restart: unless-stopped

[dgtlmoon]

moved to discussions, not sure this is a bug, more maybe like a misunderstanding of what is supported

What architecture exactly are you using?

[Stolz]

I'm using x86_64 Gentoo Linux with kernel v5.17.3. It seems I'm not the only one with this error.

I have tried using Docker image lscr.io/linuxserver/changedetection.io instead of ghcr.io/dgtlmoon/changedetection.io but also yields the same error.

Other watched sites that use basic fetcher work fine.

[dgtlmoon]

I have no idea, Ubuntu Intel i7 ProBook here, are you sure you've got the latest pull?

change-detection   | (8) accepted ('192.168.64.1', 59306)
change-detection   | 192.168.64.1 - - [15/Sep/2022 12:05:37] "GET /static/images/gradient-border.png HTTP/1.1" 304 258 0.002229
change-detection   | (8) accepted ('192.168.64.1', 59308)
change-detection   | 192.168.64.1 - - [15/Sep/2022 12:05:37] "GET /favicon.ico HTTP/1.1" 304 250 0.001951
change-detection-fetcher | 2022-09-15T12:05:40.601Z browserless:server S8XHU6W9480CI2O3U4P5BPNPQCC8SJQZ: Recording successful stat and cleaning up.
change-detection-fetcher | 2022-09-15T12:05:40.601Z browserless:job S8XHU6W9480CI2O3U4P5BPNPQCC8SJQZ: Cleaning up job
change-detection-fetcher | 2022-09-15T12:05:40.601Z browserless:job S8XHU6W9480CI2O3U4P5BPNPQCC8SJQZ: Browser not needed, closing
change-detection-fetcher | 2022-09-15T12:05:40.601Z browserless:chrome-helper Shutting down browser with close command
change-detection-fetcher | 2022-09-15T12:05:40.602Z browserless:job S8XHU6W9480CI2O3U4P5BPNPQCC8SJQZ: Browser cleanup complete.
change-detection-fetcher | 2022-09-15T12:05:40.602Z browserless:server Current workload complete.
change-detection-fetcher | 2022-09-15T12:05:40.602Z browserless:chrome-helper Sending SIGKILL signal to browser process 22
change-detection-fetcher | 2022-09-15T12:05:40.615Z browserless:chrome-helper Removing temp data-dir /tmp/browserless-data-dir-cXZTcU
change-detection-fetcher | 2022-09-15T12:05:40.652Z browserless:chrome-helper Garbage collecting and removing listeners
change-detection-fetcher | 2022-09-15T12:05:40.663Z browserless:chrome-helper Temp dir /tmp/browserless-data-dir-cXZTcU removed successfully

works perfectly

version: '3.8'

services:
  changeDetection:
    container_name: change-detection
    environment:
      BASE_URL: https://changedetection.example.com
      PLAYWRIGHT_DRIVER_URL: ws://change-detection-fetcher:3000/?token=redacted
      PGID: 1000
      PUID: 1000
    hostname: change-detection
    image: ghcr.io/dgtlmoon/changedetection.io
    ports:
      - 5000:5000
    networks:
      - reverseProxy
    restart: unless-stopped
    volumes:
      - /tmp/test-data:/datastore
  headlessBrowser:
    container_name: change-detection-fetcher
    environment: # See https://docs.browserless.io/docs/docker.html for more options
      DEFAULT_IGNORE_HTTPS_ERRORS: 'true'
      TOKEN: redacted
      WORKSPACE_DELETE_EXPIRED: 'true'
      WORKSPACE_EXPIRE_DAYS: 7
    hostname: playwright-chrome
    image: browserless/chrome:latest
    networks:
      - reverseProxy
    restart: unless-stopped

networks:
 reverseProxy:

[dgtlmoon]

$ docker pull ghcr.io/dgtlmoon/changedetection.io:latest
latest: Pulling from dgtlmoon/changedetection.io
Digest: sha256:ab5e5d6731b07204cfbe7bef5d553979cccdd30cc6ee9f63c373b3a6a892b81a
Status: Image is up to date for ghcr.io/dgtlmoon/changedetection.io:latest
ghcr.io/dgtlmoon/changedetection.io:latest

$ docker exec -t test bash -c '/usr/local/bin/pip3 list'|grep play
playwright           1.25.2

I can 100% confirm that the shipped container at sha256:ab5e5d6731b07204cfbe7bef5d553979cccdd30cc6ee9f63c373b3a6a892b81a has playwright installed

Can you run the following and paste the output

docker run -d --rm --name test ghcr.io/dgtlmoon/changedetection.io:latest
docker exec -t test bash -c '/usr/local/bin/pip3 list'|grep play

[Stolz]

Both host names are correct. When using plain Docker, all container names are added to the Docker DNS. When also using Docker Compose, service names are also added to the Docker DNS. So both names should be resolvable, as shown by below commands:

$ docker exec change-detection apt install dnsutils -yq

$ docker exec change-detection nslookup playwright-chrome
Server:         127.0.0.11
Address:        127.0.0.11#53

Non-authoritative answer:
Name:   playwright-chrome
Address: 172.20.0.30

$ docker exec change-detection nslookup change-detection-fetcher
Server:         127.0.0.11
Address:        127.0.0.11#53

Non-authoritative answer:
Name:   change-detection-fetcher
Address: 172.20.0.30

[Stolz]

After pulling the image again, the error is gone and the module is listed by docker exec -t change-detection bash -c '/usr/local/bin/pip3 list' | grep play.

Either I got wrong image or I got confused with the Linuxserver.io image. Thanks for the help!

[dgtlmoon]

Can you explain what do you mean by

I got confused with the Linuxserver.io image.

?

[Stolz]

Sure. I was testing 2 images at the same time:

• lscr.io/linuxserver/changedetection.io:latest
• ghcr.io/dgtlmoon/changedetection.io:latest

I configured both identically: Same URLs to watch, same EVN vars, same shared fetcher. Both images contain the same version v0.39.19.1 but it seems the first one is missing playwright module whereas the second one is not. I may have confuse the logs of both and wrongly assume I was reading logs of the second one when actually I was reading the logs of the first one.

[dgtlmoon]

Ahh, interesting, so some problem with linuxserver.io's builds?