Two Critical Issues with Crawlee Project Creation and Deployment
Issue 1: Playwright Template Creation Fails
Description
When attempting to create a new Crawler project with Playwright template using the command:
crawlee create my_crawler
The creation fails with a template not found error for the Playwright configuration.
Error Message
TemplateNotFound: 'routes_playwright.py' not found in search paths: '.', '../templates'
Expected Behavior
The crawlee create command should successfully create a project with the Playwright template, similar to how it works with BeautifulSoup template.
Issue 2: Docker Build Fails for BeautifulSoup Template
Description
When following the standard deployment guide with an unmodified BeautifulSoup template, the Docker build process fails during apify push command.
Steps to Reproduce
- Create new project using BeautifulSoup template
- Follow standard deploy guide
- Run
apify init
- Run
apify push
Error Message
2025-02-10T17:29:47.053Z WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
Reading package lists...
Building dependency tree...
Reading state information...
E: Unable to locate package git
---> Removed intermediate container 0acf324350f8
ACTOR: ERROR: Docker image build failed: The command '/bin/bash -o pipefail -c apt install -yq git && rm -rf /var/lib/apt/lists/*' returned a non-zero code: 100
Environment
- Command:
crawlee create my_crawler
- Template: BeautifulSoup (default)
- Date of occurrence: February 10, 2025
Additional Notes
- The BeautifulSoup template creation works, but fails during deployment
- The Docker build error suggests an issue with the base image or package repository configuration
- using crawlee=0.5.4
Two Critical Issues with Crawlee Project Creation and Deployment
Issue 1: Playwright Template Creation Fails
Description
When attempting to create a new Crawler project with Playwright template using the command:
The creation fails with a template not found error for the Playwright configuration.
Error Message
Expected Behavior
The
crawlee createcommand should successfully create a project with the Playwright template, similar to how it works with BeautifulSoup template.Issue 2: Docker Build Fails for BeautifulSoup Template
Description
When following the standard deployment guide with an unmodified BeautifulSoup template, the Docker build process fails during
apify pushcommand.Steps to Reproduce
apify initapify pushError Message
Environment
crawlee create my_crawlerAdditional Notes