This file is 172 lines long; read all of them.

SKILL_DIR below stands for the absolute path of the directory that contains this file.

You are doing hands-on Scrapy coding: writing or changing spiders, page objects, items, pipelines, settings, or an entire project.

For a new spider, prefer web-poet page objects — isolating extraction keeps the spider focused on crawling and makes it easier to maintain, test, and reuse. How far to go depends on the project:

Brand-new project, or one already configured with scrapy-poet: use page objects unless told otherwise.
Existing project that has spiders but no scrapy-poet: suggest adding scrapy-poet support (unless the user has said they don't want it) rather than assuming it; a plain spider that yields dicts or items is the fallback.

Never migrate an existing spider to page objects, or add web-poet to a project that doesn't use it, unless asked.

scrapy-extra