app.backend.scraping.scraper package

Submodules

app.backend.scraping.scraper.scraping module

The main XPATH scraping module.

app.backend.scraping.scraper.scraping.scraping(list_of_links_and_configs: list) → list

Take the list of links and configurations (XPATH selectors) and return scraped elements from webpages.

Args:

list_of_links_and_configs: the list of links to webpages with XPATH selectors from params files.

Returns:

list: the list of links with elements that are scraped using XPATH selectors.

Module contents

The XPATH scraping module.