4 docs tagged with "Starturls"

custom tags is defined as: to apply custom tag to pages w/o regex/code. Topics on: . Read more: Dev Tool, API, Online API, Typesense, Typesense Doc Scraper, Con

Page Rank is defined as: to add weight to specific pages for search. Topics on: . Read more: Dev Tool, API, Online API, Typesense, Typesense Doc Scraper, Config

start_urls is defined as: (string | {config})[] URLs to start crawling site - to spider recursively all links from pages. Topics on: url, custom tags, Page Rank

url is defined as: to set start URL to init spider - allow regex. Topics on: . Read more: Dev Tool, API, Online API, Typesense, Typesense Doc Scraper, Configjso