4 Commits

Include renames

Author	SHA1	Message	Date
lolcat	e4ce351b37	block crawlers	2026-10-18 00:22:42 -04:00
lolcat	b4c5f52cd3	robots	2026-09-11 23:15:21 -04:00
lolcat	2519666e1c	google web, videos and news, various other fixes	2023-11-27 01:01:56 -05:00
lolcat	bca265aea6	still missing things on google scraper	2023-07-22 14:41:14 -04:00