I'm working on a Startpage scraper, please stay tuned.
Just telling you now, their image search uses bing. I haven't checked for the video/news tab yet.
@lolcat I tested it with 4get.ca and it works e.g.
https://4get.ca/web?s=test. Before and now too.
No I don't mean on 4get.ca, I mean on your own config. Do all of the scrapers fail?
I was not using http sorry.
I have this error:
Shit This scraper returned an error: Failed to get html
does this error appear on every engine? If so, that…
True, but I find having a textual button visible at all times just clutters the interface. Maybe add a [options] button inline after the URL? But then, the placement of the button would change…
Last commit should fix this, feel free to reopen if there is another issue
Latest commit should fix this, feel free to re-open if other issues arises :)
0b68d6b2a9
Merge pull request 'docker_tor_documentation' (#22) from docker_tor_documentation into master
Also, keep in mind that running 4get over Tor or a vpn would have Google blocking you very soon, and there's no way to circumvent this.
You can setup proxychains
The idea was that clicking on the favicon of a website opens a dialog like usual, but with the added option in there to open a popup for filtering, with a pre-filled regexp that you can edit if…
I'm currently working on that. It will allow you to write regexp and other rule types to filter your results. Filters will be stored client-side in javascript localStorage
What do you think?