Scrapebox removed duckduckgo?

[DanTe_0101]

I am unable to see duckduckgo in scrapebox search engine harvestor

 

[loopline]

Duck duck go made changes to their search engine that made it not be able to work with scrapebox. Likely duck duck go is working hard to not be scraped.

 

[SmarterGuy]

Haven't used that browser for a while. lol

 

[DanTe_0101]

Duck duck go made changes to their search engine that made it not be able to work with scrapebox. Likely duck duck go is working hard to not be scraped.

ahh damn!
I tried manually and it was working well and thought I'd increase volume by using scrapebox lol

 

[Azaan]

I think that you can not use just for a few minutes.

Why are you spamming entirely useless answers?

 

[bendutchman]

Duck duck go made changes to their search engine that made it not be able to work with scrapebox. Likely duck duck go is working hard to not be scraped.

There is work-around for this by using the addon link extractor.

Just create a link by adding your search terms including any operators.
https://duckduckgo.com/html/?q=your search term

For example https://duckduckgo.com/html/?q="Thank you for your blog post.Really thank you! Awesome." +gaming

You can only get 30 results per url, but you can simply fix this by appending/changing the keywords.

IMPORTANT! For this to work you must include the /html/ in the url or this will not work.

Tip: use the keyword scraper to increase the amount of urls you can scrape

Cheers

 

[loopline]

There is work-around for this by using the addon link extractor.

Just create a link by adding your search terms including any operators.
https://duckduckgo.com/html/?q=your search term

For example https://duckduckgo.com/html/?q="Thank you for your blog post.Really thank you! Awesome." +gaming

You can only get 30 results per url, but you can simply fix this by appending/changing the keywords.

IMPORTANT! For this to work you must include the /html/ in the url or this will not work.

Tip: use the keyword scraper to increase the amount of urls you can scrape

Cheers

I should clarify my post, you can do this same thing, last I checked, in the harvester its self, but it also only scrapes page 1. So lots of people complained it only scraped page 1 which is why it was removed in the first place.

I believe they use ajax or another script to load additional pages. When you get into a massive userbase like scrapebox sometimes its better not to have a public functionality at all then it is to have it work with only page 1. Plus the majority of people use google and bing or their own custom search engines anyway.

none the less, just wanted to clarify.

 

[bendutchman]

I should clarify my post, you can do this same thing, last I checked, in the harvester its self, but it also only scrapes page 1. So lots of people complained it only scraped page 1 which is why it was removed in the first place.

I believe they use ajax or another script to load additional pages. When you get into a massive userbase like scrapebox sometimes its better not to have a public functionality at all then it is to have it work with only page 1. Plus the majority of people use google and bing or their own custom search engines anyway.

none the less, just wanted to clarify.

I think this should fix it.

Open the engines.dat file with notepad.
The file is located inside the configuration folder of Scrapebox.
Paste the engine config and restart Scrapebox for the changes to appear

[Engine36]
Displayname=DuckDuckGo
QueryString=https://lite.duckduckgo.com/lite/?q={KEYWORD}
MustBeInTag=
MustNotBeInTag=
MustBeInLink=http
MustNotBeInLink=
JustBeforeLink=<a rel="nofollow" href="
RightAfterLink="
PageStart=
PageInc=
NextPageMarker=<!-- <a rel="next"
Translation=
headerData=
Referer=0
SSLVersion=2
Favicon=
GracePeriod=0
UserAgent=
Selected=0
DetailedSelected=0
FollowRelocation=1
AddRelative=
AddFieldValue=
ClearCookies=0
ListMode=0
ReadOnly=0

 

[code API]

I also noticed these changes quite recently.

 

[mariusblack]

Since the last update with scrapebox I can't scrape anything, it shows me an error and crashes the app.I've sent the error but no resolve. Down i'll put a screenshot as an example.

 

[code API]

The email verifier plugin also is not working.

 

[MisterF]

Have you submitted a ticket to their support? @Sweetfunny and the team are usually very quick at replying.

 

[loopline]

Since the last update with scrapebox I can't scrape anything, it shows me an error and crashes the app.I've sent the error but no resolve. Down i'll put a screenshot as an example.

View attachment 145546

It says access is denied. That means something is stopping scrapebox from writing to the hard drive.

Make sure your hard drive is not full and make sure you whitelist/add an exception the entire scrapebox folder in all security software.

The email verifier plugin also is not working.

Its working for me fine, what is not working?

 

[mariusblack]

It says access is denied. That means something is stopping scrapebox from writing to the hard drive.

Make sure your hard drive is not full and make sure you whitelist/add an exception to the entire scrapebox folder in all security software.




It's working for me fine, what is not working?

it was working fine until I updated the software. I don't know what the heck to do, I've added permission and nothing, I've clean up the system and nothing.

 

[loopline]

it was working fine until I updated the software. I don't know what the heck to do, I've added permission and nothing, I've clean up the system and nothing.

Make sure that location exists, like that you have not deleted the folders.

I can't really tell you what is not allowing scrapebox to write to disk, but scrapebox hands the write request to windows and expects windows will save it to disk. Windows is saying it can't save it to disk. So its happening outside of scrapebox and you will have to find what it is thats not allowing windows to execute the write request.

 

[Denverfix]

Acho que isso deve consertar.

Abra o arquivo engines.dat com o bloco de notas.
O arquivo está localizado dentro da pasta de configuração do Scrapebox.
Cole a configuração do motor e reinicie o Scrapebox para que as alterações apareçam

[Engine36]
Displayname = DuckDuckGo
QueryString = https://lite.duckduckgo.com/lite/?q= {KEYWORD}
MustBeInTag =
MustNotBeInTag =
MustBeInLink = http
MustNotBeInLink =
JustBeforeLink = <a rel = "nofollow" href = "
RightAfterLink = "
PageStart =
PageInc =
NextPageMarker = <! - <a rel = "próximo"
Tradução =
headerData =
Referer = 0
SSLVersion = 2
Favicon =
GracePeriod = 0
UserAgent =
Selecionado = 0
DetailedSelected = 0
FollowRelocation = 1
AddRelative =
AddFieldValue =
ClearCookies = 0
ListMode = 0
Somente leitura = 0

Ainda está funcionando para raspar o duckduckgo?

Posso usar isto ?