URL Filter - Scrapebox

Hello,

I would like to know if scrapebox has function to delete duplicated domains with the same top level urls?

Example:
https://www.domain.com/products/school_form1.php?id=325&no=900
https://www.domain.com/products/school_form1.php?id=325
https://www.domain.com/products/school_form1.php?id=325&no=650
https://www.domain.com/products/web_space.php?id=4

The result should be left with:

https://www.nisseijushi.co.jp/products/web_space.php?id=4
https://www.nisseijushi.co.jp/products/school_form1.php?id=325 (either of the above top 3 urls)

This is not remove duplicate domain (remove duplicate domains will leave only 1 domain as a result).

Anyone can help on this? if scrapebox can not do this - what other tools option do I have?

Thanks a lot in advance,

If all your URL's are exactly like that, you could do 2 steps and remove everything after and including the & symbol which would give you:


Then remove duplicate URL's which would leave:


Sometimes with URL filtering, it may need a few steps to get the desired results.

#InBeforeLoopline

Sweetfunny said:

If all your URL's are exactly like that, you could do 2 steps and remove everything after and including the & symbol which would give you:

Code:

https://www.domain.com/products/school_form1.php?id=325
https://www.domain.com/products/school_form1.php?id=325
https://www.domain.com/products/school_form1.php?id=325
https://www.domain.com/products/web_space.php?id=4

Then remove duplicate URL's which would leave:

Code:

https://www.domain.com/products/web_space.php?id=4
https://www.domain.com/products/school_form1.php?id=325

Sometimes with URL filtering, it may need a few steps to get the desired results.

#InBeforeLoopline

Click to expand...

HAHA what a hash tag!