Link Checker (and referrer spam) | PHP/html/js script

TZ2011

Senior Member

Jun 26, 2011

1,095

1,131

• Oct 29, 2023

• #1

Entire day mincing it, let me know what to improve.

- GUI, 5 themes
- import links or paste manually
- set referrer link that will be visible in server logs of visited websites
- set speed / number of threads
- referrer link and number of threads saved to local storage so you don't need to write it over & over again
- basic functions like remove duplicated links, trim to root, shuffle links, save good links, save not working links
- links will be listed with server status, from OK (200) to 5xx (server status is not always set properly, so some false positives are possible)
- user-agent is rotated on each request/thread, set of the most popular ua's plus some custom version randomization

Note:

- Threads - Don't set more than 30 threads if your server sucks. Script will warn you if you set >30, just in case you forget
- 429 error - if you scan only links from one website don't use more than 10 threads, or you might trigger error "too many requests" (Use 'shuffle' option to mix links so they don't attack server consecutively)




Virus Total: 0/61
https://www.virustotal.com/gui/file...600138723e03654b2dad67e0133d375ec98?nocache=1
Download:
Download Link Checker

 

TZ2011

Senior Member

Jun 26, 2011

1,095

1,131

• Oct 29, 2023
• Thread Starter Thread Starter

• #2

Slightly updated for better compatibility with php 7.

https://mega.nz/file/lVYjXSID#6klpJTxI49eXohRswqKpYEOJlEj3mPyfbrpl7iTSP4s

 

amps

Junior Member

Jan 8, 2008

103

19

• Oct 29, 2023

• #3

The tool looks great. How do you go about importing links?

 

TZ2011

Senior Member

Jun 26, 2011

1,095

1,131

• Oct 29, 2023
• Thread Starter Thread Starter

• #4

Arrow to import text file with links line by line is above the first textarea... also copy paste to textarea

 

Dopious

Elite Member

Jr. VIP

Apr 4, 2009

13,911

71,089

• Oct 29, 2023

• #5

TZ2011 said:

Slightly updated for better compatibility with php 7.

Click to expand...

If you add a new file, a new VirusTotal is needed.

 

TZ2011

Senior Member

Jun 26, 2011

1,095

1,131

• Oct 29, 2023
• Thread Starter Thread Starter

• #6

https://mega.nz/file/RRJ1xBja#80gyCoPCPSa1-zA_PKH-dp09KJFmu8Tyn12bIA-8Ugw

Wordpress sites are slow sometimes, taking threads to timeout... fixed a bit with curl timeout, also buffering set because sometimes script finishes but doesn't echo results... It would be awesome if posts don't get locked so i can update links without new posts, this is ridiculous

 

TZ2011

Senior Member

Jun 26, 2011

1,095

1,131

• Oct 29, 2023
• Thread Starter Thread Starter

• #7

RoiBox said:

If you add a new file, a new VirusTotal is needed.

Click to expand...

It's same, just improving it.

here we go.
https://www.virustotal.com/gui/file...dd09759a989bab8f7db821e5d806d3aa473?nocache=1

 

Last edited: Oct 29, 2023

Dopious

Elite Member

Jr. VIP

Apr 4, 2009

13,911

71,089

• Oct 29, 2023

• #8

TZ2011 said:

It's same, just improving it. Code is open for everyone to see, by the way. If I am some malicious player I could scan whatever and upload something else, right?

Click to expand...

Sorry you feel offended, but rules are rules we all have to follow.

 

TZ2011

Senior Member

Jun 26, 2011

1,095

1,131

• Oct 29, 2023
• Thread Starter Thread Starter

• #9

RoiBox said:

Sorry you feel offended, but rules are rules we all have to follow.

Click to expand...

not offended. more like tired and talking sh*t.

 

tripartist1

Regular Member

Sep 19, 2013

203

150

• Oct 29, 2023

• #10

How long is this supposed to take per link? Just testing this on my desktop and checking 1 link never finishes, have let it run for several minutes.

 

TZ2011

Senior Member

Jun 26, 2011

1,095

1,131

• Oct 29, 2023
• Thread Starter Thread Starter

• #11

How you have checked it from desktop, like directly open from folder or from XAMPP or similar? You need to run it from the server, php 7 / 8.

Speed depends of your server, number of threads. With 10 threads sometimes finishes ~1000 links in 1 minute, sometimes in 4-5 minutes for sites like wordpress or sites that need more time to connect. I've made some basic checks for timeout and connection timeout, to stop if site isnot available within 5 seconds.

 

Last edited: Oct 29, 2023

sscaz

BANNED - Discussion of Prohibited Activities

Jul 18, 2022

5,693

5,816

• Oct 29, 2023

• #12

Wait is this a software or a script for wordpress like a plugin?

 

TZ2011

Senior Member

Jun 26, 2011

1,095

1,131

• Oct 30, 2023
• Thread Starter Thread Starter

• #13

Just a script, standalone, nothing to do with any cms.

 

TZ2011

Senior Member

Jun 26, 2011

1,095

1,131

• Oct 30, 2023
• Thread Starter Thread Starter

• #14

Updated.
- added basic server check for minimal requirements
- fixed one previous bug with download working/not-working buttons
- added small tooltips, hover over element to see what is doing
- some mini visual improvements, like scrollbar thin

Download Link Checker

VirusTotal 0/63

 

TZ2011

Senior Member

Jun 26, 2011

1,095

1,131

• Oct 31, 2023
• Thread Starter Thread Starter

• #15

Similar script but with keyword search
https://www.blackhatworld.com/seo/php-script-search-keywords.1541460/

 

ciphercipher1

Power Member

Jul 26, 2022

530

181

• Nov 2, 2023

• #16

nice bro thanks for building this. do you mind dropping some use cases to test out? what do you use it for?

 

TZ2011

Senior Member

Jun 26, 2011

1,095

1,131

• Nov 2, 2023
• Thread Starter Thread Starter

• #17

I am just testing limits of php, curl multi etc to be ready for something i am working on. Also to break the monotony of coding for specific project that is going too long already.
Scripts itself can be used in situations when you don't have access to better tools installed on computer. For example, for this keyword thing you can sit in cafe and scrape competitor's website links and check for industry specific keywords to see how many they use them. At some point i will make it to scrape all text from pages (removing the, a, and, of, to, she, he, them... and other irrelevant words) and sort single words, bigrams, trigrams by number of usage, to catch keywords they are focusing on.