What variables should I post to get a result?

lanbo

Elite Member
Jr. VIP
Premium Member
Joined
Aug 23, 2009
Messages
4,500
Reaction score
677
I'm trying to post a keyword to spyfu:
http://www.spyfu.com/

Basically when i search for a keyword, it'll redirect me to a link like this:
http://www.spyfu.com/Term.aspx?t=667453

I don't know how they're generating that number, so that means I have to submit a POST request everytime.


[TD="class: webkit-line-content"] <input name="Search1$SearchTextBox" type="text" id="Search1_SearchTextBox" autocomplete="off" tabindex="1" size="50" class="MainSearchInputBox" />[/TD]

[TD="class: webkit-line-number"][/TD]
I tried to post "Search1_SearchTextBox" to return their "spyfu classic" results but it didn't work.

Anyone have any ideas on this?

-Lanbo
 
I just looked at it at through fiddler, did a search for a keyword. The keyword post request looked like this..

Code:
POST http://www.spyfu.com/Default.aspx HTTP/1.1
Host: www.spyfu.com
User-Agent: Mozilla/5.0 (Windows NT 6.0; rv:11.0) Gecko/20100101 Firefox/11.0
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip, deflate
Connection: keep-alive
Referer: http://www.spyfu.com/
Cookie: ASP.NET_SessionId=iz4tryimvp5zp145iimbxdnd; __gads=ID=d269cb5ffee97736:T=1334787945:S=ALNI_MbCkAlCKExRRNlkJs0cNcPip5fghA; __utma=162630398.551395931.1334787943.1334787943.1334787943.1; __utmb=162630398.3.10.1334787945; __utmc=162630398; __utmz=162630398.1334787945.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none); __utmv=162630398.|1=IsLoggedIn=False=1^3=HasUSFull=False=1^4=HasUKFull=False=1^5=HasRecon=False=1; whoson=882-1334788289822
Content-Type: application/x-www-form-urlencoded
Content-Length: 3373

__VIEWSTATE=%2FwEPDwUINjIyNDMyNzIPZBYEAgEPFgIeBFRleHQFRzxsaW5rIGhyZWY9Ii9TZWFyY2hGdS5jc3M%2FMDYwNzIwMTEiIHJlbD0ic3R5bGVzaGVldCIgdHlwZT0idGV4dC9jc3MiIC8%2BZAIDD2QWBAIDD2QWCmYPFgIeBGhyZWYFAS9kAgEPFgIfAQUHL0tvbWJhdGQCAg8WAh8BBRMvS2V5d29yZFNtYXJ0U2VhcmNoZAIDDxYCHwEFDy9BZEhpc3RvcnkuYXNweGQCBQ9kFgYCAQ8PZBYEHgtvbk1vdXNlT3ZlcgVKTU1fc3dhcEltYWdlKCdTZWFyY2gxX3RvcG5hdl9zZWFyY2gnLCcnLCcvSW1hZ2VzL3JkL2hkcnRhYl9zZWFyY2gyLnBuZycsMSkeCm9uTW91c2VPdXQFE01NX3N3YXBJbWdSZXN0b3JlKClkAgIPD2QWAh4HT25DbGljawUNcmV0dXJuIGZhbHNlOxYCZg8PFgQeB1Rvb2xUaXAFFVlvdSdyZSBvbiB0aGUgVVMgU2l0ZR4ISW1hZ2VVcmwFGC9JbWFnZXMvcmQvaGRydGFiX3VzLnBuZ2RkAgMPDxYCHgtOYXZpZ2F0ZVVybAUkaHR0cDovL3d3dy5zcHlmdS5jb20vVUsvRGVmYXVsdC5hc3B4ZBYCZg8PFgQfBQUVU3dpdGNoIHRvIHRoZSBVSyBTaXRlHwYFGS9JbWFnZXMvcmQvaGRydGFiX3VrMi5wbmcWBB8CBUFNTV9zd2FwSW1hZ2UoJ1NlYXJjaDFfdG9wbmF2X3VrJywnJywnL0ltYWdlcy9yZC9oZHJ0YWJfdWsucG5nJywxKR8DBRNNTV9zd2FwSW1nUmVzdG9yZSgpZAIJD2QWCgIBDxYCHwEFImh0dHBzOi8vd3d3LnNweWZ1LmNvbS9tYWlucHVyY2hhc2VkAgIPFgIeB1Zpc2libGVoZAIDDxYCHwAFB3d3d19taW5kAgUPZBYCZg8WAh8ABbYFPCEtLXJlbWFya2V0aW5nLS0%2BPHNjcmlwdCB0eXBlPSJ0ZXh0L2phdmFzY3JpcHQiPg0KLyogPCFbQ0RBVEFbICovDQp2YXIgZ29vZ2xlX2NvbnZlcnNpb25faWQgPSAxMDcxNjk4NTU4Ow0KdmFyIGdvb2dsZV9jb252ZXJzaW9uX2xhbmd1YWdlID0gImVuIjsNCnZhciBnb29nbGVfY29udmVyc2lvbl9mb3JtYXQgPSAiMyI7DQp2YXIgZ29vZ2xlX2NvbnZlcnNpb25fY29sb3IgPSAiNjY2NjY2IjsNCnZhciBnb29nbGVfY29udmVyc2lvbl9sYWJlbCA9ICJwZV9qQ0tDYmpnSVFfcVNEX3dNIjsNCnZhciBnb29nbGVfY29udmVyc2lvbl92YWx1ZSA9IDA7DQovKiBdXT4gKi8NCjwvc2NyaXB0Pg0KPHNjcmlwdCB0eXBlPSJ0ZXh0L2phdmFzY3JpcHQiIHNyYz0iaHR0cDovL3d3dy5nb29nbGVhZHNlcnZpY2VzLmNvbS9wYWdlYWQvY29udmVyc2lvbi5qcyI%2BDQo8L3NjcmlwdD4NCjxub3NjcmlwdD4NCjxkaXYgc3R5bGU9ImRpc3BsYXk6aW5saW5lOyI%2BDQo8aW1nIGhlaWdodD0iMSIgd2lkdGg9IjEiIHN0eWxlPSJib3JkZXItc3R5bGU6bm9uZTsiIGFsdD0iIiBzcmM9Imh0dHA6Ly93d3cuZ29vZ2xlYWRzZXJ2aWNlcy5jb20vcGFnZWFkL2NvbnZlcnNpb24vcGVfakNLQ2JqZ0lRX3FTRF93TS8%2FbGFiZWw9X29RUkNNQ21qZ0lRX3FTRF93TSZhbXA7Z3VpZD1PTiZhbXA7c2NyaXB0PTAiLz4NCjwvZGl2Pg0KPC9ub3NjcmlwdD4NCmQCBg9kFgJmDxYCHwAFlAY8c2NyaXB0IHR5cGU9J3RleHQvamF2YXNjcmlwdCc%2BDQp2YXIgX2dhcSA9IF9nYXEgfHwgW107DQpfZ2FxLnB1c2goWydfc2V0QWNjb3VudCcsICdVQS02ODU4MTMyLTInXSk7DQpfZ2FxLnB1c2goWydfdHJhY2tQYWdldmlldyddKTsNCl9nYXEucHVzaChbJ19zZXRDdXN0b21WYXInLA0KMSwNCidJc0xvZ2dlZEluJywNCidGYWxzZScsDQoxDQpdKTsNCg0KX2dhcS5wdXNoKFsnX3NldEN1c3RvbVZhcicsDQoyLA0KJ1VzZXJOYW1lJywNCicnLA0KMQ0KXSk7DQoNCl9nYXEucHVzaChbJ19zZXRDdXN0b21WYXInLA0KMywNCidIYXNVU0Z1bGwnLA0KJ0ZhbHNlJywNCjENCl0pOw0KDQpfZ2FxLnB1c2goWydfc2V0Q3VzdG9tVmFyJywNCjQsDQonSGFzVUtGdWxsJywNCidGYWxzZScsDQoxDQpdKTsNCg0KX2dhcS5wdXNoKFsnX3NldEN1c3RvbVZhcicsDQo1LA0KJ0hhc1JlY29uJywNCidGYWxzZScsDQoxDQpdKTsNCg0KKGZ1bmN0aW9uKCkgew0KdmFyIGdhID0gZG9jdW1lbnQuY3JlYXRlRWxlbWVudCgnc2NyaXB0Jyk7IGdhLnR5cGUgPSAndGV4dC9qYXZhc2NyaXB0JzsgZ2EuYXN5bmMgPSB0cnVlOw0KZ2Euc3JjID0gKCdodHRwczonID09IGRvY3VtZW50LmxvY2F0aW9uLnByb3RvY29sID8gJ2h0dHBzOi8vc3NsJyA6ICdodHRwOi8vd3d3JykgKyAnLmdvb2dsZS1hbmFseXRpY3MuY29tL2dhLmpzJzsNCnZhciBzID0gZG9jdW1lbnQuZ2V0RWxlbWVudHNCeVRhZ05hbWUoJ3NjcmlwdCcpWzBdOyBzLnBhcmVudE5vZGUuaW5zZXJ0QmVmb3JlKGdhLCBzKTsNCn0pKCk7DQo8L3NjcmlwdD4NCmQYAQUeX19Db250cm9sc1JlcXVpcmVQb3N0QmFja0tleV9fFgIFFVNlYXJjaDEkdG9wbmF2X3NlYXJjaAULYnRuQ29udGludWXhuZyi0QHUVeNjjqQ9mvKXvLcxJQ%3D%3D&__EVENTTARGET=&__EVENTARGUMENT=&__EVENTVALIDATION=%2FwEWBAKv0IX%2FAgLp0NOPCQLdh7%2BKDgKYm8bUB6HN5RIgcHkEpMU%2FWJDLz6gFsbN5&Search1%24SearchTextBox=low&Search1%24topnav_search.x=30&Search1%24topnav_search.y=16

So you would need to do a post to "http://www.spyfu.com/Default.aspx" then the post content has the __VIEWSTATE variable you could parse that in the source, but idk if its necessary maybe you could bypass it?

There are some other variables that are in the post content these are "Search1%24topnav_search.x=30&Search1%24topnav_search.y=16" im guessing those can stay the way they are.. Anyway the variable that holds the keyword in the post content is this "Search1%24SearchTextBox=low" low was the keyword i searched for.

Once i issued that request. This was the response i got back.

Code:
HTTP/1.1 302 Found
Date: Wed, 18 Apr 2012 22:34:20 GMT
Server: Microsoft-IIS/6.0
X-Powered-By: ASP.NET
X-AspNet-Version: 2.0.50727
Location: /Term.aspx?t=1801116
Cache-Control: private
Content-Type: text/html; charset=utf-8
Content-Length: 143

<html><head><title>Object moved</title></head><body>
<h2>Object moved to <a href="%2fTerm.aspx%3ft%3d1801116">here</a>.</h2>
</body></html>

Got a 302 Found response with the body content above. This is what your looking for <a href="%2fTerm.aspx%3ft%3d1801116"> Notice the "1801116" thats the generated number you want, after that you would go here http://www.spyfu.com/Term.aspx?t=1801116 and there's your results!

I'm pretty sure this works. I put together the raw request in fiddler with different keywords, and got different numbers back with each keyword, and following each http://www.spyfu.com/Term.aspx?t=NEW-NUMBER url gave back the new results for each keyword.
 
Back
Top