Friday, March 5, 2010

Harvests URLs from a Google Search

I am not the original developer of this script have just edited some code in it

Adds a new button to the Google homepage to harvest all the URLs for your search term.

Harvests up to 1000 results.

Results are presented as a long list, separated by newlines. Easy to copy+paste.

Source Code ::

// ==UserScript==
// @name           Google URL Harvester
// @namespace      http://hackers-community.uk.to
// @description    Harvests URLs from a Google Search
// @include        http://www.google.co.uk/
// @include        http://www.google.com/
// @include        http://www.google.co.in/
// ==/UserScript==

var btn_container;
var inputs = document.getElementsByTagName("input");
for (var i = 0; i < inputs.length; i++) {
    if (inputs[i].name == "btnG")
        btn_container = inputs[i].parentNode;
}

function find_next_link(html) {
   
I have removed the rest of the script from here, since its blogspot &  it adds unnecessary hyperlinks

{I am too lazy to correct it :)}, you can see the rest of the script @

http://hackers-community.uk.to/board/index.php/topic,122.0.html

How to use this code ::

download and install Firefox and then download ^ install this add-on

Install GreaseMonkey {Its Grease-monkey, and its needed to run this script in Firefox}


open notepad >> copy+paste the above source code >> save as >> googleharvester.user.js (on your desktop)

You will see the icon on the desktop, just drag it & drop it to your Firefox browser

You will see something like this ::




Click "install" that will install the script & then open Google.com & you will see something like this ::



Type your search query & click on "Get urls by hackers-community.uk.to" button

& you will see all the results in plain text {it will show up to 1000 results}

For example ::

I typed "site:bfhis.blogspot.com"

With this query i am asking Google to search the blog bfhis.blogspot.com & the script will harvest all those urls from the googles webpage into plain text file

here is what i have got ::

http://bfhis.blogspot.com/2009/12/bsnl-offers-fastest-speed-broadband.html
http://bfhis.blogspot.com/
http://bfhis.blogspot.com/2010_03_01_archive.html
http://bfhis.blogspot.com/2010/03/google-advanced-search.html
http://bfhis.blogspot.com/2010/02/how-to-get-rid-of-forum-spammers-deny.html
http://bfhis.blogspot.com/2010/03/katzbabes-hack.html
http://bfhis.blogspot.com/2010/02/how-to-change-cursor-on-smf-forum-any.html
http://bfhis.blogspot.com/2010/03/best-way-to-download-movies-from-porn.html
http://bfhis.blogspot.com/2009/11/top-43-creative-anti-smoking.html
http://bfhis.blogspot.com/2009/11/run-commands-for-xp.html
http://bfhis.blogspot.com/2010/02/bsnl-account-management-helpful-links.html
http://bfhis.blogspot.com/2009/09/free-forum-software-sub-domain.html
http://bfhis.blogspot.com/2009/12/rapidshare-auto-downloader-36.html
http://bfhis.blogspot.com/2009/11/create-folder-with-any-name-reserved.html
http://bfhis.blogspot.com/2009/12/where-do-outlook-express-save-inbox.html
http://bfhis.blogspot.com/2009/09/yahoo-mail-domain-choices.html
http://bfhis.blogspot.com/2009/09/googles-new-formality.html
http://bfhis.blogspot.com/2009/11/how-to-sit-on-conference-by-not-being.html
http://bfhis.blogspot.com/2010/02/google-will-pay-researchers-for-finding.html
http://bfhis.blogspot.com/2009/12/digital-rights-groups-have-heaped.html
http://bfhis.blogspot.com/2009/10/win-xp-admin-password-bypass-step-by.html
http://bfhis.blogspot.com/2010/01/bsnls-smtp-is-not-good-for-spamming.html
http://bfhis.blogspot.com/2009/11/hacker-lands-software-job.html
http://bfhis.blogspot.com/2010/01/how-to-remove-smf-logo-from-forum-top.html
http://bfhis.blogspot.com/2009/12/hotfile-autodownloader-10.html
http://bfhis.blogspot.com/2009/12/how-to-download-flash-games-to-computer.html
http://bfhis.blogspot.com/2009/12/fastest-broadband-nations-1gbps-110mbps.html
http://bfhis.blogspot.com/2009_11_01_archive.html
http://bfhis.blogspot.com/2010_02_01_archive.html
http://bfhis.blogspot.com/2009_12_01_archive.html
http://bfhis.blogspot.com/2009_10_01_archive.html
http://bfhis.blogspot.com/2009/11/amazing-painting-of-jrd-tata-great.html
http://bfhis.blogspot.com/2010/02/diggcom-hacked-2132010.html
http://bfhis.blogspot.com/2010/02/how-to-save-all-google-results-in-text.html
http://bfhis.blogspot.com/2010/02/cyberattacks-from-us.html

Note: This script is very useful for creating site maps

That's it!

Regards
Moin Faraz

0 comments:

Post a Comment