Saturday, September 03, 2016

Open-source Intelligence Toolkit

Open-Source Intelligence Toolkit.

7/1/2016 Justin Arn

The First Step to informing ourselves is becoming aware of who delivers our information.  A lifetime ago humans had their worldview delivered and reinforced via television.  A lifetime before that it was via radio, and before that; printed leaflets and and sermons.  We call the times that we live in "The Information Age," because information is abundant. Data flows like water, sloshing around wildly just waiting to be gathered up an analyzed.


Image of Google Search Spyglass
Search is a Science










 Some people don't feel like they have access to information however, or that the information is not important.  Much of the time, I believe, these people simply don't know what kind of information really exists out there.

   Have you ever Googled someone you're about to get serious with?  Come on... we have all done this, and it's nothing to feel guilty about.  What are we really searching for?  What will we find out about the person that we don't already know?  It's what lies beneath the surface, that we search for.  If you Google Search yourself you may find out some interesting information, but the truth is that there is an ocean of data and intelligence about you that does not pop up in that Google Search.

  That ocean of experience, intellect, opinions, and history is the information that you're hoping to find when you Google your potential partner.  But you don't find it.  That must be because it is not there, you conclude.

But what if you're wrong...


What if much of that information is indeed out there in the open; for all to see, hiding just beneath the surface.  But you can't get to it, because all you did was type a name into Google.

   Okay, what about the restaurant you plan on having dinner at this evening,  Yelped it?
Yelp is good.  You can find some interesting things about a business on Yelp.  But Yelp won't tell you how well the business does adhering to the food service standards of whatever county you might live in.  And you, being cognizant of the importance of the application of food service safety techniques upon edibles, might want to know if the restaurant you're visiting is a major violator of those safety standards.....
Well, if you are in San Diego County, you would search for that information right here....

There truly is a wealth of information out there, but before you can begin putting it together, you must first be able to find it.  Below is a list Search Engines and Tools you can use to find information beyond the surface. Explanations and ratings of these sites will be coming shortly, and there are specific techniques you should use when attempting to access the information you're looking for.
 I'll go into those techniques in another post, but for now, enjoy the list and Happy Searching.
Justin.

Justin's Not-Quite-Comprehensive List of Search Tools and Methodology of Search.

Search Engines: 

Social

Science & Academic:

Tor & Deep Web: 

  1. Hidden Wiki (list of .onion directories)
  2. Tor Library
  3. Tor Dir
  4. TorLings
  5. DeepSearch
  6. DuckDuckGo
  7. The Abyss
  8. Tor Search
  9. Torch
  10. DeepLinks

Business Enterprise Search: 

Intelligence Resources:

Disowned: 


Specialty Informtion:




Posted by at