Revealing the Hidden Surface Web, Beyond Googling It – Micah Hoffman
Most of us research a variety of topics on the Internet for personal and professional reasons. While search engines harvest, store, and index billions of web site data points every day, there is much they do not contain. These pieces of OSINT data can, when put in perspective and analyzed, reveal target geolocations, friends and associates, alcohol consumption, user passwords, and more. This talk will be a series of hands-on, live demos where we put our OSINT skills to work in unconventional places to harvest this unindexed OSINT data. Using free web sites, built-in web browser tools, and free python scripts, Micah will show attendees how to harvest data from social media applications, the “whois” system, and from breach data that will not appear in search engine results. Attendees will gain a better understanding of JSON, APIs, reverse whois, and how to run python tools. Join Micah, as he examines how to move beyond “Googling it” in your investigations.
- Understanding how robots.txt files can be a valuable source of OSINT information
- Discovering how APIs and JSON-formatted content reveals data not seen on human-readable pages
- Discover connections between people and emails using reverse whois searches