Facebook crawler collects more than 170 million data sets
For users who elect to make their Facebook profiles public (under "Facebook privacy settings/Search/Public Search"), Facebook creates a preview version of their profile that's accessible to anyone. The social networking site then provides a directory of these users at facebook.com/directory. It's freely accessible to anyone, including search engines like Google, which make the publicly accessible data searchable.
Hacker Ron Bowes has written a web crawler which he used to systematically graze through this data. Bowes claims to have collected more than 170 million sets of data containing the names and URLs of public profiles. The files do not contain any further personal data such as friend lists, but the links in the profiles can easily be used to send out another crawler to collect this information. Bowes has formatted the list and, together with the crawler itself, made it available as a 2.8 GB torrent.
- Facebook worms are spreading freely, a report from The H.
- Facebook introduces security measures, a report from The H.
- Facebook, the new phishing target, a report from The H.