{"id":702,"date":"2007-10-03T20:36:44","date_gmt":"2007-10-03T20:36:44","guid":{"rendered":"https:\/\/www.darknet.org.uk\/2007\/10\/unmaskpy-statistical-e-mail-blog-profiling\/"},"modified":"2015-09-09T19:39:55","modified_gmt":"2015-09-09T11:39:55","slug":"unmaskpy-statistical-e-mail-blog-profiling","status":"publish","type":"post","link":"https:\/\/www.darknet.org.uk\/2007\/10\/unmaskpy-statistical-e-mail-blog-profiling\/","title":{"rendered":"unmask.py – Statistical E-mail & Blog Profiling"},"content":{"rendered":"

[ad]<\/p>\n

This is a cool tool I found recently amongst all the flame wars in the security mailing lists, someone developed this tool to profile the semantics of text.<\/p>\n

Basically you pump in a load of e-mails from a known source, then compare it to the anonymous socks and see what probability it is that they are the same person based on the text. You can do the same thing with blogs, not just e-mail!<\/p>\n

This is version 1.0 of Unmask – a python script that attempts to unmask anonymous text by matching its statistical properties against someone else\u2019s text with a known identity.<\/p>\n

Other uses include determining \u201carea of origin\u201d,gender,age, occupation, sexual orientation, etc from text\u2019s statistical properties. Any decision YOU can make against an unknown author, Unmask will also make. Of course, it may be less or more accurate than your determination.<\/p>\n

You should probably fiddle with it as you go, to make it work on whatever sample set you have, before using it in the wild.<\/p>\n

To use it, simple \u201cstore\u201d text (with -s bob -f file.txt). Then just compare your unknown file to that particular store, or use -i to compare it to all stores. Make up a store of all male and all female text and then compare some random weblog, just for kicks.<\/p>\n

You can download unmask here:<\/p>\n

<\/p>\n

unmask1.0.tar.gz<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

[ad] This is a cool tool I found recently amongst all the flame wars in the security mailing lists, someone developed this tool to profile the semantics of text. Basically you pump in a load of e-mails from a known source, then compare it to the anonymous socks and see what probability it is that […]<\/p>\n","protected":false},"author":25,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_seopress_robots_primary_cat":"","_seopress_titles_title":"","_seopress_titles_desc":"","_seopress_robots_index":"","_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[1],"tags":[],"featured_image_src":null,"featured_image_src_square":null,"author_info":{"display_name":"Darknet","author_link":"https:\/\/www.darknet.org.uk\/author\/darknet\/"},"_links":{"self":[{"href":"https:\/\/www.darknet.org.uk\/wp-json\/wp\/v2\/posts\/702"}],"collection":[{"href":"https:\/\/www.darknet.org.uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.darknet.org.uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.darknet.org.uk\/wp-json\/wp\/v2\/users\/25"}],"replies":[{"embeddable":true,"href":"https:\/\/www.darknet.org.uk\/wp-json\/wp\/v2\/comments?post=702"}],"version-history":[{"count":0,"href":"https:\/\/www.darknet.org.uk\/wp-json\/wp\/v2\/posts\/702\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.darknet.org.uk\/wp-json\/wp\/v2\/media?parent=702"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.darknet.org.uk\/wp-json\/wp\/v2\/categories?post=702"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.darknet.org.uk\/wp-json\/wp\/v2\/tags?post=702"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}