Happiness is having great colleagues and collaborators. I'm very happy to recommend to you two new books by three of my favorite colleagues -- Jay Jacobs (@jayjacobs), Bob Rudis (@hrbrmstr), and Adam Shostack (@adamshostack). These books not only do a great job covering the topics, they could also transform your way of thinking.
Showing posts with label data science. Show all posts
Showing posts with label data science. Show all posts
Monday, February 17, 2014
Monday, January 13, 2014
Guest on "Data-driven Security Podcast" Ep. 1
I was a guest on the new Data-driven Security Podcast, episode 1. There's the usual audio and also a video (1 hour 15 minutes). Along with hosts Bob Rudis and Jay Jacobs, I joined Michael Roytman and Alex Pinto for a lively conversation about how we all got into the data analysis side of information security and where we see it going.
The podcast and also the web site and blog are associated with a new book with the same title, Data-driven Security, authored by Bob and Jay. I was technical editor, so I can honestly say that I've read the whole book. I heartily recommend it to any information security professional or manager. It is a perfect "on-ramp" into data science and visualization as applied to information security, and it's written in your language.
The podcast and also the web site and blog are associated with a new book with the same title, Data-driven Security, authored by Bob and Jay. I was technical editor, so I can honestly say that I've read the whole book. I heartily recommend it to any information security professional or manager. It is a perfect "on-ramp" into data science and visualization as applied to information security, and it's written in your language.
Monday, July 22, 2013
Where are the NLP or Text Mining Tools for Automated Frame Analysis?
I'd like to do Frame Analysis (Goffman 1976, Johnston 1995) on a medium-sized corpus of text (articles, speeches, blog posts and comments) and I'm looking for NLP or text mining tools to help with it. Strangely, I can't find anything. All the examples of frame analysis in published research (e.g. Nisbet 2009) use purely manual methods or computer-augmented manual analysis.
Frame Analysis requires sophisticated semantic analysis, filtering, situational understanding, and inference on missing text. Near as I can tell, this level of sophistication is beyond the grasp of the common NLP and text mining tools. Is this true? If not, do any of you know of fully automated tools for Frame Analysis?
I should add that I have two use cases. First, the most demanding, is automatic identification of frames followed by text classification. Second, more feasible, is automatic classification of texts given frame definitions and sample texts. The latter fits the classic machine learning model of supervised learning, so I assume that as long as my training set is large enough and representative enough, I can probably find an adequate ML classification algorithm.
[Edit 7/23/2013: This is the best summary I could find of available tools: Frame Analysis: Software]
__________
Frame Analysis requires sophisticated semantic analysis, filtering, situational understanding, and inference on missing text. Near as I can tell, this level of sophistication is beyond the grasp of the common NLP and text mining tools. Is this true? If not, do any of you know of fully automated tools for Frame Analysis?
I should add that I have two use cases. First, the most demanding, is automatic identification of frames followed by text classification. Second, more feasible, is automatic classification of texts given frame definitions and sample texts. The latter fits the classic machine learning model of supervised learning, so I assume that as long as my training set is large enough and representative enough, I can probably find an adequate ML classification algorithm.
[Edit 7/23/2013: This is the best summary I could find of available tools: Frame Analysis: Software]
__________
Goffman, E. (1976). Frame Analysis: An Essay on the Organization of Experience. Harvard University Press.
Johnston, Hank (1995). A methodology for frame analysis: from discourse to cognitive schemata. In Social Movements and Culture (pp. 217–246). University of Minnesota Press.
Nisbet, M. C. (2009). Communicating Climate Change: Why Frames Matter for Public Engagement, Environment. Science and Policy for Sustainable Development, 51(2): 12–23.
Subscribe to:
Comments (Atom)