Add new comment

Hi Bob, thanks for watching and for the comment. I've read the definitions, and to be honest I doubt there'd be any difference in our debate were we to have been more definitionally explicit at the outset.... I know my case wouldn't change. The Wikipedia definition you cite, for example, immediately defines Big Data as "a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications." That is a definition unbounded by chronological time, and was as true in the 1950s about "massive-in-the-'50s-context" SIGINT collections as it is today for collections many orders of magnitude larger. "On-hand" tools and "traditional" applications change over time, but the aspect of Big Data about which I have been writing and speaking are relevant within whatever chronological slice one chooses in the IC's life. Again to quote the Wikipedia definition you cite, "Big data sizes are a constantly moving target," but the issue for the community is not size per se, but whether we gain value from exploiting the data we're ambitious enough to collect. I say yes.