hideThis article has multiple issues. Please help or discuss these issues on the talk page. (Learn how and when to remove these template messages)
A major contributor to this article appears to have a close connection with its subject. It may require cleanup to comply with Wikipedia's content policies, particularly neutral point of view. Please discuss further on the talk page.(November 2012) (Learn how and when to remove this template message)
The topic of this article may not meet Wikipedia's general notability guideline. Please help to demonstrate the notability of the topic by citing reliable secondary sources that are independent of the topic and provide significant coverage of it beyond a mere trivial mention. If notability cannot be shown, the article is likely to be merged, redirected, or deleted. Find sources: – ···scholar·JSTOR(March 2011) (Learn how and when to remove this template message)
This article reads like a press release or a news article and is largely based on routine coverage or sensationalism. Please with properly sourced content to meet Wikipedia's
quality standards, event notability guideline, or encyclopedic content policy.(September 2015)
(Learn how and when to remove this template message)
Rexer Analytics’s Annual Data Miner Survey is the largest survey of data mining, data science, and analytics professionals in the industry. It consists of approximately 50 multiple choice and open-ended questions that cover seven general areas of data mining science and practice: (1) Field and goals, (2) Algorithms, (3) Models, (4) Tools (software packages used), (5) Technology, (6) Challenges, and (7) Future. It is conducted as a service (without corporate sponsorship) to the data mining community, and the results are usually announced at the PAW (Predictive Analytics World) conferences and shared via freely available summary reports. In the 2013 survey, 1259 data miners from 75 countries participated.[1] After 2011, Rexer Analytics moved to a biannual schedule.
2007 Survey: 27-item survey; 314 participants from 35 countries.[19][20]
Recent survey results[]
While the five Data Miner surveys have covered many data mining topics, the three topics that get the most attention in citations and at conference presentations are:
Algorithms: Each year the surveys have consistently shown that decision trees, regression, and cluster analysis form a triad of core algorithms for most data miners. However, a wide variety of algorithms are being used. This is consistent with independent polls of data miners conducted by KDnuggets over the years.[21][22]
Data Mining Tools: Data miners report using an average of four software tool to conduct their analyses. Over the survey years, R has risen in popularity. In 2010 it overtook SPSS Statistics and SAS to become the tool used by the most data miners. And the 2011 survey showed that R is now being used by close to half of all data miners (47%). STATISTICA has also grown in popularity. From 2007-2009 more data miners indicated that SPSS Clementine (now IBM SPSS Modeler) was their primary data mining tool than any other tool. However, in 2010 and 2011, STATISTICA was cited most frequently as data miners' primary tool. In terms of satisfaction with their tools, in the past few years, STATISTICA, SPSS Modeler, R, KNIME, RapidMiner and Salford Systems have received the strongest satisfaction ratings from data miners in these surveys. The growing popularity of R is consistent with independent polls of data miners conducted by KDnuggets, but the KDnuggets polls show a different picture regarding the popularity of commercial data mining software.[23][24][25] Robert Muenchen has taken a multi-faceted approach to assessing the popularity of data analysis software - an approach that includes blog post counts, Google Scholar data, listserv subscribers, use in competitions, book publications, Google PageRank, and more.[11] His analyses are consistent with the Rexer Analytics Surveys and KDnuggets in outlining the growth of R, but Muenchen illustrates that the popularity of software is more nuanced and one's conclusions will be different depending on what measure of popularity is used. The Rexer Analytics survey summary reports include analyses of the data miners' satisfaction with 20 dimensions of their software. Haughton et al. and Nisbet have also produced reviews of data mining software.[26][27]
Challenges: Consistently across the years, dirty data, explaining data mining to others, and difficult access to data are the top challenges data miners report facing. Participants in the 2010 survey shared best practices for overcoming these challenges.[28]
^Selena Welz (2012); Meet R: a programming language that makes sense of Big Data, Technology @ Work, Tendo Communications, November 2012.
^Karl Rexer, Heather Allen, & Paul Gearan (2010); 2010 Data Miner Survey Summary, presented at Predictive Analytics World, Oct. 2010.
^Karl Rexer, Heather Allen, & Paul Gearan (2011); Understanding Data Miners, Analytics Magazine, May/June 2011 (INFORMS: Institute for Operations Research and the Management Sciences).
^Emilia Mikołajewska and Dariusz Mikołajewski (2011); System eksploracji danych na potrzeby obronności państwa], Kwartalnik Bellona, 2011, Volume 3, pages 119-129 (Data Mining system for national security purposes, Bellona Quarterly, Scientific Journal of the Polish Ministry of National Defense; Article is in Polish).
^Tomasz Ząbkowski (2011); Data Mining - Current State and Future Trends, Information Systems in Management XIII, Business Intelligence and Knowledge Management, Warsaw University of Life Sciences Press, Warsaw, 2011, pages 122-130; ISBN978-83-7583-370-6.
^Karl Rexer, Paul Gearan, & Heather Allen (2008); 2008 Data Miner Survey Summary, presented at SPSS Directions Conference, Oct. 2008, and Oracle BIWA (Business Intelligence, Data Warehousing and Advanced Analytics) Summit, Nov. 2008.