IDG Answers is a community of experts who are passionate about technology. Ask a question or answer one below.
Big Data deals with the flow of information, and having the ability to analyze this data in real time (or near-real-time). Data mining is more of the traditional searching the haystack for needles. Having faster access to the results of the analysis means big money for large corporations like Walmart and Boeing, so it's often commercial entities which are doing the research and development that leads their customers to migrate from the old methodologies to the new ones. Surprisingly, fresh approaches to solving the issues of big data comes from corporations like Sybase and not so much from universities or government institutions. This was one of the surprise findings at this year's ACM SIGKDD (Special interest group - Knowledge Discovery and Data Mining) meeting in August. This is a change from the years when universities would discover new approaches and then partner with commercial entities to make the fruits of their scientific endeavors available to the public writ-large.