The Emerging Data Economy

Irving Wladawsky-Berger

The Economist’ s May 6 issue referred to data in its cover as the world’s most valuable resource. Similarly, data centers “power all kinds of online services and, increasingly, the real world as devices become more and more connected.”.

Data 206

Big Data Takes Center Stage

Irving Wladawsky-Berger

A few recent articles have expressed concerns that big data may be at the peak of inflated expectations in the so-called hype cycle for emerging technologies, and will soon start falling into the trough of disillusionment. So is big data. .

Data 238

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Cognitive Systems and Big-Data-driven Applications

Irving Wladawsky-Berger

The need for such systems is a result of the explosive growth of data all around us. players, - was that the very process of analyzing data increases the amount of data by orders of magnitude. . This is challenging our ability to store and analyze all that data.

System 273

Becoming a Data-Driven Business: Challenges and Opportunities

Irving Wladawsky-Berger

A few weeks ago, McKinsey published The age of analytics: Competing in a data-driven world , a comprehensive report on the state of big data, and in particular, on the challenges and opportunities a company faces as it strives to become a data-driven business.

Data 199

A Data Science Approach to Organizational Health

Irving Wladawsky-Berger

I remember reading In Search of Excellence: Lessons from America’s Best Run Companies when it first came out in 1982, - one of the most influential business books of all time. A 2013 Deloitte report, Success or Struggle?

Data 242

Learning to Apply Data Science to Business Problems

Irving Wladawsky-Berger

A-Lab’s objective is to teach students how to use data sets and analytics to address real-world business problems. Companies submit project proposals prior to the start of the class, including the business problem to be addressed and the data on which the project will be based.

Data 207

Data Science: from Half-Baked Ideas to Data-Driven Insights

Irving Wladawsky-Berger

In a Big Data presentation last year, MIT professor Erik Brynjolfsson pointed out that throughout history new tools beget revolutions. Big data is leading to such a measurement-driven revolution, brought about by the new digital tools all around us, including our mobile phones; searches and web links; social media interactions; payments and transactions; and the myriads of smart sensors keeping track of the physical world.

Data 163

Searching The "Small Here"

Steven Berlin Johnson

Search doesn't yet reflect those shifting definitions of where we are, the true radius of our interest. Yes, you can search a map at Google or Bing or on your iPhone--along with a thousand other directory sites. contains two search fields: "what" and "where."

Search 153

Reflections on Big Data, Data Science and Related Subjects

Irving Wladawsky-Berger

CUSP’s research and educational programs are centered on urban informatics , - “the acquisition, integration, and analysis of data to understand and improve urban systems and quality of life.” Big Cities + Big Data and Bringing Urban Data to Life are prominently displayed in its website.

Data 271

Data Science and the Changing Nature of Research and Innovation

Irving Wladawsky-Berger

Both “are moving toward a common language: advances in mathematics, information sciences, and computer engineering allow highly diverse kinds of data to be manipulated in digital form, and this capability will help unlock problems across scientific disciplines.” .

Data 251 Radical New Innovation at Search!

Steven Berlin Johnson

» Radical New Innovation at Search! Forgot to mention that we finally restored search to But we decided a few weeks ago to do a little mod of Google site search, which turns out to work very well.

Search 130

The Data Bubble redux

Doc Searls

It gets worse: In between the Internet user and the advertiser, the Journal identified more than 100 middlemen — tracking companies, data brokers and advertising networks — competing to meet the growing demand for data on individual behavior and interests.The data on Ms.

Data 178

owning your data

Harold Jarche

I cannot see why any organization would put all of its data online. It may make sense to have some data in The Cloud to improve flexibility and accessibility, but as we see everyday, these systems break or get hacked. Own your critical data.

Data 145

Follow the Data to Find the Money

John Hagel

If you want to know where’s the money, then follow the data and don’t get distracted by the technology. Sure, technology is a key enabler of data capture, aggregation, and analytics, but the providers of this technology will not capture the vast bulk of the value – it will be those who have access to this data and, most importantly, those who can creatively find ways to generate economic value from this data. There’s a growing meme that data is the new oil.

Data 125

New Tools Beget Revolutions: Big Data and the 21st Century Information-based Society

Irving Wladawsky-Berger

While a number of transformative technologies were discussed, big data was the most prominent. . MIT professor Erik Brynjolfsson led an all-MIT academic panel of experts on The Reality of Big Data. We need to change from opinions and hunches and go with facts and data,” he said.

Data 193

Reinventing Society in the Wake of Big Data

Irving Wladawsky-Berger

For several years now, big data has been one of the hottest topics in the IT industry. But, what do we mean by big data ? A number of recent articles have been sounding the alarm that big data may be at the peak of inflated expectations in Gartner’s hype cycle.

Data 276

Open source search result clustering

David Weinberger

That was the search engine that did an amazing job of dynamically clustering search results into folders based on their topic or area. Jon Lehto, of, who pointed this out to me, notes that Carrot2 &# builds categories from search results (configurable number), and the user doesn’t need to ‘own’ the search data.&#. BTW, Northern Light is still around, although not for public Web searching. Remember Northern Light ?

[liveblog][act-tiac] A federal portal in the age of search?

David Weinberger

“In a world where everyone can search and has apps, is a web portal relevant?,” Now people arrive through search. Someone has a general idea, but not informed enough to search. Also being transparent about the data, where it’s stored, etc. E.g., I tell the site I’m turning 62 and then it gives me the relevant info, as opposed to it noting from its data that I’m turning 62. Sarah Crane , Dir.,

Search 131

Big Data, Complex Systems and Quantum Mechanics

Irving Wladawsky-Berger

Big Data is one of the hottest topics out there. Big data is a foundational element in IT’s quartet of Next Big Things : Social, Mobile, Analytics and Cloud. But, as the real world keeps reminding us, it is possible to make bad predictions and decisions even if you use tons of big data to make them. The 9/11 attacks showed how even highly sophisticated intelligence agencies can fail to pick out highly relevant signals amidst the mountains of data being analyzed.

The Data Bubble II

Doc Searls

In The Data Bubble , I told readers to mark the day: 31 July 2010. ‘Scrapers’ Dig Deep for Data on the Web. Four Aspects of Online Data Privacy. Digits Live Show: How RapLeaf Mines Data Online. That’s when The Wall Street Journal published The Web’s Gold Mine: Your Secrets , subtitled A Journal investigation finds that one of the fastest-growing businesses on the Internet is the business of spying on consumers. First in a series.

Data 218

Who forces Google to remove search results because of copyright claims?

David Weinberger

Tayob, Google has released data on which organizations request certain search results be suppressed because of copyright issues. million URLs from Google’s search results. million copyright takedowns for search… and here we are in just May of 2012, and they’re already processing over 1.2 According to a post at TechDirt by Riaz K.

Search 165

The Data Bubble

Doc Searls

It gets worse: In between the Internet user and the advertiser, the Journal identified more than 100 middlemen—tracking companies, data brokers and advertising networks—competing to meet the growing demand for data on individual behavior and interests.The data on Ms. one of the new data exchanges. Advertising may pay for lots of great stuff (such as search) that we take for granted, but advertising even at its best is guesswork. The tide turned today.

Data 217

Reduce Searching Start Talking

Tony Karrer

However, my findings indicate that using Data Driven approaches ensures that you arrive at effective sharing, but it's certainly different to share patterns as opposed to sharing additional codified knowledge. The research would seem to suggest that it's more than just an uneasy feeling after searching, but the reality is that you likely are missing things. The bottom line is to reduce the amount of time you spend search and spend more time talking.

Search 100

New Jobs Data, Same Old Story…

Andy McAfee

Here’s the same graph updated with data through April. Nothing less, nothing more… the decline of labor force participation – the technical term for the share of adults working or searching – is primarily the result of a bad economy.

Data 218

Facebook Graph Search and your company's "digital plumage"

Euen Semple

Reading Jon Battelle's great article on Facebook's graph search got me thinking about its impact on brand given my big thing that Organizations Don't Tweet - People Do Once you can search your friends, or your friends friends to see who works at, let's just say Tesco, suddenly you can not only find out who works there, which admittedly you can also do in Linkedin, but unlike Linkedin you can get to see much more of what sort of people they are and what sort of lives they live.

Search 118

Beyond Search - REAP

Tony Karrer

via Jack Vinson's post Knowledge workers do more than search , found the article: Beyond Search is REAP. The point is that searching is really just the beginning for most activities. From the post: Beyond Search is REAP - Retrieve, Extract, Arrange, Present. We're still not there with the deeper tools and the whole experience we desire for truly reaping the value from all that's available to us on the Internet.

Search 100

Data and metadata: Together again

David Weinberger

Terry Jones has an excellent post that lists the problems introduced by maintaining a hard distinction between metadata and data. Terry cites Everything Is Miscellaneous (thanks, Terry), which argues that the distinction, which is hard-coded in the Age of Databases, becomes a merely functional difference in the Age of Messy Links: Metadata is what you know and data is what you’re looking for. And in both cases, it could all be metadata in your search for lyrics.

Data 141

New and Improved Data Visualization Tool: Maps for Media Funding

Beth Kanter

Nonprofit data nerds will love this new resource from Media Impact Funders and Foundation Center called “ Foundation Maps for Media Funding ,” a free, interactive mapping and research tool that shows the full scope of philanthropically funded media projects worldwide since 2009.

Data 78

Dean Krafft on the Linked Data for Libraries project

David Weinberger

Dean Krafft , Chief Technology Strategist for Cornell University Library, is at Harvard to talk about the Mellon-funded Linked Data for Libraries (LD4L) project he leads. A nice feature of LOD is that the same URL that points to a human-readable page can also be taken as a query to show the machine-readable data. LOD is great for sharing data. It’s software, data, a standard, and a community. It provides self-describing data via shared ontologies.

Beyond Machine Learning: Capturing Cause-and-Effect Relationships

Irving Wladawsky-Berger

Machine learning advances, like deep learning , have played a central role in AI’s recent achievements, giving computers the ability to be trained by ingesting and analyzing large amounts of data instead of being explicitly programmed.

Data 200

The Economic Value of Artificial Intelligence

Irving Wladawsky-Berger

Moreover, network effects, - that is, the more data and better insights companies are able to gather, the more appealing the products and services they’ll be able to develop, - will further increase consumer demand.

Data 245

Social Physics and Cybercrime Detection

Irving Wladawsky-Berger

Social physics is based on the premise that all event-data representing human activity, - e,g,, phone call records, credit card purchases, taxi rides, web activity, - contain a special set of group behavior patterns. Data derived from human behavior is quite different.

Data 186

The 6 capabilities that drive future business value from Staggeringly Enormous Data

Ross Dawson

When asked what I thought needed to be on the business agenda, my response was Big Data, or as I more accurately described it, Staggeringly Enormous Data. Sis of the most critical capabilities for creating business value from Big Data are: Consistently capturing relevant data.

Data 252

A Novel Method for Measuring the Value of Free Digital Services

Irving Wladawsky-Berger

In one in particular, they identified the most widely used online applications and websites on various devices and aggregated them into eight different digital categories: email, search engines, maps, e-commerce, video, music, social media, and instant messaging.

Data 188

Social Media, Networks, and Data in Patient Healthcare Networks

Beth Kanter

This post summarizes some of the insights related to the effective use of networks and data in healthcare information and patient advocacy. ” CSR Data Fundraising Google InnovationClick for Twitter Transcript.

Data 89

Social Physics - Reinventing Analytics to Better Predict Human Behaviors

Irving Wladawsky-Berger

But, it wasn’t until the past two decades that we finally had enough data, powerful computers and sophisticated mathematical algorithms to develop quantitative theories of human social interactions. Endor is focused on making fast, accurate predictions using data derived from human behavior.

Help! My Nonprofit Needs A Data Nerd

Beth Kanter

We spent a fair amount of time framing and reframing the problem and ended up with a question that focused on data collection. My Nonprofit Needs A Data Nerd! In fact, some participants in the group mentioned using MBA students from local universities to assist with data collection.

Data 98

From “Buy What We Have” to “Connected Customer Strategies”

Irving Wladawsky-Berger

This is the right strategy to follow for customers who are knowledgeable, want to be in control and don’t want to share too much personal data. This requires a good understanding of a customer’s needs, and the ability to gather, analyze and interpret customer data.

Buy 167

The Top Ten Emerging Technologies of 2018

Irving Wladawsky-Berger

Machine learning tools can not only rapidly search these libraries, but can also generate virtual libraries of new compounds that have similar properties to the most promising molecules.

AI and the Evolution of History

Irving Wladawsky-Berger

But that order is now in upheaval amid a new, even more sweeping technological revolution whose consequences we have failed to fully reckon with, and whose culmination may be a world relying on machines powered by data and algorithms and ungoverned by ethical or philosophical norms.”.

Data 186

The Data Center in the Cambrian Age

Irving Wladawsky-Berger

And, at the other end of the spectrum, we are seeing the data center itself, whose roots go back to the earliest days of computers, being completely reinvented as well. The question then arises whether WSCs and Cloud data centers in general are only applicable for born-to-the-Cloud , relatively young companies like Google, Amazon and Yahoo who run a small number of huge workloads each of which exhibits a very high degree of parallelism.

Data 141

A Data Scientist You’ve Never Heard of Is Now the Master of Your Domain

Andy McAfee

And how was the team able to do this while working only with disguised data — without, in other words, knowing the true makes and models of the cars? Welcome to the weird new world big data. New tools to grab all this data and make use of it.

Data 250

Is the Digital Revolution At Last Shaking Up Banking?

Irving Wladawsky-Berger

While linked to banks in the back end, payment app companies control the customer relationship and the vast amounts of data that give them insights into their customers’ preferences and behaviors. Richer data will allow banks to take risks that currently baffle underwriters.

Data 167