The human insights missing from big data | Tricia Wang

TED・12 minutes read

Consulting oracles for guidance has been a historical practice across cultures, with modern equivalents like big data facing profitability challenges in decision-making processes due to a quantification bias. Integrating big data with qualitative insights can improve decision-making and avoid critical oversights, as seen in the case of the NSA's Skynet algorithm misinterpreting cell phone data and potentially causing civilian deaths in Pakistan.

Insights

  • Oracle consultations have been a historical practice across cultures, with modern versions like big data and AI being used for predictions in shipping, genetics, and sales.
  • Integrating big data with qualitative insights can enhance decision-making, as seen in Nokia's failure to adapt to smartphones and the potential dangers of quantification bias in automated systems like NSA's Skynet algorithm.

Get key ideas from YouTube videos. It’s free

Recent questions

  • What is the purpose of consulting an oracle?

    To seek guidance and predictions for important life decisions.

Related videos

Summary

00:00

"Oracle to Big Data: Insights for Decisions"

  • In ancient Greece, individuals from various backgrounds consulted the oracle for important life decisions.
  • The oracle would enter a trance to provide predictions as answers to questions.
  • People across different cultures have historically sought prophecies for guidance.
  • Modern oracles like big data, Watson, deep learning, and neural nets are consulted for efficient shipping methods, genetic disorder odds, and sales volume predictions.
  • Despite being a $122 billion industry, big data projects often lack profitability.
  • Technology ethnographers study data patterns and advise companies on technology usage.
  • Nokia's failure to recognize the smartphone trend led to a significant business decline.
  • Big data's success is limited in dynamic systems involving human behavior.
  • The quantification bias values measurable data over qualitative insights.
  • Integrating big data with thick data, like human stories and emotions, can provide more comprehensive insights and improve decision-making.

15:08

Skynet algorithm causes civilian deaths in Pakistan

  • NSA's Skynet algorithm may have caused civilian deaths in Pakistan due to misinterpreting cell phone data, highlighting the impact of quantification bias on our increasingly automated lives. Progress in predictive tools has advanced, emphasizing the need to merge big data with detailed insights to enhance decision-making across various sectors, ensuring improved outcomes and avoiding critical oversights.
Channel avatarChannel avatarChannel avatarChannel avatarChannel avatar

Try it yourself β€” It’s free.