Big Data Problems: Crash Course Statistics #39

There is a lot of excitement around the field of Big Data, but today we want to take a moment to look at some of the problems it creates. From questions of bias and transparency to privacy and security concerns, there is still a lot to be done to manage these problems as Big Data plays a bigger role in our lives.

Special thanks to Dr. Sameer Singh, the University of Washington, and the University of California Irvine for the content provided in this video.

Crash Course is on Patreon! You can support us directly by signing up at

Thanks to the following Patrons for their generous monthly contributions that help keep Crash Course free for everyone forever:

Sam Buck, Mark Brouwer, James Hughes, Kenneth F Penttinen, Trevin Beattie, Satya Ridhima Parvathaneni, Erika & Alexa Saur, Glenn Elliott, Justin Zingsheim, Jessica Wode, Eric Prestemon, Kathrin Benoit, Tom Trval, Jason Saslow, Nathan Taylor, Brian Thomas Gossett, Khaled El Shalakany, Indika Siriwardena, SR Foxley, Sam Ferguson, Yasenia Cruz, Eric Koslow, Caleb Weeks, Tim Curwick, D.A. Noe, Shawn Arnold, Malcolm Callis, Advait Shinde, William McGraw, Andrei Krishkevich, Rachel Bright, Mayumi Maeda, Kathy & Tim Philip, Jirat, Ian Dundore

Want to find Crash Course elsewhere on the internet?
Facebook –
Twitter –
Tumblr –
Support Crash Course on Patreon:

CC Kids:


You may also like...

26 Responses

  1. Studio Jiggly says:

    Shout out to whoever paid for the studio to be named “Chad and Stacy”.

  2. lowspeed says:

    Wait we have algorithms that humans don't know exactly what they do?

  3. Rucha Abhyankar says:

    Very informative! Real life examples make your videos more interesting.

  4. Aro-En says:

    I didn't know how much I needed to here this until right now… thank you so much. It'll definitely give my research more meat

  5. Gary D says:

    Best episode in series for ML Transparency nuts. But you /should/ watch them all. DFTBAQ! 😉

  6. Sai Jeyaprakash says:

    This video actually helped me with AP computer science principles… Thnx a lot!

  7. Theo says:

    Ashley madison haha

  8. brucewilson77 says:

    I noticed some slippery speech here. Was compass wrong about different races offending at different rates ? It wasn't clear if compass was 200% actual rates or if black defendants actually were offending at twice the rate.

  9. Skeptaculus says:

    Generalizations is what is expected from big data, so just because you don't agree with what the algorithm says doesn't mean that it is wrong. The algorithm might spew politically wrong results but statistically, it is right.

  10. Feras Awaysheh says:

    Not even mentioning Apache Hadoop, come on guys!

  11. Wout V says:

    Compass alghorititm: if (black == true) { recidivism = true} else {recidivism = false }

  12. Wolven1 Swiftwind1 says:

    My wife is getting her PHD in BIg Data:3 Im so proud of her

  13. Extraneus says:

    THANK YOU, some of us do have unique names no one else on the planet has.

  14. Mustafa Parekh says:

    I am so sorry Adriene Hill. I might seem a little ungrateful but your enthusiasm on the Economics crash course was so contagious. It really made me interested in Economics and made the videos so much fun. Really loved them! These are great as well!

  15. ResortDog says:

    A lot of us have never stopped looking at the total disregard for privacy since they created all this. You are only as silly as your leash.

  16. Ljjoon Ghost says:

    Do a video about The Assassins..

  17. Ranger Ruby says:

    I'm not taking Statistics but I still enjoy watching their videos…Anyone else?

  18. AtomicusChart says:

    Try to use NEW Data Visualization Tool The AtomicusChart® get free trial for 3 month

  19. Maja M says:

    You guys are really helping me understanding different subjects for my media-exam. Will defiantly use your videos for my other subjects as well. Thank you!

  20. Rui Ma says:

    Is there anyone who knows how to make this awesome videos?

  21. raikespeare says:

    Conspicuously absent is talk about buying and selling user data to create audience-targetted political propaganda…

  22. Shayne T says:

    One of the biggest issues in big data is outsourcing algorithms, which gives companies plausible deniability when the program does something that could be considered unfair with the data.

  23. Yuval says:

    That not big data.

  24. Jason Thornton says:

    Fudging the data to excuse for minorities and the fairer sex more like!

  25. Mighty Kimo says:

    This video deserves much much more views..

  26. JC Rising Late ʕ•ᴥ•ʔߛ ̋ l Verified l V l says:

    9:00 golden state killer dna + me

Leave a Reply