DATA REVOLUTION a closer look at the
a closer look at the
DATA REVOLUTION Donabel Santos Development & Alumni Engagement, UBC @sqlbelle
READY FOR THE VISUAL TOUR?
comes in all
shapes & siz
es
Source: http://www.flickr.com/photos/c_x_2/11975237633/
ERP Enterprise Resource Planning
ERP Enterprise Resource Planning
CRM Customer Relationship Management
ERP Enterprise Resource Planning
CRM Customer Relationship Management
ERP Enterprise Resource Planning
CRM Customer Relationship Management
These are still all “small data”
BUT LATELY …
http://www.flickr.com/photos/cocoarmani/2059353149/sizes/l
Source: http://www.flickr.com/photos/56155476@N08/6660122741
Source: http://www.flickr.com/photos/avancemba/8764505090
Source: http://www.flickr.com/photos/djou/11306191086
http://www.flickr.com/photos/ikhlasulamal/5671062190
http://www.flickr.com/photos/courosa/4798875920
WELCOME TO THE ERA OF BIG DATA
Terminologies First ~ # of 0s Bit
1 or 0
Byte
8 Bits
Kilobyte
KB
1,024 bytes
3
Megabyte
MB
1,024 KB
6
Gigabyte
GB
1,024 MB
9
Terabyte
TB
1,024 GB
12
Petabyte
PB
1,024 TB
15
Exabyte
EB
1,024 PB
18
Zettabyte
ZB
1,024 EB
21
Yottabyte
YB
1,024 ZB
24
Brontobyte
BB
1,024 YB
27
Geopbyte
GPB
1,024 BB
30
Terminologies First ~ # of 0s Bit
1 or 0
Byte
8 Bits
Kilobyte
KB
1,024 bytes
3
Megabyte
MB
1,024 KB
6
Gigabyte
GB
1,024 MB
9
Terabyte
TB
1,024 GB
12
Petabyte
PB
1,024 TB
15
Exabyte
EB
1,024 PB
18
Zettabyte
ZB
1,024 EB
21
Yottabyte
YB
1,024 ZB
24
Brontobyte
BB
1,024 YB
27
Geopbyte
GPB
1,024 BB
30
EXABYTE
1,000,000,000,000,000,000
Source: http://www.flickr.com/photos/kalexanderson/5277334834
2009 Source. Simon, Phil. Too Big To Ignore
~500 Exabytes
Source: http://www.flickr.com/photos/kalexanderson/5277334834
2009 2016
Source. Simon, Phil. Too Big To Ignore
~500 Exabytes ~130 Exabytes/year **Cisco estimate
SO BIG DATA IS ….
Source: Wikibon.org
Source: Wikibon.org
http://www.ibmbigdatahub.com/infographic/four-vs-big-data
http://www.ibmbigdatahub.com/infographic/four-vs-big-data
http://www.ibmbigdatahub.com/infographic/four-vs-big-data
http://www.ibmbigdatahub.com/infographic/four-vs-big-data
http://www.ibmbigdatahub.com/infographic/four-vs-big-data
http://www.ibmbigdatahub.com/infographic/four-vs-big-data
http://www.ibmbigdatahub.com/infographic/four-vs-big-data
Big Data’s Gang of Four
Source: Simon, Phil. Too Big to Ignore. The Business Case for Big Data.
Source: http://michaelhyatt.com/9-astonishing-facts-about-amazon-2.html Source: http://www.theverge.com/2013/12/26/5245008/amazon-sees-prime-spike-in-2013-holiday-season
#1 online retailer 160M products (Target sells 500K)
300M customers 426 items sold/sec (run up to Christmas 2013) Source: http://michaelhyatt.com/9-astonishing-facts-about-amazon-2.html Source: http://www.theverge.com/2013/12/26/5245008/amazon-sees-prime-spike-in-2013-holiday-season
Source http://michaelhyatt.com/9-astonishing-facts-about-amazon-2.html
Source http://michaelhyatt.com/9-astonishing-facts-about-amazon-2.html
Source http://michaelhyatt.com/9-astonishing-facts-about-amazon-2.html
Source: http://www.affordableschoolsonline.com/wp-content/uploads/2011/11/FathomingAmazon.png
Source: http://www.bizjournals.com/sanjose/news/2013/06/11/14-eye-popping-apple-statistics-from.html
>700M iOS devices >300M iCloud users >500M active iTunes users ~2B iMessages/day
Source: http://www.bizjournals.com/sanjose/news/2013/06/11/14-eye-popping-apple-statistics-from.html
http://www.theverge.com/2013/10/22/4866302/apple-announces-1-million-apps-in-the-app-store
Source: http://www.the-digital-reader.com/2011/01/22/apples-app-stores-hit-1b-downloads
Source: http://www.the-digital-reader.com/2011/01/22/apples-app-stores-hit-1b-downloads
2009
Source: http://thenextweb.com/apple/2012/03/03/apples-app-store-hits-25b-downloads-right-when-we-predicted-at-a-rate-of-48-6m-a-day/
Source: http://thenextweb.com/apple/2012/03/03/apples-app-store-hits-25b-downloads-right-when-we-predicted-at-a-rate-of-48-6m-a-day/
2012
Source: http://www.engadget.com/2013/10/22/apple-ios-7-downloaded-over-200-million-times-in-5-days/
Source: http://www.engadget.com/2013/10/22/apple-ios-7-downloaded-over-200-million-times-in-5-days/
2013
http://expandedramblings.com/index.php/by-the-numbers-17-amazing-facebook-stats
>1.26B registered users (~7B world population) >757M active users/day >1B pieces of content/day >300PB user data
~45% 65 and older http://expandedramblings.com/index.php/by-the-numbers-17-amazing-facebook-stats
Source: http://www.sociallystacked.com/2013/08/infographic-of-the-day-13-mindblowing-facebook-statistics
Source: http://www.sociallystacked.com/2013/08/infographic-of-the-day-13-mindblowing-facebook-statistics
Source: http://expandedramblings.com/index.php/by-the-numbers-a-gigantic-list-of-google-stats-and-facts
>12.8B searches/month >1.17B searchers/month
~66.9% search market share >425M Gmail users ~1B YouTube users Source: http://expandedramblings.com/index.php/by-the-numbers-a-gigantic-list-of-google-stats-and-facts
http://www.digitalinformationworld.com/2013/09/41-amazing-google-facts-and-stats.html
SOCIAL MEDIA DATA
Source: http://growingsocialmedia.com/social-media-statistics-and-facts-of-2013-infographic/
Source: http://growingsocialmedia.com/social-media-statistics-and-facts-of-2013-infographic/
Source: http://growingsocialmedia.com/social-media-statistics-and-facts-of-2013-infographic/
Source: http://growingsocialmedia.com/social-media-statistics-and-facts-of-2013-infographic/
Source: http://growingsocialmedia.com/social-media-statistics-and-facts-of-2013-infographic/
Source: http://growingsocialmedia.com/social-media-statistics-and-facts-of-2013-infographic/
Source: http://infographicb2b.com/2013/08/26/social-media-statistics-infographic-2/
Source: http://infographicb2b.com/2013/08/26/social-media-statistics-infographic-2/
Source: http://infographicb2b.com/2013/08/26/social-media-statistics-infographic-2/
Source: http://infographicb2b.com/2013/08/26/social-media-statistics-infographic-2/
Source: http://infographicb2b.com/2013/08/26/social-media-statistics-infographic-2/
OPEN DATA
freely available
Source: Wikipedia
freely available without restrictions from copyrights, patents or other mechanisms of control
Source: Wikipedia
freely available without restrictions from copyrights, patents or other mechanisms of control
gaining popularity launch of open-data government initiatives such as Data.gov and Data.gov.uk.
Source: Wikipedia
http://vancouver.ca/your-government/open-data-catalogue.aspx
HOW DOES IT AFFECT US?
Source: http://www.flickr.com/photos/hikingartist/6217869581
http://www.datainnovationday.org/
HOW DOES IT AFFECT US? INSURANCE
Source: http://www.flickr.com/photos/3059349393/3419667270
Source: http://www.flickr.com/photos/masterslate/2522767675
Source: http://www.progressive.com/auto/snapshot/
Pay as you drive
Source: http://www.progressive.com/auto/snapshot/
Pay as you drive Pay how you drive Source: http://www.progressive.com/auto/snapshot/
Source: http://www.progressive.com/auto/snapshot/
HOW DOES IT AFFECT US? UTILITIES
HOW DOES IT AFFECT US? NATURE
Source: http://www.livescience.com/39099-gem-model-earthquake-hazards-risk.html
HOW DOES IT AFFECT US? HEALTH
Source: http://www.flickr.com/photos/berkeleylab/4885621404
Source: http://strata.oreilly.com/2013/08/genomics-and-the-role-of-big-data-in-personalizing-the-healthcare-experience.html
10 years 2-3 days Source: http://www.flickr.com/photos/dullhunk/4422227111
http://www.flickr.com/photos/ricricciardi/11622986115
Not one treatment fits all
http://www.flickr.com/photos/ricricciardi/11622986115
Personal Genomics
http://www.flickr.com/photos/ricricciardi/11622986115
Personal Genomics
Preventive, Personalized, Pre-emptive Medicine
HOW DOES IT AFFECT US? SPORTS
HOW DOES IT AFFECT US? ELECTION
http://www.wired.com/underwire/2012/11/nate-silver-facts-election/
HOW DOES IT AFFECT US? ENTERTAINMENT
Source: http://www.rottentomatoes.com/ as of Feb 09, 2014
HOW DOES IT AFFECT US? DINING
Source: http://yelp.ca of Feb 09, 2014
HOW DOES IT AFFECT US? RETAIL
Is cheaper usually better?
Is much cheaper usually better?
No review
Is better rating usually better?
HOW DOES IT AFFECT US? EVENTS
HOW DOES IT AFFECT US? NEWS AND BROADCAST
Twitter
Twitter
Twitter
Twitter
Twitter
Twitter
Twitter
Twitter
HOW DOES IT AFFECT US? CIVIC CAUSES
http://www.houstonhackathon.com/
http://www.houstonpermittingcenter.org/
http://lincolnlabs.com/hackathons/seattle.html
48 hour hackathon – Feb 28, 2014 http://blogs.vancouversun.com/2014/01/20/canada-wide-hackathon-to-create-apps-using-canadian-government-data/
HOW DOES IT AFFECT US? FUNDRAISING
http://www.saleschase.com/blog/2012/04/11/how-crowdfunding-can-finance-your-small-business/
http://www.cbsplans.com/funding-your-start-up-business-crowdfunding-options/
http://www.saleschase.com/blog/2012/04/11/how-crowdfunding-can-finance-your-small-business/
http://blog.fundrazr.com/about-crowdfunding/crowdfunding-a-viable-solution-to-health-care-medical-crowdfunding-infographic-sheds-light/
http://blog.fundrazr.com/about-crowdfunding/crowdfunding-a-viable-solution-to-health-care-medical-crowdfunding-infographic-sheds-light/
HOW DOES IT REALLY AFFECT US?
UBC Alumni Analytics Director in Silicon Valley Attends Bubble Tea Meetup group Connected to C-level executives in Amazon and Microsoft Social Media Powerhouse (10K followers on Twitter) Actively blog and active Youtube TV on Gaming Passionate about green living and saving the planet Organizes hackathons for civic causes
Previously supported cause for brain research
http://www.flickr.com/photos/slackpics/4289782818
HOW TO GET IT
http://www.capgemini.com/
ADDITIONAL CONSIDERATIONS
Additional Considerations Security
Governance
Signal vs Noise
Ethics
Small Data Relevance
Relationships Gut vs Data Data Quality Big Data Limitations http://www.flickr.com/photos/theartdontstop/5509919918
http://www.flickr.com/photos/usoceangov/8290528771
RESOURCES
THANK YOU
DATA REVOLUTION Donabel Santos Development & Alumni Engagement, UBC @sqlbelle
READY FOR THE VISUAL TOUR?
comes in all
shapes & siz
es
Source: http://www.flickr.com/photos/c_x_2/11975237633/
ERP Enterprise Resource Planning
ERP Enterprise Resource Planning
CRM Customer Relationship Management
ERP Enterprise Resource Planning
CRM Customer Relationship Management
ERP Enterprise Resource Planning
CRM Customer Relationship Management
These are still all “small data”
BUT LATELY …
http://www.flickr.com/photos/cocoarmani/2059353149/sizes/l
Source: http://www.flickr.com/photos/56155476@N08/6660122741
Source: http://www.flickr.com/photos/avancemba/8764505090
Source: http://www.flickr.com/photos/djou/11306191086
http://www.flickr.com/photos/ikhlasulamal/5671062190
http://www.flickr.com/photos/courosa/4798875920
WELCOME TO THE ERA OF BIG DATA
Terminologies First ~ # of 0s Bit
1 or 0
Byte
8 Bits
Kilobyte
KB
1,024 bytes
3
Megabyte
MB
1,024 KB
6
Gigabyte
GB
1,024 MB
9
Terabyte
TB
1,024 GB
12
Petabyte
PB
1,024 TB
15
Exabyte
EB
1,024 PB
18
Zettabyte
ZB
1,024 EB
21
Yottabyte
YB
1,024 ZB
24
Brontobyte
BB
1,024 YB
27
Geopbyte
GPB
1,024 BB
30
Terminologies First ~ # of 0s Bit
1 or 0
Byte
8 Bits
Kilobyte
KB
1,024 bytes
3
Megabyte
MB
1,024 KB
6
Gigabyte
GB
1,024 MB
9
Terabyte
TB
1,024 GB
12
Petabyte
PB
1,024 TB
15
Exabyte
EB
1,024 PB
18
Zettabyte
ZB
1,024 EB
21
Yottabyte
YB
1,024 ZB
24
Brontobyte
BB
1,024 YB
27
Geopbyte
GPB
1,024 BB
30
EXABYTE
1,000,000,000,000,000,000
Source: http://www.flickr.com/photos/kalexanderson/5277334834
2009 Source. Simon, Phil. Too Big To Ignore
~500 Exabytes
Source: http://www.flickr.com/photos/kalexanderson/5277334834
2009 2016
Source. Simon, Phil. Too Big To Ignore
~500 Exabytes ~130 Exabytes/year **Cisco estimate
SO BIG DATA IS ….
Source: Wikibon.org
Source: Wikibon.org
http://www.ibmbigdatahub.com/infographic/four-vs-big-data
http://www.ibmbigdatahub.com/infographic/four-vs-big-data
http://www.ibmbigdatahub.com/infographic/four-vs-big-data
http://www.ibmbigdatahub.com/infographic/four-vs-big-data
http://www.ibmbigdatahub.com/infographic/four-vs-big-data
http://www.ibmbigdatahub.com/infographic/four-vs-big-data
http://www.ibmbigdatahub.com/infographic/four-vs-big-data
Big Data’s Gang of Four
Source: Simon, Phil. Too Big to Ignore. The Business Case for Big Data.
Source: http://michaelhyatt.com/9-astonishing-facts-about-amazon-2.html Source: http://www.theverge.com/2013/12/26/5245008/amazon-sees-prime-spike-in-2013-holiday-season
#1 online retailer 160M products (Target sells 500K)
300M customers 426 items sold/sec (run up to Christmas 2013) Source: http://michaelhyatt.com/9-astonishing-facts-about-amazon-2.html Source: http://www.theverge.com/2013/12/26/5245008/amazon-sees-prime-spike-in-2013-holiday-season
Source http://michaelhyatt.com/9-astonishing-facts-about-amazon-2.html
Source http://michaelhyatt.com/9-astonishing-facts-about-amazon-2.html
Source http://michaelhyatt.com/9-astonishing-facts-about-amazon-2.html
Source: http://www.affordableschoolsonline.com/wp-content/uploads/2011/11/FathomingAmazon.png
Source: http://www.bizjournals.com/sanjose/news/2013/06/11/14-eye-popping-apple-statistics-from.html
>700M iOS devices >300M iCloud users >500M active iTunes users ~2B iMessages/day
Source: http://www.bizjournals.com/sanjose/news/2013/06/11/14-eye-popping-apple-statistics-from.html
http://www.theverge.com/2013/10/22/4866302/apple-announces-1-million-apps-in-the-app-store
Source: http://www.the-digital-reader.com/2011/01/22/apples-app-stores-hit-1b-downloads
Source: http://www.the-digital-reader.com/2011/01/22/apples-app-stores-hit-1b-downloads
2009
Source: http://thenextweb.com/apple/2012/03/03/apples-app-store-hits-25b-downloads-right-when-we-predicted-at-a-rate-of-48-6m-a-day/
Source: http://thenextweb.com/apple/2012/03/03/apples-app-store-hits-25b-downloads-right-when-we-predicted-at-a-rate-of-48-6m-a-day/
2012
Source: http://www.engadget.com/2013/10/22/apple-ios-7-downloaded-over-200-million-times-in-5-days/
Source: http://www.engadget.com/2013/10/22/apple-ios-7-downloaded-over-200-million-times-in-5-days/
2013
http://expandedramblings.com/index.php/by-the-numbers-17-amazing-facebook-stats
>1.26B registered users (~7B world population) >757M active users/day >1B pieces of content/day >300PB user data
~45% 65 and older http://expandedramblings.com/index.php/by-the-numbers-17-amazing-facebook-stats
Source: http://www.sociallystacked.com/2013/08/infographic-of-the-day-13-mindblowing-facebook-statistics
Source: http://www.sociallystacked.com/2013/08/infographic-of-the-day-13-mindblowing-facebook-statistics
Source: http://expandedramblings.com/index.php/by-the-numbers-a-gigantic-list-of-google-stats-and-facts
>12.8B searches/month >1.17B searchers/month
~66.9% search market share >425M Gmail users ~1B YouTube users Source: http://expandedramblings.com/index.php/by-the-numbers-a-gigantic-list-of-google-stats-and-facts
http://www.digitalinformationworld.com/2013/09/41-amazing-google-facts-and-stats.html
SOCIAL MEDIA DATA
Source: http://growingsocialmedia.com/social-media-statistics-and-facts-of-2013-infographic/
Source: http://growingsocialmedia.com/social-media-statistics-and-facts-of-2013-infographic/
Source: http://growingsocialmedia.com/social-media-statistics-and-facts-of-2013-infographic/
Source: http://growingsocialmedia.com/social-media-statistics-and-facts-of-2013-infographic/
Source: http://growingsocialmedia.com/social-media-statistics-and-facts-of-2013-infographic/
Source: http://growingsocialmedia.com/social-media-statistics-and-facts-of-2013-infographic/
Source: http://infographicb2b.com/2013/08/26/social-media-statistics-infographic-2/
Source: http://infographicb2b.com/2013/08/26/social-media-statistics-infographic-2/
Source: http://infographicb2b.com/2013/08/26/social-media-statistics-infographic-2/
Source: http://infographicb2b.com/2013/08/26/social-media-statistics-infographic-2/
Source: http://infographicb2b.com/2013/08/26/social-media-statistics-infographic-2/
OPEN DATA
freely available
Source: Wikipedia
freely available without restrictions from copyrights, patents or other mechanisms of control
Source: Wikipedia
freely available without restrictions from copyrights, patents or other mechanisms of control
gaining popularity launch of open-data government initiatives such as Data.gov and Data.gov.uk.
Source: Wikipedia
http://vancouver.ca/your-government/open-data-catalogue.aspx
HOW DOES IT AFFECT US?
Source: http://www.flickr.com/photos/hikingartist/6217869581
http://www.datainnovationday.org/
HOW DOES IT AFFECT US? INSURANCE
Source: http://www.flickr.com/photos/3059349393/3419667270
Source: http://www.flickr.com/photos/masterslate/2522767675
Source: http://www.progressive.com/auto/snapshot/
Pay as you drive
Source: http://www.progressive.com/auto/snapshot/
Pay as you drive Pay how you drive Source: http://www.progressive.com/auto/snapshot/
Source: http://www.progressive.com/auto/snapshot/
HOW DOES IT AFFECT US? UTILITIES
HOW DOES IT AFFECT US? NATURE
Source: http://www.livescience.com/39099-gem-model-earthquake-hazards-risk.html
HOW DOES IT AFFECT US? HEALTH
Source: http://www.flickr.com/photos/berkeleylab/4885621404
Source: http://strata.oreilly.com/2013/08/genomics-and-the-role-of-big-data-in-personalizing-the-healthcare-experience.html
10 years 2-3 days Source: http://www.flickr.com/photos/dullhunk/4422227111
http://www.flickr.com/photos/ricricciardi/11622986115
Not one treatment fits all
http://www.flickr.com/photos/ricricciardi/11622986115
Personal Genomics
http://www.flickr.com/photos/ricricciardi/11622986115
Personal Genomics
Preventive, Personalized, Pre-emptive Medicine
HOW DOES IT AFFECT US? SPORTS
HOW DOES IT AFFECT US? ELECTION
http://www.wired.com/underwire/2012/11/nate-silver-facts-election/
HOW DOES IT AFFECT US? ENTERTAINMENT
Source: http://www.rottentomatoes.com/ as of Feb 09, 2014
HOW DOES IT AFFECT US? DINING
Source: http://yelp.ca of Feb 09, 2014
HOW DOES IT AFFECT US? RETAIL
Is cheaper usually better?
Is much cheaper usually better?
No review
Is better rating usually better?
HOW DOES IT AFFECT US? EVENTS
HOW DOES IT AFFECT US? NEWS AND BROADCAST
HOW DOES IT AFFECT US? CIVIC CAUSES
http://www.houstonhackathon.com/
http://www.houstonpermittingcenter.org/
http://lincolnlabs.com/hackathons/seattle.html
48 hour hackathon – Feb 28, 2014 http://blogs.vancouversun.com/2014/01/20/canada-wide-hackathon-to-create-apps-using-canadian-government-data/
HOW DOES IT AFFECT US? FUNDRAISING
http://www.saleschase.com/blog/2012/04/11/how-crowdfunding-can-finance-your-small-business/
http://www.cbsplans.com/funding-your-start-up-business-crowdfunding-options/
http://www.saleschase.com/blog/2012/04/11/how-crowdfunding-can-finance-your-small-business/
http://blog.fundrazr.com/about-crowdfunding/crowdfunding-a-viable-solution-to-health-care-medical-crowdfunding-infographic-sheds-light/
http://blog.fundrazr.com/about-crowdfunding/crowdfunding-a-viable-solution-to-health-care-medical-crowdfunding-infographic-sheds-light/
HOW DOES IT REALLY AFFECT US?
UBC Alumni Analytics Director in Silicon Valley Attends Bubble Tea Meetup group Connected to C-level executives in Amazon and Microsoft Social Media Powerhouse (10K followers on Twitter) Actively blog and active Youtube TV on Gaming Passionate about green living and saving the planet Organizes hackathons for civic causes
Previously supported cause for brain research
http://www.flickr.com/photos/slackpics/4289782818
HOW TO GET IT
http://www.capgemini.com/
ADDITIONAL CONSIDERATIONS
Additional Considerations Security
Governance
Signal vs Noise
Ethics
Small Data Relevance
Relationships Gut vs Data Data Quality Big Data Limitations http://www.flickr.com/photos/theartdontstop/5509919918
http://www.flickr.com/photos/usoceangov/8290528771
RESOURCES
THANK YOU
