Angel \”Java\” Lopez on Blog

June 12, 2013

Big Data: Links, News And Resources (1)

Filed under: Big Data, Links — ajlopez @ 1:48 pm

Next Post

My first links about this topic:

http://en.wikipedia.org/wiki/Big_data

Big data[1][2] is a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications. The challenges include capture, curation, storage,[3] search, sharing, transfer, analysis,[4] and visualization. The trend to larger data sets is due to the additional information derivable from analysis of a single large set of related data, as compared to separate smaller sets with the same total amount of data, allowing correlations to be found to “spot business trends, determine quality of research, prevent diseases, link legal citations, combat crime, and determine real-time roadway traffic conditions.”[5][6][7]

As of 2012, limits on the size of data sets that are feasible to process in a reasonable amount of time were on the order of exabytes of data.[8][9] Scientists regularly encounter limitations due to large data sets in many areas, including meteorology, genomics,[10] connectomics, complex physics simulations,[11] and biological and environmental research.[12] The limitations also affect Internet search, finance andbusiness informatics. Data sets grow in size in part because they are increasingly being gathered by ubiquitous information-sensing mobile devices, aerial sensory technologies (remote sensing), software logs, cameras, microphones, radio-frequency identification readers, andwireless sensor networks.[13][14] The world’s technological per-capita capacity to store information has roughly doubled every 40 months since the 1980s;[15] as of 2012, every day 2.5 quintillion (2.5×1018) bytes of data were created.[16] The challenge for large enterprises is determining who should own big data initiatives that straddle the entire organization.[17]

Big data is difficult to work with using most relational database management systems and desktop statistics and visualization packages, requiring instead “massively parallel software running on tens, hundreds, or even thousands of servers”.[18] What is considered “big data” varies depending on the capabilities of the organization managing the set, and on the capabilities of the applications that are traditionally used to process and analyze the data set in its domain. “For some organizations, facing hundreds of gigabytes of data for the first time may trigger a need to reconsider data management options. For others, it may take tens or hundreds of terabytes before data size becomes a significant consideration.”[19]

What is big data?
http://www-01.ibm.com/software/data/bigdata/

El desafío del “big data”, más que sólo grandes volúmenes de datos
http://tecno.americaeconomia.com/noticias/el-desafio-del-big-data-mas-que-solo-grandes-volumenes-de-datos

http://www.mckinsey.com/Insights/MGI/Research/Technology_and_Innovation/Big_data_The_next_frontier_for_innovation
Big data: The next frontier for innovation, competition, and productivity

Big Data
http://www.emc.com/microsites/bigdata/index.htm

Data Science Summit
http://www.greenplum.com/datasciencesummit/

Big Data: Evolution or Revolution?
http://www.infoq.com/news/2011/11/bigdata

DataSift Using MySQL, HBase, Memcached to Deal With Twitter Firehose
http://nosql.mypopescu.com/post/13540746376/datasift-using-mysql-hbase-memcached-to-deal-with

DataSift Architecture: Realtime Datamining At 120,000 Tweets Per Second
http://highscalability.com/blog/2011/11/29/datasift-architecture-realtime-datamining-at-120000-tweets-p.html

Explaining Hadoop to Your CEO
http://www.forbes.com/sites/danwoods/2011/11/03/explaining-hadoop-to-your-ceo/

The World’s Technological Capacity to Store, Communicate, and Compute Information
http://www.sciencemag.org/content/early/2011/02/09/science.1200970

The Big Data Boom Is the Innovation Story of Our Time
http://www.theatlantic.com/business/archive/2011/11/the-big-data-boom-is-the-innovation-story-of-our-time/248215/

MongoDB Intro & Application for Big Data
http://www.slideshare.net/doryokujin/mongodb-intro-application-for-big-data

The Big Data Bottleneck In The Consumer Web
http://techcrunch.com/2011/11/21/the-big-data-bottleneck-in-the-consumer-web/

Microsoft drops Dryad; puts its big-data bets on Hadoop
http://www.zdnet.com/blog/microsoft/microsoft-drops-dryad-puts-its-big-data-bets-on-hadoop/11226

Distributed Cache as a NoSQL Data Store?
http://www.infoq.com/news/2011/11/distributed-cache-nosql-data-sto

Building Scalable Systems: an Asynchronous Approach
http://www.infoq.com/presentations/Building-Scalable-Systems-Asynchronous-Approach

Big Data Intelligence on Hadoop
http://karmasphere.com/

Ville Tuulos on Big Data and Map/Reduce in Erlang and Python with Disco
http://www.infoq.com/interviews/tuulos-erlang-mapreduce

The elephant in the room … Hadoop and BigData!
http://mikethetechie.com/post/6822576191/the-elephant-in-the-room-hadoop-and-bigdata

Is Microsoft’s Future in Data-as-a-Service?
http://www.readwriteweb.com/cloud/2011/05/is-microsofts-future-in-its-ap.php

Resolving the contradictions between web services, clouds, and open source
http://radar.oreilly.com/2010/12/what-are-the-chances-for-a-fre.html

Strata Gems: Where to find data
http://radar.oreilly.com/2010/12/where-to-find-data.html

Big crime meets big data
http://radar.oreilly.com/2011/12/marc-goodman-data-crime.html
Data and social media are being used against us in creative new ways.

Tech Talk: Nathan Marz — “Clojure at BackType”
http://sna-projects.com/blog/2010/11/clojure-at-backtype/

Do We Need a New Programming Language for Big Data?
http://www.theopenforce.com/2010/09/do-we-programming-language-big-data.html

My Links
http://delicious.com/ajlopez/bigdata

Keep tuned!

Angel “Java” Lopez
http://www.ajlopez.com
http://twitter.com/ajlopez

2 Comments »

  1. […] Big Data: Links, News And Resources (1) […]

    Pingback by Big Data: Links, News And Resources (1) | MVPs de LATAM — July 2, 2013 @ 3:09 pm

  2. […] Previous Post […]

    Pingback by Big Data: Links, News And Resources (2) | Angel "Java" Lopez on Blog — December 14, 2013 @ 5:44 pm


RSS feed for comments on this post. TrackBack URI

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

The Shocking Blue Green Theme. Create a free website or blog at WordPress.com.

Follow

Get every new post delivered to your Inbox.

Join 65 other followers

%d bloggers like this: