The internet of things and big data Unlocking the power. The IoT will massively increase the amount of data available for analysis by all manner of organisations. Lets find out why Pluto is no longer considered a planet. Pluto was first discovered in 1930 by Clyde W. Tombaugh at the Lowell Observatory in Flagstaff Arizona. Planet Big Data is an aggregator of blogs about big data, Hadoop, and related topics. We include posts by bloggers worldwide. Email us to have your blog. The internet of things and big data Unlocking the power The internet of things Io. T and big data are two of the most talked about technology topics in recent years, which is why they occupy places at or near the peak of analyst firm Gartners most recent Hype Cycle for Emerging Technologies Gartners 2. Hype Cycle for Emerging Technologies If you have somehow missed the hype, the Io. Now, Its Not Personal But like it or not, meateating is becoming a problem for everyone on the planet. Ask people where theyd rank meateating as an issue of. Little Big Planet 2 Save Data' title='Little Big Planet 2 Save Data' />T is a fast growing constellation of internet connected sensors attached to a wide variety of things. Sensors can take a multitude of possible measurements, internet connections can be wired or wireless, while things can literally be any object living or inanimate to which you can attach or embed a sensor. If you carry a smartphone, for example, you become a multi sensor Io. T thing, and many of your day to day activities can be tracked, analysed and acted upon. Big data, meanwhile, is characterised by four Vs volume, variety, velocity and veracity. Little Big Planet 2 Save Data' title='Little Big Planet 2 Save Data' />That is, big data comes in large amounts volume, is a mixture of structured and unstructured information variety, arrives at often real time speed velocity and can be of uncertain provenance veracity. Such information is unsuitable for processing using traditional SQL queried relational database management systems RDBMSs, which is why a constellation of alternative tools notably Apaches open source Hadoop distributed data processing system, plus various No. SQL databases and a range of business intelligence platforms has evolved to service this market. The Io. T and big data are clearly intimately connected billions of internet connected things will, by definition, generate massive amounts of data. However, that in itself wont usher in another industrial revolution, transform day to day digital living, or deliver a planet saving early warning system. As EMC and IDC point out in their latest Digital Universe report, organisations need to hone in on high value, target rich data that is 1 easy to access 2 available in real time 3 has a large footprint affecting major parts of the organisation or its customer base andor 4 can effect meaningful change, given the appropriate analysis and follow up action. As we shall see, theres a great deal less of this actionable data than you might think if you simply looked at the size of the digital universe and the number of internet connected things. How many Io. T things A huge number of things could join the Io. I/61MsoxVB-yL.jpg' alt='Little Big Planet 2 Save Data' title='Little Big Planet 2 Save Data' />T, whose recent rise to prominence is the result of several trends conspiring to cause a tipping point low cost, low power sensor technology widespread wireless connectivity huge amounts of available and affordable largely cloud based storage and compute power and plenty of internet addresses to go round, courtesy of the IPv. IPv. 4. Estimates and projections of the current and future number of internet connected objects vary, depending on the definitions used and the optimism of whoever is doing the estimating and projecting. Instruction Manual For Guns. Even if you regularly eschew meateating and take public transportation, all your efforts at reducing your carbon footprint can be easily outweighed by indulging in. Little Big Planet 2 Save Data' title='Little Big Planet 2 Save Data' />The best known figures come from Cisco, which puts the current February 2. Image Cisco. EMC and IDC are somwhat more conservative, putting the 2. Io. T population at 3. Gartner comes in with 2. How much big data Data was getting seriously big even before Io. T devices entered the picture. EMC and IDC have been tracking the size of the Digital Universe, or DU, since 2. DU is all the digital data created, replicated and consumed in a single year. In 2. 01. 2 EMC and IDC estimated that the DU would double every two years to reach 4. ZB by 2. 02. 0 a number since revised upwards to 4. ZB thats 4. 4 trillion gigabytes. Astronomical numbers perhaps need astronomical illustrations, which may be why EMCIDC pictured 4. ZB as 6. 6 stacks of 1. GB i. Pad Air tablets reaching from Earth to the moon. The DU estimate for 2. ZB or one stack of i. Pads reaching two thirds of the way to the moon. The 2. 01. 3 4. 4. ZB DU estimate breaks down into 2. ZB generated by consumers and 1. ZB generated by enterprises. However, only 0. 6. ZB 1. 5 of the consumer portion is not touched by enterprises in some way, leaving enterprises responsible for the vast majority of the worlds data about 3. ZB in 2. 01. 3. As noted above, EMC and IDC forecast that the Io. T will grow to 3. DU up from 2 in 2. In terms of geography, EMC and IDC predict that the balance will swing from mature markets, which accounted for 6. DU in 2. 01. 3, to emerging markets, which will generate a similar percentage in 2. Fortunately for enterprises, the target rich data that can potentially deliver actionable business insights is estimated by EMC and IDC to be a more manageable 1. ZB, or 6. 6 million terabytes. Ciscos large scale data tracking project, the Global Cloud Index GCI, focuses on data centre and cloud based IP traffic, estimating the 2. ZByear 1. 5. ZB in traditional data centres, 1. ZB in cloud data centres. By 2. 01. 8, this is predicted to have risen to 8. ZB, with the majority of growth happening in cloud data centres 2. ZB traditional, 6. ZB cloud. According to Cisco, 7. ZB will remain within data centres storage, production, development, and authentication traffic, with 1. ZB flowing between data centres to users, and 8 percent 0. ZB flowing between data centres replication and inter database links. Whats startling, however, is Ciscos estimate of the amount of data generated by Internet of Everything Io. E devices which encompasses people to people P2. P, machine to people M2. P, and machine to machine M2. M connections by 2. ZB, which is 4. 7 times the estimated total data centre traffic and 2. Ciscos Forecast and Methodology white paper for more details. No wonder service providers and mobile operators are taking the Io. T extremely seriously. Where will Io. Tbig data make an impact The Io. T and big data are clearly growing apace, and are set to transform many areas of business and everyday life. But which particular sectors are likely to feel the Io. Tbig data disruption first In its 2. Internet of Things predictions, IDC notes that Today, over 5. Io. T activity is centered in manufacturing, transportation, smart city, and consumer applications, but within five years all industries will have rolled out Io. T initiatives. In its 2. Digital Universe report, EMC and IDC see the Io. T creating new business opportunities in five main areas, summarised in this slide. Image EMCIDC. To deliver on these opportunities, according to EMCs Bill Schmarzo, a new generation of Io. T applications is required to address specific business needs such as predictive maintenance loss prevention asset utilization inventory tracking disaster planning and recovery downtime minimization energy usage optimization device performance effectiveness network performance management capacity utilization capacity planning demand forecasting pricing optimization yield management and load balancing optimization. If these and other nuts and bolts of the Io. Tbig data revolution can be put in place, theres a great deal of economic value to play for. For example, Cisco published a pair of studies in 2. Internet of Everything Io. E and came up with 1. In the private sector, Cisco expects the value to be driven in five main areas asset utilisation 2. In the public sector the main proposed drivers are employee productivity 1. As usual when it comes to the Io.