We live in the digital data age. Everything from the goods and services we buy to the way we interact with our friends and colleagues have been transformed almost beyond recognition. Our physical world is also affected. CCTV systems see our every step, mobile phones report our physical location, smart devices and networked sensors effectively digitally capture the physical world we inhabit.
Data, contains information of value. Often business intelligence and insights are locked within the data. Data needs to be refined to create this information.
Big Data refers to tools, processes and procedures allowing the creation, manipulation and management of very large amounts of data. However, the size is only one of the characteristics of Big Data. Over the last few years analysts and technologists have sought greater insight. Big Data can be split into Volume, Velocity and Variety; and requires validation software to mine the value from the information. Information that has the ability to tell us things we never knew before and help us make better and more informed decisions.
To mine the value from the data you need to gather it, validate and change the data (quality assurance), analyse it, and finally report it on a software dashboard.