Big Data is by essence the production of data, linked to a process or activity which requires to be stored. The safe storage of these data will ensure the availability and traceability of this process or activity, but will also generate a significant volume of data to be stored on various media.
The volume of data produced by company and governmental organisations have increased significantly thru the years. the development and digitalisation of the business model and pushed up the companies and organisations to transfer the data to a digital format.
Different media for data recording have been developped thru the years, such as tapes, floppy disks, hard disks, online storage solutions, creating a diversity in the data storage format and its complexity to access and protect the data.
The transfer of data to data servers or cloud solutions have created a higher risk in the management of the data privacy and cybersecurity. therefor we can see the emergence of private cloud solutions showing a higher protection to the cyberattacks.
Moving the data to an external service provider is still an ongoing process, involving the company internal policies modification regarding, the management of labor, services providers and cybersecurity awareness. A large number of companies are still using tape as digital support, in order to protect the data due to their highly competitive market.
Big data management means, managing a large volume of raw data to be re-organised and process in prevision of further data analysis.
We can see various situations starting with the ability to access the data and to generate a basic insight. A good example here would be the ability to access a data or to allow the collection of an information from an equipment. IoT development and 5G networks will allow here the collection of information and data at a global level.
The second level of Analytics is the ability to generate a dashboard and KPIs showing the overall performance of an equipment or status of data