Big Data tools - EGI Landscape Analysis

Permalink:

https://documents.egi.eu/document/3697

Document #:

EGI-doc-3697-v1

Document type:

Internal document

Submitted by:

Andrea Manzi

Updated by:

Andrea Manzi

Document Created:

09 Feb 2021, 13:33

Contents Revised:

09 Feb 2021, 13:33

Metadata Revised:

29 Mar 2021, 14:59

Abstract:

he document reports a landscape analysis of the Big Data tools.
Big Data refers to the non-traditional strategies and technologies needed to collect, organize, process, and gather insights from large datasets. While the problem of working with data that exceeds the computing power or storage of a single computer is not new, the pervasiveness, scale, and value of this type of computing has greatly expanded in recent years.
In addition, the hype of Big Data services and tools is now linked to other technological trends such as the Internet of Things (IoT) and Artificial Intelligence(AI)/ Machine Learning (ML), and it’s focusing more on what is referred to analytics of data-in-motion rather than data-at-rest.
Development of all big data related technologies and approaches has mainly been driven by non-EU companies, and in particular lots of big data tools and services are provided by the big US public cloud providers. Recently though in Europe, the EC with the publication of the European Data Strategy is planning to become a leader in a data-driven society hence also providing big data tools services in the EU. A number of related EU projects will be funded to implement this strategy and EGI could play an important role bringing its experience on dealing with very large datasets in extreme distributed environments.

Files in Document:

• Big Data tools - EGI Landscape Analysis.pdf (810.9 kB)

Topics:

• EGI.eu
• EGI

Authors:

• Andrea Manzi
• Diego Scardaci

Keywords:

bigdata landscape data