The End of the Data Lifecycle

This chapter assesses the transitory nature of data and its deletion, by either design or accident. In the data-driven world we live in, while it sometimes seems that data lasts forever, they all pass through a lifecycle. For the majority of data points, this cycle passes very quickly as the data are transitory — created, processed, and deleted in micro-seconds. Value is extracted, or they are never examined or processed, and then they are discarded because they have little further utility and there is no point wasting resources storing them. In some cases, useful data might be deleted accidentally, or without forethought. Given the massive amounts of data presently being produced, often only a sample are retained and stored rather than a full set. Indeed, the data we store in archives and repositories is often derived data. In the case of data brokers, producing derived data is also a means to bypass the fair-information-practice principle of data minimization which states that data should only be used for the purpose for which it was intended. Similarly, metadata — factual information about data — is often retained rather than the data themselves.