Data do not exist in a vacuum. To be useful, data must be accompanied by context on how they are captured, processed, analyzed, and validated and other information that enables interpretation and use.
Provenance is information about entities, activities, and people involved in producing a piece of data or thing, which can be used to form assessments about its quality, reliability or trustworthiness.
. The fact of coming from some particular source or quarter; origin, derivation
. The history or pedigree of a work of art, manuscript, antiques etc.
. A record of the passage of an item through its various owners
Why we need Provenance ?
To assess its quality, reliability & trustworthiness.
Provenance, from the French provenir, "to come from", refers to the chronology of the ownership, custody or location of a historical object. The term was originally mostly used in relation to works of art, but is now used in similar senses in a wide range of fields, including archaeology, paleontology, archives, manuscripts, printed books, and science and computing. The primary purpose of tracing the provenance of an object or entity is normally to provide contextual and circumstantial evidence for its original production or discovery, by establishing, as far as practicable, its later history, especially the sequences of its formal ownership, custody, and places of storage. The practice has a particular value in helping authenticate objects. Comparative techniques, expert opinions, and the results of scientific tests may also be used to these ends, but establishing provenance is essentially a matter of documentation. In archaeology, the term provenience is used in related but a subtly different sense to provenance. Archaeological researchers use provenience to refer to the three-dimensional location of an artifact or feature within an archaeological site, whereas provenance covers an object's complete documented history. Provenience can be used more broadly, especially when an artifact was found by a private party and its specific position not recorded. Any given antiquity may therefore have both a provenience and a provenance. In rare cases, e.g. known artisanship or original ownership, an antiquity's provenance may include facts that predate its entry into the archaeological record, as well as those relating to its history after rediscovery.
Persistent identifiers are identifiers that persist on a particular representation of a resource. They can be updated as the resources themselves change, thus persistent identifiers make resource representation accessible even in the case of the knowledge going off-line or changing locations. Persistent identifiers also enable linked data.
This software aims to incorporate both provenance and persistent identifiers to the data analytics processes in big data. A provenance system responsible for creating entities and recording processes will be developed. The entities will be made available via persistent identifiers, allowing the knowledge representation in both graphical and textual forms.
. Quick & Simple Configuration
. Live Sever/Application migration
. Application/Data Cloning
. Realtime Application and Database Backups
. Secure Network
. Dynamic Firewall Configuration
. Monitoring & Alerting
. Central Logging
. Application Code Management
. Dedicated Environment