{"id":5158,"date":"2014-06-22T15:02:07","date_gmt":"2014-06-22T19:02:07","guid":{"rendered":"http:\/\/www.iri.com\/blog\/?p=5158"},"modified":"2021-10-21T09:31:02","modified_gmt":"2021-10-21T13:31:02","slug":"lineage-analysis-git","status":"publish","type":"post","link":"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/","title":{"rendered":"Metadata Management: Lineage Tracking in Git (Part 3 of 4)"},"content":{"rendered":"

This article is third\u00a0in a 4-part series on managing metadata assets in\u00a0IRI Workbench<\/a>\u00a0using Git. It\u00a0focuses on its value in\u00a0tracking metadata lineage.\u00a0Other articles in the series cover the use of Git as a<\/em><\/em>\u00a0metadata asset hub<\/a>, for\u00a0version control<\/a>, and for\u00a0<\/em>metadata security<\/a>.<\/em><\/p>\n

In the previous article<\/a>, I demonstrated the submission of IRI project metadata assets through Git in\u00a0IRI Workbench<\/a>, built on Eclipse\u2122. This article explains the importance of metadata lineage analysis, and how to view\u00a0the\u00a0history of a project stored in a Git repository.<\/p>\n

Metadata lineage shows us the origin of our data and how it has been transformed during processing in order to reach its current state. Understanding\u00a0and retaining the knowledge of data’s origins, changes, and destinations, are fundamental to data governance.\u00a0It also\u00a0improves confidence in the metadata itself, the data and processes the metadata defines, and the decisions we make from the end results of the processing.<\/span><\/p>\n

Along with documenting\u00a0the flow of data, metadata\u00a0lineage\u00a0can help us manage and secure our\u00a0data more\u00a0appropriately, since lineage also stores information on the location,\u00a0time, and data managers themselves. \u00a0<\/span><\/p>\n

Using Git, lineage can be presented conveniently\u00a0in the context of metadata\u00a0version control. The history of\u00a0each version of your asset can be viewed and analyzed, with a log of the changes and who made them. To access this view, right-click on your project and go to Team > Show in History<\/em>.<\/span><\/p>\n

\"612_1\"<\/a><\/p>\n

With this selected, the project history appears, and details each commit made over time. \u201cHead\u201d means that this is the current commit where your repository is pointing; and \u201cmaster\u201d signifies that this is the main branch of your project.<\/span><\/p>\n

\"Screen<\/a><\/p>\n

At any time, you can compare the current and past state of a file. To do so, right-click on the file you wish to analyze and select Compare With > Local<\/em> History; then select the revision for comparison. This will indicate the exact changes between the two versions. Following is an example of a field (column) name change in a SortCL<\/a> job script managed\u00a0by an IRI CoSort<\/a> user:<\/span><\/p>\n

\"Screen<\/a><\/p>\n

Changes to metadata and other assets are easy to see in this view, as is who made\u00a0the change (and when). Having\u00a0those changes in the repository will allow\u00a0others to deliberate over the\u00a0implications. Searching (see below) for all\u00a0instances of the string across\u00a0your projects will expose their impact beyond the immediate application.<\/p>\n

Beyond the metadata lineage information that Git provides, IRI Workbench users can use the extensive file and text search features of Eclipse to analyze lineage, along with the impact of changes (metadata impact analysis). Search for\u00a0metadata within or across projects;\u00a0for example, column names that appear in one or more\u00a0data definition files (.DDF repositories), or transformation rules (like conditions) in IRI job scripts.<\/p>\n

Search window results allow you to not only see occurrences at a glance, but drill down to\u00a0open each asset where the item occurs (e.g., when a given field name is specified). This gives you and your team better insight (and foresight) into the impact changes to that metadata asset before (and after) they are made.<\/p>\n

\"Screen<\/a><\/p>\n

If you need more information on the IRI metadata management using Git series, you can visit part two of the series – Version Control<\/a>. You can also read more here about using Git for Asset Security<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

This article is third\u00a0in a 4-part series on managing metadata assets in\u00a0IRI Workbench\u00a0using Git. It\u00a0focuses on its value in\u00a0tracking metadata lineage.\u00a0Other articles in the series cover the use of Git as a\u00a0metadata asset hub, for\u00a0version control, and for\u00a0metadata security. In the previous article, I demonstrated the submission of IRI project metadata assets through Git in\u00a0IRI<\/p>\n

Read More<\/a><\/div>\n","protected":false},"author":44,"featured_media":5393,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[91,216,233],"tags":[473,470,450,1546,469,472,281,471,468],"class_list":["post-5158","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-iri-workbench","category-master-data-metadata-management","category-metadata-management","tag-analyze-metadata-lineage","tag-data-lineage","tag-egit","tag-git","tag-lineage-tracking","tag-metadata-asset","tag-metadata-management-2","tag-metadata-repository","tag-version-control"],"acf":[],"yoast_head":"\nMetadata Management: Lineage Tracking in Git (Part 3 of 4) - IRI<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Metadata Management: Lineage Tracking in Git (Part 3 of 4) - IRI\" \/>\n<meta property=\"og:description\" content=\"This article is third\u00a0in a 4-part series on managing metadata assets in\u00a0IRI Workbench\u00a0using Git. It\u00a0focuses on its value in\u00a0tracking metadata lineage.\u00a0Other articles in the series cover the use of Git as a\u00a0metadata asset hub, for\u00a0version control, and for\u00a0metadata security. In the previous article, I demonstrated the submission of IRI project metadata assets through Git in\u00a0IRIRead More\" \/>\n<meta property=\"og:url\" content=\"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/\" \/>\n<meta property=\"og:site_name\" content=\"IRI\" \/>\n<meta property=\"article:published_time\" content=\"2014-06-22T19:02:07+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-10-21T13:31:02+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/beta.iri.com\/blog\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-25-at-3.46.29-PM.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1270\" \/>\n\t<meta property=\"og:image:height\" content=\"636\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Allison Aguirre\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Allison Aguirre\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/\"},\"author\":{\"name\":\"Allison Aguirre\",\"@id\":\"https:\/\/beta.iri.com\/blog\/#\/schema\/person\/196d8057adb8838df5bddf4544beb507\"},\"headline\":\"Metadata Management: Lineage Tracking in Git (Part 3 of 4)\",\"datePublished\":\"2014-06-22T19:02:07+00:00\",\"dateModified\":\"2021-10-21T13:31:02+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/\"},\"wordCount\":574,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/beta.iri.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/beta.iri.com\/blog\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-25-at-3.46.29-PM.png\",\"keywords\":[\"analyze metadata lineage\",\"data lineage\",\"EGit\",\"Git\",\"lineage tracking\",\"metadata asset\",\"metadata management\",\"metadata repository\",\"version control\"],\"articleSection\":[\"IRI Workbench\",\"MDM\",\"Metadata Management\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/\",\"url\":\"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/\",\"name\":\"Metadata Management: Lineage Tracking in Git (Part 3 of 4) - IRI\",\"isPartOf\":{\"@id\":\"https:\/\/beta.iri.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/beta.iri.com\/blog\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-25-at-3.46.29-PM.png\",\"datePublished\":\"2014-06-22T19:02:07+00:00\",\"dateModified\":\"2021-10-21T13:31:02+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#primaryimage\",\"url\":\"https:\/\/beta.iri.com\/blog\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-25-at-3.46.29-PM.png\",\"contentUrl\":\"https:\/\/beta.iri.com\/blog\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-25-at-3.46.29-PM.png\",\"width\":1270,\"height\":636},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/beta.iri.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Metadata Management: Lineage Tracking in Git (Part 3 of 4)\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/beta.iri.com\/blog\/#website\",\"url\":\"https:\/\/beta.iri.com\/blog\/\",\"name\":\"IRI\",\"description\":\"Total Data Management Blog\",\"publisher\":{\"@id\":\"https:\/\/beta.iri.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/beta.iri.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/beta.iri.com\/blog\/#organization\",\"name\":\"IRI\",\"url\":\"https:\/\/beta.iri.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/beta.iri.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/beta.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"contentUrl\":\"https:\/\/beta.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"width\":750,\"height\":206,\"caption\":\"IRI\"},\"image\":{\"@id\":\"https:\/\/beta.iri.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/beta.iri.com\/blog\/#\/schema\/person\/196d8057adb8838df5bddf4544beb507\",\"name\":\"Allison Aguirre\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/beta.iri.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/0210c89c4e232a0c94809253910d4226?s=96&d=blank&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/0210c89c4e232a0c94809253910d4226?s=96&d=blank&r=g\",\"caption\":\"Allison Aguirre\"},\"url\":\"https:\/\/beta.iri.com\/blog\/author\/allisona\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Metadata Management: Lineage Tracking in Git (Part 3 of 4) - IRI","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/","og_locale":"en_US","og_type":"article","og_title":"Metadata Management: Lineage Tracking in Git (Part 3 of 4) - IRI","og_description":"This article is third\u00a0in a 4-part series on managing metadata assets in\u00a0IRI Workbench\u00a0using Git. It\u00a0focuses on its value in\u00a0tracking metadata lineage.\u00a0Other articles in the series cover the use of Git as a\u00a0metadata asset hub, for\u00a0version control, and for\u00a0metadata security. In the previous article, I demonstrated the submission of IRI project metadata assets through Git in\u00a0IRIRead More","og_url":"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/","og_site_name":"IRI","article_published_time":"2014-06-22T19:02:07+00:00","article_modified_time":"2021-10-21T13:31:02+00:00","og_image":[{"width":1270,"height":636,"url":"https:\/\/beta.iri.com\/blog\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-25-at-3.46.29-PM.png","type":"image\/png"}],"author":"Allison Aguirre","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Allison Aguirre","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#article","isPartOf":{"@id":"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/"},"author":{"name":"Allison Aguirre","@id":"https:\/\/beta.iri.com\/blog\/#\/schema\/person\/196d8057adb8838df5bddf4544beb507"},"headline":"Metadata Management: Lineage Tracking in Git (Part 3 of 4)","datePublished":"2014-06-22T19:02:07+00:00","dateModified":"2021-10-21T13:31:02+00:00","mainEntityOfPage":{"@id":"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/"},"wordCount":574,"commentCount":0,"publisher":{"@id":"https:\/\/beta.iri.com\/blog\/#organization"},"image":{"@id":"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#primaryimage"},"thumbnailUrl":"https:\/\/beta.iri.com\/blog\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-25-at-3.46.29-PM.png","keywords":["analyze metadata lineage","data lineage","EGit","Git","lineage tracking","metadata asset","metadata management","metadata repository","version control"],"articleSection":["IRI Workbench","MDM","Metadata Management"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/","url":"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/","name":"Metadata Management: Lineage Tracking in Git (Part 3 of 4) - IRI","isPartOf":{"@id":"https:\/\/beta.iri.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#primaryimage"},"image":{"@id":"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#primaryimage"},"thumbnailUrl":"https:\/\/beta.iri.com\/blog\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-25-at-3.46.29-PM.png","datePublished":"2014-06-22T19:02:07+00:00","dateModified":"2021-10-21T13:31:02+00:00","breadcrumb":{"@id":"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#primaryimage","url":"https:\/\/beta.iri.com\/blog\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-25-at-3.46.29-PM.png","contentUrl":"https:\/\/beta.iri.com\/blog\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-25-at-3.46.29-PM.png","width":1270,"height":636},{"@type":"BreadcrumbList","@id":"https:\/\/beta.iri.com\/blog\/iri\/iri-workbench\/lineage-analysis-git\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/beta.iri.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Metadata Management: Lineage Tracking in Git (Part 3 of 4)"}]},{"@type":"WebSite","@id":"https:\/\/beta.iri.com\/blog\/#website","url":"https:\/\/beta.iri.com\/blog\/","name":"IRI","description":"Total Data Management Blog","publisher":{"@id":"https:\/\/beta.iri.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/beta.iri.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/beta.iri.com\/blog\/#organization","name":"IRI","url":"https:\/\/beta.iri.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/beta.iri.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/beta.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","contentUrl":"https:\/\/beta.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","width":750,"height":206,"caption":"IRI"},"image":{"@id":"https:\/\/beta.iri.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/beta.iri.com\/blog\/#\/schema\/person\/196d8057adb8838df5bddf4544beb507","name":"Allison Aguirre","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/beta.iri.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/0210c89c4e232a0c94809253910d4226?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/0210c89c4e232a0c94809253910d4226?s=96&d=blank&r=g","caption":"Allison Aguirre"},"url":"https:\/\/beta.iri.com\/blog\/author\/allisona\/"}]}},"jetpack_featured_media_url":"https:\/\/beta.iri.com\/blog\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-25-at-3.46.29-PM.png","_links":{"self":[{"href":"https:\/\/beta.iri.com\/blog\/wp-json\/wp\/v2\/posts\/5158"}],"collection":[{"href":"https:\/\/beta.iri.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/beta.iri.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/beta.iri.com\/blog\/wp-json\/wp\/v2\/users\/44"}],"replies":[{"embeddable":true,"href":"https:\/\/beta.iri.com\/blog\/wp-json\/wp\/v2\/comments?post=5158"}],"version-history":[{"count":30,"href":"https:\/\/beta.iri.com\/blog\/wp-json\/wp\/v2\/posts\/5158\/revisions"}],"predecessor-version":[{"id":15066,"href":"https:\/\/beta.iri.com\/blog\/wp-json\/wp\/v2\/posts\/5158\/revisions\/15066"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/beta.iri.com\/blog\/wp-json\/wp\/v2\/media\/5393"}],"wp:attachment":[{"href":"https:\/\/beta.iri.com\/blog\/wp-json\/wp\/v2\/media?parent=5158"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/beta.iri.com\/blog\/wp-json\/wp\/v2\/categories?post=5158"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/beta.iri.com\/blog\/wp-json\/wp\/v2\/tags?post=5158"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}