ETL Methodology

Recording Script : Module 1 – Data Migration Process 
Welcome to the partner enablement training. In this video, we will be covering the basics of a the ETL methodology, I’ll share a quick migration journey from start to finish so that you can have an example of how we apply ETL to our data migrations and then we’ll take a look at the Xill 4 software so that you can have a first look at the platform and get some first impressions. Let’s begin. 

The data migration process can be broken down into three simple steps. 
Step 1 is extraction: Which is the process of collecting data from the source system, saving it in an external repository, which for us, will be the Xillio content store. We’ll talk more about the content store in a video which is coming later in this course. If you think of migrating data as moving furniture from one house to another, then the extraction step would be equivalent to packing all furniture and personal belongings in the house and loading it into the moving truck. 
Step 2 is transformation: This step involves cleaning, converting, or restructuring the extracted data for many reasons, such as meeting the requirements of the target system. We know that Documentum and SharePoint are two different systems which may have different rules for how content can be stored or accessed. For this reason, we need to transform the data to meet Microsoft’s requirements for SharePoint online. 
The final step, or step 3, is Loading: This is where we insert the transformed data into the target system. To go back to our analogy of moving from one house to another, the loading step would be equivalent to offloading the furniture from the mover’s truck and carrying it into the new house, placing each item of furniture exactly where the client would like it to be and making sure that nothing is missing, broken or out of place.  

These  3 main steps of a data migration are commonly known as ETL, and to come full circle with the concept, allow me to share an example of a migration journey so that you have an impression of how we apply ETL through Xill 4.
 

Explain it on your own, keep it short.
This is how ETL is applied through the Xill 4 platform. And I know right about now you’re probably keen to see exactly what the platform looks like so without further to do, let’s take a first look at Xill 4: 

So, welcome to the Xill 4 Platform. At the time of this recording, I am using Xill 4 version 4.53.1, but there’s a chance that by the time you watch this video, there’s a newer release available, but it probably won’t be drastically different to what you’re seeing right now. At the moment, Xill4  is running on my local machine on port 8000, I am in a project I created called Documentum_To_SPO_Migration. And this project has a number of different flows inside of it. For example, the documentum source connector flow which connects to documentum and extracts data through the API. 

Inside the connector we can see the components which make up the flow and what each component is responsible for. You can create your own projects, your own flows to satisfy any requirements you may have, everything is completely customizable and we’ll talk more about that in the next video. I hope you enjoyed this sneak peak of what’s to come. Goodbye.