How to extract and analyse data in Xill4

1. Extraction

1.1. Extract the data from the source system using a Xill 4 source connector. Choose the appropriate source connector from the list of accelerators in the accelerator library at this link (https://xillio.community/accelerators) but you will need a valid license key to access the accelerator library.

1.2. Download the source connector to your local machine and unzip the file.

1.3. Import the source connector file into your Xill 4 project.

1.4. Configure your source connector by following the configuration instructions in the Xill 4 documentation which you can find at this link.(https://docs.xill.io/xill4/category/source-accelerators/).

1.5. Run the source connector flow and monitor the extraction for any errors which may arise in the Xill 4 console. For guidance on how to debug errors, please see the debugging documentation at this link (https://docs.xill.io/xill4/quick-start/#debugging).

1.6. Once the extraction is complete, validate that you successfully extracted all in scope data for the migration.

1.7. Generate extraction reports using the extraction report accelerator which you can download from this link (https://xillio.community/accelerators). Share this report with the client and ask them to validate the extraction by way of a formal sign-off.

These are the basic steps of successfully completing an extraction.

1. Analysis
   1. Download the insights accelerator from the accelerator library at link (https://xillio.community/accelerators). You will find it under “framework” accelerators.
   2. Configure the 1st and 2nd flows of the insights accelerator according to the documentation which you can find at this link (https://docs.xill.io/xill4/category/framework-accelerators/)

Note: Bear in mind that if your migration and insights servers are on two separate machines, you will need to convert the folder which contains the Elasticsearch certificates to a shared folder, accessible over the network, to use it in the Ingestion flow of the Insights accelerator.

1. Run the first flow which analyses the data pre-ingestion into Xillio Insights.
2. Run the second flow which ingests the analysed data into Xillio insights.
3. Log into Kibana and create a data view associated with your index.
4. Upload the default dashboards which are in the Insights accelerator folder you already downloaded. The dashboards will be in the form of an .ndjson file.
5. Upload the default dashboards into Kibana.
6. Assign the data view you created earlier to all the visualisations in the dashboards. At this point, you should start to see your ingested data showing up in your dashboards.