Create your first Data Pipeline

Let’s look at how to create a data pipeline using the QuickML platform.

Resources: Click here to access some sample datasets to get started with.

Creating Data Pipeline using pipeline builder interface

1. Go to the datasets section

2. Click Import Dataset to upload a dataset to QuickML platform using the available data connector options.
   

3. Select the preferred data source to perform the import operation.
   After uploading the file from the above given options, the data quality score will be displayed.
   

4. In order to create a data pipeline, click Go to Data Cleaning. The Create pipeline popup will appear asking you to provide a pipeline name then click the Create Pipeline button.
   

5. You’ll then be taken to the Pipeline Builder page where you can perform the below Data preprocessing operations simply by drag and drop components as shown in the left pane and connecting to previous and subsequent components to create a pipeline.

   • Data Cleaning
   • Data Transformation
   • Data Extraction

Components under each data preprocessing step in the left pane can be viewed by expanding them.

6. Every operation performed inside the builder can be seen processed on the sample data in the preview section. Example: Drag and drop the Select/Drop component under the Data Cleaning section; select the required columns; and select the Drop/select operation. You will be able to confirm in the preview section that the columns have dropped.
   

7. In a similar manner, drag and drop all required components into the builder and connect the last component to the destination to finish building the pipeline. It will appear as follows:
   

8. To run the pipeline, click the Execute button. Once the pipeline is executed, it will appear as follows:
   

9. Clicking on the car_price dataset will take you to the car_prices dataset details page, where you can verify new versions and other relevant Dataset profile information
   

Note: QuickML uses Zoho IAM as an authentication manager. In order to use the service, the user must be signed in using Zoho account.