Import Metadata

Import the raw data you need into the dataset for cleaning. If you're a developer, check our documentation to learn how to import via API.

Once a dataset is created, you can directly access the dataset details page by clicking on the dataset from the homepage.

1. Choose Import Method

Dataset

On the import page, you can select a suitable import method from various data sources:

• Import via API:

  1. Refer to the API section.

  2. Once configured, you can use the API to import data.

• Webpage Import: Supports fetching data from webpages starting with https://.

• Import from local text: Supports processing .docx .pdf .txt .md .json, and other file formats.

• Import from audio: Supports processing.mp3 .wavfiles.

• Import from picture: Supports processing .png .jpg files.

• Import from videos: Supports processing.mov .mp4 .mpv files.

2. Filtering and managing tasks

To better manage and view import tasks, you can use task filtering functionality:

1. Use the "Filter Tasks" function to quickly find tasks based on their status (such as "Not Started," "Importing," "Completed," "Import Failed").

2. You can also search for specific tasks by entering the task name in the search box.

3. Viewing Import Progress

The import page displays the progress of all tasks:

1. In the "Not Started" or "Importing" tabs, each task has a set of buttons next to it for starting, stopping, or deleting the task. Here are the specific functions of these buttons:

   1. Start button

      • Function: Click the "▶️" button to initiate an import task that has been configured but not yet started.

      • Use Case: Use the "▶️" button when the task configuration is complete and ready for execution. By clicking "▶️", the task will commence, and the system will begin fetching and importing data according to the set rules.

   2. Stop button

      • Function: Click the "⏸️" button to interrupt a task that is currently in progress. After stopping the task, the system will no longer continue fetching or processing data.

      • Use Case: You can use the "⏸️" button when you need to interrupt a task or if you discover a configuration error in the task. Once the task is stopped, its status will be displayed as "Stopped," and you have the option to delete the task.

   3. Delete button

      • Function: Click the "❌️" button to permanently remove a task and its associated uploaded data (excluding already fetched data). Please note that the deletion operation is irreversible.

      • Use Case: You can use the "❌️" button when you are certain that a task is no longer needed and wish to completely remove it. This is useful in situations such as configuration errors or when uploaded data from completed tasks is no longer required to be saved.

Through the import progress area and the functions of each button, you can have full control over all data import tasks, pause, resume, stop, or retry tasks at any time, and analyze the execution status of tasks in-depth. If you have further questions or need assistance, feel free to contact our support team.