Learn how to register and manage your Object Stores within Kosmoy Studio’s Data Catalog.
The Object Stores section of the Data Catalog allows you to register your object storage services (like Amazon S3, Azure Blob Storage, and Google Cloud Storage), making it easier to manage and utilize your unstructured data within Kosmoy Studio.
Prerequisites:
Before registering an Object Store, you must have an active Integration with the corresponding cloud provider (AWS, Azure, or Google). Refer to the Managing Integrations section for details.
Navigate to Object Stores: From the Kosmoy Studio home page, click on the “Data Management” menu in the left-hand navigation bar, then select “Data Catalog” and then click on “Object Stores”.
Add a New Object Store: Click the ”+ ADD” button located in the upper right corner of the Object Stores section.
Select Provider: Choose the cloud provider of your object store (e.g., Amazon, Azure, Google).
Select Integration: From the dropdown menu, select the appropriate pre-configured Integration for your cloud provider.
Select Object Store: Choose the specific object store (e.g., S3 bucket, Blob container) you want to register. The available options will be dynamically listed based on your selected Integration.
Click “Next”.
Name and Describe the Object Store: Give your object store a unique name and an optional description.
Click “Review”: Review the object store details.
Click “Create”: Register the object store in the Data Catalog.
The Object Stores section displays each registered object store as a card. Each card shows:
You cannot edit or delete an Object Store if it is currently referenced by other entities within Kosmoy Studio. This includes being used in:
Before attempting to edit or delete an Object Store, ensure it is not actively used in any of these areas.
You can update the configuration of a registered Object Store, including its name, description, and even the selected object store itself, provided it is not currently referenced by any other component.
If you attempt to edit an Object Store that is currently in use, a warning banner will be displayed at the top of the screen, preventing the modification.
You can remove a registered Object Store if it’s no longer needed. However, you cannot delete an Object Store that is currently referenced by any other component.
If you attempt to delete an Object Store that is currently in use, a modal will appear, preventing the deletion and explaining that the Object Store is in use.
Warning: Deleting an Object Store is a permanent action and cannot be undone. Ensure that the Object Store is not being referenced by any other component before proceeding.
Registered Object Stores are primarily used when configuring Vector Pipelines in the Data Ingestion section. You can select an Object Store and a specific Folder within it as the source for your unstructured data (PDF and Office files) that will be processed by the pipeline.