Is There an Existing Issue for This?

• I have searched the existing issues

Where do you intend to apply this feature?

Instill Cloud, Console

Is your Proposal Related to a Problem?

Instill’s powerful building blocks enable users to bring their crazy ideas to life. However, the diversity of data formats and workflows poses a challenge. For instance, in my astrophysics project, I need to use the HDF5 data format, which is not supported by Instill's pipeline. While the new Instill Artifact can handle various unstructured data types, it doesn’t support HDF5. Given the constraints on resources, it’s understandable that supporting every data format isn’t feasible. Therefore, a component that facilitates custom data input conversion would greatly enhance the usability and flexibility of Instill for diverse projects.

Describe Your Proposed Solution

I've developed a pipeline to convert unstructured HDF5 data into AI-usable JPG images and another process to convert these images into 3D point clouds. This work was time-consuming and I would love to publish my work out there so that people with the same demand wouldn't need to repeat the whole exploring steps all over again. So, I'm wondering if there could be a component that allows users to customize their data input and upload their conversion processes. Eg. a component that enables HDF5-to-JPG or IMG2PointCloud or even Epub2Pdf conversion.

Highlight the Benefits

This will allow the Instill Cloud to be more flexible and attract more use cases even if some of the features aren't existed on the platform yet.

Anything Else?

This is a little demo of what the conversion looks like, from slicing HDF5 to 2D images and eventually stack them back together and visualize as 3D point clouds.