Data:
{
"text": "How much are you talking about? 10GB, 100GB, 1TB?\n\nYou might have a better luck with open source tools pointed out below who could support these operations. However, each has their own limitation as they might have different pace of development and priorities. If you are just experimenting with a few MB worth of data then I would definitely look using open source tools or building your own. It takes time but it is a lot of fun. You will understand how search works in-depth.\n\nWe are building Multimodal Search for high volume data companies at Joyspace AI. We have ready-to-use APIs and in-memory search engine for video, audio, and text data. Companies using our product have 25 GB data to start with and some have 5 TB+ volume data spread across multiple domains. I don't see why we can't support smaller volume of data. We are happy to look at your use case and see if it makes sense for you. Feel free to DM me.",
"label": "r/datascience",
"dataType": "comment",
"communityName": "r/datascience",
"datetime": "2024-05-22",
"username_encoded": "Z0FBQUFBQm5Lak1PRXItdTB2V25XN21uS0xHR0lneWZOd0NQX3pEYTVuV3V0UllIQS1nRS1iYlI3OUFkcVhCOExIY21fQUd4NDJ4cWM5YVBSU3Z3dzR6NWc5a3A3UTl0M2c9PQ==",
"url_encoded": "Z0FBQUFBQm5Lak9lcWI1Q0s1dmN1RFFlYmZhbFZCRTNpZ2N6ZDFFSGg3N3pyVGVBLVBfcUNHd3JJRTJJVlEzdzRzVFV5WnNrOHZ5aGQ1Y19nWEUyVUYzQW9WMVpyczRxVkxTQlVhTTlNVW1HcXNsX3lCYTRYNElMNnJSUFc5aVBCb0pPV3JMSjRfdUlMX3dXODNqaDN2aE9DQkJENmxwTUZYSEcyeVNmWEJGRXc5MGVRdkF6VzAxbjQ2T0pERTU3QzNKem0wbHdkZU5TbWx1VWpHUXFqbHJTZkZNSnMzV0xUUT09"
}