Row 78782

Row ID: 78782 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 78782 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Thanks for sharing the app but the problem is not TTS or Voice to text. The problem is time to first token. In my implementation, the model is running locally on an M2 Air, so to get the first set of tokens to start speech streaming takes time. Instead of a local LLM if you add Groq it will be way faster, near about the same time as the app you shared.

FieldValue
text Thanks for sharing the app but the problem is not TTS or Voice to text. The problem is time to first token. In my implementation, the model is running locally on an M2 Air, so to get the first set of tokens to start speech streaming takes time. Instead of a local LLM if you add Groq it will be way faster, near about the same time as the app you shared.
label r/openai
dataType comment
communityName r/OpenAI
datetime 2024-05-24
username_encoded Z0FBQUFBQm5Lak1rMW4yQ0ZadTdtOWtJcHFkMV9Tb1g2VFYtNFgzM3JWbXhGTWNUbUp1aXZhWmVFcHJxVFVVNlpUUGdLZ04wNThBLUpzRUt2M0FCRjhRcVpJZmM2NzQ2TzlXN1dZU1hHYndpWkZCWHE4RE1EY1k9
url_encoded Z0FBQUFBQm5Lak8xRUdyZGt6cDFkTzRhWks1TEFCLTdjd1p5VmNXQ19VbmphSmJOaVJzSVltZzRaQW9FRUJiOTNHYy1kUHhCWFEwemlCRHU2VmNZdExwMGM2WHBQcjFVU0tKSlNDUE91YWlYOWEtM0w4OXZiNElfcmJSakFsYkxQRkNwWWVNRFltdWsyNkhYV1J4SEw3OXRjQ1BqMjZVQi1tX2VzTXpReVJCQVpqT3FWMmtuUG1DOWNXeWN0QXNWZ1ItRXZvTXM1akF1SnprMnhrbFU0NHR6cG9TVUs2ZjktQT09

Raw Record

{
  "text": "Thanks for sharing the app but the problem is not TTS or Voice to text. The problem is time to first token. In my implementation, the model is running locally on an M2 Air, so to get the first set of tokens to start speech streaming takes time. Instead of a local LLM if you add Groq it will be way faster, near about the same time as the app you shared.",
  "label": "r/openai",
  "dataType": "comment",
  "communityName": "r/OpenAI",
  "datetime": "2024-05-24",
  "username_encoded": "Z0FBQUFBQm5Lak1rMW4yQ0ZadTdtOWtJcHFkMV9Tb1g2VFYtNFgzM3JWbXhGTWNUbUp1aXZhWmVFcHJxVFVVNlpUUGdLZ04wNThBLUpzRUt2M0FCRjhRcVpJZmM2NzQ2TzlXN1dZU1hHYndpWkZCWHE4RE1EY1k9",
  "url_encoded": "Z0FBQUFBQm5Lak8xRUdyZGt6cDFkTzRhWks1TEFCLTdjd1p5VmNXQ19VbmphSmJOaVJzSVltZzRaQW9FRUJiOTNHYy1kUHhCWFEwemlCRHU2VmNZdExwMGM2WHBQcjFVU0tKSlNDUE91YWlYOWEtM0w4OXZiNElfcmJSakFsYkxQRkNwWWVNRFltdWsyNkhYV1J4SEw3OXRjQ1BqMjZVQi1tX2VzTXpReVJCQVpqT3FWMmtuUG1DOWNXeWN0QXNWZ1ItRXZvTXM1akF1SnprMnhrbFU0NHR6cG9TVUs2ZjktQT09"
}
Explore Dataset Explore Row

Entry Information