Live Translation Captioning

[thetownrapist]

Hello,

I’m trying to cater to a broader audience and live captioning in a translated language would be perfect, as many French people watch my stream.

I’ve found this website
https://webcaptioner.com/captioner

It recognizes my voice really well (probably using google translate api) and starts a new line whenever I make a pause, which is perfect for captioning, but it doesn’t feature a live translation functionality.

Is there a way of adding this functionality?
If impossible, is there any workaround to get a similar result?

In the best case scenario I’d get a webhook I could add as browser source on OBS that translates everything I say in the language I want.

I think it’d be a great idea for a team to develop such a tool.
It’d greatly increase the accessibility of live streamer’s content.

[Dist]

One option to consider is the Stream Closed Captioner extension, by @talk2megoosman https://dashboard.twitch.tv/extensions/h1ekceo16erc49snp0sine3k9ccbh9-1.4.2 I believe that does language translations.

[talk2megoosman]

Yep my extension is designed to do what your looking for. Challenge faced for any solution that wants to do translations is cost. You can find free solutions to do Speech to Text but if you want to have that then translated, you will have to pay to do that.

[thetownrapist]

Actually I found a piece of software that does both for free and works almost perfectly

Only downside the software is entirely written in Japanese

But with some tweaks it can translate any language to any other language (within the limits of Gtranslate)

I’d be maybe rude if I gave out its name as you just advertised your own code, not sure what to do.

[S0und]

@thetownrapist give it out, it’s not your fault if a free app outperforms something that cost money. IF the free app is actually better or as good as.

Honestly the best option would be google’s Live Transcribe app WITH translation. That app is dead on.