sync.labs (YC W24)
@synclabs_so
Followers
3,244
Following
0
Media
25
Statuses
77
crafting magic ⚡ shoot the perfect video in a single take lipsync-1+ apis @ join our discord @ 🛠️ by the creators of wav2lip
San Francisco, CA
Joined July 2023
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
seokjin
• 869658 Tweets
#THEFIRSTTAKE_SB19第2弾
• 101126 Tweets
#海のはじまり
• 92958 Tweets
Judge Cannon
• 92748 Tweets
Jack Smith
• 77202 Tweets
Morning Joe
• 68681 Tweets
キィニチ
• 50153 Tweets
UVERworld
• 44696 Tweets
あんスタ
• 43349 Tweets
Coolock
• 37664 Tweets
海ちゃん
• 32515 Tweets
Ford Foundation
• 31305 Tweets
夏休みキャンペーン
• 25757 Tweets
ジンくん
• 19995 Tweets
#たまみだいすこ
• 19811 Tweets
CHK CHK BOOM MV TEASER 2
• 19447 Tweets
#StrayKids_ATE_D3
• 18896 Tweets
BLEND AND BREW X NORAWIT
• 16388 Tweets
gracie
• 15026 Tweets
11th Circuit
• 14830 Tweets
田中れい
• 14462 Tweets
#幸せになってほしかったキャラ挙げろ
• 11457 Tweets
Mase
• 11431 Tweets
Museum Card
• 10499 Tweets
Jay Slater
• 10199 Tweets
Last Seen Profiles
Pinned Tweet
⚡today we're launching lipsync-1.7.0-beta
an experimental state-of-the-art video-to-video lipsync model that generates more natural teeth and accurate skin tones
also generates ~1.5x faster than 1.6.0 and ~2x faster than 1.6.1 👀
available now – also through our new discord
2
25
96
⚡ launch + monetize your own AI dubbing app in <30 mins
drop a YouTube link + translate videos w/ perfect lip-sync
curious? we open sourced the whole repo 🚀
try it out / clone it here 👇
21
45
276
⚡️its official: we got into
@ycombinator
🙏
the last 4 weeks have been a blessing
yc w24 + 2 world renowned professors joining as advisors + 6k dev signups / 120+hrs of video generated in a single month
and we're just getting started
curious? check out what else is new👇
23
7
210
⚡️introducing visual dubbing w/ sync.
our api syncs the lips in a video to a new dubbed audio track – no more bad / misaligned dubs
now everyone can experience content like it was made for them in their native language
check out who we are + how it works 👇🧵
15
11
106
⚡launch your own AI dubbing app w/ lipsync in <30mins — now w/
@replit
our OSS repo is powerful, but complex
so we launched a repl — no devops, minimal setup 🚀
where we're born should never hold us back – we're making tools like this more accessible to everyone, everywhere👇
7
13
62
⚡ introducing sync-v1.5.0 – a stable model w/ premium lipsync across high angles / side profiles
available to all users now :)
this week we also:
- open sourced an AI dubbing app 🌍
- launched sync-v1.5.1-beta: an experimental build w/ more natural lip shapes / skin tones
-
6
5
56
⚡we launched a major speedup – lipsync a 15 min video < 45 mins
over the last week we also:
- launched an open source repl for AI dubbing w/ lipsync
- revamped our dev docs + API experience
- upgraded limits on file size and length (1hr max, up from 5 mins) 💪
we rebuilt our
6
8
53
⚡️in the last 2 weeks 3000+ devs used our api / playground to lipsync over 6000+ videos
this is up from 1k devs / 2k vids since our last changelog
this sprint we're rolling out an updated model w/ higher lipsync accuracy + fewer artifacts
check out what else is new👇
7
2
50
⚡lipsync-1.5-beta is live
the past few weeks were wild:
– our team moved to SF + setup the hacker house
– kicked off
@ycombinator
w24 batch
– launched an updated lipsync model + subscriptions
– crossed 10k+ users / 160hrs+ generated weekly 🚀
catch up w/ us in sync.log 004 👇
2
5
46
here’s how it works:
[1] transcribe + translate video w/
@gladia_io
[2] clone the speakers voice + generate tts w/
@elevenlabsio
[3] lipsync video to translated audio w/
@synclabs_ai
[4] get paid over the internet w/
@stripe
[5] deploy in <15 mins w/
@vercel
+
@supabase
1
2
24
🚀 quick ship: sync-1.5 in beta
just released beta access to an updated lipsync model
~40% better lipsync accuracy + reduced bounding box artifact
try it out 👇
4
1
23
a simple, aesthetic update :)
check our new landing page 👀
1
3
23
clone the repo / launch for yourself here:
1
0
19
talk to José Mourinho through the magic of sync! ⚽️
sync x snickers x t&pm and helo
2
7
19
powered by:
@Replit
– deployment / devops
@gladia_io
– transcription / translation
@elevenlabsio
– voice cloning + TTS
@stripe
– payments
@inngest
– queueing / orchestration
and
@syncdotso
for lipsync :)
hopefully we're one step closer to dissolving the language barrier 🌍
0
0
14
try it out for yourself and let us know what you think
if you have any questions join our slack channel / raise an issue on github
o/w – just dm
@therealprady
:)
1
1
14
try it out here – your first 5 mins are free:
1
0
13
we're excited to have
@therealprady
give a sneak peak of our new synchronizer model tomorrow
we've been busy building, but we're looking forward to showing you all the fruit of our labor
see you soon.
In the 16th session of
#MultimodalWeekly
, we have two exciting speakers who will share their work in LLM research and video AI👇
1
0
1
0
3
11
sync-1.7.0 can bring new life to old content
charlie chaplin was able to finally find his voice 🎩
lipsync any content using our simple web playground 🪄🛝
0
1
10
upload your video / translated audio + lip-sync the speaker to the new audio track
your first 5 mins of video generation every month is free
sign up here:
check how how I translate + visually dub Tim Ferris into Spanish
1
0
8
imagine a world where any video and any character can be repurposed + remixed to tell entirely new stories
eg. helping charlie chaplin find his voice 📣
0
1
8
check out the repl:
2
0
8
huge shoutout to
@atbeme
+
@noahmilberger
for hacking this together 🚀
special things happen when you work w/ special people 🙏
3
1
7
most lipsync models can't do side angles / profiles very well
our models are learning accurate sync from multiple angles – moving beyond a talking head looking into a camera
1
0
7
check out the teeth – better formed, and fewer weird artifacts at the edges
more natural to the subject, not generic like older models
2
0
7
another huge shoutout to
@mhadimedia
insane creative work + storytelling w/ an incredible work ethic
2
1
6
deploy it here:
1
0
6
⚠️ our production servers are currently down
we saw suspicious activity on our cloud account, we're taking precautions / making changes we're debugging now
we should have the service back up soon. will keep y'all up to date.
appreciate your patience 🙏 we're all hands on deck
3
0
5
heres a link to try it out:
your first 5 mins are free :)
0
0
3
check out
@therealprady
+ our founding story
tldr:
sync. is short for synchronicity.labs 🤔
ATTENTION HEADS – EP 9.0
@0xSamHogan
and I sit down with
@therealprady
, cofo + CEO of Sync, a real time lip-syncing API.
We discuss:
- Personalized ads
- Challenges of building a foundational model
- The paper I saw but didn’t read (a model to detect smells)
LINK ->
3
0
27
0
0
3
we're back online 👌
seeing a few users in different geos still not able to upload audio / video pairs to our app
we have a workaround in the discord^ if you're affected join and we'll help you out
0
0
2