Yanpei Cao
@yanpei_cao
Followers
1,050
Following
1,057
Media
37
Statuses
170
Head of Research @VastAIResearch @tripoai . Prev: Principal Researcher @TencentGlobal , Kuaishou (HKG:1024), CTO @OwliiTech (acq. by Kuaishou), @Tsinghua_Uni .
Earth
Joined June 2011
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
#BUS_KnockKnockKnock_Korat
• 177812 Tweets
#UFC307
• 142680 Tweets
Watch Sant RampalJi YouTube
• 130762 Tweets
Tennessee
• 114600 Tweets
Dodgers
• 112274 Tweets
Miami
• 88066 Tweets
Pereira
• 83005 Tweets
ドジャース
• 68815 Tweets
Khalil
• 54463 Tweets
Arkansas
• 39206 Tweets
Aldo
• 33921 Tweets
Ifigenia Martínez
• 30631 Tweets
Pennington
• 23256 Tweets
京都大賞典
• 23058 Tweets
Poatan
• 14637 Tweets
#PressConMGSongKhla25xENGLOT
• 11943 Tweets
Cam Ward
• 10462 Tweets
Canes
• 10220 Tweets
Good news! We've open-sourced our TGS (Triplane meets Gaussian Splatting) code on GitHub and uploaded the model to Hugging Face. Discover how the code and model can be helpful to your 3D GenAI research:
🔗 GitHub:
🔗 Hugging Face:
Play with our TGS (Triplane meets Gaussian Splatting) on the new Gradio demo!
Fast 3D generation from a single image and real-time online 3DGS viewing.
Get hands-on:
3
71
274
3
70
283
Play with our TGS (Triplane meets Gaussian Splatting) on the new Gradio demo!
Fast 3D generation from a single image and real-time online 3DGS viewing.
Get hands-on:
Check out TGS (Triplane meets Gaussian Splatting) for single-view 3D reconstruction!
Introducing a hybrid Triplane-Gaussian representation to achieve generalizable 3DGS.
The result? High-quality 3D from single images in mere tenths of a second!
🔗:
4
45
193
3
71
274
Proud to introduce TripoSR, our collaborative effort with
@StabilityAI
, setting a new benchmark in single-image 3D reconstruction.
Today we are releasing TripoSR in collaboration with
@tripoAI
. TripoSR is a new image-to-3D model capable of creating high quality outputs in less than a second.
Learn more here:
38
172
718
5
39
205
Check out TGS (Triplane meets Gaussian Splatting) for single-view 3D reconstruction!
Introducing a hybrid Triplane-Gaussian representation to achieve generalizable 3DGS.
The result? High-quality 3D from single images in mere tenths of a second!
🔗:
4
45
193
🚀 Excited to share our new
#SIGGRAPH2023
paper "NeRF-Texture", a novel method for capturing & synthesizing real-world textures with NeRFs from multi-view images.
Check it out 👉
#ComputerGraphics
#NeRF
#TextureSynthesis
2
34
166
Amidst the wave of cool 3DGS research, we're bringing a slightly different recipe, "VMesh", a hybrid volume-mesh representation, to
#SIGGRAPHASIA2023
.
Expect efficient rendering, compact storage, and high-fidelity geometry representation.
🔗
1
35
166
3D Gaussian Splattings are cool, dynamic 3D Gaussians are even cooler, and we make dynamic 3D Gaussians editable!
"SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes": our approach for high-fidelity, editable dynamic scenes.
🔗:
2
22
129
Code released:
3D Gaussian Splattings are cool, dynamic 3D Gaussians are even cooler, and we make dynamic 3D Gaussians editable!
"SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes": our approach for high-fidelity, editable dynamic scenes.
🔗:
2
22
129
2
21
105
@ThatRosaryGirl
@JohannJaegerson
@thecathguy
I just made a 3D model of your husband's anime figurine using Tripo ()
Get drafts in seconds and final models in 5 mins - currently free to try! Check it out, it's cool:
2
6
87
Thanks for the awesome work from
@MrForExample
🔥
Now you can incorporate TGS in your ComfyUI workflow👀
ComfyUI-3D-Pack:
TGS:
#ComfyUI
Integrated Triplane Gaussian Transformers into:
Now it support single image to 3DGS:
1
19
95
2
20
86
The code for training BakedAvatars and the real-time web demo is out!
Check it out:
Really excited about recent works in 3DGS for Human Avatars! Yet, there's still room for polygon rasterization with stronger graphics pipeline compatibility and better geometric fidelity.
At
#SIGGRAPHAsia2023
, we're introducing BakedAvatar - it achieves real-time rendering on
1
7
65
3
18
73
Really excited about recent works in 3DGS for Human Avatars! Yet, there's still room for polygon rasterization with stronger graphics pipeline compatibility and better geometric fidelity.
At
#SIGGRAPHAsia2023
, we're introducing BakedAvatar - it achieves real-time rendering on
1
7
65
The first 3D creation GPTs? 😋
Chat 3D into reality with Tripo!
0
10
61
Thanks
@_akhaliq
for sharing our work.
Text to relightable 3D asset generation is here!
With
#UniDream
, we're turning textual descriptions into realistic 3D objects with enhanced realism and relighting capabilities.
UniDream: Unifying Diffusion Priors for Relightable Text-to-3D Generation
paper page:
Recent advancements in text-to-3D generation technology have significantly advanced the conversion of textual descriptions into imaginative well-geometrical and finely
0
29
100
1
10
42
Code for our "NeRF-Texture" is now live on GitHub. Visit here👉
#NeRF
#SIGGRAPH2023
🚀 Excited to share our new
#SIGGRAPH2023
paper "NeRF-Texture", a novel method for capturing & synthesizing real-world textures with NeRFs from multi-view images.
Check it out 👉
#ComputerGraphics
#NeRF
#TextureSynthesis
2
34
166
2
14
41
Meet us at the Thursday PM session at 4:30pm
#029
!
We introduce an explicit 3D shape prior to CLIP-guided 3D optimization methods, generating imaginative 3D content with better visual quality and shape accuracy.
#CVPR2023
Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models
abs:
project page:
7
135
637
2
4
37
🚀 Excited to share
#threestudio
- A unified framework for 3D content generation!
🔗 Check it out: 🎉
🤝 Collaboration between Tsinghua University, Tencent ARC Lab, and Tencent AI Lab.
💡 Stay tuned for more!
#3D
#GenerativeAI
1
6
38
Thanks
@_akhaliq
for sharing our room-scale 3D generation project!
ShowRoom3D: Text to High-Quality 3D Room Generation Using 3D Priors
paper page:
introduce ShowRoom3D, a three-stage approach for generating high-quality 3D room-scale scenes from texts. Previous methods using 2D diffusion priors to optimize neural
1
22
118
0
7
38
Introducing Tripo, our 3D foundation model and 3D modeling tool.
Explore now:
#GenAI
#3D
#3dmodeling
Introduce Tripo, the advanced 3D Foundation Model.
👣
Tripo can generate textured 3D mesh models in 8 seconds. Moreover, refinement only takes 5 minutes, giving you 3D models that rival the quality of handcrafted ones with an impressive 95% success rate and beyond. 🚀
3
62
216
2
4
33
#NeurIPS2023
is coming! Delighted to present 𝗣𝗮𝗻𝗼𝗚𝗥𝗙:
1⃣ Elevates VR with 6DoF & tackles wide-baseline challenges
2⃣ Introduces Generalizable Spherical Radiance Fields for 360° prior
3⃣ Fuses 360° monocular depth & MVS for occlusion
🔗
A 🧵:
1
6
32
Huge congrats to the team and our collaborators!
Thrilled to share that 𝗮𝗹𝗹 (𝟲/𝟲) submissions from our VAST AI Research team made it to
#CVPR2024
!
Covering 𝗧𝗚𝗦, 𝗣𝗜𝟯𝗗, 𝗦𝗖-𝗚𝗦, 𝗪𝗼𝗻𝗱𝗲𝗿𝟯𝗗, 𝗘𝗽𝗶𝗗𝗶𝗳𝗳, and 𝗗𝗿𝗲𝗮𝗺𝗖𝗼𝗺𝗽𝗼𝘀𝗲𝗿. Kudos to the team & collaborators!
Details: (1/n)
3
4
25
0
0
19
VAST AI Research released model for Triplane Meets Gaussian Splatting on Hugging Face
Fast and Generalizable Single-View 3D Reconstruction with Transformers
model:
demo:
3
24
142
5
3
19
Appreciating the entire workflow’s stunning results! Proud to see Tripo’s
@tripoai
image-to-3D capabilities helped in creating the mesh.
Let’s continue shaping an unimaginable future together.
A generated mesh using an image made with Leonardo AI. The image was re-projected onto the mesh as the texture had lost some definition. The jawline is clearly not so successful here, but besides that this is a pretty crazy look at a very near future where AI gen works in 3D at a
21
88
682
1
3
16
NeRF-Texture will be part of the "Material Rendering" session on Wednesday (8/9) at 2pm in Petree Hall D. Looking forward to discussing our work and seeing you there! 😊
#SIGGRAPH2023
🚀 Excited to share our new
#SIGGRAPH2023
paper "NeRF-Texture", a novel method for capturing & synthesizing real-world textures with NeRFs from multi-view images.
Check it out 👉
#ComputerGraphics
#NeRF
#TextureSynthesis
2
34
166
1
2
14
Proud to have been part of this incredible journey with ARC Lab! It’s amazing to see how our AI has brought new life to such historic artifacts.
🌟 Harnessing Tech for Good: ARC Lab is thrilled to be a part of the team integrating cutting-edge AI to restore a stunning 4,500-year-old statue.
#TechForGood
#Innovation
#tencent
#ARCLab
0
3
11
0
1
10
Excited to share our
#CVPR2023
paper SurfelNeRF! We introduce a novel approach to online photorealistic reconstruction of indoor scenes.
Project page: .
Don't miss our poster at Tuesday AM session, TUE-AM-011.
0
1
10
Amazing work 4D-fy!🎉 It's fantastic to see threestudio contributing to such incredible 4D generation work. Seems it's time for a dimensionality expansion for threestudio too - t̶h̶r̶e̶e̶34studio? 😆
📢📢📢 thrilled to announce "𝟒𝐃-𝐟𝐲: 𝐓𝐞𝐱𝐭-𝐭𝐨-𝟒𝐃 𝐆𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐨𝐧 𝐔𝐬𝐢𝐧𝐠 𝐇𝐲𝐛𝐫𝐢𝐝 𝐒𝐜𝐨𝐫𝐞 𝐃𝐢𝐬𝐭𝐢𝐥𝐥𝐚𝐭𝐢𝐨𝐧 𝐒𝐚𝐦𝐩𝐥𝐢𝐧𝐠"
Way to start
@sherwinbahmani
🎉
PhD co-advised with
@DaveLindell
at
#UofT
.
11
80
391
1
0
10
Exciting times for DreamAvatar! Pushing the boundaries yet again in controllable 3D avatar generation. 𝐀𝐧𝐝 𝐠𝐫𝐞𝐚𝐭 𝐧𝐞𝐰𝐬 – 𝐭𝐡𝐞 𝐜𝐨𝐝𝐞 𝐢𝐬 𝐧𝐨𝐰 𝐚𝐯𝐚𝐢𝐥𝐚𝐛𝐥𝐞! A huge hats off to the team
@yukangcao
,
@kaihan_vis
, for elevating this project to new heights!
💃Glad to re-introduce DreamAvatar!💃
DreamAvatar was the first to generate controllable 3D avatars via diffusion models.
We are now happy to bring it to a higher level!
- Project:
- Code:
- arXiv:
0
19
121
0
0
8
The new extension system for threestudio is here! It marks the start of an even more collaborative workflow. Eager to see the diverse 3D Generative AI tech our community will bring 👀
Link:
Excited to announce that threestudio now supports an extension system: . This is just the beginning 🚀. We aim to update various 3D representations and diffusion models with the power of the 3D generation community 💪. Let's build the future together!
1
7
31
0
0
7
@camenduru
@replicate
A small tip: on A100s you may consider adjusting the "chunk-size" argument to 0, and it will run at around 0.5s per 3D model 😁
0
0
5
@NickADobos
@Kwebbelkop
If you're looking for "image to 3D", Tripo () might be a handy tool.
Quick drafts in seconds, final models in 5 mins. Currently free to try!
See how it works on one of your figurines:
0
0
5
threestudio now supports mesh export⚡️
You can now export meshes from threestudio! 🔥
Use your generated 3D assets in 3D editing tools, game engines, VR/AR scenes ...
Enjoy 👇
3
16
60
0
0
4
ProlificDreamer is already in threestudio!👇 Shout out to
@superbennyguo
@ChengLu05671218
ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation
propose to model the 3D parameter as a random variable instead of a constant as in SDS and present variational score distillation (VSD), a principled particle-based variational
5
53
268
0
0
3
0
0
2
👀
can’t imagine that I even thought about bringing every cutting-edge technique into threestudio🤯 good news is threestudio is making a change so that we can keep unifying all the great works in one framework 😉 stay tuned!
0
2
23
0
0
2
Amazing work Lucas
@bioinfolucas
!
I created a cool JRPG3d AI scene while playing with
@tripoai
this holiday. It's probably the best 3dAI tool I had tried until the moment:
Midjourney concept-> TripoAI -> models/meshes
Midjourney -> marigold(depth maps) -> scenario
Mixamo -> animation
#GodotEngine
-> scene.
4
4
38
0
0
2
Just tried out Tripo for myself and here are a few 3D models I generated. Check them out!
1
0
2
@poolio
😄 Indeed, threestudio could use some steroids to keep pace!
Any cool features or ideas you're hoping we'll add soon?
0
0
1
0
0
1
0
0
1
@taneemishere
Thanks for the interest! We’re working hard on finalizing the code for release. Stay tuned, it’s indeed coming soon!
1
0
1
@yoshi25133
Thanks for the kind words! You're right; it's a top hat 3D model with NeRF texture. Great spot!
0
0
1
“a DSLR photo of a blue jay standing on a large basket of rainbow macarons.”
1
0
1
“a DSLR photo of a robot and dinosaur playing chess, high resolution.”
1
0
1
@YarivLior
Looks fantastic! Really impressed with the simplicity and effectiveness of the 3D representation.
0
0
1
@janusch_patas
Thank you for sharing our work! Also, just wanted to let you know that the list of 3DGS is extremely helpful! 🔥
1
0
1
@MrForExample
Thanks for bringing TGS into ComfyUI! Merging 3D workflows into ComfyUI is indeed exciting and holds great potential. We've had similar thoughts and would love to explore this further.
Perhaps, we could collaborate on enhancing 3D capabilities in ComfyUI together?
1
0
1