Nature presents a captivating confluence of similarity and diversity.
Our new method 3D-Fauna learns a pan-category articulated 3D model of quadruped animals from Internet photos. At test time, it turns a single image into an animatable textured 3D mesh in a feed-forward pass.
🎠🎠 We're presenting MagicPony at CVPR!
It turns a photo of an animal into a fully articulated 3D model ready for animation. It is trained using just online images, without any 3D data, keypoints or template shapes.
Drop by our poster on Wed morning!
Let's turn photos of ancient "revolutionary" (rotationally symmetric) artefacts into 3D and rotate them, or even change the lighting!
Our model learns to de-render a single image of a vase into shape, albedo, material & lighting, from just a single-image collection.
#CVPR2021
I have passed my DPhil viva (defense) 🎓!
Four years flew by 💨 It is very sad to be leaving this wonderful place and so many lovely people
@Oxford_VGG
😢
Thank you the Best Advisors Andrea and
@chrirupp
who have shaped me into who I am today!
🕊️ DOVE: Learning Deformable 3D Objects by Watching Videos
Our method learns articulated 3D birds from only monocular videos, with automatically obtained masks and optical flow.
No keypoints, camera viewpoint or template shapes required!
Check the demo:
We are extremely honored to receive the Best Paper Award
#CVPR2020
!
I'd like to thank
@chrirupp
and Andrea for their enormous guidance and constant support all the way, especially when nothing actually worked after months.
Nature presents a captivating confluence of similarity and diversity.
Our new method 3D-Fauna learns a pan-category articulated 3D model of quadruped animals from Internet photos. At test time, it turns a single image into an animatable textured 3D mesh in a feed-forward pass.
Super excited to announce that our workshop proposal on Unsup3D: Unsupervised 3D Learning in the Wild has been accepted to
#ICCV2021
!
We're putting together an incredible line-up of talks! Stay tuned!
@ICCV_2021
Congrats to the team
@chrirupp
@NataliaNeverova
Paolo & Andrea
Announcing
@ICCV_2021
workshop on "Unsupervised 3D Learning in the Wild" with an incredible line-up of speakers on this topic!
#ICCV2021
🚩 Website:
📅 Time: 7:00-18:00 EDT / 12:00-23:00 BST, 11 Oct 2021
Calendar: (mark it down!)
Code released for our
#CVPR2020
oral paper on unsupervised single image 3D reconstruction!
We also host a demo website:
Visualize your faces or cats in 3D!
w/
@chrirupp
, Andrea Vedaldi
@Oxford_VGG
Schedule of the Neural Geometry and Rendering Workshop
#ECCV22
is now available:
This will happen in a hybrid mode on Monday Oct 24
@eccvconf
Mark it on your calendar:
And there is still TIME to participate in the CO3D Challenge!
🐎 Let the hooves pound!
Our new method Ponymation learns a generative model of 3D articulated animal motions from raw unlabeled Internet videos.
Page:
Paper:
Led by
@skq719
& Dor Litvak, w/
@zhang_yunzhi
Hongsheng Li
@jiajunwu_cs
Schedule of the Neural Geometry and Rendering Workshop
#ECCV22
is now available:
This will happen in a hybrid mode on Monday Oct 24
@eccvconf
Mark it on your calendar:
And there is still TIME to participate in the CO3D Challenge!
If you're in the niche NeRF / 3D reconstruction community, consider participating in the CO3D Challenge!
Open until Oct 20:
hosted with the Neural Geometry and Rendering workshop
@eccvconf
The Common Objects in 3D v2
#CO3Dv2
dataset is the next version of the first real-life dataset enabling large-scale 3D reconstruction of object categories. Together w/ the new version, we're also pleased to announce the CO3D challenge happening at
#ECCV22
!
Same as last year, I'll be sharing some hidden gems I found
#CVPR23
.
The first one is this really cool dataset of 3D broken objects 💔
It would be super cool if we could analyze the fracture patterns and infer fine-grained materials, or detect defects!
Latest trend in "self-supervised learning":
Abstract: we present a self-supervised method for ...
Somewhere on page 6: actually, we find it hard to train, so we pretrain on a SMALL set of labeled data
The Fundamental Matrix song by the creator Daniel Wedge and the mind-blowing
@CVPR
house band!
@yalesong
: "can you imagine Andrew Zisserman coming up to the stage and sing the song?"
@Oxford_VGG
Enjoy the full song:
Announcing
@ICCV_2021
workshop on "Unsupervised 3D Learning in the Wild" with an incredible line-up of speakers on this topic!
#ICCV2021
🚩 Website:
📅 Time: 7:00-18:00 EDT / 12:00-23:00 BST, 11 Oct 2021
Calendar: (mark it down!)
Glad to share the TPAMI journal extension of our CVPR2020 paper:
We added many interesting experiments providing insights on how the method works in various scenarios, as well as evaluations on 3D face benchmarks.
We are extremely honored to receive the Best Paper Award
#CVPR2020
!
I'd like to thank
@chrirupp
and Andrea for their enormous guidance and constant support all the way, especially when nothing actually worked after months.
Let the hooves pound and the wings flap!
Finally found some time to clean up the code for both 🎠 MagicPony and 🕊️ Dove:
(sadly these birds haven't grown wings just yet..)
🎠🎠 We're presenting MagicPony at CVPR!
It turns a photo of an animal into a fully articulated 3D model ready for animation. It is trained using just online images, without any 3D data, keypoints or template shapes.
Drop by our poster on Wed morning!
Cool papers I found
#CVPR2021
and didn't see on twitter 👇
"HistoGAN: Controlling Colors of GAN-Generated and Real Images via Color Histograms" by Afifi et al.
Let's turn photos of ancient "revolutionary" (rotationally symmetric) artefacts into 3D and rotate them, or even change the lighting!
Our model learns to de-render a single image of a vase into shape, albedo, material & lighting, from just a single-image collection.
#CVPR2021
The 4th CV4Animals workshop will take place at
#CVPR2024
in Seattle!
@CVPR
🦒🪼🐬🐿️🦩🐢🦘🦜🦥🦋
We invite submissions in 2 tracks:
- short 4-page unpublished work (potential invitation to IJCV Special Issue)
- published work
⏰ Deadline: March 27, 2024
Schedule of the Neural Geometry and Rendering Workshop
#ECCV22
is now available:
This will happen in a hybrid mode on Monday Oct 24
@eccvconf
Mark it on your calendar:
And there is still TIME to participate in the CO3D Challenge!
Following in
@jbhuang0604
's footsteps, I've set up some public office hours:
I might not be of much help, but will always be happy to chat about research (or anything really) and learn from each other.
Keep conversations going and perhaps even further!
Open Office Hours
I set aside some time each week to meet with *anyone* (preferably students from underrepresented groups tho).
Happy to chat about any topics that may be helpful.
10-min for each slot, but you can reserve multiple slots if needed.
@CSProfKGD
@elliottszwu
@CVPR
thanks, would also be great to meet, sent a dm, also I am at the coffee shop outside Hall C for the next 30 mins but will be leaving afterwards, will also be here tomorrow. I am wearing a green shirt
Send in your favorite animal papers to our CV4Animals workshop
@CVPR
by March 27!
🦒🪼🐬🐿️🦩🐢🦘🦜🦥🦋
Look forward to the exciting program and hope to see many animal enthusiasts in Seattle
#CVPR2024
!
Announcing
@ICCV_2021
workshop on "Unsupervised 3D Learning in the Wild" with an incredible line-up of speakers on this topic!
#ICCV2021
🚩 Website:
📅 Time: 7:00-18:00 EDT / 12:00-23:00 BST, 11 Oct 2021
Calendar: (mark it down!)
Organizing the first NYC vision workshop was super fun! Shout out to other organizers
@elliottszwu
@Haian_Jin
and especially
@Jimantha
for the generous support!
#icvss2019
Jitendra Malik gave a great talk
@icvss
covering the history of CV, with a substantial focus on unsupervised 3D. Our recent work recovers 3D from single images without even keypoints/masks, using the idea of shape from shading. Poster
#72
on Tue
Thanks AZ and
@vincesitzmann
for making it such an enjoyable viva!
And to my collaborators, labmates, friends, it's been an honor to have you!
Next step will be Stanford as a postdoc working with
@jiajunwu_cs
! Very sad departure but also a very exciting journey ahead!
"Self-Portraits"
Pareidolic faces are images in natural world on which we subconsciously cast a humanoid interpretation. These are moments we find ourselves in an unexpected encounter with another being. They are mirrors through which we see the images of ourselves as humans.
#ScholarPhi
is what I've been looking for years!
It peeps into symbol definitions, terms, and references inline in PDFs. Don't need to scroll all the way down to figure out the reference and forget where I was any more!
Demo looks amazing
Today at
#CHI2021
, I will be presenting a new project, "Augmenting Scientific Papers with Just-in-Time, Position-Sensitive Definitions of Terms and Symbols". You can catch it at 4pm PST today, 8am tomorrow, or at
Summary follows (1/8)
Announcing
@ICCV_2021
workshop on "Unsupervised 3D Learning in the Wild" with an incredible line-up of speakers on this topic!
#ICCV2021
🚩 Website:
📅 Time: 7:00-18:00 EDT / 12:00-23:00 BST, 11 Oct 2021
Calendar: (mark it down!)
Happy to be on the list of Top Reviewers
#NeurIPS
Reviewer awards have been one of the most mysterious ones. It's such a hard RL task with extremely sparse rewards. I'm very curious about the results of the review evaluation finally introduced this year.
So many great 3D papers in one single session (
#5
)
@ICCV_2021
and I could only attend so few of them!!
Very grateful some authors are still there even after 30 mins!
🌹 "People where you live ... grow five thousand roses in one garden ... And yet what they’re looking for could be found in a single rose." -- "The Little Prince" by Antoine de Saint-Exupery
Drop by our poster
#CVPR2023
on Tuesday morning!
What is a rose🌹visually? A rose is characterized by its intrinsics: the distribution of geometry, texture, material.
We learn a generative model that discovers object intrinsics from just a few instances in a single image - a task humans can do with ease.
#CVPR23
poster Tue AM
Together with
@MetaAI
, we're organizing an
#ECCV
workshop on Neural Geometry and Rendering with an incredible line-up of distinguished speakers!
@eccvconf
AND an exciting new Challenge on reconstructing common objects in 3D!
📢
🏆
In a nutshell, we exploit the rotational symmetry of these vases to learn the 3D shape, and introduce a Self-supervised Albedo Discriminator to recover realistic albedo under specular reflections.
See the full video:
@akanazawa
This is so great! I remember having to memorize thounsands of words that I never encounter afterwards and to pay them ~30 bucks just to send the scores to each school electronically 🤷♂️
Recent work with
@chrirupp
and Andrea Vedaldi on unsupervised learning of 3D objects. The model trained on real face images generalizes surprisingly well to paintings and abstract faces.
Video:
Learning weakly symmetric 3D objects from single-view images only, without any additional supervision, eg. multi-views, keypoints, or prior shape models etc, by
@elliottszwu
,
@chrirupp
and Andrea Vedaldi.
Paper:
Project:
Announcing
@ICCV_2021
workshop on "Unsupervised 3D Learning in the Wild" with an incredible line-up of speakers on this topic!
#ICCV2021
🚩 Website:
📅 Time: 7:00-18:00 EDT / 12:00-23:00 BST, 11 Oct 2021
Calendar: (mark it down!)
Surprised to find
#CVPR2021
cemera ready deadline to be Mar 26 (), which is 2 days after
#ICCV2021
sup. mat. deadline.
This sounds pretty stressful. Is it finalized?
@georgiagkioxari
New
#RSS2020
paper by
@TimYQTang
and coauthors on self-supervised cross-modality localisation.
We leverage cycle consistency for learning cross-modality SE(2) registration without GT pose or pose-aligned data, which allows vehicles to use satellite images for localisation.
This is such a great talk by
@Jimantha
! It's just so scientifically intriguing and inspiring that I couldn't stop looking into the mirror!
Highly recommend:
Schedule of the Neural Geometry and Rendering Workshop
#ECCV22
is now available:
This will happen in a hybrid mode on Monday Oct 24
@eccvconf
Mark it on your calendar:
And there is still TIME to participate in the CO3D Challenge!
Schedule of the Neural Geometry and Rendering Workshop
#ECCV22
is now available:
This will happen in a hybrid mode on Monday Oct 24
@eccvconf
Mark it on your calendar:
And there is still TIME to participate in the CO3D Challenge!
This paper analyzing physical impacts from transient surface wave imaging is also super cool!
It essentially allows you to localize impact from tiny surface vibrations observed behind the direct line of sight.
Great work by
@Desmond_pku
@MarkSheinin
et al
Excited to share our
#NeurIPS2022
work, cGOF, a NeRF-based conditional 3D face synthesis framework, which enables 3D controllability over the generated face images.
Poster:
📍Hall J
#240
⏰Tue 29 Nov 9 a.m. PST — 11 a.m. PST
Project:
@ursNwaldmann
@gengshanY
@annazama
Please consider contributing as a reviewer if you work on relevant fields of computer vision, biology, ecology, animal studies etc.:
Having a diverse set of expertise across various fields is absolutely crucial in this interdisciplinary topic.
As I'm finishing up the
#ICCV
reviews, I find this answer to the reproducibility question a bit awkward. I do not think that one line footnote of code promise makes me more believe its reproducibility.
Also, I miss the short rating justification. Now I add it to summary.
🏆 Congratulations to Taewan Ethan Kim on winning the the 1st place in the CO3D challenge on the "Many-view" track, and to
@zhizdev
on winning the 1st place in the "Few-view" track!
Schedule of the Neural Geometry and Rendering Workshop
#ECCV22
is now available:
This will happen in a hybrid mode on Monday Oct 24
@eccvconf
Mark it on your calendar:
And there is still TIME to participate in the CO3D Challenge!
@jbhuang0604
Aha they've evolved - group meetings. Interesting! How's that going?
I've had lots of fun with 1:1 conversations with such public hours. Curious to know if these group ones are even more fun.
@wjscheirer
I'm really curious to see how Motion 4 will be implemented. I voted yes (for its spirit), but I think there are many challenges in terms of implementation, which the proposal did not address.
@arkosiorek
I actually find it much easier to skim through the posters than watching the videos, especially when going though hundreds of papers and trying to decide in seconds whether to jump into the discussion or not.
Here are some comparisons with existing methods.
They use keypoints, camera viewpoint, template shapes, or (self-supervised) part segmentations for supervision.
I really like Shane Wighton's videos. They're like scientific reports, including motivation, methodology, results and ablations/backward analysis, but much more entertaining and also insightful.
It would be super cool to present papers in such a way 🙂
We will have an exciting line-up of talks across various disciplines to be announced soon (stay tuned)!
Co-organized with
@ursNwaldmann
@gengshanY
@annazama
and an amazing advising team!
Humans as Light Bulbs: reconstructing 3D humans from infrared radiation reflected off object surfaces
by
@ruoshi_liu
@cvondrick
Accidental Light Probes: recovering environment lighting from Coke cans
by
@Koven_Yu
and the team
Artwork by FrānkǎnLīsà ()
Visualizing pareidolic faces in 3D using our unsupervised machine learning model trained on human face images:
Preview version:
Have you ever wondered why papers from top universities/research labs often appear in the top few positions in the daily email and web announcements from arXiv?
Why is that the case? Why should I care?
3D-Fauna leverages pre-trained unsupervised image features from DINO and automatically learns a semantically-adaptive bank of base 3D shapes for all quadrupeds in a canonical space, from scratch, without relying on any category labels.
Also obviously the unspoken rule is that every CVPR paper must contain pictures of animals. If this is news to you and you're upset about your reviews, you know what to do.
This Kaleidoscopic Space Sculpting paper reminds me of the Infinity Mirror Rooms installation by Yayoi Kusama at Tate Modern.
A kaleidoscope consists of a camera looking at multiple mirrors. These mirror reflections can be used to sculpt complex 3D shapes.
Also thanks to other organizers for putting this together:
@chrirupp
@NataliaNeverova
Paolo & Andrea!
Hope it has been a rewarding full-day experience for all the attendees! Enjoy the rest of
@ICCV_2021
!
"Blocks-World Cameras" by Jongho Lee, Mohit Gupta
Probing block scene geometry with a pattern projector (I'm sure I've seen some similar ideas, let me know if you find them!)
#CVPR2020
Are there any instructions for authors during Q&A sessions?
Do we have control over the assigned Zoom rooms? How can we prevent it from being hijacked?
@CVPR
I've seen that happen at a workshop...
I'm sure
@CSProfKGD
knows as well :)