RT @bjo3rn: Also today at #UIST2024, see @cvachha and team's poster on Dreamcrafter, a VR-based 3D scene editing system for radiance fields…

@parastooabtahi @PrincetonHCI Thank you @parastooabtahi, I'm excited to join the lab this fall and I'm looking forward to my time at Princeton!

Thank you @bjo3rn for all your excellent guidance and mentorship throughout my time at Berkeley!

RT @nerfstudioteam: 🎉 V1.0.0 officially released! * New splatfacto model, nerfstudio's implementation of Gaussian splatting * Complete rew…

From Berkeley, CA to #SIGGRAPH2023 Check out the Nerfstudio talk at @siggraph! Render created with @nerfstudioteam Blender VFX Add-on #vfx #blender #NeRF #neuralrendering #nerfstudio

Experimenting with compositing NeRFs over real footage using @nerfstudioteam Blender VFX Add-on and the Tracky motion tracking system.  I composited multiple Nerfstudio NeRF renders and used Tracky to camera track the NeRFs over footage. #NeRF #vfx #blender #b3d #neuralrendering

This is really helpful! The app requires a LiDAR sensor on iPhone, but I was able to get this running on my iPhone SE by removing references to the segmentation and depth videos in the Xcode files and Blender script. Looking forward to using this for NeRF composites.

@NMDdesign @nerfstudioteam Using the Nerfstudio Blender VFX add-on, you can select the NeRF representation as a point cloud/mesh and the script takes the transform, FOV, and properties of the Blender camera and returns the corresponding Nerfstudio json camera path. Documentation:

@SurrealJoe @nerfstudioteam I expect that within this year there will be a proper way to view NeRFs in VR. NVIDIA Instant NeRF supports VR but requires a strong GPU. There is research going on and given recent realtime rendering methods from LumaLabsAI and Google, I expect that this will be possible soon.

@gaikowzki @nerfstudioteam There is currently research and work being done to do this, and there is a startup @VolingaAI which allows for importing and viewing NeRFs in realtime into Unreal Engine.

@SanxRoz @nerfstudioteam Thank you, this uses Nerfstudio's Blender VFX add-on which allows for compositing meshes and NeRF renders by generating a camera path to align them. NeRFs are rendered from Nerfstudio and shadows are from meshed NeRFs in Blender.

@nickfloats Using the Nerfstudio Blender VFX add-on and compositing NeRF renders in the scene using meshed NeRFs in Blender as reference. I rendered the cropped NeRF and the accumulation in Nerfstudio to mask it when compositing. Shadows are from Blender meshes.

@nickfloats @nerfstudioteam This is using the Nerfstudio Blender VFX add-on which helps composite meshes or NeRFs into the scene by generating a camera path relative to a NeRF representation (point cloud/mesh) in the Blender scene to render in Nerfstudio. Here is the documentation:

Super excited to announce this! Looking forward to seeing what new forms of visual effects can be created with NeRFs. Lots of potential with compositing, greenscreen, and more.

NeRF of Lego Bonsai Tree (both variants) using @LumaLabsAI #NeRF #neuralrendering #LEGOBuildDay #lego

Compositing virtual Legos over a NeRF captured with @LumaLabsAI using Blender. NeRF backgrounds and motion tracking can allow for new interesting camera movements and realism for VFX. #neuralrendering #nerf #blender #vfx

@existencefee @LumaLabsAI It is possible to composite greenscreen footage into a NeRF (@CorridorDigital showed excellent examples of this). Regarding the relighting of a person, a possible option is to use neural relighting (ex. Google's Total Relighting) over HDR 360 renders of the NeRF per frame.