3d_generation.md

3D Generation

• 3D Generation
  • Survey
  • 3D Generation
  • Text To 3D
  • Image To 3D
  • 3D Editting
  • 3D Reconstruction
  • 4D Generation
  • Gaussian Splatting
  • Tutorials
  • Products
  • Misc

Survey

3D Generation

• Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoders, arXiv, 2412.17808, arxiv, pdf, cication: -1

  Rui Chen, Jianfeng Zhang, Yixun Liang, ..., Jiashi Feng, Ping Tan · (aruichen.github)

• Structured 3D Latents for Scalable and Versatile 3D Generation, arXiv, 2412.01506, arxiv, pdf, cication: -1

  Jianfeng Xiang, Zelong Lv, Sicheng Xu, ..., Xin Tong, Jiaolong Yang · (trellis3d.github) · (TRELLIS - Microsoft) · (huggingface)

• MV-Adapter: Multi-view Consistent Image Generation Made Easy, arXiv, 2412.03632, arxiv, pdf, cication: -1

  Zehuan Huang, Yuan-Chen Guo, Haoran Wang, ..., Yan-Pei Cao, Lu Sheng

• GaussianAnything: Interactive Point Cloud Latent Diffusion for 3D Generation, arXiv, 2411.08033, arxiv, pdf, cication: -1

  Yushi Lan, Shangchen Zhou, Zhaoyang Lyu, ..., Xingang Pan, Chen Change Loy · (GaussianAnything - NIRVANALAN)

• CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLM, arXiv, 2411.04954, arxiv, pdf, cication: -1

  Jingwei Xu, Chenyu Wang, Zibo Zhao, ..., Yi Ma, Shenghua Gao · (cad-mllm.github)

• The Scene Language: Representing Scenes with Programs, Words, and Embeddings

  · (scene-language - zzyunzhi)

• LLaMA-Mesh: Unifying 3D Mesh Generation with Language Models, arXiv, 2411.09595, arxiv, pdf, cication: -1

  Zhengyi Wang, Jonathan Lorraine, Yikai Wang, ..., Sanja Fidler, Xiaohui Zeng

• Wavelet Latent Diffusion (Wala): Billion-Parameter 3D Generative Model with Compact Wavelet Encodings, arXiv, 2411.08017, arxiv, pdf, cication: -1

  Aditya Sanghi, Aliasghar Khani, Pradyumna Reddy, ..., Kanika Madan, Hooman Shayani · (wala - autodeskailab) · (autodeskailab.github)

Text to 3D

• MARVEL-40M+: Multi-Level Visual Elaboration for High-Fidelity Text-to-3D Content Creation, arXiv, 2411.17945, arxiv, pdf, cication: -1

  Sankalp Sinha, Mohammad Sadil Khan, Muhammad Usama, ..., Sk Aziz Ali, Muhammad Zeshan Afzal

• DreamPolish: Domain Score Distillation With Progressive Geometry Generation, arXiv, 2411.01602, arxiv, pdf, cication: -1

  Yean Cheng, Ziqi Cai, Ming Ding, ..., Jie Tang, Boxin Shi

• Tencent Hunyuan3D-1.0: A Unified Framework for Text-to-3D and Image-to-3D Generation 🤗

  · (Hunyuan3D-1 - tencent) · (3d.hunyuan.tencent) · (qbitai)

Image to 3D

• Stable Point Aware 3D (SPAR3D) is a large reconstruction model based on SF3D 🤗

• StdGEN: Semantic-Decomposed 3D Character Generation from Single Images, arXiv, 2411.05738, arxiv, pdf, cication: -1

  Yuze He, Yanning Zhou, Wang Zhao, ..., Yong-Jin Liu, Xiao Han · (stdgen.github)

• GarVerseLOD: High-Fidelity 3D Garment Reconstruction from a Single In-the-Wild Image using a Dataset with Levels of Details, arXiv, 2411.03047, arxiv, pdf, cication: -1

  Zhongjin Luo, Haolin Liu, Chenghong Li, ..., Weikai Chen, Xiaoguang Han · (garverselod.github) · (arxiv)

• DreamCraft3D++: Efficient Hierarchical 3D Generation with Multi-Plane Reconstruction Model, arXiv, 2410.12928, arxiv, pdf, cication: -1

  Jingxiang Sun, Cheng Peng, Ruizhi Shao, ..., Bo Zhang, Yebin Liu · (dreamcraft3dplus.github)

• Large Spatial Model: End-to-end Unposed Images to Semantic 3D, arXiv, 2410.18956, arxiv, pdf, cication: -1

  Zhiwen Fan, Jian Zhang, Wenyan Cong, ..., Marco Pavone, Yue Wang · (largespatialmodel.github)

3D Editting

3D Reconstruction

• Reconstructing People, Places, and Cameras

• 3D Convex Splatting: Radiance Field Rendering with 3D Smooth Convexes, arXiv, 2411.14974, arxiv, pdf, cication: -1

  Jan Held, Renaud Vandeghen, Abdullah Hamdi, ..., Bernard Ghanem, Marc Van Droogenbroeck · (convexsplatting.github) · (𝕏)

• Quark: Real-time, High-resolution, and General Neural View Synthesis

  · (arxiv)

• SpectroMotion: Dynamic 3D Reconstruction of Specular Scenes, arXiv, 2410.17249, arxiv, pdf, cication: -1

  Cheng-De Fan, Chen-Wei Chang, Yi-Ruei Liu, ..., Yu-Chee Tseng, Yu-Lun Liu

4D Generation

• CAT4D: Create Anything in 4D with Multi-View Video Diffusion Models, arXiv, 2411.18613, arxiv, pdf, cication: -1

  Rundi Wu, Ruiqi Gao, Ben Poole, ..., Jonathan T. Barron, Aleksander Holynski · (cat-4d.github)

• GenXD: Generating Any 3D and 4D Scenes, arXiv, 2411.02319, arxiv, pdf, cication: -1

  Yuyang Zhao, Chung-Ching Lin, Kevin Lin, ..., Gim Hee Lee, Lijuan Wang · (gen-x-d.github)

• Tex4D: Zero-shot 4D Scene Texturing with Video Diffusion Models, arXiv, 2410.10821, arxiv, pdf, cication: -1

  Jingzhi Bao, Xueting Li, Ming-Hsuan Yang · (tex4d.github) · (Tex4D - ZqlwMatt)

Gaussian Splatting

• SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis, arXiv, 2411.16443, arxiv, pdf, cication: -1

  Hyojun Go, Byeongjun Park, Jiho Jang, ..., Soonwoo Kwon, Changick Kim · (gohyojun15.github)

• SplatFormer: Point Transformer for Robust 3D Gaussian Splatting, arXiv, 2411.06390, arxiv, pdf, cication: -1

  Yutong Chen, Marko Mihajlovic, Xiyi Chen, ..., Sergey Prokudin, Siyu Tang · (SplatFormer - ChenYutongTHU) · (sergeyprokudin.github)

• SplatFormer - ChenYutongTHU

  Point Transformer for Robust 3D Gaussian Splatting

• MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Views

• PF3plat - cvlab-kaist

  Pose-Free Feed-Forward 3D Gaussian Splatting

• FCGS - YihangChen-ee

Tutorials

Products

Misc

• MVPaint: Synchronized Multi-View Diffusion for Painting Anything 3D, arXiv, 2411.02336, arxiv, pdf, cication: -1

  Wei Cheng, Juncheng Mu, Xianfang Zeng, ..., Ziwei Liu, Liang Pan · (mvpaint.github) · (MVPaint - 3DTopia)

• blendify - ptrvilya