1. Bhalgat, Y., Laina, I., Henriques, J.F., Zisserman, A., Vedaldi, A.: Contrastive lift: 3d object instance segmentation by slow-fast contrastive fusion. arXiv preprintarXiv:2306.04633 (2023)

2. Byravan, A., et al.: Nerf2real: sim2real transfer of vision-guided bipedal motion skills using neural radiance fields. In: 2023 IEEE International Conference on Robotics and Automation (ICRA), pp. 9362–9369. IEEE (2023)

   Google Scholar 

3. Cheng, B., Misra, I., Schwing, A.G., Kirillov, A., Girdhar, R.: Masked-attention mask transformer for universal image segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1290–1299 (2022)

   Google Scholar 

4. Dai, A., Chang, A.X., Savva, M., Halber, M., Funkhouser, T., Nießner, M.: Scannet: richly-annotated 3d reconstructions of indoor scenes. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5828–5839 (2017)

   Google Scholar 

5. De Brabandere, B., Neven, D., Van Gool, L.: Semantic instance segmentation with a discriminative loss function. arXiv preprintarXiv:1708.02551 (2017)

6. Deng, N., et al.: Fov-nerf: foveated neural radiance fields for virtual reality. IEEE Trans. Visual Comput. Graph.28(11), 3854–3864 (2022)

   Article  Google Scholar 

7. Fan, Z., Wang, P., Jiang, Y., Gong, X., Xu, D., Wang, Z.: Nerf-sos: any-view self-supervised object segmentation on complex scenes. arXiv preprintarXiv:2209.08776 (2022)

8. Fathi, A., et al.: Semantic instance segmentation via deep metric learning. arXiv preprintarXiv:1703.10277 (2017)

9. Fu, X., et al.: Panoptic nerf: 3d-to-2d label transfer for panoptic urban scene segmentation. In: 2022 International Conference on 3D Vision (3DV), pp. 1–11. IEEE (2022)

   Google Scholar 

10. Kerr, J., Kim, C.M., Goldberg, K., Kanazawa, A., Tancik, M.: Lerf: language embedded radiance fields. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 19729–19739 (2023)

    Google Scholar 

11. Kirillov, A., He, K., Girshick, R., Rother, C., Dollár, P.: Panoptic segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9404–9413 (2019)

    Google Scholar 

12. Kirillov, A., et al.: Segment anything. arXiv preprintarXiv:2304.02643 (2023)

13. Kobayashi, S., Matsumoto, E., Sitzmann, V.: Decomposing nerf for editing via feature field distillation. Adv. Neural. Inf. Process. Syst.35, 23311–23330 (2022)

    Google Scholar 

14. Kong, S., Fowlkes, C.C.: Recurrent pixel embedding for instance grouping. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 9018–9028 (2018)

    Google Scholar 

15. Kundu, A., et al.: Panoptic neural fields: a semantic object-aware neural scene representation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 12871–12881 (2022)

    Google Scholar 

16. Li, C., Li, S., Zhao, Y., Zhu, W., Lin, Y.: Rt-nerf: real-time on-device neural radiance fields towards immersive ar/vr rendering. In: Proceedings of the 41st IEEE/ACM International Conference on Computer-Aided Design, pp. 1–9 (2022)

    Google Scholar 

17. Li, Z., Li, L., Zhu, J.: Read: large-scale neural scene rendering for autonomous driving. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 37, pp. 1522–1529 (2023)

    Google Scholar 

18. Liang, S., Huang, C., Tian, Y., Kumar, A., Xu, C.: Av-nerf: learning neural fields for real-world audio-visual scene synthesis. Adv. Neural Inf. Process. Syst.36 (2024)

    Google Scholar 

19. Liu, Y., Hu, B., Huang, J., Tai, Y.W., Tang, C.K.: Instance neural radiance field. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 787–796 (2023)

    Google Scholar 

20. Mascaro, R., Teixeira, L., Chli, M.: Diffuser: multi-view 2d-to-3d label diffusion for semantic scene segmentation. In: 2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 13589–13595. IEEE (2021)

    Google Scholar 

21. Mescheder, L., Oechsle, M., Niemeyer, M., Nowozin, S., Geiger, A.: Occupancy networks: learning 3d reconstruction in function space. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4460–4470 (2019)

    Google Scholar 

22. Mildenhall, B., Srinivasan, P.P., Tancik, M., Barron, J.T., Ramamoorthi, R., Ng, R.: Nerf: representing scenes as neural radiance fields for view synthesis. Commun. ACM65(1), 99–106 (2021)

    Article  Google Scholar 

23. Mirzaei, A., Kant, Y., Kelly, J., Gilitschenski, I.: Laterf: label and text driven object radiance fields. In: European Conference on Computer Vision, pp. 20–36. Springer, Heidelberg (2022).https://doi.org/10.1007/978-3-031-20062-5_2

24. Novotny, D., Albanie, S., Larlus, D., Vedaldi, A.: Semi-convolutional operators for instance segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 86–102 (2018)

    Google Scholar 

25. Oechsle, M., Peng, S., Geiger, A.: Unisurf: unifying neural implicit surfaces and radiance fields for multi-view reconstruction. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 5589–5599 (2021)

    Google Scholar 

26. Park, J.J., Florence, P., Straub, J., Newcombe, R., Lovegrove, S.: Deepsdf: learning continuous signed distance functions for shape representation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 165–174 (2019)

    Google Scholar 

27. Sharma, P., et al.: Neural groundplans: persistent neural scene representations from a single image. In: International Conference on Learning Representations (2023)

    Google Scholar 

28. Siddiqui, Y., et al.: Panoptic lifting for 3d scene understanding with neural fields. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9043–9052 (2023)

    Google Scholar 

29. Sitzmann, V., Rezchikov, S., Freeman, B., Tenenbaum, J., Durand, F.: Light field networks: neural scene representations with single-evaluation rendering. Adv. Neural Inf. Process. Syst. (NeurIPS)34, 19313–19325 (2021)

    Google Scholar 

30. Sitzmann, V., Zollhöfer, M., Wetzstein, G.: Scene representation networks: continuous 3d-structure-aware neural scene representations. Adv. Neural Inf. Process. Syst.32 (2019)

    Google Scholar 

31. Straub, J., et al.: The replica dataset: a digital replica of indoor spaces. arXiv preprintarXiv:1906.05797 (2019)

32. Tschernezki, V., Laina, I., Larlus, D., Vedaldi, A.: Neural feature fusion fields: 3d distillation of self-supervised 2d image representations. In: 2022 International Conference on 3D Vision (3DV), pp. 443–453. IEEE (2022)

    Google Scholar 

33. Tschernezki, V., Larlus, D., Vedaldi, A.: Neuraldiff: segmenting 3d objects that move in egocentric videos. In: 2021 International Conference on 3D Vision (3DV), pp. 910–919. IEEE (2021)

    Google Scholar 

34. Ulku, I., Akagündüz, E.: A survey on deep learning-based architectures for semantic segmentation on 2d images. Appl. Artif. Intell.36(1), 2032924 (2022)

    Article  Google Scholar 

35. Wang, B., Chen, L., Yang, B.: Dm-nerf: 3d scene geometry decomposition and manipulation from 2d images. arXiv preprintarXiv:2208.07227 (2022)

36. Wang, P., Liu, L., Liu, Y., Theobalt, C., Komura, T., Wang, W.: Neus: learning neural implicit surfaces by volume rendering for multi-view reconstruction. arXiv preprintarXiv:2106.10689 (2021)

37. Wu, Q., et al.: Object-compositional neural implicit surfaces. In: European Conference on Computer Vision, pp. 197–213. Springer, Heidelberg (2022).https://doi.org/10.1007/978-3-031-19812-0_12

38. Wu, Q., Wang, K., Li, K., Zheng, J., Cai, J.: Objectsdf++: improved object-compositional neural implicit surfaces. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 21764–21774 (2023)

    Google Scholar 

39. Xie, C., Park, K., Martin-Brualla, R., Brown, M.: Fig-nerf: figure-ground neural radiance fields for 3d object category modelling. In: 2021 International Conference on 3D Vision (3DV), pp. 962–971. IEEE (2021)

    Google Scholar 

40. Xu, J., Liu, S., Vahdat, A., Byeon, W., Wang, X., De Mello, S.: Open-vocabulary panoptic segmentation with text-to-image diffusion models. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2955–2966 (2023)

    Google Scholar 

41. Yariv, L., Gu, J., Kasten, Y., Lipman, Y.: Volume rendering of neural implicit surfaces. Adv. Neural. Inf. Process. Syst.34, 4805–4815 (2021)

    Google Scholar 

42. Yariv, L., et al.: Multiview neural surface reconstruction by disentangling geometry and appearance. Adv. Neural. Inf. Process. Syst.33, 2492–2502 (2020)

    Google Scholar 

43. Zhao, X., et al.: Contrastive learning for label efficient semantic segmentation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10623–10633 (2021)

    Google Scholar 

44. Zhi, S., Laidlow, T., Leutenegger, S., Davison, A.J.: In-place scene labelling and understanding with implicit scene representation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 15838–15847 (2021)

    Google Scholar 

45. Zhou, X., Girdhar, R., Joulin, A., Krähenbühl, P., Misra, I.: Detecting twenty-thousand classes using image-level supervision. In: European Conference on Computer Vision, pp. 350–368. Springer, Heidelberg (2022).https://doi.org/10.1007/978-3-031-20077-9_21

Download references