- Notifications
You must be signed in to change notification settings - Fork8
[ECCV 2024] This is the official implementation of HRMapNet, maintaining and utilizing a low-cost global rasterized map to enhance online vectorized map perception.
License
HXMap/HRMapNet
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
Xiaoyu Zhang1*,Guangwei Liu2*,Zihao Liu3,Ningyi Xu3,Yunhui Liu1✉️,Ji Zhao2#,
*Equal contribution.✉️Corresponding author.#Project lead
1 The Chinese University of Hong Kong,2 Huixi Technology,3 Shanghai Jiao Tong University
ArXiv Preprint (arXiv 2409.00620)
Accepted byECCV 2024
This project introduces HRMapNet, leveraging a low-cost Historical Rasterized Map to enhance online vectorized map perception.The historical rasterized map can be easily constructed from past predicted vectorized results and provides valuable complementary information.To fully exploit a historical map, we propose two novel modules to enhance BEV features and map element queries.For BEV features, we employ a feature aggregation module to encode features from both onboard images and the historical map.For map element queries, we design a query initialization module to endow queries with priors from the historical map.The two modules contribute to leveraging map information in online perception.Our HRMapNet can be integrated with most online vectorized map perception methods, significantly improving their performance on both the nuScenes and Argoverse 2 datasets.
hrmapnet.mp4
| Method | Epoch | APdiv | APped | APbou | mAP | Initial Map | Config | Download |
|---|---|---|---|---|---|---|---|---|
| MapTRv2+ HRMapNet | 24 | 67.4 | 65.6 | 68.5 | 67.2 | Empty | config | model |
| MapTRv2+ HRMapNet | 24 | 72.1 | 73.0 | 73.9 | 73.0 | Testing Map | config | model |
| MapTRv2+ HRMapNet | 24 | 86.2 | 81.0 | 83.6 | 83.6 | Training Map | config | model |
| MapTRv2+ HRMapNet | 110 | 72.7 | 72.2 | 75.7 | 73.5 | Empty | config | model |
- To get the best performance, please usea single GPU for validation.
- By default, the global map is constructed from empty with online perception results.
- In practice, a well-constructed global map can be provided for much better results.Here, we provide two pre-built map, using testing data or training data.Note they are tested with the same model without re-training.You can download the pre-built maps into the "maps" folder or build by yourself.
| Method | Epoch | APdiv | APped | APbou | mAP | Initial Map | Config | Download |
|---|---|---|---|---|---|---|---|---|
| MapTRv2 | 30 | 68.7 | 60.0 | 64.2 | 64.3 | - | config | model |
| MapTRv2+ HRMapNet | 30 | 71.4 | 65.1 | 68.6 | 68.3 | Empty | config | model |
- We change the sensor frequency to 2 Hz for both training and testing, the same as in nuScenes. Thus, the setting here is different from that in original Map TRv2.
Here we also provide results based on ourMapQR. This is not included in our paper.
| Method | Epoch | APdiv | APped | APbou | mAP | Initial Map | Config | Download |
|---|---|---|---|---|---|---|---|---|
| MapQR+ HRMapNet | 24 | 70.1 | 70.3 | 71.1 | 70.5 | Empty | config | model |
| MapQR+ HRMapNet* | 24 | 73.1 | 72.2 | 72.5 | 72.6 | Empty | config | model |
*Fix a bug in MapQR.
These settings are similar withMapTRv2
MapQR is mainly based onMapTRv2 andNMP.
It is also greatly inspired by the following outstanding contributions to the open-source community:BEVFormer,MapQR,BoundaryFormer.
If you find this project is useful in your research or applications,please consider giving us a star 🌟 and citing it by the following BibTeX entry.
@inproceedings{zhang2024hrmapnet,title={Enhancing Vectorized Map Perception with Historical Rasterized Maps},author={Zhang, Xiaoyu and Liu, Guangwei and Liu, Zihao and Xu, Ningyi and Liu, Yunhui and Zhao, Ji},booktitle={European Conference on Computer Vision},year={2024}}