Text-based 3D Animal Fine-Grained Retrieval (TextANIMAR)
The main objective of this challenge is to leverage artificial intelligence research on 3D animal models. The rapid development of 3D technologies produced a markable number of 3D models. Therefore, 3D model retrieval has drawn significant attention and is beneficial in real-life demands, such as video games, arts, films, and virtual reality. Compared with searching 3D general objects of a given category, 3D animal model fine-grained retrieval is much more challenging due to the large discrepancy of animal breeds and poses.
This track proposes a realistic and promising setting for 3D animal model fine-grained retrieval, which aims to search for relevant 3D animal models from a dataset using sentences inputted by users. It can help users to get access to 3D models quickly by natural descriptions.
January 2, 2023: Track announcement
January 25, 2023: Preliminary training data released [Download]
February 15, 2023: Updated training data released [Registration Required To Access] (Extended to February 20, 2023)
February 15, 2023: Testing data released [Registration Required To Access] (Extended to February 25, 2023)
March 10, 2023: Team registration deadline
March 15, 2023: Team submission deadline (together with 4-page brief reports)
March 18, 2023: Result notification
March 28, 2023: Track paper submitted for review at Computers and Graphics journal
Please contact the task organizers with any questions on these points.
Signing up: Fill in the registration form. (The link is not available. If you want to use the dataset, please send an email to email@example.com)
Making your submission: To be announced (check the task readme)
Preparing your working notes paper: Instructions on preparing your working notes paper can be found in Submission Instructions.
Our TextANIMAR2023 dataset has the structure as follow:
3D Model References: 711 animal 3D models (<Model ID>.obj)
References.csv: list of <Model ID>
TextQuery_Train.csv: list of 100 text queries for training, including <Text Query ID> and <Description>
TextQuery_GT_Train.csv: maching pairs of <Sketch Query ID> and <Model ID> for training
TextQuery_Test.csv: list of 50 text queries for testing, including <Text Query ID> and <Description>
Participants require to submit a CSV file with the format name (<Team Name>_TextANIMAR2023.csv) to CodaLab (https://codalab.lisn.upsaclay.fr/competitions/11093). The file has to be compressed to submission.zip before being submitted to CodaLab. Each team has 25 submissions as the maximum.
Given N models and Q queries, each row needs to show retrieval results in descending order. A sample .csv file is below.
Each team also needs to send a working notes paper to the organizers (firstname.lastname@example.org) by the submission deadline with the email title "[TextANIMAR2023] <Team Name> Working notes paper submission".
The working notes paper is four pages long and in two-column IEEE format. You are allowed to add a fifth page that contains only references. Your paper should cite the Challenge Overview paper written by the organizers. This paper contains all the necessary information on the challenge definition and the dataset. Therefore, you don't need to repeat to describe the challenge or the dataset. Instead, you can devote the four pages exclusively to presenting the motivation for your approach, explaining your method, showing your results, analyzing your results, and giving an outlook on future work.
The metrics used for this track are:
Nearest Neighbor (NN): top-1 accuracy.
Precision-at-10 (P@10): ratio of relevant items in the top-10 returned results.
Normalized Discounted Cumulative Gain (NDCG).
Mean average precision (mAP).
Trung-Nghia Le, University of Science, VNU-HCM, Vietnam
Minh-Triet Tran, University of Science, VNU-HCM, Vietnam
Minh-Quan Le, University of Science, VNU-HCM, Vietnam
Thang-Long Nguyen-Ho, University of Science, VNU-HCM, Vietnam
Trong-Thuan Nguyen, University of Science, VNU-HCM, Vietnam
Viet-Tham Huynh, University of Science, VNU-HCM, Vietnam
Mai-Khiem Tran, University of Science, VNU-HCM, Vietnam
Trong-Le Do, University of Science, VNU-HCM, Vietnam
Khanh-Duy Le, University of Science, VNU-HCM, Vietnam
Vinh-Tiep Nguyen, University of Information Technology, VNU-HCM, Vietnam
Tam V. Nguyen, University of Dayton, U.S.A.
Akihiro Sugimoto, National Institute of Informatics, Japan
Trung-Nghia Le, Tam V. Nguyen, Minh-Quan Le, Trong-Thuan Nguyen, Viet-Tham Huynh, Trong-Le Do, Khanh-Duy Le, Mai-Khiem Tran, Nhat Hoang-Xuan, Thang-Long Nguyen-Ho, Vinh-Tiep Nguyen, Tuong-Nghiem Diep, Khanh-Duy Ho, Xuan-Hieu Nguyen, Thien-Phuc Tran, Tuan-Anh Yang, Kim-Phat Tran, Nhu-Vinh Hoang, Minh-Quang Nguyen, E-Ro Nguyen, Minh-Khoi Nguyen-Nhat, Tuan-An To, Trung-Truc Huynh-Le, Nham-Tan Nguyen, Hoang-Chau Luong, Truong Hoai Phong, Nhat-Quynh Le-Pham, Huu-Phuc Pham, Trong-Vu Hoang, Quang-Binh Nguyen, Hai-Dang Nguyen, Akihiro Sugimoto, Minh-Triet Tran, "TextANIMAR: Text-based 3D Animal Fine-Grain", ArXiv Pre-print: 2304.06053, 2023. [PDF]
© Copyright Software Engineering Laboratory, University of Science, VNU-HCM, Vietnam