Yuan, H;
Xu, J;
Pan, H;
Bousseau, A;
Mitra, NJ;
Li, C;
(2024)
CADTalk: An Algorithm and Benchmark for Semantic Commenting of CAD Programs.
In:
Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.
(pp. pp. 3753-3762).
IEEE: Seattle, WA, USA.
Preview |
Text (Article)
Yuan_CADTalk_An_Algorithm_and_Benchmark_for_Semantic_Commenting_of_CAD_CVPR_2024_paper.pdf - Accepted Version Download (2MB) | Preview |
Preview |
Text (Supplementary Information)
Yuan_CADTalk_An_Algorithm_CVPR_2024_supplemental.pdf Download (6MB) | Preview |
Abstract
CAD programs are a popular way to compactly encode shapes as a sequence of operations that are easy to para-metrically modify. However, without sufficient semantic comments and structure, such programs can be challenging to understand, let alone modify. We introduce the problem of semantic commenting CAD programs, wherein the goal is to segment the input program into code blocks corresponding to semantically meaningful shape parts and assign a semantic label to each block. We solve the problem by combining program parsing with visual-semantic analysis afforded by recent advances in foundational language and vision models. Specifically, by executing the input programs, we create shapes, which we use to generate conditional photorealistic images to make use of semantic annotators for such images. We then distill the information across the images and link back to the original programs to semantically comment on them. Additionally, we collected and annotated a benchmark dataset, CADTalk, consisting of 5,288 machine-made programs and 45 human-made programs with ground truth semantic comments. We exten-sively evaluated our approach, compared it to a GPT-based baseline, and an open-set shape segmentation baseline, and reported an 83.24% accuracy on the new CADTalk dataset. Code and data: https://enigma-li.github.io/CADTalk/.
| Type: | Proceedings paper |
|---|---|
| Title: | CADTalk: An Algorithm and Benchmark for Semantic Commenting of CAD Programs |
| Event: | 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) |
| Dates: | 16 Jun 2024 - 22 Jun 2024 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/CVPR52733.2024.00360 |
| Publisher version: | https://doi.org/10.1109/CVPR52733.2024.00360 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10199675 |
Archive Staff Only
 |
View Item |
