Jack Wei Lun Shi

I am a third year Ph.D. student in the Department of Civil and Environmental Engineering at the National University of Singapore, advised by Justin K.W. Yeoh and Wawan Solihin. My primary research focuses on spatial intelligence for BIM, exploring how geometric world models and joint-embedding approaches can train machines to reason about buildings in 3D space. Earlier on, I worked on leveraging and improving large language models and information retrieval techniques to automate code compliance for building regulations, with the goal of enhancing the design process in the architecture, engineering, and construction industry. I am also working with Kaichen Zhou on research relating to computer vision and world models.

If you're interested in my research or would like to collaborate, please don't hesitate to reach out via email.

Jack Wei Lun Shi

Research

Honeycomb: Constant-size scene memory representation for video world models
Jack Wei Lun Shi, Kaichen Zhou, Haoyu Chen, Yufeng Weng, Keane Ong, Ruojin Cai, Hang Hua, Justin K.W. Yeoh, Mengyu Wang
arXiv, 2026
project page / paper / code

Honeycomb is a video world model whose HexMemory stores the scene in six fixed-size feature planes, keeping long-horizon generation consistent when revisiting regions while memory stays constant in size.

IFCContextNet target element in context Context-aware IFC element classification using geometric, semantic, and spatial graphs
Mingsong Yang, Yuan Cao, Xinhong Hei, Jack Wei Lun Shi, Haoding Xu, Xiaogang Song, Qin Zhao
Automation in Construction, 2027
Under review

IFCContextNet classifies IFC elements by combining three separately encoded graphs: the element's geometry, its IFC semantic relations, and its surrounding spatial context.

Thermal delamination masks and cross-modal heat maps Automated concrete delamination detection via physics-guided SAM and unaligned cross-modal verification
Yufeng Weng, Jack Wei Lun Shi, Yimin Zhao, Yuhan Zhou, Ser-Tong Quek, Justin K.W. Yeoh
Automation in Construction, 2027
Under review

A zero-shot framework that segments concrete delamination in drone thermal images with physics-guided SAM and filters false positives against unaligned visible imagery.

Toward generalizable foundation models for 3D BIM geometry using a joint embedding predictive architecture
Jack Wei Lun Shi, Wawan Solihin, Yufeng Weng, Houhao Liang, Yimin Zhao, Leong Hien Poh, Justin K.W. Yeoh
Automation in Construction, 2026
project page / paper / code

A point cloud foundation model for 3D BIM geometry that generalizes across object classification, segmentation, and zero-shot tasks such as shape retrieval and anomaly detection.

BIVQA damage localization Visual question answering for bridge damage inspection using a multi-modal large language model
Minghao Dang, Jack Wei Lun Shi, Yapeng Guo, Hongtao Cui, Justin K.W. Yeoh, Shunlong Li
Automation in Construction, 2026
paper

BIVQA, built on a multi-modal large language model, answers natural-language questions about bridge inspection images while simultaneously localizing the damage.

Self-supervised learning for BIM element classification using a joint embedding predictive architecture
Jack Wei Lun Shi, Wawan Solihin, Yufeng Weng, Yimin Zhao, Leong Hien Poh, Justin K.W. Yeoh
Automation in Construction, 2026
project page / paper / code

By predicting the latent representations of masked regions of unlabeled BIM element point clouds, the pre-trained model outperforms supervised methods on element classification, especially when labeled data is scarce.

P4IR tree edit distance heatmap Reinforcement learning to improve large language model-based automated code compliance systems
Jack Wei Lun Shi, Minghao Dang, Wawan Solihin, Leong Hien Poh, Justin K.W. Yeoh
arXiv, 2026
paper

P4IR combines supervised fine-tuning with GRPO reinforcement learning to generate more accurate code skeletons from building regulations, outperforming leading frontier LLMs in a zero-shot setting.

Attribution maps for FFT, LoRA and QLoRA LLM attribution analysis across different fine-tuning strategies and model scales for automated code compliance
Jack Wei Lun Shi, Minghao Dang, Wawan Solihin, Justin K.W. Yeoh
International Conference on Computing in Civil and Building Engineering (ICCCBE), 2026
paper

Perturbation-based attribution shows that full fine-tuning yields more focused attribution patterns over building regulation text than LoRA and QLoRA, and that larger LLMs learn to prioritize numerical constraints and rule identifiers.

BuildThemis framework Fine-tuning a large language model for automated code compliance of building regulations
Jack Wei Lun Shi, Wawan Solihin, Justin K.W. Yeoh
Advanced Engineering Informatics, 2025
project page / paper

BuildThemis combines a fine-tuned LLM with retrieval-augmented generation to turn building regulations into draft compliance-checking scripts that experts can readily refine.

Humanity's last exam Humanity's last exam
Long Phan, Alice Gatti, Ziwen Han, Nathaniel Li, ..., Jack Wei Lun Shi, ..., Alexandr Wang, Dan Hendrycks
Nature, 2026
project page / paper

A benchmark of 2,500 expert-written questions at the frontier of human knowledge, on which state-of-the-art LLMs still score poorly.

CBROM poster Component-based reduced order modeling for heat transfer in thermal fin and data server
Jack Wei Lun Shi, Xiang Zhao, My Ha Dao
International Workshop on Reduced Order Methods, 2023 (poster)
poster

Decomposing a thermal fin and a data server into reusable components yields reduced order models that match high-fidelity FEA results while running 26 and 6.5 times faster.