Post by SHU XIAO

Thrilled to share my final thesis project, AIBOTIX, developed at the Institute for Advanced Architecture of Catalonia as part of the Master in Robotics & Advanced Construction, with the incredible support of my tutor, Júlia Marsal Perendreu! This project investigates how vision-guided robotics and AI agents can enable autonomous on-site assembly in complex and dynamic construction environments. Using a UR10e robotic arm, an Orbbec Femto Bolt camera, and ArUco markers, the system performs real-time pick-and-place tasks based on spatial data and digital design input. What makes it more interactive is the integration of an AI agent—capable of communicating with users in common languages to help guide or adjust the workflow in real-time. 💡 Highlights: — Real-time object detection & manipulation — Adaptive behavior via ROS2 and TF2 — Design-to-robot pipeline using Rhino-Grasshopper — AI agent for intuitive human-machine collaboration — Safer, more efficient assembly with minimal supervision This work envisions a more collaborative future between humans and robots in architecture—where machines don’t just follow commands, but understand and adapt. Huge thanks to the MRAC faculty and peers for all the guidance and support! Github Link: https://lnkd.in/dpdhqJVZ 📍 #Robotics #cConstructionAutomation #AI #ros2 #HumanRobotInteraction #DigitalFabrication #IAAC #ur10e #ComputerVision #FinalProject #RoboticFabrication #AIAgent

Video Content