BrickAnything uses point clouds as a unified interface to predict autoregressive brick sequences from 3D shapes. The framework enforces discrete part constraints and structural stability to ensure outputs are physically buildable. This approach replaces heuristic optimization with a geometry-conditioned model. It provides a more reliable pipeline for translating complex 3D representations into physical assemblies.