MegaParts scales part-aware 3D generation to 300 parts

MegaParts scales part-aware 3D generation to 300 parts

Researchers introduce MegaParts, an autoregressive framework for part-aware 3D object generation, aimed at a scaling problem that has held back the field: as an object's part count grows, generating detailed geometry for every part becomes prohibitively expensive in both token length and memory, so existing part-aware methods do not scale to highly complex objects. Part-aware generation matters for graphics work such as controllable modeling, editing, and articulation, where an object needs to be treated as a coherent assembly of separate semantic parts rather than one solid mesh.

MegaParts tackles the scaling problem with two pieces working together. First, a vector-quantized shape tokenizer learns discrete latent representations of part-level geometry, minimizing the number of tokens used per part while still requiring high-fidelity reconstruction; because token length adapts to each part's geometric complexity, simple parts cost fewer tokens and complex parts cost more, rather than every part being assigned a fixed budget. Second, on top of this compact tokenized representation, a large language model is trained to generate an object's overall bounding box, each part's bounding box, and each part's shape tokens together within one unified structured sequence. Combined with an efficient long-context training strategy, this token-efficient setup lets the system scale to objects with up to 300 parts and sequence lengths of up to 256k tokens, while keeping the compositional, part-level structure intact so individual parts remain controllable.

The authors report that MegaParts achieves higher mesh quality than baseline autoregressive and diffusion models on this task, and argue that this shows compressed discrete part tokens improve not just scalability but also the fidelity that is achievable in generated geometry. On that basis, they suggest that LLM-native, token-efficient autoregressive modeling is a compelling alternative to diffusion for large-scale part-aware 3D generation. A project page with further material is available at expmaster.github.io/megaparts_webpage.

Key facts

  • MegaParts is an autoregressive framework for part-aware 3D object generation that scales to objects with up to 300 parts.
  • Its vector-quantized shape tokenizer produces adaptive-length tokens per part, minimizing token usage while preserving high-fidelity reconstruction.
  • A large language model generates an object's bounding box, each part's bounding box, and each part's shape tokens in one unified sequence, trained with a long-context strategy reaching sequence lengths up to 256k tokens.
  • The authors report MegaParts achieves higher mesh quality than baseline autoregressive and diffusion models on this task.
  • The authors argue the results make LLM-native, token-efficient autoregressive modeling a compelling alternative to diffusion for large-scale part-aware 3D generation.

Why it matters

Part-aware 3D generation lets an object be built and edited as an assembly of separate, controllable parts rather than one solid mesh, which is what tools for controllable modeling, editing, and articulation need. Existing methods hit a wall as part count rises, since detailed geometry becomes prohibitively expensive in token length and memory. MegaParts pushes that ceiling to objects with up to 300 parts and sequences up to 256k tokens while keeping the part-level structure intact, and it does so with an autoregressive, LLM-style approach rather than diffusion, which the authors say improves fidelity as well as scale.

Who it affects

Graphics researchers and engineers building controllable 3D modeling, editing, or articulation tools, where objects must be manipulated part by part instead of as a single mesh. The token-efficient, adaptive-length tokenization approach is also relevant to anyone working on other LLM-native generation tasks that run into similar token or memory scaling limits.

How to use it

The paper points to a project page at expmaster.github.io/megaparts_webpage for further material. The source text does not state whether code or model weights are released, nor does it mention any licence or pricing, so none of that can be reported here.

How solid is it

This is a research paper describing a new method and its results; the source text gives no publication venue, date, or author names, and the claim of higher mesh quality than baseline autoregressive and diffusion models is stated without accompanying numeric scores in the text. The scaling figures, 300 parts and 256k-token sequences, are stated directly as the method's demonstrated capability.

Risks and caveats

The mesh-quality comparison against baseline models is presented as a qualitative claim in the source, without the specific benchmark numbers that would let a reader judge the size of the improvement. The text also does not name the training dataset or give details of the long-context training strategy beyond its name, so independent verification of both the quality claim and the method's robustness beyond 300 parts would need the full paper.