Creasy, from the dodgers
Quantum bits | public qbitai
Just now on the cvpr, the goose factory 3d generation model 3d 2. 1 officially declared open source
It closely follows the tide, finely presenting itself as a red fried chicken labubu。
It can also follow a retrograde route and produce finely texture brass。
In sum, compared to the previous generation of 2. 0, the combined 3d 2. 1 hit is a double optimization of geometry and texture。
In particular, there is a greater optimization of texture paste to achieve sota in the current open source 3d model。
For example, in this metal field, the grape stylish, 2. 1 and the previous 2. 0, the temperature and light contrasts very clearly:
And training codes, model weights, data processing processes are all open, supporting one-key deployment, and developers are able to fine-tune independently。
According to the information, this was the first full chain open source of a large industrial 3d generation model that reached the closed-source level and could be matched with a consumption level graphic card。
Primary geometry and texture optimization
As noted at the beginning, the combined 3d 2. 1 hit is geometry and texture double optimization。
Geometry determines the accuracy of the shape of the model created, and the texture reduces the colour, glitter and detail of the surface of the model。
2. 1 mixtures 3d 2. 1 can generate different profiles of basic colours, metallicity, roughness, etc., and also support high-quality rendering of complex materials such as leather, wood, metal, ceramics, etc。
For example, this small boat, made of valor, can see that version 2. 1 on the right produces a much more glamorous result, that the bottom is more nuanced, and that the bouquet is more reasonably distributed。
For the same object, the combination of different materials produces different effects, such as metal tigers and jade tigers below。
There are also different tastes in the same model, such as in the group of "blowing monks", which see not only a clearer wrinkle on the face but also a stronger sense of metal on the horn。
There was no excessive reflection of the clothes, a clearer pattern of the shirts and even more natural water in the cups。
The details of the model and the complexity of the pattern can also be refined to the level of hands-on。
At the technical level, the 3d 2. 1 model further strengthens the geometric-tangular understanding architecture based on the 3d 2. 0 mix。
Based on the dit geometry structure, hybrids 3d 2. 1 optimized detail modelling to make the grid more precise and more shape-consistent in order to make subsequent texture better。
At the same time, hybrids introduce pbr texture generation techniques in 3d open source models. Compared to the traditional rgb poster technology, pbr enhances the visual consistency of models in different light environments by simulating the physical interaction of light with materials。
Compared to other models, such as texgen, and version 2. 0 before mixtures 3d, the new mixtures 3d model has achieved optimal material reduction capability。
The pbr texture of hybrid 3d 2. 1 compared to the rgb stickers in a user-blind survey showed a high rate of satisfaction of 78 per cent。
In addition, the standardized properties of pbr materials make them compatible with mainstream replicators (e. G. Unreal engineering, unity) and more easily reused on other platforms。
All open-source model code data
The hybrid 3d 2. 1 provides a full-chain open source of model weights, training codes and data-processing processes, and developers are free to fine-tune, retrain or optimize。
In terms of configuration, a mix of 3d 2. 1 is suitable for a consumption-level graphic card and provides detailed deployment and use curricula, with easy access for developers。
Since november 2024, when the first generation of the 3d generation model was released and launched, in january this year, 3d 2. 0 exceeded the mainstream model in terms of text consistency and geometric precision。
Since the open source, the hybrid 3d model has downloaded over 1. 8 million people on the hugging face platform and has been recognized by global developers。
The current version 2. 1 further enhances the quality of the 3d model, bringing the 3d model produced by ai closer to “real”。
As guo chun-chul, the director of the 3d department of information, said:
The comprehensive open source of hybrid 3d 2. 1 is a new starting point and looks forward to working with global developers, creators and researchers to create a more prosperous 3d open source ecology。
Also, at 11 p. M. This sunday (15 june) there will be a live broadcast entitled "twirling $3d 2. 1" that can be viewed by the quantuan video number if interested
