A 3D texture generation prototype project driven by advances in generative AI. With 3D-tool plugins for this already emerging, I needed to validate whether generating 3D textures was viable in a browser environment, and identify what to consider for future projects.
The goal was to validate the technical feasibility of AI-based 3D texture generation in the browser, and to explore ways to improve the user experience despite long API response times.
Built the 3D environment on Vite and React-three/fiber and integrated the Hugging Face API. For texture optimization, implemented a masked-region approach that updated only specific parts, merging images on a canvas and applying them to the model dynamically. To improve the experience during long API wait times, implemented a bloom effect using a shader applied to the area being textured.
Successfully built a browser-based AI 3D texture generation prototype. Secured ways to improve the experience around API response delays, and derived both technical validation and improvement points for future related projects.
A toon-rendering prototype project undertaken while exploring a potential collaboration with the anime-style NFT project AZUKI. Given the character of the 3D models, cartoon-style rendering was needed instead of realistic rendering, so I had to validate a toon-rendering approach suited to the browser.
The goal was to review the best way to implement cartoon-style rendering in the browser, and secure visual quality suitable for an anime-style NFT project.
Built the 3D environment on Vite and React-three/fiber, implementing toon rendering by combining MeshToonMaterial, a gradient map, and outline processing. Resolved a shader issue discovered during implementation by filing an issue upstream in the open-source project, completing a stable toon-rendering pipeline.
Established a methodology for high-quality toon rendering in the browser. Alongside solving a technical problem through an open-source contribution, laid the technical groundwork for a potential anime-style NFT collaboration.