{"id":3654,"date":"2022-09-14T06:51:18","date_gmt":"2022-09-14T06:51:18","guid":{"rendered":"https:\/\/cocoalopez.com\/blog\/?p=3654"},"modified":"2022-09-14T06:52:59","modified_gmt":"2022-09-14T06:52:59","slug":"interactive-3d-face-drawing","status":"publish","type":"post","link":"https:\/\/cocoalopez.com\/blog\/?p=3654","title":{"rendered":"Interactive 3D Face Drawing"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">IDE-3D: Interactive Disentangled Editing for High-Resolution 3D-aware Portrait Synthesis<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Existing 3D-aware facial generation methods face a dilemma in quality ver- sus editability: they either generate editable results in low resolution, or high quality ones with no editing flexibility. In this work, we propose a new approach that brings the best of both worlds together. Our system consists of three major components: (1) a 3D-semantics-aware generative model that produces view-consistent, disentangled face images and semantic masks; (2) a hybrid GAN inversion approach that initialize the latent codes from the semantic and texture encoder, and further optimized them for faithful reconstruction; and (3) a canonical editor that enables efficient manipulation of semantic masks in canonical view and producs high quality editing re- sults. Our approach is competent for many applications, e.g. free-view face drawing, editing and style control. Both quantitative and qualitative results show that our method reaches the state-of-the-art in terms of photorealism, faithfulness and efficiency.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<span class=\"embed-youtube\" style=\"text-align:center; display: block;\"><iframe loading=\"lazy\" class=\"youtube-player\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/sgp7Pjj6fOw?version=3&#038;rel=1&#038;showsearch=0&#038;showinfo=1&#038;iv_load_policy=1&#038;fs=1&#038;hl=en-US&#038;autohide=2&#038;wmode=transparent\" allowfullscreen=\"true\" style=\"border:0;\" sandbox=\"allow-scripts allow-same-origin allow-popups allow-presentation allow-popups-to-escape-sandbox\"><\/iframe><\/span>\n<\/div><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/mrtornado24.github.io\/IDE-3D\/\">https:\/\/mrtornado24.github.io\/IDE-3D\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>IDE-3D: Interactive Disentangled Editing for High-Resolution 3D-aware Portrait Synthesis Existing 3D-aware facial generation methods face a dilemma in quality ver- sus editability: they either generate editable results in low resolution, or high quality ones with no editing flexibility. In this work, we propose a new approach that brings the best of both worlds together. Our [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":3657,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"tdm_status":"","tdm_grid_status":"","_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[1002],"tags":[],"class_list":["post-3654","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-featured"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2022\/09\/pipeline1.png?fit=3350%2C1576&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p9XJix-WW","jetpack-related-posts":[{"id":4097,"url":"https:\/\/cocoalopez.com\/blog\/?p=4097","url_meta":{"origin":3654,"position":0},"title":"RecolorNeRF: Layer Decomposed Radiance Field for Efficient Color Editing of 3D Scenes","author":"cgmodeler","date":"January 20, 2023","format":false,"excerpt":"Tool for recoloring Nerfs (Code Coming Soon) Radiance fields have gradually become a main representation of media. Although its appearance editing has been studied, how to achieve view-consistent recoloring in an efficient manner is still under explored. We present RecolorNeRF, a novel user-friendly color editing approach for the neural radiance\u2026","rel":"","context":"In &quot;Tools&quot;","block_context":{"text":"Tools","link":"https:\/\/cocoalopez.com\/blog\/?cat=1137"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?fit=1139%2C624&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?fit=1139%2C624&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?fit=1139%2C624&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?fit=1139%2C624&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?fit=1139%2C624&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":3704,"url":"https:\/\/cocoalopez.com\/blog\/?p=3704","url_meta":{"origin":3654,"position":1},"title":"How to Approach Flat Character Design in Maya &#038; Rig Them","author":"cgmodeler","date":"September 27, 2022","format":false,"excerpt":"James Crossley shows some methods for creating flat characters in a 3D world. There is a certain appeal to having characters that look hand-drawn or hand-painted. In a digital world, that means using a 2D animation app like\u00a0Spine,\u00a0ToonBoom, Ae,\u00a0Moho, or others. Some other alternatives work with a hybrid of 2D\u2026","rel":"","context":"In &quot;Featured&quot;","block_context":{"text":"Featured","link":"https:\/\/cocoalopez.com\/blog\/?cat=1002"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2022\/09\/maxresdefault.jpg?fit=1200%2C675&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2022\/09\/maxresdefault.jpg?fit=1200%2C675&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2022\/09\/maxresdefault.jpg?fit=1200%2C675&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2022\/09\/maxresdefault.jpg?fit=1200%2C675&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2022\/09\/maxresdefault.jpg?fit=1200%2C675&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":173,"url":"https:\/\/cocoalopez.com\/blog\/?p=173","url_meta":{"origin":3654,"position":2},"title":"Nude #004","author":"cgmodeler","date":"October 7, 2009","format":false,"excerpt":"Continuing with the nude modeling sessions, decided to keep a more interesting background, i think i'll go with this sketchbook approach from now on. Same workflow, pencil sketch, digital paint... Thanks to the model...","rel":"","context":"In &quot;3d &amp; Design&quot;","block_context":{"text":"3d &amp; Design","link":"https:\/\/cocoalopez.com\/blog\/?cat=2"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2009\/10\/nude_004_small.jpg?fit=700%2C839&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2009\/10\/nude_004_small.jpg?fit=700%2C839&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2009\/10\/nude_004_small.jpg?fit=700%2C839&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2009\/10\/nude_004_small.jpg?fit=700%2C839&ssl=1&resize=700%2C400 2x"},"classes":[]},{"id":169,"url":"https:\/\/cocoalopez.com\/blog\/?p=169","url_meta":{"origin":3654,"position":3},"title":"Armored Creature Model","author":"cgmodeler","date":"September 14, 2009","format":false,"excerpt":"High Poly Model for the Armored Creature Concept Base mesh in 3dsmax, HP in Zbrush.","rel":"","context":"In &quot;3d &amp; Design&quot;","block_context":{"text":"3d &amp; Design","link":"https:\/\/cocoalopez.com\/blog\/?cat=2"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2009\/09\/render_hp_web.jpg?fit=1200%2C946&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2009\/09\/render_hp_web.jpg?fit=1200%2C946&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2009\/09\/render_hp_web.jpg?fit=1200%2C946&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2009\/09\/render_hp_web.jpg?fit=1200%2C946&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2009\/09\/render_hp_web.jpg?fit=1200%2C946&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":4186,"url":"https:\/\/cocoalopez.com\/blog\/?p=4186","url_meta":{"origin":3654,"position":4},"title":"XReal Air \u2014 Multi-Monitor AR Setup on Windows using Nebula &amp; Troubleshooting","author":"cgmodeler","date":"August 28, 2023","format":false,"excerpt":"XReal Air Virtual Desktop with Nebula August 2nd, 2023 Update Nebula for Windows Beta V2 has been released with additional performance and stability improvements. This guide has been updated to reflect that. Most VR and AR glasses tend to focus on gaming or entertainment. As of now, the XReal Air\u2026","rel":"","context":"In &quot;Featured&quot;","block_context":{"text":"Featured","link":"https:\/\/cocoalopez.com\/blog\/?cat=1002"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/07\/image-1.png?fit=658%2C555&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/07\/image-1.png?fit=658%2C555&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/07\/image-1.png?fit=658%2C555&ssl=1&resize=525%2C300 1.5x"},"classes":[]},{"id":3133,"url":"https:\/\/cocoalopez.com\/blog\/?p=3133","url_meta":{"origin":3654,"position":5},"title":"Endless landscape with AI and GAN","author":"cgmodeler","date":"April 16, 2021","format":false,"excerpt":"So this amazing code brings you to incorporate several landscapes onto a unlimited background, it has also been tested with interiors. Summary We develop a method to generate infinite high-resolution images with diverse and complex content. It is based on a perfectly equivariant generator with synchronous interpolations in the image\u2026","rel":"","context":"In &quot;Featured&quot;","block_context":{"text":"Featured","link":"https:\/\/cocoalopez.com\/blog\/?cat=1002"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2021\/04\/image-13.png?fit=628%2C478&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2021\/04\/image-13.png?fit=628%2C478&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2021\/04\/image-13.png?fit=628%2C478&ssl=1&resize=525%2C300 1.5x"},"classes":[]}],"_links":{"self":[{"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/3654","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3654"}],"version-history":[{"count":1,"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/3654\/revisions"}],"predecessor-version":[{"id":3656,"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/3654\/revisions\/3656"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=\/wp\/v2\/media\/3657"}],"wp:attachment":[{"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3654"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3654"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3654"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}