{"id":4097,"date":"2023-01-20T09:17:09","date_gmt":"2023-01-20T15:17:09","guid":{"rendered":"https:\/\/cocoalopez.com\/blog\/?p=4097"},"modified":"2023-01-20T09:17:12","modified_gmt":"2023-01-20T15:17:12","slug":"recolornerf-layer-decomposed-radiance-field-for-efficient-color-editing-of-3d-scenes","status":"publish","type":"post","link":"https:\/\/cocoalopez.com\/blog\/?p=4097","title":{"rendered":"RecolorNeRF: Layer Decomposed Radiance Field for Efficient Color Editing of 3D Scenes"},"content":{"rendered":"\n<div data-mode=\"normal\" data-oembed=\"1\" data-provider=\"youtube\" id=\"arve-youtube-9ci7auchfny\" class=\"arve\" class=\"wp-block-nextgenthemes-arve-block\">\n\t<div class=\"arve-inner\">\n\t\t<div style=\"aspect-ratio:87\/49\" class=\"arve-embed arve-embed--has-aspect-ratio\">\n\t\t\t<div class=\"arve-ar\" style=\"padding-top:56.321839%\"><\/div>\n\t\t\t<iframe allow=\"accelerometer &apos;none&apos;;autoplay &apos;none&apos;;bluetooth &apos;none&apos;;browsing-topics &apos;none&apos;;camera &apos;none&apos;;clipboard-read &apos;none&apos;;clipboard-write;display-capture &apos;none&apos;;encrypted-media &apos;none&apos;;gamepad &apos;none&apos;;geolocation &apos;none&apos;;gyroscope &apos;none&apos;;hid &apos;none&apos;;identity-credentials-get &apos;none&apos;;idle-detection &apos;none&apos;;keyboard-map &apos;none&apos;;local-fonts;magnetometer &apos;none&apos;;microphone &apos;none&apos;;midi &apos;none&apos;;otp-credentials &apos;none&apos;;payment &apos;none&apos;;picture-in-picture;publickey-credentials-create &apos;none&apos;;publickey-credentials-get &apos;none&apos;;screen-wake-lock &apos;none&apos;;serial &apos;none&apos;;summarizer &apos;none&apos;;sync-xhr;usb &apos;none&apos;;web-share;window-management &apos;none&apos;;xr-spatial-tracking &apos;none&apos;;\" allowfullscreen=\"\" class=\"arve-iframe fitvidsignore\" credentialless data-arve=\"arve-youtube-9ci7auchfny\" data-lenis-prevent=\"\" data-src-no-ap=\"https:\/\/www.youtube-nocookie.com\/embed\/9cI7auchFNY?feature=oembed&amp;iv_load_policy=3&amp;modestbranding=1&amp;rel=0&amp;autohide=1&amp;playsinline=0&amp;autoplay=0\" frameborder=\"0\" height=\"0\" loading=\"lazy\" name=\"\" referrerpolicy=\"strict-origin-when-cross-origin\" sandbox=\"allow-scripts allow-same-origin allow-presentation allow-popups allow-popups-to-escape-sandbox\" scrolling=\"no\" src=\"https:\/\/www.youtube-nocookie.com\/embed\/9cI7auchFNY?feature=oembed&#038;iv_load_policy=3&#038;modestbranding=1&#038;rel=0&#038;autohide=1&#038;playsinline=0&#038;autoplay=0\" title=\"\" width=\"0\"><\/iframe>\n\t\t\t\n\t\t<\/div>\n\t\t\n\t<\/div>\n\t\n\t\n\t<script type=\"application\/ld+json\">{\"@context\":\"http:\\\/\\\/schema.org\\\/\",\"@id\":\"https:\\\/\\\/cocoalopez.com\\\/blog\\\/?p=4097#arve-youtube-9ci7auchfny\",\"type\":\"VideoObject\",\"embedURL\":\"https:\\\/\\\/www.youtube-nocookie.com\\\/embed\\\/9cI7auchFNY?feature=oembed&iv_load_policy=3&modestbranding=1&rel=0&autohide=1&playsinline=0&autoplay=0\"}<\/script>\n\t\n<\/div>\n\n\n<p>Tool for recoloring Nerfs (Code Coming Soon)<\/p>\n\n\n\n<p><em>Radiance fields have gradually become a main representation of media. Although its appearance editing has been studied, how to achieve view-consistent recoloring in an efficient manner is still under explored. We present RecolorNeRF, a novel user-friendly color editing approach for the neural radiance field. Our key idea is to decompose the scene into a set of pure-colored layers, forming a palette. Thus, color manipulation can be conducted by altering the color components of the palette directly. To support efficient palette-based editing, the color of each layer needs to be as representative as possible. In the end, the problem is formulated as in an optimization formula, where the layers and their blending way are jointly optimized with the NeRF itself. Extensive experiments show that our jointly-optimized layer decomposition can be used against multiple backbones and produce photo-realistic recolored novel-view renderings. We demonstrate that RecolorNeRF outperforms baseline methods both quantitatively and qualitatively for color editing even in complex real-world scenes.<\/em><\/p>\n\n\n\n<p><a href=\"https:\/\/sites.google.com\/view\/recolornerf\">https:\/\/sites.google.com\/view\/recolornerf<\/a><\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"696\" height=\"381\" data-attachment-id=\"4098\" data-permalink=\"https:\/\/cocoalopez.com\/blog\/?attachment_id=4098\" data-orig-file=\"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?fit=1139%2C624&amp;ssl=1\" data-orig-size=\"1139,624\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"image-4\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?fit=300%2C164&amp;ssl=1\" data-large-file=\"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?fit=696%2C381&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4-1024x561.png?resize=696%2C381&#038;ssl=1\" alt=\"\" class=\"wp-image-4098\" srcset=\"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?resize=1024%2C561&amp;ssl=1 1024w, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?resize=300%2C164&amp;ssl=1 300w, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?resize=768%2C421&amp;ssl=1 768w, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?resize=672%2C368&amp;ssl=1 672w, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?resize=1038%2C569&amp;ssl=1 1038w, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?resize=400%2C219&amp;ssl=1 400w, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?w=1139&amp;ssl=1 1139w\" sizes=\"auto, (max-width: 696px) 100vw, 696px\" \/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Tool for recoloring Nerfs (Code Coming Soon) Radiance fields have gradually become a main representation of media. Although its appearance editing has been studied, how to achieve view-consistent recoloring in an efficient manner is still under explored. We present RecolorNeRF, a novel user-friendly color editing approach for the neural radiance field. Our key idea is [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":4098,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[1137],"tags":[],"class_list":["post-4097","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tools"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/01\/image-4.png?fit=1139%2C624&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p9XJix-145","jetpack-related-posts":[{"id":3167,"url":"https:\/\/cocoalopez.com\/blog\/?p=3167","url_meta":{"origin":4097,"position":0},"title":"UV Map checker online generator","author":"cgmodeler","date":"May 18, 2021","format":false,"excerpt":"Time for this nifty online tool that generates a customized UV Map Tile checker, play with parameters like thickness, color palette and even Index and numbers to personalize your UV map needs. On a side note, I've never thought that rounded quads could look so cool on a UV map\u2026","rel":"","context":"In &quot;Featured&quot;","block_context":{"text":"Featured","link":"https:\/\/cocoalopez.com\/blog\/?cat=1002"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2021\/05\/imagen-2.png?fit=1200%2C685&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2021\/05\/imagen-2.png?fit=1200%2C685&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2021\/05\/imagen-2.png?fit=1200%2C685&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2021\/05\/imagen-2.png?fit=1200%2C685&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2021\/05\/imagen-2.png?fit=1200%2C685&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":4332,"url":"https:\/\/cocoalopez.com\/blog\/?p=4332","url_meta":{"origin":4097,"position":1},"title":"Photoshop TIPS 1 Short TIPS for drawing animation backgrounds &#8211; Part 1 &#8211; A gradient map of the aori sky","author":"cgmodeler","date":"April 23, 2024","format":false,"excerpt":"The mini lecture I gave the other day at the \u201c3D Background Shop Community,\u201d a loose gathering of people who use 3DCG tools to create backgrounds for animation and manga, was surprisingly well received.Table of Contents Speed is the name of the game when it comes to animation background art!\u2026","rel":"","context":"In &quot;Tips y Tutoriales&quot;","block_context":{"text":"Tips y Tutoriales","link":"https:\/\/cocoalopez.com\/blog\/?cat=31"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2024\/04\/picture_pc_0e5b0989d5bb4efe85b19b09b6bb3013.webp?fit=800%2C471&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2024\/04\/picture_pc_0e5b0989d5bb4efe85b19b09b6bb3013.webp?fit=800%2C471&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2024\/04\/picture_pc_0e5b0989d5bb4efe85b19b09b6bb3013.webp?fit=800%2C471&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2024\/04\/picture_pc_0e5b0989d5bb4efe85b19b09b6bb3013.webp?fit=800%2C471&ssl=1&resize=700%2C400 2x"},"classes":[]},{"id":3654,"url":"https:\/\/cocoalopez.com\/blog\/?p=3654","url_meta":{"origin":4097,"position":2},"title":"Interactive 3D Face Drawing","author":"cgmodeler","date":"September 14, 2022","format":false,"excerpt":"IDE-3D: Interactive Disentangled Editing for High-Resolution 3D-aware Portrait Synthesis Existing 3D-aware facial generation methods face a dilemma in quality ver- sus editability: they either generate editable results in low resolution, or high quality ones with no editing flexibility. In this work, we propose a new approach that brings the best\u2026","rel":"","context":"In &quot;Featured&quot;","block_context":{"text":"Featured","link":"https:\/\/cocoalopez.com\/blog\/?cat=1002"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2022\/09\/pipeline1.png?fit=1200%2C565&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2022\/09\/pipeline1.png?fit=1200%2C565&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2022\/09\/pipeline1.png?fit=1200%2C565&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2022\/09\/pipeline1.png?fit=1200%2C565&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2022\/09\/pipeline1.png?fit=1200%2C565&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":932,"url":"https:\/\/cocoalopez.com\/blog\/?p=932","url_meta":{"origin":4097,"position":3},"title":"Maya MUT (Mark-Up-Tool)","author":"cgmodeler","date":"December 6, 2011","format":"video","excerpt":"Atenci\u00f3n a los interesados en las \u00a0utilidades para animadores. Encontr\u00e9 \u00e9sta peque\u00f1a herramienta que hace maravillas, funciona con maya 2011. Es un MEL script que nos permite dibujar sobre el viewport de maya utilizando los paintFX. Tiene la funci\u00f3n para exportar las notas, cambiar color de la brocha, grosor y\u2026","rel":"","context":"In &quot;Gobelins&quot;","block_context":{"text":"Gobelins","link":"https:\/\/cocoalopez.com\/blog\/?cat=13"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2011\/12\/maxresdefault-3.jpg?fit=1200%2C675&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2011\/12\/maxresdefault-3.jpg?fit=1200%2C675&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2011\/12\/maxresdefault-3.jpg?fit=1200%2C675&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2011\/12\/maxresdefault-3.jpg?fit=1200%2C675&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2011\/12\/maxresdefault-3.jpg?fit=1200%2C675&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":4230,"url":"https:\/\/cocoalopez.com\/blog\/?p=4230","url_meta":{"origin":4097,"position":4},"title":"Procreate Dreams &#8211; Better stay dreaming&#8230;","author":"cgmodeler","date":"December 4, 2023","format":false,"excerpt":"So I've been a procreate user for several years ever since the first betas and being an animator myself naturally I had to try Dreams out. In one word, \"disappointment\" The few things that I liked: The lasso editing for the timeline and intuitive playback controls, the drag and throw\u2026","rel":"","context":"In &quot;reviews&quot;","block_context":{"text":"reviews","link":"https:\/\/cocoalopez.com\/blog\/?cat=1140"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/12\/image.png?fit=649%2C482&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/12\/image.png?fit=649%2C482&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2023\/12\/image.png?fit=649%2C482&ssl=1&resize=525%2C300 1.5x"},"classes":[]},{"id":3754,"url":"https:\/\/cocoalopez.com\/blog\/?p=3754","url_meta":{"origin":4097,"position":5},"title":"FAKE SSS for 3DS MAX Viewport","author":"cgmodeler","date":"October 9, 2022","format":false,"excerpt":"https:\/\/vimeo.com\/41147048 Code over here: http:\/\/www.aardolino.com\/blog\/ or Playing Remedy\u2019s Alan Wake for Xbox, and feeling lost seeing its marvelous forest environment, wondering about how to procedurally animate trees and vegetation using vertex colors, the idea of SS&F-SSS came out: use mesh thickness to modulate a SSS color. [Yes\u2026it\u2019s not related to\u2026","rel":"","context":"In &quot;Featured&quot;","block_context":{"text":"Featured","link":"https:\/\/cocoalopez.com\/blog\/?cat=1002"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2022\/10\/imagen-7.png?fit=1016%2C784&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2022\/10\/imagen-7.png?fit=1016%2C784&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2022\/10\/imagen-7.png?fit=1016%2C784&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/cocoalopez.com\/blog\/wp-content\/uploads\/2022\/10\/imagen-7.png?fit=1016%2C784&ssl=1&resize=700%2C400 2x"},"classes":[]}],"_links":{"self":[{"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/4097","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=4097"}],"version-history":[{"count":1,"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/4097\/revisions"}],"predecessor-version":[{"id":4099,"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/4097\/revisions\/4099"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=\/wp\/v2\/media\/4098"}],"wp:attachment":[{"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=4097"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=4097"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cocoalopez.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=4097"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}