Home Blog Page 3

3D GAUSSIAN SPLATTING TUTORIAL (ONE CLICK INSTALL)

For those looking for a one click (almost solution) there’s this nifty little tool called pinokio that auto installs dependencies and environments (yeah including conda) for running web apps and python based scripts with one click install and run.

Summary:

  1. Install Pinokio:
    https://docs.pinokio.computer/download/windows.html
  2. Install NVIDIA CUDA 11.8:
    https://developer.download.nvidia.com/compute/cuda/11.8.0/local_installers/cuda_11.8.0_522.06_windows.exe
    (Or newer)
    https://developer.nvidia.com/cuda-11-8-0-download-archive?target_os=Windows&target_arch=x86_64&target_version=10&target_type=exe_local
  3. Open Pinokio and click on DISCOVER
  4. Paste the Gaussian Splatting GIT URL:
    https://github.com/bycloud-AI/gaussian-splatting-Windows.git
  5. Click on “One click Install with Pinokio”
  6. After Downloading everything, click on “INSTALL”, this will run the python scripts, setup the conda environment, and install almost everything needed for it.
  7. Once its done, it will pop a Command Window, before you can use it you need to run the next two commands
  8. pip install submodules\diff-gaussian-rasterization
  9. pip install submodules\simple-knn
  10. Once they are installed, you can run the normal python commands for COLMAP, Training and Viewing

There are 3 steps to follow in order to get a gaussian splat:

  1. Place your image sequence on input_data/YOURPROJECT then run the following python command:
    python convert.py -s input_data/YOURPROJECT --colmap_executable COLMAP-3.8-windows-cuda\COLMAP.bat
  2. After the COLMAP has been extracted, you gotta create the Gaussian Splat by training it with the following command:
    python train.py -s input_data/YOURPROJECT
  3. Once the training is finished, the Gaussian Splat will be located at the folder “Output”, from there you gotta rename the last created folder to the name of YOURPROJECT, eg.
    Created folder was named “de225777-e” at “output”, so you gotta rename it to “YOURPROJECT”
  4. Once you renamed the folder, you can view your Gaussian Splat by running this python command:
    start viewers/bin/SIBR_GaussianViewer_app.exe . -m output\YOURPROJECT

TUTORIAL

Gaussian Splatting GITHUB PINOKIO

https://github.com/bycloud-AI/gaussian-splatting-Windows

GAUSSIAN SPLATTING

Notes:
Remember to install CUDA 11.8 onwards


IF you get a “ModuleNotFoundError: No module named ‘diff_gaussian_rasterization'” Error
Download CUDA 11.8. https://developer.nvidia.com/cuda-11-8-0-download-archive
It should be installed according to your system, and to get whether if you have installed correctly, you can double check with this method: https://github.com/bycloudai/SwapCudaVersionWindows

Common ERRORS:

I’m getting the following error, can anyone help beyond this point (gaussian_splatting) C:\Windows\System32\gaussian-splatting>python train.py -s data/MetalContainer
Traceback (most recent call last):
File “train.py”, line 16, in
from gaussian_renderer import render, network_gui
File “C:\Windows\System32\gaussian-splatting\gaussian_renderer_init_.py”, line 14, in
from diff_gaussian_rasterization import GaussianRasterizationSettings, GaussianRasterizer
ModuleNotFoundError: No module named ‘diff_gaussian_rasterization’

You need to run the PIP commands within the CMD window of the pinokio after you’ve installed CUDA 11.8

Hi, you need to install the submodules in cli navigate to the root folder of this repo.
pip install submodules\diff-gaussian-rasterization
pip install submodules\simple-knn If running these produces an error then you might need to re-clone the repo with the –recursive flag
Then re-install

Procreate Dreams – Better stay dreaming…

0

So I’ve been a procreate user for several years ever since the first betas and being an animator myself naturally I had to try Dreams out.

In one word, “disappointment”

The few things that I liked:

  • The lasso editing for the timeline and intuitive playback controls,
  • the drag and throw to play the layer instantly
  • Zoom management of the timeline with fingers is pretty cool
  • Video layer works great

All the bad:

  • Clunky UI, nothing like procreate, too much text everywhere, no intuitiveness, Giant icons that take up almost 1/3 or the workspace which you cannot hide BTW.
  • Hacky use of filters as track settings (If you want opacity for your track you don’t have a setting for it so you must add a filter and then set the opacity)
  • Flipbook overlay can’t be hidden, as soon as you hide it it goes back to the timeline
  • UI duplication, clicking on Close flipbook and done do the same
  • No per frame timeline settings, basically you’re left with HH,MM,SS for your project settings, (As if you were going to animate 1 Hour of animation on an ipad app)
  • No instances, everything works on frames so flipbook’s onion skin is useless if you already timed your drawing
  • No custom sizes for project presets
  • No brush editing
  • no canvas flipping
  • No lasso or selection tools or even move tools on drawing mode (all procreate should be here or at least the best of it)
  • No page frame flipping, it would be cool to see two three or even four fingers flipping between frame as if you were with real paper, curved motion (wishful thinking here).
  • And many many more…

So I would recommend to wait until it’s polished, BTW I haven’t explored the export format but it seems they use transparent PNG and JSON as their export so I see it as an interesting candidate if it’s polished to put on a professional pipeline. Until then, I’m not even going to open the app again…

How to block twitter sidebar + trending topics

0

Updated 6 June 2023

Twitter can be a great source of connections, industry news and light-hearted fun (if you follow the right people!). Unfortunately, the “What’s happening” trending topics sidebar can be a constant source of misery that by now can be simply too much to bear.

If you’d rather keep on top of your news and trends in a more mindful way rather than have it shoved in your face every time you browse your feed on a desktop browser then here’s what you can do.

uBlock Origin

uBlock Origin (Chrome, Firefox, Edge) is a fantastic ad blocking tool which blocks a huge array of banner advertisements, analytics, tracking and even Twitter promoted posts and YouTube video ads.

No – this post isn’t sponsored or affiliated – it’s really just that great. Browsing the web without can really be a miserable experience.

As a bonus, it also comes with a nifty feature that allows you to set your own blocking rules.

Once installed, click the uBlock Origin button in your browser toolbar and select the ‘Dashboard’ icon (looks like three cogs). On the dashboard page, select ‘My Filters’ from the top bar.

Screenshot showing the uBlock interface to block the Twitter What's Happening trends sidebar
After installing uBlock Origin, click the icon in the toolbar (may be hidden behind an extension button) and then the dashboard page that looks like 3 cogs

The ‘My Filters’ page will show a large text box. You may find it empty or populated with custom rules you have already created. We’re able to add to this list to block any elements we please. Simply paste in your desired filters from the filter rules section below and select ‘Apply Changes’ when done.

Screenshot showing the uBlock filters interface to block the Twitter What's Happening trends sidebar
The my filters page allows you to paste in and save custom filters to block and hide elements on any webpage

Filter Rules

Twitter’s dynamically generated HTML & CSS classes can make targeting specific elements a little fiddly. Fortunately, there are a number of accessibility labels and other fingerprints we can target to purge the website of unwanted features.

The Twitter website showing the "What's Happening" sidebar removed
The Twitter website showing the “What’s Happening” sidebar removed

Hide the ‘What’s happening’ sidebar on Twitter

Add the following filter rule to your uBlock configuration as per the instructions above.

! Hide the 'What's happening' sidebar on Twitter.com
twitter.com##*[aria-label="Timeline: Trending now"]

How to hide the ‘Topics to follow’ sidebar on Twitter

Add the following filter rule to your uBlock configuration as per the instructions above.

! Hide the 'Topics to follow' sidebar on Twitter.com
twitter.com##*[aria-label="Timeline: "]

How to hide “Who to follow” sidebar on Twitter

! Hide the 'Who to follow' sidebar on Twitter.com
twitter.com##*[aria-label="Who to follow"]

Hide everything in sidebar except search bar

! Hide everything in sidebar except search bar on Twitter.com
twitter.com##*[data-testid="sidebarColumn"] aside

Hide the bottom messages panel on Twitter

! Hide the bottom message panel Twitter.com
twitter.com##*[data-testid="DMDrawerHeader"]

How to disable the new Twitter “Chirp” font

Not a fan of the new Twitter font? Add the following URLs to your filters list in uBlock to block the new Twitter “Chirp” font from loading and revert back to a default font.

https://abs.twimg.com/fonts/chirp-regular-web.woff
https://abs.twimg.com/fonts/chirp-medium-web.woff
https://abs.twimg.com/fonts/chirp-heavy-web.woff
https://abs.twimg.com/fonts/chirp-bold-web.woff

DMX Human upper body motion

0

Digital Motion Xray (DMX) video where you can see the movement of the joints. Especially in the shoulders, if you live normally, you won’t know the fact that the collarbone and scapula move together. When you see this kind of thing, the range of motion increases and it becomes easier to move.

Amazing Tenochtitlan digital reconstruction

Take a look at the work by thomas kole, using arch sources plus a lot of drone data he managed to create an amazing visualization of what the 500+ old city of Tenochtitlan might have looked like.


For more you can visit: http://tenochtitlan.thomaskole.nl/

Looking Glass WEB DEPTH VIEWER

This great site has a viewer for the looking glass, sequences, movies and still images with depth.

http://stereo.jpn.org/lkg/indexe.html

http://stereo.jpn.org/lkg/depth/depthe.html

Deep Learning Depth And Normal Maps from Image (WIN)

To generate a depth map from any image (offline) using ML and then get a tangent space normal map.

With this software you can quickly obtain the depth and normal maps of any image.

It uses a deep learning model to generate the depth map of the image (monocular depth estimation), and then uses the generated depth map to calculate a normal map encoded in tangent space.

Highlights:

  • Free lifetime access to future versions and updates
  • Standalone executable, no need to install anything
  • Use it on any number of computers you personally own
  • Works completely offline, no internet required
  • Pay only once, use it forever
  • No GPU required

https://samontab.itch.io/depth-and-normal-maps-from-image

XREAL AIR Buttons

0

Explanation of XREAL Air Button Functions

Support Thread

There are three buttons on the right arm of the XREAL Air.

  • Display on/off button
  • Default brightness up button
  • Default brightness down button
r/Xreal - Explanation of XREAL Air Button Functions

In our pursuit of crafting compact and lightweight glasses while enhancing their capabilities, we’ve maximized the potential of these limited buttons. This endeavor grants our glasses expanded functionality, yet it also presents users with the challenge of memorizing these features. This conundrum fuels our ongoing commitment to discovering optimal solutions.For the sake of simplicity in memorization, I’ve compiled this post elucidating the button functions. Please don’t hesitate to leave a comment if you have any thoughts you’d like to share with us.

Button Functions

Display On/Off Button

  1. Single click

Activates or deactivates the glasses’ display.

2) Long press for about 3 seconds

Converts brightness control buttons into volume control ONLY when the XREAL Air connects to the XREAL Adapter directly.

Default brightness up button

  1. Hold for approximately 3 seconds until a beep

Switches the glasses between 2D and 3D modes. Not applicable when Beam is connected.

2) Hold for about 6 seconds until two beeps

Adjusts the glasses to operate at 120 Hz, applicable only during screen mirroring. Not recommended for Nebula or Beam usage, where the maximum supported refresh rate is 72 Hz.

Default brightness down button

  1. Hold for approximately 3 seconds until a beep

Enables DP audio passthrough when using glasses. Particularly beneficial when the XREAL Air pairs with third-party adapters that output DP audio. Not applicable when Beam is connected.

📌

All button adjustments do not have a memory function. After re-plugging the connection, the button functions will revert to those shown in the above diagram. If you encounter difficulties during the button adjustment process, you can attempt to unplug and then plug in the glasses again before making further adjustments.

XReal Air — Multi-Monitor AR Setup on Windows using Nebula & Troubleshooting

XReal Air Virtual Desktop with Nebula

August 2nd, 2023 Update

  • Nebula for Windows Beta V2 has been released with additional performance and stability improvements. This guide has been updated to reflect that.

Most VR and AR glasses tend to focus on gaming or entertainment. As of now, the XReal Air is the first pair of glasses that is actually viable as a monitor replacement. Imagine being able to travel with just a laptop, tablet, or even phone and put on glasses and have multiple monitor configurations from an ultra-widescreen to a dual/triple monitor setup with near-perfect text quality and 120hz support.

This article will primarily focus on setting up the Windows Beta and providing solutions to common issues. The glasses are currently compatible with a wide variety from phones and laptops to gaming consoles.

If your having issues with the Windows Nebula Beta, skip down to the troubleshooting section.

MAKE SURE TO TRY RESETTING SAVED MONITOR SETTINGS!

Nebula Setup on Windows

Prerequisites

  1. You laptop needs to have a USB-C port that supports DisplayPort output. These tend to have a lightning symbol or the letter D next to them. Otherwise you will need an adapter. The XReal community has compiled a list of community-tested adapters.
  2. Windows Nebula Beta client. You can request access to the Windows Beta client in the XReal Discord. It usually takes 12–24 hours. (Which can be downloaded from here as well: https://drive.google.com/file/d/1C7a3eMzAJwftBwmNuY1V444m9zc1Akel/view?pli=1)

Running the Nebula for Windows Beta

To run Nebula for Windows, open the beta folder and run the file named “Nebula for Windows” or “Nebula for Windows.exe”. You can then pick the virtual monitor setup above and click the start button.

Troubleshooting Performance and Stability

General Recommendations

  • Make sure to have the latest Windows / Driver Updates
  • Reset Windows Monitor Settings ← ****************
    In my experience, most issues are resolved by resetting External Monitor Settings in Windows. This is because the beta does not do a good job of configuring/editing existing monitor configurations which sometimes causes the virtual displays to be recognized as a display that they are not (like maybe an old monitor you had used before).

How to Reset Windows Monitor Settings

1. Disconnect the XREAL Air and make sure Nebula is closed.
2. Press Windows + R
3. Type regedit and hit ENTER
4. A window called “Registry Editor” should show.
Locate this three registry keys:
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\GraphicsDrivers\Configuration
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\GraphicsDrivers\Connectivity
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\GraphicsDrivers\ScaleFactors
4. After finding them right click on each folder and select delete than yes.
5. Open Nebula and re-connect the Air

Mouse Lag

  • Make sure the primary physical monitor (in my case it was my laptop’s monitor) is set to 60hz or 72hz.
  • Try disabling/enabling the integrated GPU on your laptop.

Screen Tearing / Stutter

  • Try to keep an eye on task manager because this could be caused by hardware constraints. If it seems like a hardware bottleneck, try less virtual monitors and/or lower resolutions.
  • Make sure the refresh rate of the physical monitor matches that of the virtual monitor(s) (60–72hz).
USB C Thunderbolt and Displayport Icons
  • If using USB-C, make sure you are using one that supports display out (look for a DisplayPort icon or a Lightning icon)
  • Set Vertical Sync to FAST in NVIDIA Control Panel
  • Adjust other settings in NVIDIA Control Panel. I will share my full list of settings but keep in mind they might not be applicable to everyone:

NVIDIA Control Panel → 3D SettingsImage Scaling: On
Aniostropic Filtering Application-Controlled
Antialiasing – FXAA Off
Antialiasing – Gamma Correction On
Antialiasing – Mode Application-Controlled
Antialiasing – Setting Application-Controlled
Antialiasing – Transparency Off
Automatic Display Switching Off
Background Application Max Frame Rate Off
CUDA – GPUs All
Low Latency Mode Ultra
Max Frame Rate Off
Multi-Frame Sampled AA (MFAA) Off
OpenGL GDI Compatibility Auto
OpenGL rendering GPU Auto-Select
Power Management Mode Prefer Maximum Perforance
Texture Filtering – Anisotropic On
Texture Filtering – Negative LOD Bias Allow
Texture Filtering – Quality High Performance
Texture Filtering – Trilinear On
Threaded Optimization Auto
Triple Buffering On
Vertical Sync Fast
Virtual Reality Pre-Rendered Frames 2
Vulkan/OpenGL Present Method Auto

NVIDIA Control Panel → 3D SettingsScaling Mode: Aspect Ratio
Perform scaling on: GPU

Virtual Display Color Improvement

  • Some people find the default settings for the virtual monitors to not be as good as when they are in mirroring mode.
  • Virtual Display color settings can be adjusted by going to NVIDIA Control Panel → Adjust Desktop Color Settings
  • Configuration depends on personal preference and whether or not you’re using the lens cover. For me, I prefer to just increase the Contrast and Digital Vibrance sliders from 50% → 60%.

If problems persist:

DOUBLE CHECK

These are the official instructions:

Installation Steps @everyone

➤ 1. Download the package from the Google Drive link: https://drive.google.com/file/d/1C7a3eMzAJwftBwmNuY1V444m9zc1Akel/view?usp=sharing

➤ 2. Unpack the file and click the exe ‘Nebula for Windows’; Then double click the ‘Nebula for Windows.exe’. (Please do not delete or edit any file in the unpacked folder.)

➤ 3. Please insert the Air glass according to the guide, and set the glass as an extended screen;

➤ 4. Wait for the software to be launched well. Select Virtual Screen mode(five different modes) and click ‘Start AR Desktop’;

Please note: (1) If you encounter white screens during use, please check if the screen is set to extended screens under the current virtual mode; (2) Please try to reconnect the glass if the image just follows your head.

Recommended Configuration Before Start

  1. When you double-click the .exe, it may request Admin permission, please select ‘Yes’;
  2. After inserting the XREAL Air, please check if it is connected to the discrete graphics card through the USB-C port;
  3. Set the Vertical Sync function of the discrete graphics card to ‘Fast’ through the Nvidia control panel. Also, make sure that it is running in High-Performance mode.

Maya and Pyserial fix on Windows

0

Well, I was having issues getting pyserial and Maya to run for serial communications using python. I was getting the error “Error: No module named serial”

The solution:

Make sure that pyserial is installed, if not type the following on any command (CMD) window

python -m pip install pyserial

After it was installed, go to the python console and type:

  • import sys (hit enter)
  • sys.path (hit enter and it will return a list of paths of your python)
  • Modify the following mel script with your python paths and run it
global proc appendSystemPath(){
python( "import sys" );
python( "sys.path.append('C:/Python310/Lib/site-packages')" );
python( "sys.path.append('C:/Python310/Lib/site-packages/win32')" );
python( "sys.path.append('C:/Python310/Lib/site-packages/win32/lib')" );
python( "sys.path.append('C:/Python310/Lib')" );
}
appendSystemPath();

Then just run your python script as normal using the “import serial” line

import serial