Home Blog Page 4

XReal Air — Multi-Monitor AR Setup on Windows using Nebula & Troubleshooting

XReal Air Virtual Desktop with Nebula

August 2nd, 2023 Update

  • Nebula for Windows Beta V2 has been released with additional performance and stability improvements. This guide has been updated to reflect that.

Most VR and AR glasses tend to focus on gaming or entertainment. As of now, the XReal Air is the first pair of glasses that is actually viable as a monitor replacement. Imagine being able to travel with just a laptop, tablet, or even phone and put on glasses and have multiple monitor configurations from an ultra-widescreen to a dual/triple monitor setup with near-perfect text quality and 120hz support.

This article will primarily focus on setting up the Windows Beta and providing solutions to common issues. The glasses are currently compatible with a wide variety from phones and laptops to gaming consoles.

If your having issues with the Windows Nebula Beta, skip down to the troubleshooting section.

MAKE SURE TO TRY RESETTING SAVED MONITOR SETTINGS!

Nebula Setup on Windows

Prerequisites

  1. You laptop needs to have a USB-C port that supports DisplayPort output. These tend to have a lightning symbol or the letter D next to them. Otherwise you will need an adapter. The XReal community has compiled a list of community-tested adapters.
  2. Windows Nebula Beta client. You can request access to the Windows Beta client in the XReal Discord. It usually takes 12–24 hours. (Which can be downloaded from here as well: https://drive.google.com/file/d/1C7a3eMzAJwftBwmNuY1V444m9zc1Akel/view?pli=1)

Running the Nebula for Windows Beta

To run Nebula for Windows, open the beta folder and run the file named “Nebula for Windows” or “Nebula for Windows.exe”. You can then pick the virtual monitor setup above and click the start button.

Troubleshooting Performance and Stability

General Recommendations

  • Make sure to have the latest Windows / Driver Updates
  • Reset Windows Monitor Settings ← ****************
    In my experience, most issues are resolved by resetting External Monitor Settings in Windows. This is because the beta does not do a good job of configuring/editing existing monitor configurations which sometimes causes the virtual displays to be recognized as a display that they are not (like maybe an old monitor you had used before).

How to Reset Windows Monitor Settings

1. Disconnect the XREAL Air and make sure Nebula is closed.
2. Press Windows + R
3. Type regedit and hit ENTER
4. A window called “Registry Editor” should show.
Locate this three registry keys:
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\GraphicsDrivers\Configuration
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\GraphicsDrivers\Connectivity
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\GraphicsDrivers\ScaleFactors
4. After finding them right click on each folder and select delete than yes.
5. Open Nebula and re-connect the Air

Mouse Lag

  • Make sure the primary physical monitor (in my case it was my laptop’s monitor) is set to 60hz or 72hz.
  • Try disabling/enabling the integrated GPU on your laptop.

Screen Tearing / Stutter

  • Try to keep an eye on task manager because this could be caused by hardware constraints. If it seems like a hardware bottleneck, try less virtual monitors and/or lower resolutions.
  • Make sure the refresh rate of the physical monitor matches that of the virtual monitor(s) (60–72hz).
USB C Thunderbolt and Displayport Icons
  • If using USB-C, make sure you are using one that supports display out (look for a DisplayPort icon or a Lightning icon)
  • Set Vertical Sync to FAST in NVIDIA Control Panel
  • Adjust other settings in NVIDIA Control Panel. I will share my full list of settings but keep in mind they might not be applicable to everyone:

NVIDIA Control Panel → 3D SettingsImage Scaling: On
Aniostropic Filtering Application-Controlled
Antialiasing – FXAA Off
Antialiasing – Gamma Correction On
Antialiasing – Mode Application-Controlled
Antialiasing – Setting Application-Controlled
Antialiasing – Transparency Off
Automatic Display Switching Off
Background Application Max Frame Rate Off
CUDA – GPUs All
Low Latency Mode Ultra
Max Frame Rate Off
Multi-Frame Sampled AA (MFAA) Off
OpenGL GDI Compatibility Auto
OpenGL rendering GPU Auto-Select
Power Management Mode Prefer Maximum Perforance
Texture Filtering – Anisotropic On
Texture Filtering – Negative LOD Bias Allow
Texture Filtering – Quality High Performance
Texture Filtering – Trilinear On
Threaded Optimization Auto
Triple Buffering On
Vertical Sync Fast
Virtual Reality Pre-Rendered Frames 2
Vulkan/OpenGL Present Method Auto

NVIDIA Control Panel → 3D SettingsScaling Mode: Aspect Ratio
Perform scaling on: GPU

Virtual Display Color Improvement

  • Some people find the default settings for the virtual monitors to not be as good as when they are in mirroring mode.
  • Virtual Display color settings can be adjusted by going to NVIDIA Control Panel → Adjust Desktop Color Settings
  • Configuration depends on personal preference and whether or not you’re using the lens cover. For me, I prefer to just increase the Contrast and Digital Vibrance sliders from 50% → 60%.

If problems persist:

DOUBLE CHECK

These are the official instructions:

Installation Steps @everyone

➤ 1. Download the package from the Google Drive link: https://drive.google.com/file/d/1C7a3eMzAJwftBwmNuY1V444m9zc1Akel/view?usp=sharing

➤ 2. Unpack the file and click the exe ‘Nebula for Windows’; Then double click the ‘Nebula for Windows.exe’. (Please do not delete or edit any file in the unpacked folder.)

➤ 3. Please insert the Air glass according to the guide, and set the glass as an extended screen;

➤ 4. Wait for the software to be launched well. Select Virtual Screen mode(five different modes) and click ‘Start AR Desktop’;

Please note: (1) If you encounter white screens during use, please check if the screen is set to extended screens under the current virtual mode; (2) Please try to reconnect the glass if the image just follows your head.

Recommended Configuration Before Start

  1. When you double-click the .exe, it may request Admin permission, please select ‘Yes’;
  2. After inserting the XREAL Air, please check if it is connected to the discrete graphics card through the USB-C port;
  3. Set the Vertical Sync function of the discrete graphics card to ‘Fast’ through the Nvidia control panel. Also, make sure that it is running in High-Performance mode.

Maya and Pyserial fix on Windows

0

Well, I was having issues getting pyserial and Maya to run for serial communications using python. I was getting the error “Error: No module named serial”

The solution:

Make sure that pyserial is installed, if not type the following on any command (CMD) window

python -m pip install pyserial

After it was installed, go to the python console and type:

  • import sys (hit enter)
  • sys.path (hit enter and it will return a list of paths of your python)
  • Modify the following mel script with your python paths and run it
global proc appendSystemPath(){
python( "import sys" );
python( "sys.path.append('C:/Python310/Lib/site-packages')" );
python( "sys.path.append('C:/Python310/Lib/site-packages/win32')" );
python( "sys.path.append('C:/Python310/Lib/site-packages/win32/lib')" );
python( "sys.path.append('C:/Python310/Lib')" );
}
appendSystemPath();

Then just run your python script as normal using the “import serial” line

import serial

Xreal Air Updating on Windows 10

So I had to update the xreal glasses and it turns out that the stock USB C – USB C cable doesn’t work very well on windows for updating firmware so here are the steps I followed to update the firmware successfully to version 1110

  1. Connect your Xreal Air to your pc using another USB C to USB A cable (it worked for me using a USB C to Mini USB adapter and then any USB A cable) and plug it directly to the PC, don’t use any dongle or hub and avoid using the stock cable
  2. Open Chrome (preferably on incognito mode) and load the update website (https://ota.xreal.com/en/air-update.html )
  3. Follow the steps to download the firmware, connect the Air and click on the MCU Firmware update.
  4. It should update without trouble
  5. Once you finish click on update DP Firmware
  6. It will say that it CANT CONNECT or THE GLASSES ARE NOT CONNECTED
  7. Unplug your glasses from the pc and plug them back
  8. Click OK on the popup and it will show the connection dialog
  9. Select your glasses from it and continue the update.
  10. Everything should be updated (at the time of writing the xreal firmware version was “air_07.1.02.201_20230228.bin”

Wacom Cintiq and Sai V2 skipping when drawing

I’ve had this issue for a while and if you have the same problem where the drawing skips when painting or when moving the canvas with your pen, the issue is related to the latest wacom drivers, I have a 24QHD and the latest drivers that work flawlessly with Paintool Sai are 6.3.42 anything newer will lag when using SAI (despite switching from Wintab to Windows Ink)

Symptoms:

  • Draw a line or move the canvas without lifting the pen
  • The pen will skip randomly after a few seconds
  • Restart and reinstall newer drivers won’t remove the issue
  • Photoshop, CPS, Paintstorm or Tvpaint don’t seem to be affected by this issue
  • Paintool Sai V2 will skip all the time
  • This is using Windows 10 x64

Solution:

AutoRecon: Automated 3D Object Discovery and Reconstruction

0

Extremely impressive work for object reconstruction using a few pictures, neural rendering included (materials). Great work whose code is going to be released “soon”

https://zju3dv.github.io/autorecon/

Download videos from M3U playlist files

0

Little open sourcee software to download from M3U8 and M3U playlist files.

This is an m3u8 downloader.

Summary

Supports:

  • Auto decrypt for AES-128-CBC
  • Master List
  • Live stream recording(BETA)
  • Customize HTTP headers
  • Auto merge clips(Binary or ffmpeg)
  • Select save clip by time code or index
  • Network driver on Windows OS
  • Alternative audio/video track
  • Mux without video track
  • Custom HTTP proxy or Use system proxy
  • Optimization for Chinese streaming platforms

https://github.com/nilaoda/N_m3u8DL-CLI/blob/master/README_ENG.md

Release: https://github.com/nilaoda/N_m3u8DL-CLI/releases/tag/3.0.2

Just paste the m3u address and the software will give you the options to download the video.

AI Powered PIANO “Piano Genie”

0

Piano Genie is in some ways reminiscent of video games such as Rock Band and Guitar Hero that are accessible to novice musicians, with the crucial difference that users can freely improvise on Piano Genie rather than re-enacting songs from a fixed repertoire. You can try it out yourself via our interactive web demo!

Code and source so you can train it with your own MIDI files.

https://magenta.tensorflow.org/pianogenie

Contraposto for Engaging Posing!

Using contraposto for developing interesting poses, JAP with ENG subtitles.

BiteyCastle Academy 2dFX FREE COURSE

During many years I followed and took this course for FX animation, covers all the basics from lighting to smoke clouds and motion layering with perspective. An amazing asset that Adam Phillips has made available for free, more than 40 lessons including videos, timing sheets and .fla files to get you started on the wonderful world of 2D Animated FX.

If you feel like trying right away and don’t have a software, here’s a link to my AzDrawing version with the animation capabilities.

Bitey Castle FX Course: https://chluaid.gumroad.com/l/bcafx

AzDrawing: https://cocoalopez.com/blog/?p=1963

A spherical flame is something one may have previously thought impossible but it’s nice to know that our reality can surprise us at times.

Animated tones, rims and highlights


Extracted from Adam’s website:

The BCAFX Course is now free!

The decision to offer the course for free was not an easy one. After all, it has been helping to pay my bills for a decade! However, the price point on the course was never intended to make me rich, it was merely to support me in my personal projects, and make animation inexpensive and accessible to animators, whether they’re young, old, amateur or expert. 

Sure $20 monthly is inexpensive for a course of this calibre and depth, but it’s still a bit too much if you’re a student or hobbyist; and everything’s a subscription nowadays, we can’t keep up with them all! When you’re starting out on your animation journey, it’s important that you have access to quality learning from mentors who know what they’re talking about and have proven their skill in production. Unfortunately high quality learning from industry professionals doesn’t always come cheap.

Hopefully now that BCAFX is free, we can see more and more up-and-coming animators dedicating themselves to the craft of FX animation.

Wagner PMC documentary

Found this at RT website, I find it interesting to see many sides of any conflict and since there’s a blockade everywhere for anything that diverts the common speech regarding the war, thought about sharing it here.