AudioLink

AudioLink is a system that analyzes and processes in-world audio into many different highly reactive data streams and exposes the data to both Udon and custom shaders. For Avatars, this allows the ability to create a wide variety of visual effects that react to in-world audio in real time.

For more information on AudioLink, visit the website at https://audiolink.dev/ or view the GitHub Repository

In Poiyomi Shaders, there are various features that support AudioLink. However, they will only be available when AudioLink is activated on the Material.

Demonstration of various AudioLink effects on this Avatar, with the AudioLink Controller on the left. (Un-mute to hear sound)

AudioLink

• Type: Checkbox

If enabled, activates AudioLink features and exposes AudioLink parameter controls for supported modules and effects.

info

When this feature activates, the following sections in Poiyomi Shaders will have their AudioLink properties exposed for you to use! Refer to each of their Documentation Entries for more information.

• Alpha Options
• Vertex Options
• Vertex Glitching
• Decals
• Matcap
• Rim Lighting
• Outlines
• Dissolve
• Flipbook
• Emission
• Glitter / Sparkle
• Pathing
• Voronoi
• Truchet

Anim Toggle

• Type: Checkbox

tip

Animate this checkbox when creating toggles for AudioLink on this Material. Animating the Section Header will not work!

Smoothing

Bass

• Type: Float, Range: 0.0 - 1.0

Modifier for smoothing the Bass Band.

Low Mid

• Type: Float, Range: 0.0 - 1.0

Modifier for smoothing the Low Mid Band.

High Mid

• Type: Float, Range: 0.0 - 1.0

Modifier for smoothing the High Mid Band.

Treble

• Type: Float, Range: 0.0 - 1.0

Modifier for smoothing the Treble Band.

Overrides

Properties that allow animated overrides of the Audio Bands against AudioLink data from the World.

Band Overrides

• Type: Checkbox

Enables the Band Overrides function. These sliders will manually override the mentioned Band as if music is playing, except that now you're manually animating it's values.

This can be useful if you for some reason wish to use the Voice VRChat Parameter to also animate the forementioned Overrides in your Animator. As an example, you could use Voice to make those Bands have an effect when you speak.

Band Overrides Options

Bass

• Type: Float4, Range: 0.0 - 1.0

How much to override the Bass Band. A value greater than 0 will override the Band to the specified value.

Low Mid

• Type: Float4, Range: 0.0 - 1.0

How much to override the Low Mid Band. A value greater than 0 will override the Band to the specified value.

High Mid

• Type: Float4, Range: 0.0 - 1.0

How much to override the High Mid Band. A value greater than 0 will override the Band to the specified value.

Treble

• Type: Float4, Range: 0.0 - 1.0

How much to override the Treble Band. A value greater than 0 will override the Band to the specified value.

How to test AudioLink using Poiyomi Shaders

In order to see how AudioLink functions on your Material, you must set up the AudioLink package in Unity.

Below is a Video Tutorial on how to set it up, courtesy of Community Member Teeh.

Instructions

Here are text instructions on how to set up AudioLink, as explained in the video above:

1. Use the VRChat Creator Companion and click Manage Project for your Unity Project.
2. Under Manage Project, ensure you have Curated enabled in your Selected Repos. Look for AudioLink in your list.
3. Click the + Button on the listing for AudioLink to add it to your project.
   • If you cannot use Creator Companion, you can alternatively download the AudioLink "Minimal" Unity Package and install it to your Project. Get it here: https://github.com/llealloo/vrc-udon-audio-link/releases
4. Launch Unity.
5. In Unity, on the Menu Bar, click Tools -> AudioLink -> Add AudioLink Prefab to Scene. A prefab named AudioLinkAvatar should be added to your Scene.
   • Alternatively, you can add AudioLinkAvatar.prefab to your Scene by navigating in your Project Files to Packages/AudioLink/Runtime. You can then drag & drop the AudioLinkAvatar.prefab Prefab from there into your Scene's Hierarchy.
6. If you haven't already, activate AudioLink on your Poiyomi Material(s).
7. Enter Play Mode and a music track should be audible. If you hear this, then AudioLink is now playing.

As the audio plays, you can fiddle around with the AudioLink settings on your Material while the music is continuously playing in the background. As you do this, the changes should be instantly reflected on your Avatar.

Only use Play Mode to test AudioLink!

While in Play Mode, nothing will be saved other than your Materials. Make sure you exit Play Mode before you intend to do further edits to your Avatar!

Change the Music

If you are not a fan of the music that is playing, feel free to change it! To do this, expand the AudioLinkAvatar Object in your Hierarchy. Select the Object named AudioLinkYtdlpPlayer.

You can then change the URL from the Inspector. Paste the new URL into the field as shown below. If you're already in Play Mode, click Reload URL to switch it.