Al Reports

This ‘Beat Saber’ Project Uses AI to Generate Custom Beat Maps for Any Song

Originally posted on:

Manually creating beat maps for your favorite songs in Beat Saber (2018) requires a bit of know-how and time. If you’re looking for a quick and surprisingly effective solution to automatically creating beat maps for any song, look no further than the fan-built service called ‘Beat Sage’.

Beat Sage is an AI which creates custom beat maps with any song on YouTube, or any mp3 in your possession.

Simply navigate to the Beat Sage website, plug in the song’s YouTube URL (or upload your own mp3), tick a few boxes for level difficulty, game modes, and song events, and you’ll have a brand new mess of levels for Beat Saber on SteamVR headsets and Oculus Quest. And it’s free.

Created by Beat Saber fans Chris Donahue and Abhay Agarwal, Beat Sage is said to use two neural networks to map an audio file into what the team calls “a plausible Beat Saber level.”

“These neural networks were trained on Beat Saber levels created by humans,” the team explains. “The first neural network listens to the audio and predicts at what points in time blocks should be placed.

The second neural network looks at the predicted timings and maps each to a timestamp to a block type (e.g. red up, blue down, red up + blue down).”

Check out the promo below to see some of the results, timestamped showing Ariana Grande’s song ‘thank u, next’.

Installing the songs is fairly straightforward on PC, as it doesn’t require any modding. Find the ‘CustomLevels’ subfolder in your directory either via Steam or Oculus Home—depending on where you bought Beat Saber. Here’s the default locations.

  • Steam VR: C:\Program Files (x86)\Steam\steamapps\common\Beat Saber\Beat Saber_Data\CustomLevels
  • Oculus Home: C:\Program Files (x86)\Oculus Apps\Software\hyperbolic-magnetism-beat-saber\Beat Saber_Data\CustomLevels

From there you unzip the downloaded folder into CustomLevels and you’re off to the races.

Installing for Oculus Quest is a bit more involved, as it requires modding through the unofficial sideloading app SideQuest. Check out the full instructions on how to install the custom songs on Quest.

Beat Sage is free, however, the team is taking donations through its Patreon, which they say will help keep the service free moving forward.

Order the Insta360 One X here and get a FREE Selfie Stick!
Order the Insta360 One X here and get a FREE Selfie Stick!

What is 360 VR Video?

360 video is a video that is recorded in all directions at the same time with multiple cameras. The videos are stitched together either internally in the camera or externally using special software.

It then forms one spherical video that is controlled by the viewer, enabling them to look up, down, right or left at their discretion.

Is 360 Video Virtual Reality?

I want you to be the judge.

Recommended MicroSD Card for use with the Fusion 360 camera

Recommended MicroSD Card for use with the Fusion 360 camera 

How are you watching your 360 VR Video?

Are you watching on your PC?

Is it Facebook? YouTube? Veer.TV ?

Or better still, are you using your Samsung Galaxy Smartphone with your Samsung Gear VR Headset?

GoPro-Fusion-Tripod-Mount-1_4-20-screw-thread for GoPro Fusion

Or are you using another smartphone with a Google Cardboard? Google Daydream?

Leave a comment below. Let us know what you like or don’t like. If you have seen a 360 VR video that you think is awesome, tell us, and we will feature it.

What type of VR Headset do you own? Or do you watch with your computer? Smartphone?

Do you have a VR camera? Ricoh Theta S? Ion360?  Samsung 360 gear? Insta360?

And if you are looking for 360 Video Production Services, contact Al Caudullo

With 37 years of Media experience, we can Deliver More for You in 360 Video. Click here to see what our customers say about our work

Utilizing state of the art technology, Al Caudullo, and his team has been delivering award-winning compelling productions spanning the globe. Exotic destinations blended with unique cultural experiences give viewers an experience like no other.

From vibrant American cities like San Francisco and Las Vegas to the isolated mountains of Mongolia. From ancient civilizations of Cambodia and Myanmar to the lush resorts of Southeast Asia and beyond. All from the comfort of your living room.