Guitar Video Transcription AI

[bencuri]

I am trying to figure out a song from a video, a solo fingerpicking tune. Usually I use Spectralayers Pro for learning songs. But I noticed that for acoustic guitar Spectralayers is just a mess. Very difficult to follow.

And this time I am having difficulties, too: the bass line is invisible. I don't even understand how it is possible, you can hear the bass notes but don't see it. By trial and error I managed to figure out that you can catch the bass notes with the selection tool if you set it to consider the selected pitch as the 2nd harmonic of the note. That way it works. So you don't see the bass note but by trial and error you can select the relevant harmonics and then you can figure out things very slowly.

Parallelly, I have also been trying to turn this to tab with transcription softwares, but the result is the same: they miss the bass notes.

Of course on the video you can see he is picking the bass and where he is picking it (it is just too fast and too tiring to follow).

So I have a clue what's going on: the base note of the bass might be too low for the 'sensor' of these softwares, so they skip it. Even if you hear it is there because you can recognise it by the harmonics. But softwares do not.

However all this could be solved, if the AI of the software would look at the video as well to check the player fingers. I know it might sound futuristic, but is there any software like that? That could easily solve this issue of mapping the bass. Other way it is not possible to map the bass because they just seem to be confused in case of the acoustic guitar.

[BJG145]

(it is just too fast and too tiring to follow)

Can you slow it down? YT has playback speed built in.

[bencuri]

In this recent case the problem is not slowing down. I can, and all in all, the information is there for me to learn the song. It can be slowed down, output of normal transcribing apps are partly usable, Spectralayers partly usable. The question rather is: how long it takes? If I had a complete tab with the full bass line, it would speed up the process significantly, sparing me weeks. But that is what is not available visually. And I am not that skilled to listen to the slowed down version and memorize the full bass line at once. And for certain songs I often have this problem.

[Kwackman]

Have you checked to see if the song’s tab is available on one of the guitar tab sites?

[bencuri]

Have you checked to see if the song’s tab is available on one of the guitar tab sites?

Yes but not available. It is a lesser known artist.

So the situation is I can learn it but the tool I mentioned would be useful. Or a better normal transcription app.

However it has just come to my mind that the new Spectralayers Pro has a feature to separate the track to instruments. I will download a trial version and check what it achieves maybe it is better than the other softwares.

[merlyn]

I saw an open source pitch to MIDI app NeuralNote:

https://github.com/DamRsn/NeuralNote

I haven't tried it as I can usually work things out by ear. It might be good, as it uses a neural network.