Thank you for all the great answers.
@Wonks
Here is how I did set up SPAN (in the picture above). So it should be fine right?

By the way if anyone can tell me what the drawback of high overlap (makes the graphic move smoother) is, that would be greatly appreachiated as well.
Is there a free tool I can do offline frequency analysis with? As far as I understand it the blue graphic above is infact offline, but I am not sure.
Put a high pass 120dB/octave slope filter at 100Hz on the sound and look at the waveform and you’ll almost certainly see a very similar waveform, despite you having filtered it out.
It does disappear.

If you have got unwanted low frequency noise, then I’d just use a gentle high-pass filter. I think Hugh has mentioned no more than 18dB/octave to avoid filter ringing.
I can set a highpass 6-18db/octave. Since my lower pitch samples go down to 80Hz/E2 should I move the highpass filter for those specific samples since the low end there is actually useful? For the higher pitch samples I would keep the HP constant at a frequency that covers the rumble, no need to micro adjust there. What do you think?
If you do have low frequency noise (e.g. if using a mic, there might be some traffic noise or ventilation noise in the background), the slope you use will depend on how much there is and if it runs all the way up to the wanted sounds or not.
I did record a friends voice. The enviroment was pretty quiet but I did had three preamps (including the audio interface input) to color the sound. I then ran the samples through a noise reduction tool, but appearently it did not get rid of everything. I should have been more careful at this stage. Since I did alot of work on the samples since then, I need to fix this at this stage.
You can always use two filters in series; an aggressive one at say 25-30Hz, to cut out any subsonic noise, and a gentle one at say 60Hz, to reduce noise levels above that and reduce any ringing from the sharper filter.
That is a great idea. Thank you.
But my advice would simply be to build a stack of your samples to create the pad and listen for low-end problems. Experiment with an 18dB/oct high-pass (low-cut) FILTER tuned somewhere around 60Hz to see if you can hear any benefit on headphones.
So obviously my advice is to use very good headphones, try different filters and slopes, and run it up until you hear the effect on what you want to keep and back it down.
I'm going to try this as well. Thank you.
The greater the number of samples the greater the accuracy of the frequency display at both high and low frequencies, though it does slow down the update of the display considerably. 32768 samples at 44.1kHz is around 3/4 of a second.
I have mine at 65536 Block Size at 192kHz.
In this instance, although of a female vocal (so you normally wouldn't expect too much below 200Hz), it was a rough-and-ready recording to capture a song quickly, so the mic was picking up thumps from the keyboard beneath it. So although the low frequency stuff is 30-40dB down on the peak vocal, it still benefited from high-pass filtering.
I suspect that my analog signal chain introduced this noise floor. The voice itself goes down to 80Hz in the lowest sample.
Thanks again. This give me a much better understanding how to approach these issues.