No noise when running on battery, but it's not the case when used with a transformer.
So the noise must be coming from the electrical source, therefore, a simple cable was made:
One end should be inserted between the guitar/ukulele while the other end should be placed on the ground, or better yet, step on it.
No more noise.