Is moving down a set in Maths something to be embarrassed about?

Instead of letting it embarrass you, use it as motivation to really get after things and move up to the next set. You can do it.