The middle class can't be destroyed because its just the midline of median incomes in the US. It can be narrowed and it can be attacked though.
To your question: Yes, the entire fiat money system is based on rumors and not actual value. As long as that's true everything can fall to a rumor.