It does count as vandalism because the school owns the desk.
Unless you brought the desk from home to school, they still have a reason to send you to the office.
although I agree, that is a stupid reason to get sent to the office.
Back in my day there were doodles on every desk in class.