I think it should be up to the individual to decide want they go by. Although technically, it could fall into non-binary because the term "non-binary" is used to encompass everyone who doesn't recognize as solely man or woman.
But if someone who is agender doesn't recognize as non-binary, I think that should be up to them.