As a flat-earther, I can confirm that I and others like Jeranism believe that. There is one direction to which matter (especially when heavier) will always be attracted, which has nothing to do with the earth's mass. The reason that everything gets pulled down in that direction is that all of the energy is inclined to flow in a certain direction. This is caused by the fact that when one force goes in a certain direction, the other forces nearby all follow. For example, when wind blows, objects are carried along with it, those objects cause more things to move in the same direction, and eventually, erosion starts to favor the direction of said wind.