Well, if you craft a torch using one stick and one piece of coal (Or charcoal) And place it under the gravel whenever you break a block. It will continuously break it whenever it falls on top of it. Therefore, you will no longer have to worry about the gravel