Worth noting here that although the Andrew Johnson impeachment only failed by one vote in the Senate, that’s largely because many Democratic Senators (who would have supported him) were disqualified from participating. 10 former Confederate states had not yet been re-admitted to the Union for purposes of Senate representation.
Mitt Romney’s vote to impeach Trump on a single count (Art. I) marked the first time in U.S. history that any Senator voted to remove a President of their own party.
Impeachment has always been overwhelmingly partisan.
I suppose if the presidential violation were as open, obvious, and egregious as the President literally shooting someone on Fifth Avenue (as Trump joked), then maybe.
Other than something like that: the only two things that can hold a U.S. President accountable are the President himself (through resignation), or We The People through the ballot box.