Going to remember that you seem genuinely interested in debating the finer points without hostility, so I'll keep my irons down.
So, let's look at what states tried to recall their electors. Where does it state that this was a constitutional violation? Which states had done this?
Looking at general provisions under the US Constitution, I found this interpretation of the law from constitutioncenter.org:
"One unusual feature of the Elections Clause is that it does not confer the power to regulate congressional elections on states as a whole, but rather the “Legislature” of each state. The Supreme Court has construed the term “Legislature” extremely broadly to include any entity or procedure that a state’s constitution permits to exercise lawmaking power. Thus, laws regulating congressional elections may be enacted not only by a state’s actual legislature, but also directly by a state’s voters through the initiative process or public referendum, in states that allow such procedures.
The Court also has held that a legislature may delegate its authority under the Elections Clause to other entities or officials. A few states have chosen to transfer power to draw congressional district lines from their respective legislatures to non-partisan or bipartisan “independent redistricting commissions.” These states believe that such commissions can make the electoral process more fair by preventing voters from being divided into congressional districts in ways that unduly protect existing officeholders (“gerrymandering”)."
It appears to me, from the verbiage of this passage, that states do not inherently require the formal legislative body to determine how voting is accomplished.