Official Fate/Apocrypha materials confirm Astolfo is male and identifies as such. He only looks girly (although he's got noticeable muscle tone when not wearing armor—a Paladin of Charlemagne needs to be in good shape, after all!) and likes cute stuff.