Tries from Amlin Man of the Match Ed Jackson and left wing Josh Bassett saw Wasps overturn a 10-6 half-time deficit and they are now four points clear at the head of the group.
"We're happy with two from two - that was our aim going into it," said Hayter, who was the penultimate scorer in Wasps' 14-try victory over Viadana in Round One.
"We were really happy to come away with five points last week and another win at home was important to get us on a good footing.
"We gained a lot of confidence from last week. We got to go through some new stuff we'd brought in and that helped.
"We're going hard for this competition: you saw that by the side we put out for Bayonne. This game was tough and it was probably more satisfying to get the win, grinding it out against a good Bayonne side."
Hayter admits that the first-half was far from perfect but he was more than happy with the way his team-mates put things right with 20 unanswered points after the break.
The result never looked in doubt once Jackson and Bassett crossed in the space of three minutes midway through the third quarter and Hayter claims he always felt confident the game would go Wasps' way.
"We were a bit scrappy in the first half and made a few too many errors and didn't look after the ball well enough. We came out in the second half and got our game plan together, looked after the ball and put some phases together," added Hayter.
"Bayonne are a good physical side and they showed that in the first half. We knew we just needed to stick to our game plan and our patterns and things would fall into place. It took a little longer than we were hoping to get into that but, once we did, we were quite comfortable with that.
"The forwards put in a massive shift. The ball was really greasy and they provided that platform. Goodey (Andy Goode), Joey (Simpson) and Tommy (Bell) were kicking the corners really nicely and the pack putting massive pressure on their scrum and lineout was a huge help."
As well as recognising the role played by those up front, Hayter also reserved a special mention for England and Lions wing Christian Wade.
Wade stopped a certain try with a last-gasp tackle on Scott Spedding when Wasps were already behind in the first period and he then provided the game's moment of magic when he somehow found the space to put Bassett for the match-clinching score.
"Christian's a class act. He's dangerous in any weather conditions and in any competition. He's so dangerous but he showed his defensive skills as well. I certainly wouldn't want to be facing him."