Despite the Hail Mary touchdown, Aaron Rodgers and the New York Jets fell to the Buffalo Bills in their first game since the head coach was fired. CNN

The Buffalo Bills overcame Aaron Rodgers' Hail Mary touchdown pass late in the first half to outlast the New York Jets 23-20 in a penalty-filled victory Monday night in East Rutherford, New Jersey.

Bills kicker Tyler Bass made a 22-yard field goal with 3:43 left in the game and Buffalo cornerback Taron Johnson intercepted a pass from Rodgers in the final two minutes to snap a two-game losing streak and improve to 4-2.

Bills quarterback Josh Allen was stellar in the win, completing 19-of-25 passes for 215 yards and two touchdowns, along with a score in the first quarter.

According to the NFL, Monday's game was Allen's 21st career game with multiple passing touchdowns and at least one rushing score, putting him just behind Cam Newton — who has 22 — atop the all-time list.

“The first half was very good, and we found a way in that second half to keep that momentum going,” Allen said afterward. “There's a lot to learn from it, we were a bit sloppy there at the end, got a few penalties, but it was a team win.”

Second-year running back Ray Davis rushed 20 times for 97 yards and 55 yards through the air in the victory. Davies was filling in for James Cook, who was ruled out with a toe injury earlier in the game.

It was the Jets' first game since firing head coach Robert Saleh, with defensive coordinator Jeff Ulbrich named interim coach, while the franchise demoted offensive coordinator Nathaniel Hackett from play-calling duties in favor of Todd Downing.

And the moves seemed to pay off from the get-go, as New York scored a field goal and a touchdown on the team's first two offensive possessions for a 10-7 lead after the first quarter.

New York's advantage was short-lived though as Allen completed a long drive with a touchdown pass to receiver Mack Hollins and Buffalo returned with running back Dawson Knox in the second quarter.

Buffalo seemed poised to take a 20-10 lead into the half, until Rodgers produced some magic. With just seconds left in the first half, the four-time NFL MVP launched a prayer toward the end zone from near the 50-yard line, where Allen Lazard soared over two Bills defenders for a 52-yard Hail Mary touchdown. .

The Hail Mary was Rodgers' fourth of his career, making it the most by any NFL player since the 1970s.

The moment was widely praised on social media, with Kansas City Chiefs quarterback Patrick Mahomes writing on social media: “Why is Aaron so good at this,” with NBA superstar LeBron James replying: “Right!! This is ridiculous!”

After an exciting first half, both teams struggled to score in the second half.

New York was capped by an unusual night for kicker Greg Zuerlein, who missed two potential go-ahead field goals at a windy MetLife Stadium as the Jets dropped their third straight game to drop to 2-4 on the season.

For the Bills, the win cemented their position in the AFC East division ahead of their home game against the Tennessee Titans on Sunday.