The Nazi Party publicly and loudly identified with religion

Okay and? Did you want them to be outspoken atheists in 1920s Germany?

Most historians argue he was prepared to delay conflicts for political reasons and that his intentions were to eventually eliminate Christianity in Germany, or at least reform it to suit a Nazi outlook.

and persecuted and purged the Jews who had been treated awfully by Christians in Europe for centuries.

Okay and? Antisemitism was already a thing independent of the Christianity that created it. The Nazis also went after leftists, (forgot to complete that sentence so edit:) Romas, Catholics and Slavs, among others.

“The Führer is deeply religious, though completely anti-Christian. He views Christianity as a symptom of decay. Rightly so. It is a branch of the Jewish race. This can be seen in the similarity of their religious rites. Both (Judaism and Christianity) have no point of contact to the animal element, and thus, in the end they will be destroyed.” So privately Hitler was religious, and publicly the Nazis were religious,

Yeah why do you want them to be atheists? Nearly everyone was religious back then, so obviously they were going to be religious too. And in the first place, Hitler repeatedly challenged orthodox religious beliefs in his time, so if anything to him Christianity was a pain in the ass that he needed to deal with and not a part of his ideology. He also persecuted non-Nazi Christians almost as soon as they took power.

and one of the most sickening, widespread, and prominent atrocities they committed was the persecution and genocide of a religious minority.

See above.