align sum && mean on cpu with torch in single thread (#79568)

* align sum && mean on cpu with torch

* fix issues according to ci bots

* fix according to ci-bot

* improve code structure

* add support for bf16/fp16

* fix according to ci-bot

* no need to use flag

* change test standard