Nothing at all wrong with a .357. The only gripe I have ever had with it is you need the right bullet choice for deer. Watch out for the ones that open too fast made for defense or those too tough for expansion in deer.
Listen to those with many deer kills for the proper boolit.