Abstract: Rural society is an important part of the national governance system. Its governance effectiveness affects the progress of national governance modernization. Strengthening rural governance is an urgent problem to be solved in current rural construction. The rule of virtue is one of the important magic weapons of rural governance, which makes up for the lack of autonomy and the rule of law and promotes the prosperity of rural culture. In order to further improve the effectiveness of the rule of virtue, we can strengthen the governance ideas from the aspects of strengthening rural morality construction, inheriting the excellent traditional local culture and cultivating the new era of rural people, and continuously improve the overall level of rural governance.