How can I display icons next to the menu items?

Please navigate to Appearance->Menus.

Provide the font-awesome icons like ‘fa-home’ to Icon field for each menu item. Please find the attached screen-shot.