In some cases the uninstaller may be part of the application's installer, and is invoked by clicking on a Customize button that will appear during the install process.
Some applications may install an uninstaller program that can be used to remove the application. If you want you can look for them in the above location and delete them, too. Although they do nothing once you delete the associated application, they do take up some disk space. Applications may create preference files that are stored in the /Home/Library/Preferences/ folder. Most OS X applications are completely self-contained 'packages' that can be uninstalled by simply dragging the application to the Trash.