The contact form in the ads sidebar and the new user registration email settings are built into the theme. If you were referring to a general contact form (i.e. the "Contact" page).. that is a plugin.
Yes, the categories are completely up to you to create within the
wp-admin, the default theme does not have the categories already pre-setup.