The following meta tags are used to prevent caching and archiving of pages. Tags permit robots to follow and index pages (important to be included in search engines). Three of the tags (at the bottom) prevent Microsoft "innovations" that I don't want in my pages. Finally, at the end, there is a small script to BREAK frames so that your pages may not be displayed on another site inside it's frames.
Note that some robots won't respect your tags, but most will.
Add inside the <header> section of your web page.
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<meta name="robots" content="index, follow" />
<meta name="googlebot" content="index, follow" />
<meta name="robots" content="noarchive" />
<meta name="Googlebot" content="noarchive" />
<meta name="cache-control" content="no-cache" />
<meta http-equiv="MSThemeCompatible" content="no" />
<meta name="MSSmartTagsPreventParsing" content="true" />
<meta http-equiv="imagetoolbar" content="false" />
<!--BREAK FRAMES-->
<script type="text/javascript">if (window.self !=window.top)
window.top.location = window.self.location;</script>
<!--END BREAK FRAMES-->
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="robots" content="index, follow">
<meta name="googlebot" content="index, follow">
<meta name="robots" content="noarchive">
<meta name="Googlebot" content="noarchive">
<meta name="cache-control" content="no-cache">
<meta http-equiv="MSThemeCompatible" content="no">
<meta name="MSSmartTagsPreventParsing" content="true">
<meta http-equiv="imagetoolbar" content="false">
<!--BREAK FRAMES-->
<script type="text/javascript">if (window.self !=window.top)
window.top.location = window.self.location;</script>
<!--END BREAK FRAMES-->